2024-09-17T01:20:07.146 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T01:20:07.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T01:20:07.287 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7908332' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 993 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 165/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXHPC0U4+ALLSlD/qBDT8ZbwiCh4vWN1cesueqzvtDSafFQoBTs2ZB13F8/zI5nv062AiMtxBAMbT7tXxS4v8w= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmllD0Blqc1juWQFyEva+j33rv9tWGocJSzcCzMK0S5JHYjG2S0rXB2TFBwEFVwSFqAvyAXi9vrknArtgvasgM= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/pdonnell/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20240916.200549-debug/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_01:09:11 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-17T01:20:07.287 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T01:20:07.288 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T01:20:07.288 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T01:20:07.290 INFO:teuthology.task.internal:Checking packages... 2024-09-17T01:20:07.312 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T01:20:07.312 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:20:07.312 INFO:teuthology.packaging:ref: None 2024-09-17T01:20:07.313 INFO:teuthology.packaging:tag: None 2024-09-17T01:20:07.313 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:20:07.313 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:20:07.313 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:20:07.454 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T01:20:07.455 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T01:20:07.462 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T01:20:07.462 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T01:20:07.691 INFO:teuthology.task.internal:Saving configuration 2024-09-17T01:20:07.711 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T01:20:07.864 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T01:20:07.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:15:09.485577', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXHPC0U4+ALLSlD/qBDT8ZbwiCh4vWN1cesueqzvtDSafFQoBTs2ZB13F8/zI5nv062AiMtxBAMbT7tXxS4v8w='} 2024-09-17T01:20:07.912 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 01:15:09.484335', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOmllD0Blqc1juWQFyEva+j33rv9tWGocJSzcCzMK0S5JHYjG2S0rXB2TFBwEFVwSFqAvyAXi9vrknArtgvasgM='} 2024-09-17T01:20:07.912 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T01:20:07.920 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T01:20:07.920 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-17T01:20:07.920 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T01:20:08.184 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f376e713ac0>, signals=[15]) 2024-09-17T01:20:08.184 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T01:20:08.234 INFO:teuthology.task.internal:Opening connections... 2024-09-17T01:20:08.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:20:08.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:20:08.316 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T01:20:08.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:20:08.395 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T01:20:08.402 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-09-17T01:20:08.420 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-09-17T01:20:08.421 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-09-17T01:20:08.478 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-09-17T01:20:08.478 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:20:08.479 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:20:08.480 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-09-17T01:20:08.505 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-17T01:20:08.523 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-17T01:20:08.523 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-17T01:20:08.581 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-17T01:20:08.582 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T01:20:08.583 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T01:20:08.583 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T01:20:08.583 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-17T01:20:08.604 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T01:20:08.614 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T01:20:08.727 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T01:20:08.727 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:20:08.730 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-17T01:20:08.747 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T01:20:08.757 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T01:20:08.757 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:20:08.787 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-17T01:20:08.818 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T01:20:08.875 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T01:20:08.927 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T01:20:08.927 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T01:20:08.928 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:20:08.928 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T01:20:08.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:20:08.946 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-17T01:20:08.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:20:08.947 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-17T01:20:09.003 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:20:09.003 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-503.el9.x86_64 2024-09-17T01:20:09.003 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-09-17T01:20:09.005 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-503.el9.x86_64 2024-09-17T01:20:09.005 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-503.el9.x86_64 2024-09-17T01:20:09.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-09-17T01:20:12.485 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-17T01:20:14.851 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.3 MB 00:04 2024-09-17T01:20:16.935 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-17T01:20:22.991 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-17T01:20:23.118 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 20 MB 00:09 2024-09-17T01:20:24.359 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 115 kB/s | 19 kB 00:00 2024-09-17T01:20:26.080 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 14 MB/s | 23 MB 00:01 2024-09-17T01:20:27.562 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-17T01:20:28.945 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-17T01:20:31.057 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:01 2024-09-17T01:20:31.402 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-17T01:20:33.316 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T01:20:33.316 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T01:20:33.402 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T01:20:33.413 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-09-17T01:20:33.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:20:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 79 M 2024-09-17T01:20:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 126 M 2024-09-17T01:20:33.415 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:20:33.553 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 384 kB/s | 36 kB 00:00 2024-09-17T01:20:33.962 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-17T01:20:34.420 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-17T01:20:34.696 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-17T01:20:34.696 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:20:34.697 INFO:teuthology.orchestra.run.smithi082.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-17T01:20:35.383 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:20:35.727 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:20:35.727 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:20:36.555 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T01:20:36.663 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:20:36.663 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:20:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T01:20:38.494 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T01:20:38.577 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:20:38.584 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-17T01:20:38.585 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:20:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 79 M 2024-09-17T01:20:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 126 M 2024-09-17T01:20:38.586 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:20:38.714 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 365 kB/s | 36 kB 00:00 2024-09-17T01:20:39.093 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:20:39.115 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-17T01:20:39.573 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-17T01:20:39.751 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:20:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:20:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-17T01:20:39.840 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:20:39.841 INFO:teuthology.orchestra.run.smithi167.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-17T01:20:40.524 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:20:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:20:40.885 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:20:42.564 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:20:42.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:20:44.279 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:20:45.148 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:20:45.241 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:20:47.493 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:20:47.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:20:48.016 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:20:48.152 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:20:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:20:52.979 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:20:53.102 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:20:57.933 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:30.609 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:30.647 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:31.015 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:31.015 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:21:31.015 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:21:31.015 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:21:31.835 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:21:32.222 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:21:32.295 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:32.296 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:21:32.296 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T01:21:32.296 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:21:32.296 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:21:32.297 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-17T01:21:32.297 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:21:32.297 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:21:32.356 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:32.356 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:21:32.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 82.el9 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:21:32.394 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8274670 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:21:32.395 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:21:32.396 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:21:32.396 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:21:32.396 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-09-17T01:21:32.396 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:21:32.396 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:21:32.397 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:21:32.397 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-508.el9.x86_64 2024-09-17T01:21:32.397 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:21:33.017 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-09-17T01:21:34.352 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:21:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-09-17T01:21:34.383 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-09-17T01:21:34.399 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.PBXj18TooS 2024-09-17T01:21:34.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PBXj18TooS 2024-09-17T01:21:34.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.PBXj18TooS 2024-09-17T01:21:34.604 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.PBXj18TooS is 6KB 2024-09-17T01:21:34.625 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.PBXj18TooS 2024-09-17T01:21:34.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:21:34.703 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:21:34.703 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:21:34.703 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:21:34.703 INFO:teuthology.orchestra.run.smithi082.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T01:21:34.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T01:21:34.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-09-17T01:21:36.227 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:36.267 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:36.531 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:36.531 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T01:21:36.531 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T01:21:36.531 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.360 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:21:37.361 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:21:37.735 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:21:37.819 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.820 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:21:37.820 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T01:21:37.820 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T01:21:37.820 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T01:21:37.820 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-17T01:21:37.820 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T01:21:37.820 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T01:21:37.879 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T01:21:37.879 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T01:21:37.880 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-17T01:21:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-17T01:21:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-17T01:21:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-17T01:21:37.917 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-17T01:21:37.918 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:21:37.919 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T01:21:37.920 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T01:21:37.920 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-508.el9.x86_64 2024-09-17T01:21:37.920 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T01:21:38.519 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-17T01:21:39.904 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T01:21:39.937 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-17T01:21:39.939 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-17T01:21:39.955 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.q4i4W9oq8q 2024-09-17T01:21:39.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.q4i4W9oq8q 2024-09-17T01:21:40.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.q4i4W9oq8q 2024-09-17T01:21:40.170 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.q4i4W9oq8q is 6KB 2024-09-17T01:21:40.219 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.q4i4W9oq8q 2024-09-17T01:21:40.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T01:21:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T01:21:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T01:21:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T01:21:40.297 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T01:21:40.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T01:21:40.454 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-17T01:22:04.872 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-17T01:22:04.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:22:04.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:10.464 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-17T01:22:10.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:22:10.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:23.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-17T01:22:28.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T01:22:32.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:22:32.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:35.485 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-09-17T01:22:37.801 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:22:37.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:40.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T01:22:47.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:22:47.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:22:52.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:22:52.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:23:11.297 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-17T01:23:19.392 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-17T01:23:19.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:23:19.956 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T01:23:19.956 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-09-17T01:23:20.002 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-508.el9.x86_64 2024-09-17T01:23:20.002 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T01:23:20.002 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:23:20.003 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:23:21.003 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-17T01:23:21.004 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:23:21.070 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-09-17T01:23:21.097 DEBUG:teuthology.parallel:result is None 2024-09-17T01:23:26.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:23:26.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:23:26.674 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-17T01:23:27.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:23:27.097 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T01:23:27.097 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-17T01:23:27.111 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-508.el9.x86_64 2024-09-17T01:23:27.111 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T01:23:27.111 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T01:23:27.111 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T01:23:28.112 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-17T01:23:28.112 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T01:23:28.203 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-17T01:23:28.223 DEBUG:teuthology.parallel:result is None 2024-09-17T01:23:28.223 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T01:23:28.230 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T01:23:28.231 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:23:28.233 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T01:23:28.249 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T01:23:28.296 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T01:23:28.553 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T01:23:28.553 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:23:28.556 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T01:23:28.669 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T01:23:28.863 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T01:23:28.864 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:23:28.866 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T01:23:28.899 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:28.908 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:28.911 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:28.918 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T01:23:28.920 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T01:23:28.927 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T01:23:28.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:23:28.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T01:23:28.985 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T01:23:29.209 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T01:23:29.210 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:23:29.212 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T01:23:29.227 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:29.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:29.365 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:29.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:29.491 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:23:29.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:23:29.558 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:29.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T01:23:29.663 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:29.744 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T01:23:29.786 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:23:29.787 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T01:23:29.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-09-17T01:23:29.854 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-17T01:23:29.898 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:23:29.933 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T01:23:30.254 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T01:23:30.261 INFO:teuthology.task.internal:Starting timer... 2024-09-17T01:23:30.262 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T01:23:30.326 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T01:23:30.558 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-17T01:23:30.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-09-17T01:23:30.616 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-09-17T01:23:30.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-17T01:23:30.719 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-17T01:23:30.724 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T01:23:30.724 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-09-17T01:23:30.785 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-09-17T01:23:30.785 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-17T01:23:30.850 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-17T01:23:30.850 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-17T01:23:30.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T01:23:30.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:23:30.882 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T01:23:30.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:23:30.936 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T01:23:30.936 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:23:30.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-17T01:23:31.254 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T01:23:31.263 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T01:23:31.275 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T01:23:31.276 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T01:27:16.496 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-17T01:27:16.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:27:16.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:27:16.580 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-09-17T01:27:16.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-09-17T01:27:16.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:27:16.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T01:27:16.740 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-17T01:27:16.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-17T01:27:16.821 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T01:27:16.835 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T01:27:16.835 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:27:16.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:27:16.839 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T01:27:16.839 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T01:27:16.867 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:27:16.882 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:27:16.894 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T01:27:16.906 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-09-17T01:27:16.909 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T01:27:16.917 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-09-17T01:27:16.931 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:27:16.934 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-17T01:27:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:27:16.945 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-17T01:27:16.960 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T01:27:16.974 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T01:27:17.002 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:27:17.005 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:27:17.005 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-17T01:27:17.005 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.005 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.006 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.006 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.032 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.035 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T01:27:17.036 INFO:teuthology.run_tasks:Running task install... 2024-09-17T01:27:17.044 DEBUG:teuthology.task.install:project ceph 2024-09-17T01:27:17.044 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T01:27:17.044 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T01:27:17.044 INFO:teuthology.task.install:Using flavor: default 2024-09-17T01:27:17.053 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T01:27:17.054 INFO:teuthology.task.install:extra packages: [] 2024-09-17T01:27:17.054 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T01:27:17.054 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:27:17.055 INFO:teuthology.packaging:ref: None 2024-09-17T01:27:17.055 INFO:teuthology.packaging:tag: None 2024-09-17T01:27:17.055 INFO:teuthology.packaging:branch: squid 2024-09-17T01:27:17.055 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:27:17.055 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T01:27:17.057 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T01:27:17.058 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:27:17.058 INFO:teuthology.packaging:ref: None 2024-09-17T01:27:17.058 INFO:teuthology.packaging:tag: None 2024-09-17T01:27:17.058 INFO:teuthology.packaging:branch: squid 2024-09-17T01:27:17.058 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:27:17.058 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T01:27:17.270 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-17T01:27:17.332 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-17T01:27:17.338 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/ 2024-09-17T01:27:17.338 INFO:teuthology.task.install.rpm:Package version is 19.2.0-0 2024-09-17T01:27:17.390 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:27:17.390 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:27:17.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:27:17.393 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T01:27:17.393 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:27:17.393 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T01:27:17.419 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T01:27:17.419 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:27:17.419 INFO:teuthology.packaging:ref: None 2024-09-17T01:27:17.419 INFO:teuthology.packaging:tag: None 2024-09-17T01:27:17.419 INFO:teuthology.packaging:branch: squid 2024-09-17T01:27:17.420 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:27:17.420 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:27:17.421 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T01:27:17.421 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:27:17.421 INFO:teuthology.packaging:ref: None 2024-09-17T01:27:17.421 INFO:teuthology.packaging:tag: None 2024-09-17T01:27:17.421 INFO:teuthology.packaging:branch: squid 2024-09-17T01:27:17.421 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:27:17.421 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T01:27:17.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:27:17.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T01:27:17.561 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:27:17.563 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T01:27:17.625 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-09-17T01:27:17.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-09-17T01:27:17.627 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-17T01:27:17.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-17T01:27:17.863 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-17T01:27:17.865 INFO:teuthology.orchestra.run.smithi082.stdout:45 files removed 2024-09-17T01:27:17.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw 2024-09-17T01:27:17.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw 2024-09-17T01:27:18.303 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 654 kB/s | 83 kB 00:00 2024-09-17T01:27:18.309 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 639 kB/s | 83 kB 00:00 2024-09-17T01:27:18.480 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 88 kB/s | 11 kB 00:00 2024-09-17T01:27:18.510 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 74 kB/s | 11 kB 00:00 2024-09-17T01:27:18.605 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 25 kB/s | 2.2 kB 00:00 2024-09-17T01:27:18.673 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 17 kB/s | 2.2 kB 00:00 2024-09-17T01:27:20.302 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-17T01:27:20.389 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-17T01:27:22.447 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-17T01:27:23.065 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-17T01:27:27.923 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.5 MB 00:01 2024-09-17T01:27:28.005 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-17T01:27:29.366 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-17T01:27:29.581 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-17T01:27:30.562 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T01:27:30.777 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T01:27:36.009 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-17T01:27:36.174 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T01:27:38.269 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-17T01:27:38.284 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-17T01:27:38.285 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:27:38.286 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout:Install 30 Packages 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 2 Packages 2024-09-17T01:27:38.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:27:38.288 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 60 M 2024-09-17T01:27:38.288 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:27:38.418 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.2.0-0.el9 ceph 11 M 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-17T01:27:38.433 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.2.0-0.el9 ceph 3.4 M 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.2.0-0.el9 ceph 3.2 M 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.2.0-0.el9 ceph 21 M 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.2.0-0.el9 ceph 25 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.2.0-0.el9 ceph 751 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T01:27:38.434 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.2.0-0.el9 ceph 506 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.2.0-0.el9 ceph 5.4 M 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.2.0-0.el9 ceph 45 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.2.0-0.el9 ceph 135 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.2.0-0.el9 ceph 161 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.2.0-0.el9 ceph 320 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.2.0-0.el9 ceph 301 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.2.0-0.el9 ceph 99 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T01:27:38.435 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:Install 30 Packages 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 2 Packages 2024-09-17T01:27:38.436 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:27:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 60 M 2024-09-17T01:27:38.437 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:27:38.537 INFO:teuthology.orchestra.run.smithi082.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 31 MB/s | 5.4 MB 00:00 2024-09-17T01:27:38.585 INFO:teuthology.orchestra.run.smithi082.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 508 kB/s | 25 kB 00:00 2024-09-17T01:27:38.636 INFO:teuthology.orchestra.run.smithi082.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 15 MB/s | 751 kB 00:00 2024-09-17T01:27:38.861 INFO:teuthology.orchestra.run.smithi082.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 2.2 MB/s | 506 kB 00:00 2024-09-17T01:27:38.893 INFO:teuthology.orchestra.run.smithi167.stdout:(1/32): ceph-base-19.2.0-0.el9.x86_64.rpm 33 MB/s | 5.4 MB 00:00 2024-09-17T01:27:38.918 INFO:teuthology.orchestra.run.smithi167.stdout:(2/32): ceph-selinux-19.2.0-0.el9.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-09-17T01:27:38.951 INFO:teuthology.orchestra.run.smithi167.stdout:(3/32): libcephfs2-19.2.0-0.el9.x86_64.rpm 22 MB/s | 751 kB 00:00 2024-09-17T01:27:38.985 INFO:teuthology.orchestra.run.smithi167.stdout:(4/32): libradosstriper1-19.2.0-0.el9.x86_64.rp 15 MB/s | 506 kB 00:00 2024-09-17T01:27:39.028 INFO:teuthology.orchestra.run.smithi082.stdout:(5/32): librgw2-19.2.0-0.el9.x86_64.rpm 32 MB/s | 5.4 MB 00:00 2024-09-17T01:27:39.094 INFO:teuthology.orchestra.run.smithi167.stdout:(5/32): librgw2-19.2.0-0.el9.x86_64.rpm 49 MB/s | 5.4 MB 00:00 2024-09-17T01:27:39.119 INFO:teuthology.orchestra.run.smithi167.stdout:(6/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-09-17T01:27:39.162 INFO:teuthology.orchestra.run.smithi082.stdout:(6/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 13 MB/s | 11 MB 00:00 2024-09-17T01:27:39.169 INFO:teuthology.orchestra.run.smithi167.stdout:(7/32): python3-ceph-common-19.2.0-0.el9.x86_64 2.6 MB/s | 135 kB 00:00 2024-09-17T01:27:39.187 INFO:teuthology.orchestra.run.smithi082.stdout:(7/32): python3-ceph-argparse-19.2.0-0.el9.x86_ 284 kB/s | 45 kB 00:00 2024-09-17T01:27:39.212 INFO:teuthology.orchestra.run.smithi082.stdout:(8/32): python3-ceph-common-19.2.0-0.el9.x86_64 2.6 MB/s | 135 kB 00:00 2024-09-17T01:27:39.261 INFO:teuthology.orchestra.run.smithi082.stdout:(9/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 2.2 MB/s | 161 kB 00:00 2024-09-17T01:27:39.286 INFO:teuthology.orchestra.run.smithi167.stdout:(8/32): ceph-radosgw-19.2.0-0.el9.x86_64.rpm 19 MB/s | 11 MB 00:00 2024-09-17T01:27:39.287 INFO:teuthology.orchestra.run.smithi082.stdout:(10/32): python3-rados-19.2.0-0.el9.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2024-09-17T01:27:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:(9/32): python3-cephfs-19.2.0-0.el9.x86_64.rpm 1.1 MB/s | 161 kB 00:00 2024-09-17T01:27:39.321 INFO:teuthology.orchestra.run.smithi082.stdout:(11/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 4.9 MB/s | 301 kB 00:00 2024-09-17T01:27:39.337 INFO:teuthology.orchestra.run.smithi167.stdout:(10/32): python3-rados-19.2.0-0.el9.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2024-09-17T01:27:39.347 INFO:teuthology.orchestra.run.smithi082.stdout:(12/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 1.6 MB/s | 99 kB 00:00 2024-09-17T01:27:39.371 INFO:teuthology.orchestra.run.smithi167.stdout:(11/32): python3-rbd-19.2.0-0.el9.x86_64.rpm 5.0 MB/s | 301 kB 00:00 2024-09-17T01:27:39.396 INFO:teuthology.orchestra.run.smithi167.stdout:(12/32): python3-rgw-19.2.0-0.el9.x86_64.rpm 1.7 MB/s | 99 kB 00:00 2024-09-17T01:27:39.564 INFO:teuthology.orchestra.run.smithi082.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 18 MB/s | 21 MB 00:01 2024-09-17T01:27:39.605 INFO:teuthology.orchestra.run.smithi082.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-17T01:27:39.638 INFO:teuthology.orchestra.run.smithi167.stdout:(13/32): ceph-common-19.2.0-0.el9.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-09-17T01:27:39.639 INFO:teuthology.orchestra.run.smithi082.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 548 kB/s | 160 kB 00:00 2024-09-17T01:27:39.664 INFO:teuthology.orchestra.run.smithi082.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-17T01:27:39.731 INFO:teuthology.orchestra.run.smithi082.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-17T01:27:39.757 INFO:teuthology.orchestra.run.smithi082.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 460 kB/s | 42 kB 00:00 2024-09-17T01:27:39.782 INFO:teuthology.orchestra.run.smithi082.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-17T01:27:39.807 INFO:teuthology.orchestra.run.smithi082.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-17T01:27:39.832 INFO:teuthology.orchestra.run.smithi082.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-17T01:27:39.858 INFO:teuthology.orchestra.run.smithi082.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-17T01:27:39.916 INFO:teuthology.orchestra.run.smithi082.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-17T01:27:39.942 INFO:teuthology.orchestra.run.smithi082.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-17T01:27:39.967 INFO:teuthology.orchestra.run.smithi082.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 277 kB/s | 26 kB 00:00 2024-09-17T01:27:40.001 INFO:teuthology.orchestra.run.smithi082.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-17T01:27:40.034 INFO:teuthology.orchestra.run.smithi082.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T01:27:40.093 INFO:teuthology.orchestra.run.smithi082.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-17T01:27:40.135 INFO:teuthology.orchestra.run.smithi082.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T01:27:40.196 INFO:teuthology.orchestra.run.smithi167.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 81 kB/s | 45 kB 00:00 2024-09-17T01:27:40.219 INFO:teuthology.orchestra.run.smithi082.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-17T01:27:40.230 INFO:teuthology.orchestra.run.smithi167.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 124 kB/s | 107 kB 00:00 2024-09-17T01:27:40.272 INFO:teuthology.orchestra.run.smithi167.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 183 kB/s | 160 kB 00:00 2024-09-17T01:27:40.302 INFO:teuthology.orchestra.run.smithi082.stdout:(31/32): librados2-19.2.0-0.el9.x86_64.rpm 16 MB/s | 3.4 MB 00:00 2024-09-17T01:27:40.361 INFO:teuthology.orchestra.run.smithi082.stdout:(32/32): librbd1-19.2.0-0.el9.x86_64.rpm 14 MB/s | 3.2 MB 00:00 2024-09-17T01:27:40.366 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:27:40.366 INFO:teuthology.orchestra.run.smithi082.stdout:Total 29 MB/s | 60 MB 00:02 2024-09-17T01:27:40.470 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:27:40.507 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:27:40.507 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:27:40.856 INFO:teuthology.orchestra.run.smithi167.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 72 kB/s | 42 kB 00:00 2024-09-17T01:27:41.073 INFO:teuthology.orchestra.run.smithi167.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 347 kB/s | 292 kB 00:00 2024-09-17T01:27:41.098 INFO:teuthology.orchestra.run.smithi167.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 736 kB/s | 662 kB 00:00 2024-09-17T01:27:41.175 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:27:41.175 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:27:41.623 INFO:teuthology.orchestra.run.smithi167.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 65 kB/s | 36 kB 00:00 2024-09-17T01:27:41.673 INFO:teuthology.orchestra.run.smithi167.stdout:(21/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.1 MB/s | 308 kB 00:00 2024-09-17T01:27:41.715 INFO:teuthology.orchestra.run.smithi167.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 78 kB/s | 47 kB 00:00 2024-09-17T01:27:41.741 INFO:teuthology.orchestra.run.smithi167.stdout:(23/32): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-09-17T01:27:41.791 INFO:teuthology.orchestra.run.smithi167.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 353 kB/s | 26 kB 00:00 2024-09-17T01:27:41.824 INFO:teuthology.orchestra.run.smithi167.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-17T01:27:41.850 INFO:teuthology.orchestra.run.smithi167.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 478 kB/s | 49 kB 00:00 2024-09-17T01:27:41.884 INFO:teuthology.orchestra.run.smithi167.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-17T01:27:41.926 INFO:teuthology.orchestra.run.smithi167.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-17T01:27:42.009 INFO:teuthology.orchestra.run.smithi167.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-17T01:27:42.060 INFO:teuthology.orchestra.run.smithi167.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-17T01:27:42.110 INFO:teuthology.orchestra.run.smithi167.stdout:(31/32): librados2-19.2.0-0.el9.x86_64.rpm 19 MB/s | 3.4 MB 00:00 2024-09-17T01:27:42.168 INFO:teuthology.orchestra.run.smithi167.stdout:(32/32): librbd1-19.2.0-0.el9.x86_64.rpm 20 MB/s | 3.2 MB 00:00 2024-09-17T01:27:42.175 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:27:42.175 INFO:teuthology.orchestra.run.smithi167.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-17T01:27:42.279 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:27:42.316 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:27:42.317 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:27:42.700 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:27:42.795 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T01:27:42.824 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T01:27:42.858 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T01:27:42.889 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T01:27:42.925 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T01:27:42.996 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:27:42.997 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:27:43.140 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T01:27:43.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T01:27:43.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T01:27:43.668 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:27:43.759 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:27:43.847 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T01:27:43.869 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:27:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:27:43.977 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T01:27:44.021 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T01:27:44.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T01:27:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:27:44.161 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:27:44.195 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T01:27:44.303 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T01:27:44.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T01:27:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T01:27:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T01:27:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T01:27:44.479 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:27:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T01:27:44.544 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T01:27:44.573 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T01:27:44.607 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T01:27:44.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T01:27:44.654 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T01:27:44.816 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T01:27:44.841 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T01:27:44.861 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T01:27:44.894 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T01:27:44.953 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T01:27:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-17T01:27:45.028 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T01:27:45.287 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T01:27:45.367 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:27:45.451 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:27:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T01:27:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T01:27:45.540 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T01:27:45.569 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:27:45.594 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T01:27:45.616 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:27:45.652 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T01:27:45.675 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-17T01:27:45.697 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T01:27:45.725 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-17T01:27:45.774 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T01:27:45.796 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:27:45.861 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:27:45.896 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T01:27:46.007 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T01:27:46.038 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T01:27:46.080 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T01:27:46.148 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T01:27:46.316 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T01:27:46.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T01:27:46.677 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T01:27:46.728 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T01:27:46.819 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.2.0-0.el9.x86_64 22/34 2024-09-17T01:27:46.850 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.2.0-0.el9.x86_64 23/34 2024-09-17T01:27:46.886 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T01:27:47.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T01:27:47.389 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T01:27:47.461 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.2.0-0.el9.x86_64 26/34 2024-09-17T01:27:47.538 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.2.0-0.el9.x86_64 27/34 2024-09-17T01:27:47.566 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.2.0-0.el9.x86_64 28/34 2024-09-17T01:27:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T01:27:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T01:27:48.756 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:27:48.756 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:27:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:27:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:27:49.869 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:49.905 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:50.470 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.2.0-0.el9.x86_64 29/34 2024-09-17T01:27:50.509 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T01:27:50.602 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.2.0-0.el9.x86_64 30/34 2024-09-17T01:27:50.602 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T01:27:50.602 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T01:27:50.602 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:27:50.643 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-09-17T01:27:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:27:59.704 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:27:59.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:27:59.732 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T01:27:59.807 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T01:27:59.807 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:00.583 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:28:00.583 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-17T01:28:00.583 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-17T01:28:00.584 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:00.987 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-17T01:28:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T01:28:00.989 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T01:28:00.990 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T01:28:00.990 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T01:28:00.990 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T01:28:00.990 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T01:28:00.990 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T01:28:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T01:28:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T01:28:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:28:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T01:28:00.991 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-17T01:28:01.533 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T01:28:01.559 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.2.0-0.el9.x86_64 32/34 2024-09-17T01:28:01.560 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:01.560 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T01:28:01.560 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:28:01.560 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T01:28:01.560 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:01.561 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T01:28:01.635 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T01:28:01.635 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.266 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.267 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:28:02.268 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:28:02.268 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:28:02.268 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:28:02.269 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:02.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-test 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.2.0-0.el9.x86_64 1/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.2.0-0.el9.x86_64 2/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.2.0-0.el9.x86_64 3/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.2.0-0.el9.x86_64 4/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.2.0-0.el9.x86_64 5/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.2.0-0.el9.x86_64 6/34 2024-09-17T01:28:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.2.0-0.el9.x86_64 7/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.2.0-0.el9.x86_64 8/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.2.0-0.el9.x86_64 9/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.2.0-0.el9.x86_64 10/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.2.0-0.el9.x86_64 11/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.2.0-0.el9.x86_64 12/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.2.0-0.el9.x86_64 13/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T01:28:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T01:28:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T01:28:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T01:28:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T01:28:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.2.0-0.el9.x86_64 31/34 2024-09-17T01:28:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T01:28:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.2.0-0.el9.x86_64 33/34 2024-09-17T01:28:03.238 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:03.374 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:03.374 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:03.375 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-09-17T01:28:03.376 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:03.376 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 49 M 2024-09-17T01:28:03.376 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 208 M 2024-09-17T01:28:03.376 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:03.647 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 731 kB/s | 163 kB 00:00 2024-09-17T01:28:04.014 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T01:28:04.014 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.2.0-0.el9.x86_64 librbd1-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T01:28:04.015 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.016 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:04.017 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:04.247 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): ceph-test-19.2.0-0.el9.x86_64.rpm 59 MB/s | 49 MB 00:00 2024-09-17T01:28:04.272 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2024-09-17T01:28:04.298 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): socat-1.7.4.1-6.el9.x86_64.rpm 348 kB/s | 304 kB 00:00 2024-09-17T01:28:04.300 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:04.300 INFO:teuthology.orchestra.run.smithi082.stdout:Total 53 MB/s | 49 MB 00:00 2024-09-17T01:28:04.328 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:04.348 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:04.348 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:04.353 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-test 2024-09-17T01:28:04.722 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:04.722 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:04.939 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:05.079 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:05.079 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:05.079 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:28:05.079 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.2.0-0.el9 ceph 49 M 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.2.0-0.el9 ceph 163 k 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-17T01:28:05.080 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:05.081 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 49 M 2024-09-17T01:28:05.081 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 208 M 2024-09-17T01:28:05.081 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:05.252 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): libcephsqlite-19.2.0-0.el9.x86_64.rpm 2.4 MB/s | 163 kB 00:00 2024-09-17T01:28:05.266 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:05.348 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T01:28:05.388 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T01:28:05.394 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-17T01:28:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T01:28:05.469 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-17T01:28:05.920 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): ceph-test-19.2.0-0.el9.x86_64.rpm 66 MB/s | 49 MB 00:00 2024-09-17T01:28:05.922 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:05.923 INFO:teuthology.orchestra.run.smithi167.stdout:Total 58 MB/s | 49 MB 00:00 2024-09-17T01:28:05.949 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:28:05.970 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:28:05.970 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:28:06.341 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:28:06.342 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:28:06.868 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:28:06.955 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T01:28:06.994 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T01:28:07.030 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T01:28:10.047 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T01:28:10.123 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T01:28:11.626 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.2.0-0.el9.x86_64 3/4 2024-09-17T01:28:11.705 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T01:28:12.471 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T01:28:12.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-17T01:28:12.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-17T01:28:12.471 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T01:28:12.815 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:12.816 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:13.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph 2024-09-17T01:28:13.687 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:13.833 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:13.836 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:28:13.837 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:28:13.838 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout:Install 37 Packages 2024-09-17T01:28:13.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:13.840 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 30 M 2024-09-17T01:28:13.840 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 108 M 2024-09-17T01:28:13.840 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:14.095 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-test-2:19.2.0-0.el9.x86_64 4/4 2024-09-17T01:28:14.095 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.2.0-0.el9.x86_64 1/4 2024-09-17T01:28:14.095 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.2.0-0.el9.x86_64 2/4 2024-09-17T01:28:14.096 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.2.0-0.el9.x86_64 libcephsqlite-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:14.411 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:14.690 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph 2024-09-17T01:28:14.757 INFO:teuthology.orchestra.run.smithi082.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 79 kB/s | 6.5 kB 00:00 2024-09-17T01:28:14.824 INFO:teuthology.orchestra.run.smithi082.stdout:(2/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2024-09-17T01:28:14.925 INFO:teuthology.orchestra.run.smithi082.stdout:(3/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2024-09-17T01:28:14.983 INFO:teuthology.orchestra.run.smithi082.stdout:(4/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 7.7 MB/s | 2.4 MB 00:00 2024-09-17T01:28:15.009 INFO:teuthology.orchestra.run.smithi082.stdout:(5/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 2.9 MB/s | 249 kB 00:00 2024-09-17T01:28:15.176 INFO:teuthology.orchestra.run.smithi082.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-17T01:28:15.278 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:15.359 INFO:teuthology.orchestra.run.smithi082.stdout:(7/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 31 MB/s | 17 MB 00:00 2024-09-17T01:28:15.384 INFO:teuthology.orchestra.run.smithi082.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 511 kB/s | 106 kB 00:00 2024-09-17T01:28:15.422 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.2.0-0.el9 ceph 6.5 k 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.2.0-0.el9 ceph 2.4 M 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.2.0-0.el9 ceph 1.5 M 2024-09-17T01:28:15.425 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.2.0-0.el9 ceph-noarch 249 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.2.0-0.el9 ceph 4.7 M 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.2.0-0.el9 ceph 17 M 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T01:28:15.426 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T01:28:15.427 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout:Install 37 Packages 2024-09-17T01:28:15.428 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:15.429 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 30 M 2024-09-17T01:28:15.429 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 108 M 2024-09-17T01:28:15.429 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:15.438 INFO:teuthology.orchestra.run.smithi082.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.3 MB/s | 125 kB 00:00 2024-09-17T01:28:15.480 INFO:teuthology.orchestra.run.smithi082.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-17T01:28:15.514 INFO:teuthology.orchestra.run.smithi082.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-17T01:28:15.548 INFO:teuthology.orchestra.run.smithi082.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 719 kB/s | 135 kB 00:00 2024-09-17T01:28:15.615 INFO:teuthology.orchestra.run.smithi082.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 521 kB/s | 35 kB 00:00 2024-09-17T01:28:15.640 INFO:teuthology.orchestra.run.smithi082.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-17T01:28:15.665 INFO:teuthology.orchestra.run.smithi082.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-17T01:28:15.691 INFO:teuthology.orchestra.run.smithi082.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-17T01:28:15.716 INFO:teuthology.orchestra.run.smithi082.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-17T01:28:15.741 INFO:teuthology.orchestra.run.smithi082.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 551 kB/s | 42 kB 00:00 2024-09-17T01:28:15.800 INFO:teuthology.orchestra.run.smithi082.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-17T01:28:15.825 INFO:teuthology.orchestra.run.smithi082.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 521 kB/s | 43 kB 00:00 2024-09-17T01:28:15.842 INFO:teuthology.orchestra.run.smithi082.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-17T01:28:15.876 INFO:teuthology.orchestra.run.smithi082.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-17T01:28:15.892 INFO:teuthology.orchestra.run.smithi082.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.2 MB/s | 18 kB 00:00 2024-09-17T01:28:15.909 INFO:teuthology.orchestra.run.smithi082.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 159 kB/s | 11 kB 00:00 2024-09-17T01:28:15.926 INFO:teuthology.orchestra.run.smithi082.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-09-17T01:28:15.943 INFO:teuthology.orchestra.run.smithi082.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 582 kB/s | 19 kB 00:00 2024-09-17T01:28:15.968 INFO:teuthology.orchestra.run.smithi082.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.4 MB/s | 358 kB 00:00 2024-09-17T01:28:16.002 INFO:teuthology.orchestra.run.smithi082.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-17T01:28:16.027 INFO:teuthology.orchestra.run.smithi082.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-09-17T01:28:16.053 INFO:teuthology.orchestra.run.smithi082.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2024-09-17T01:28:16.078 INFO:teuthology.orchestra.run.smithi082.stdout:(31/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-17T01:28:16.103 INFO:teuthology.orchestra.run.smithi082.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-17T01:28:16.129 INFO:teuthology.orchestra.run.smithi082.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-17T01:28:16.154 INFO:teuthology.orchestra.run.smithi082.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T01:28:16.179 INFO:teuthology.orchestra.run.smithi082.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T01:28:16.205 INFO:teuthology.orchestra.run.smithi082.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-17T01:28:16.229 INFO:teuthology.orchestra.run.smithi082.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T01:28:16.233 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:16.233 INFO:teuthology.orchestra.run.smithi082.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-17T01:28:16.382 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:16.423 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:16.580 INFO:teuthology.orchestra.run.smithi167.stdout:(1/37): ceph-19.2.0-0.el9.x86_64.rpm 78 kB/s | 6.5 kB 00:00 2024-09-17T01:28:16.648 INFO:teuthology.orchestra.run.smithi167.stdout:(2/37): ceph-mds-19.2.0-0.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-09-17T01:28:16.681 INFO:teuthology.orchestra.run.smithi167.stdout:(3/37): ceph-mgr-19.2.0-0.el9.x86_64.rpm 8.4 MB/s | 1.5 MB 00:00 2024-09-17T01:28:16.714 INFO:teuthology.orchestra.run.smithi167.stdout:(4/37): ceph-mgr-modules-core-19.2.0-0.el9.noar 7.3 MB/s | 249 kB 00:00 2024-09-17T01:28:16.790 INFO:teuthology.orchestra.run.smithi167.stdout:(5/37): ceph-mon-19.2.0-0.el9.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2024-09-17T01:28:16.927 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:16.928 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:17.007 INFO:teuthology.orchestra.run.smithi167.stdout:(6/37): ceph-osd-19.2.0-0.el9.x86_64.rpm 47 MB/s | 17 MB 00:00 2024-09-17T01:28:17.115 INFO:teuthology.orchestra.run.smithi167.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 633 kB/s | 253 kB 00:00 2024-09-17T01:28:17.166 INFO:teuthology.orchestra.run.smithi167.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 671 kB/s | 106 kB 00:00 2024-09-17T01:28:17.191 INFO:teuthology.orchestra.run.smithi167.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-17T01:28:17.250 INFO:teuthology.orchestra.run.smithi167.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-09-17T01:28:17.275 INFO:teuthology.orchestra.run.smithi167.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-17T01:28:17.367 INFO:teuthology.orchestra.run.smithi167.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.1 MB/s | 1.2 MB 00:00 2024-09-17T01:28:17.443 INFO:teuthology.orchestra.run.smithi167.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-17T01:28:17.476 INFO:teuthology.orchestra.run.smithi167.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 834 kB/s | 188 kB 00:00 2024-09-17T01:28:17.493 INFO:teuthology.orchestra.run.smithi167.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 276 kB/s | 35 kB 00:00 2024-09-17T01:28:17.518 INFO:teuthology.orchestra.run.smithi167.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-17T01:28:17.544 INFO:teuthology.orchestra.run.smithi167.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 758 kB/s | 51 kB 00:00 2024-09-17T01:28:17.561 INFO:teuthology.orchestra.run.smithi167.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 618 kB/s | 42 kB 00:00 2024-09-17T01:28:17.611 INFO:teuthology.orchestra.run.smithi167.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-17T01:28:17.645 INFO:teuthology.orchestra.run.smithi167.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.3 MB/s | 172 kB 00:00 2024-09-17T01:28:17.662 INFO:teuthology.orchestra.run.smithi167.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 433 kB/s | 43 kB 00:00 2024-09-17T01:28:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 639 kB/s | 11 kB 00:00 2024-09-17T01:28:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:(23/37): lua-devel-5.4.4-4.el9.x86_64.rpm 120 kB/s | 22 kB 00:00 2024-09-17T01:28:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-09-17T01:28:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 759 kB/s | 19 kB 00:00 2024-09-17T01:28:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.4 MB/s | 358 kB 00:00 2024-09-17T01:28:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 374 kB/s | 20 kB 00:00 2024-09-17T01:28:17.843 INFO:teuthology.orchestra.run.smithi167.stdout:(28/37): python3-jaraco-collections-3.0.0-8.el9 167 kB/s | 23 kB 00:00 2024-09-17T01:28:17.868 INFO:teuthology.orchestra.run.smithi167.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 583 kB/s | 46 kB 00:00 2024-09-17T01:28:17.893 INFO:teuthology.orchestra.run.smithi167.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-17T01:28:17.918 INFO:teuthology.orchestra.run.smithi167.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-17T01:28:17.944 INFO:teuthology.orchestra.run.smithi167.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-17T01:28:17.969 INFO:teuthology.orchestra.run.smithi167.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-17T01:28:17.994 INFO:teuthology.orchestra.run.smithi167.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T01:28:18.020 INFO:teuthology.orchestra.run.smithi167.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-17T01:28:18.045 INFO:teuthology.orchestra.run.smithi167.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T01:28:18.070 INFO:teuthology.orchestra.run.smithi167.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T01:28:18.074 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:18.074 INFO:teuthology.orchestra.run.smithi167.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-17T01:28:18.227 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:28:18.268 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:28:18.268 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:28:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T01:28:18.399 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T01:28:18.426 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T01:28:18.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T01:28:18.534 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T01:28:18.566 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T01:28:18.658 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T01:28:18.743 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:28:18.744 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:28:18.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T01:28:18.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T01:28:18.821 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T01:28:18.851 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T01:28:18.885 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T01:28:18.927 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T01:28:18.968 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T01:28:19.003 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T01:28:19.045 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T01:28:19.102 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T01:28:19.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T01:28:19.226 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T01:28:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T01:28:19.453 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T01:28:19.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T01:28:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T01:28:19.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T01:28:19.657 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T01:28:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T01:28:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T01:28:19.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T01:28:20.074 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T01:28:20.115 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T01:28:20.154 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:28:20.215 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T01:28:20.232 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T01:28:20.257 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T01:28:20.284 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T01:28:20.354 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T01:28:20.391 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T01:28:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-17T01:28:20.425 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T01:28:20.427 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T01:28:20.453 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T01:28:20.453 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:20.454 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:28:20.454 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:28:20.454 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:28:20.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:20.517 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T01:28:20.595 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T01:28:20.635 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T01:28:20.679 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T01:28:20.709 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T01:28:20.743 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T01:28:20.776 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T01:28:20.825 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T01:28:20.860 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T01:28:20.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T01:28:20.943 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T01:28:20.984 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T01:28:21.058 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T01:28:21.207 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T01:28:21.286 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T01:28:21.339 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T01:28:21.374 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T01:28:21.423 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T01:28:21.479 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T01:28:21.667 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T01:28:21.720 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T01:28:21.798 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T01:28:21.887 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T01:28:21.903 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T01:28:21.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T01:28:21.930 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T01:28:21.930 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:21.930 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:28:21.930 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:28:21.931 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:28:21.931 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:22.043 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T01:28:22.201 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 32/37 2024-09-17T01:28:22.230 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T01:28:22.256 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.2.0-0.el9.x86_64 33/37 2024-09-17T01:28:22.256 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:22.257 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T01:28:22.257 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:28:22.257 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T01:28:22.257 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:22.370 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T01:28:22.394 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T01:28:22.394 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:22.394 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:28:22.395 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:28:22.395 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:28:22.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T01:28:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T01:28:22.654 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:22.654 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:28:22.654 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:28:22.654 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:28:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:22.717 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T01:28:23.706 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T01:28:23.733 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.2.0-0.el9.x86_64 34/37 2024-09-17T01:28:23.733 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:23.733 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T01:28:23.733 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:28:23.734 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T01:28:23.734 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:24.173 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T01:28:24.198 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.2.0-0.el9.x86_64 35/37 2024-09-17T01:28:24.198 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:24.198 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T01:28:24.198 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:28:24.198 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T01:28:24.199 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:24.424 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.2.0-0.el9.x86_64 36/37 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T01:28:24.449 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:24.513 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T01:28:24.551 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T01:28:24.552 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T01:28:24.553 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T01:28:24.555 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T01:28:24.556 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T01:28:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:28:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:28:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:25.651 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:26.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-base 2024-09-17T01:28:26.295 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-2:19.2.0-0.el9.x86_64 37/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.2.0-0.el9.x86_64 1/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.2.0-0.el9.x86_64 2/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.2.0-0.el9.x86_64 3/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.2.0-0.el9.x86_64 4/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.2.0-0.el9.x86_64 5/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 6/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T01:28:26.296 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T01:28:26.297 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T01:28:26.298 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T01:28:26.650 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:26.740 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:28:26.782 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:26.786 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:28:26.786 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:26.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install cephadm 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:27.295 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.2.0-0.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T01:28:27.296 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T01:28:27.297 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T01:28:27.298 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T01:28:27.298 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T01:28:27.298 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T01:28:27.300 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T01:28:27.300 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T01:28:27.300 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T01:28:27.300 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T01:28:27.300 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T01:28:27.301 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T01:28:27.301 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T01:28:27.301 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:27.301 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:27.438 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:27.568 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:27.568 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:27.568 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 765 k 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 771 k 2024-09-17T01:28:27.569 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:27.653 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm-19.2.0-0.el9.noarch.rpm 8.9 MB/s | 765 kB 00:00 2024-09-17T01:28:27.654 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:27.654 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.8 MB/s | 765 kB 00:00 2024-09-17T01:28:27.654 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:27.659 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:27.659 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:27.665 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:27.665 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:27.708 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-base 2024-09-17T01:28:27.736 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:28.255 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:28.309 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:28.399 INFO:teuthology.orchestra.run.smithi167.stdout:Package ceph-base-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:28:28.441 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:28.442 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:28:28.442 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:28.514 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install cephadm 2024-09-17T01:28:28.679 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:28.936 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:28.936 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:28.937 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:28.937 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-17T01:28:28.937 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:28.937 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:29.091 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:29.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T01:28:29.222 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:29.222 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:29.222 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.2.0-0.el9 ceph-noarch 765 k 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 765 k 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 771 k 2024-09-17T01:28:29.223 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:29.275 INFO:teuthology.orchestra.run.smithi167.stdout:cephadm-19.2.0-0.el9.noarch.rpm 15 MB/s | 765 kB 00:00 2024-09-17T01:28:29.276 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:29.276 INFO:teuthology.orchestra.run.smithi167.stdout:Total 14 MB/s | 765 kB 00:00 2024-09-17T01:28:29.276 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:28:29.281 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:28:29.281 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:28:29.287 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:28:29.287 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:28:29.360 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:28:29.744 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:29.836 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:29.881 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repo Size 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:29.882 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 145 k 2024-09-17T01:28:29.883 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 435 k 2024-09-17T01:28:29.883 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:29.929 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:29.952 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 2.0 MB/s | 145 kB 00:00 2024-09-17T01:28:29.953 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:29.953 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.0 MB/s | 145 kB 00:00 2024-09-17T01:28:29.953 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:29.961 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:29.961 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:30.019 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:30.019 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:30.181 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:30.278 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:30.285 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:30.304 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:30.304 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:30.304 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:28:30.304 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.2.0-0.el9.noarch 1/1 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.2.0-0.el9.noarch 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:30.527 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:30.730 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T01:28:31.226 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:31.227 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:31.227 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:31.227 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:31.328 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:31.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr 2024-09-17T01:28:31.465 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repo Size 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.2.0-0.el9 ceph 145 k 2024-09-17T01:28:31.466 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 145 k 2024-09-17T01:28:31.467 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 435 k 2024-09-17T01:28:31.468 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:31.499 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-immutable-object-cache-19.2.0-0.el9.x86_64 4.5 MB/s | 145 kB 00:00 2024-09-17T01:28:31.500 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:31.500 INFO:teuthology.orchestra.run.smithi167.stdout:Total 4.3 MB/s | 145 kB 00:00 2024-09-17T01:28:31.501 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:28:31.507 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:28:31.508 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:28:31.565 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:28:31.565 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:28:31.718 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:28:31.783 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:31.808 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:28:31.808 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T01:28:31.808 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:32.037 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:32.129 INFO:teuthology.orchestra.run.smithi082.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:28:32.172 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:32.173 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:28:32.173 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:32.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T01:28:32.780 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:28:32.780 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:32.780 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:32.781 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.2.0-0.el9.x86_64 2024-09-17T01:28:32.781 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:32.781 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:32.829 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:32.960 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-17T01:28:32.961 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout:Install 12 Packages 2024-09-17T01:28:32.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:32.963 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 8.7 M 2024-09-17T01:28:32.963 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 104 M 2024-09-17T01:28:32.963 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:33.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr 2024-09-17T01:28:33.498 INFO:teuthology.orchestra.run.smithi082.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 374 kB/s | 32 kB 00:00 2024-09-17T01:28:33.523 INFO:teuthology.orchestra.run.smithi082.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 149 kB/s | 16 kB 00:00 2024-09-17T01:28:33.598 INFO:teuthology.orchestra.run.smithi082.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 19 MB/s | 3.6 MB 00:00 2024-09-17T01:28:33.626 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:33.715 INFO:teuthology.orchestra.run.smithi082.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 269 kB 00:00 2024-09-17T01:28:33.717 INFO:teuthology.orchestra.run.smithi167.stdout:Package ceph-mgr-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:28:33.760 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:28:33.761 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:33.766 INFO:teuthology.orchestra.run.smithi082.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-17T01:28:33.799 INFO:teuthology.orchestra.run.smithi082.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-17T01:28:33.816 INFO:teuthology.orchestra.run.smithi082.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 385 kB/s | 19 kB 00:00 2024-09-17T01:28:33.845 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T01:28:33.858 INFO:teuthology.orchestra.run.smithi082.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.2 MB/s | 863 kB 00:00 2024-09-17T01:28:33.884 INFO:teuthology.orchestra.run.smithi082.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.3 MB/s | 144 kB 00:00 2024-09-17T01:28:33.918 INFO:teuthology.orchestra.run.smithi082.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.0 MB/s | 188 kB 00:00 2024-09-17T01:28:33.942 INFO:teuthology.orchestra.run.smithi082.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 374 kB/s | 31 kB 00:00 2024-09-17T01:28:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-17T01:28:33.988 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:33.988 INFO:teuthology.orchestra.run.smithi082.stdout:Total 8.4 MB/s | 8.7 MB 00:01 2024-09-17T01:28:34.036 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:34.053 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:34.053 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:34.270 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:34.271 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:34.423 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:34.557 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.2.0-0.el9 ceph-noarch 3.6 M 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.2.0-0.el9 ceph-noarch 32 k 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.2.0-0.el9 ceph-noarch 16 k 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T01:28:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:34.559 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:34.560 INFO:teuthology.orchestra.run.smithi167.stdout:Install 12 Packages 2024-09-17T01:28:34.560 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 8.7 M 2024-09-17T01:28:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 104 M 2024-09-17T01:28:34.561 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:34.753 INFO:teuthology.orchestra.run.smithi167.stdout:(1/12): ceph-grafana-dashboards-19.2.0-0.el9.no 481 kB/s | 32 kB 00:00 2024-09-17T01:28:34.786 INFO:teuthology.orchestra.run.smithi167.stdout:(2/12): ceph-prometheus-alerts-19.2.0-0.el9.noa 164 kB/s | 16 kB 00:00 2024-09-17T01:28:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:34.853 INFO:teuthology.orchestra.run.smithi167.stdout:(3/12): ceph-mgr-dashboard-19.2.0-0.el9.noarch. 21 MB/s | 3.6 MB 00:00 2024-09-17T01:28:34.902 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T01:28:34.945 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T01:28:34.991 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T01:28:35.004 INFO:teuthology.orchestra.run.smithi167.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-17T01:28:35.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T01:28:35.037 INFO:teuthology.orchestra.run.smithi167.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-09-17T01:28:35.071 INFO:teuthology.orchestra.run.smithi167.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-09-17T01:28:35.113 INFO:teuthology.orchestra.run.smithi167.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 264 kB/s | 19 kB 00:00 2024-09-17T01:28:35.124 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T01:28:35.147 INFO:teuthology.orchestra.run.smithi167.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.8 MB/s | 548 kB 00:00 2024-09-17T01:28:35.172 INFO:teuthology.orchestra.run.smithi167.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.5 MB/s | 144 kB 00:00 2024-09-17T01:28:35.197 INFO:teuthology.orchestra.run.smithi167.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 1.2 MB/s | 31 kB 00:00 2024-09-17T01:28:35.222 INFO:teuthology.orchestra.run.smithi167.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T01:28:35.249 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T01:28:35.281 INFO:teuthology.orchestra.run.smithi167.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2024-09-17T01:28:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:35.284 INFO:teuthology.orchestra.run.smithi167.stdout:Total 12 MB/s | 8.7 MB 00:00 2024-09-17T01:28:35.332 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:28:35.342 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T01:28:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:28:35.349 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:28:35.393 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T01:28:35.431 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T01:28:35.462 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-17T01:28:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:28:35.563 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:28:36.086 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:28:36.165 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T01:28:36.200 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T01:28:36.247 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T01:28:36.277 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T01:28:36.377 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T01:28:36.505 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T01:28:36.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-17T01:28:36.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T01:28:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T01:28:36.649 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T01:28:36.677 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T01:28:36.709 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 10/12 2024-09-17T01:28:37.767 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 11/12 2024-09-17T01:28:37.802 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T01:28:37.852 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T01:28:37.853 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-17T01:28:38.185 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:38.186 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:38.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T01:28:39.026 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:04 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 12/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 1/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 3/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T01:28:39.135 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T01:28:39.136 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T01:28:39.136 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T01:28:39.136 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T01:28:39.157 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:39.158 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:39.158 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:28:39.159 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout:Install 12 Packages 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:39.160 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 38 M 2024-09-17T01:28:39.161 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 212 M 2024-09-17T01:28:39.161 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:39.463 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.2.0-0.el9.noarch 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.2.0-0.el9.noarch 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.2.0-0.el9.noarch 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T01:28:39.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T01:28:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T01:28:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T01:28:39.465 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:39.465 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:28:39.626 INFO:teuthology.orchestra.run.smithi082.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 24 MB/s | 7.4 MB 00:00 2024-09-17T01:28:39.651 INFO:teuthology.orchestra.run.smithi082.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 583 kB/s | 191 kB 00:00 2024-09-17T01:28:39.711 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T01:28:39.726 INFO:teuthology.orchestra.run.smithi082.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-17T01:28:39.768 INFO:teuthology.orchestra.run.smithi082.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-09-17T01:28:39.869 INFO:teuthology.orchestra.run.smithi082.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 385 kB/s | 38 kB 00:00 2024-09-17T01:28:39.893 INFO:teuthology.orchestra.run.smithi082.stdout:(6/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 109 kB/s | 18 kB 00:00 2024-09-17T01:28:40.036 INFO:teuthology.orchestra.run.smithi082.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-17T01:28:40.186 INFO:teuthology.orchestra.run.smithi082.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.6 MB/s | 3.0 MB 00:00 2024-09-17T01:28:40.245 INFO:teuthology.orchestra.run.smithi082.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-17T01:28:40.294 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:04 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:28:40.370 INFO:teuthology.orchestra.run.smithi082.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-17T01:28:40.426 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.0-0.el9 ceph-noarch 7.4 M 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T01:28:40.427 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:28:40.428 INFO:teuthology.orchestra.run.smithi167.stdout:Install 12 Packages 2024-09-17T01:28:40.429 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:28:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 38 M 2024-09-17T01:28:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 212 M 2024-09-17T01:28:40.429 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:28:40.765 INFO:teuthology.orchestra.run.smithi167.stdout:(1/12): ceph-mgr-diskprediction-local-19.2.0-0. 45 MB/s | 7.4 MB 00:00 2024-09-17T01:28:40.804 INFO:teuthology.orchestra.run.smithi082.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.3 MB/s | 4.9 MB 00:00 2024-09-17T01:28:40.832 INFO:teuthology.orchestra.run.smithi167.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 825 kB/s | 191 kB 00:00 2024-09-17T01:28:40.924 INFO:teuthology.orchestra.run.smithi167.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-17T01:28:41.066 INFO:teuthology.orchestra.run.smithi167.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 109 kB/s | 33 kB 00:00 2024-09-17T01:28:41.162 INFO:teuthology.orchestra.run.smithi082.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-17T01:28:41.162 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:41.163 INFO:teuthology.orchestra.run.smithi082.stdout:Total 19 MB/s | 38 MB 00:02 2024-09-17T01:28:41.208 INFO:teuthology.orchestra.run.smithi167.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 64 kB/s | 18 kB 00:00 2024-09-17T01:28:41.258 INFO:teuthology.orchestra.run.smithi167.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 200 kB/s | 38 kB 00:00 2024-09-17T01:28:41.515 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:41.541 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:41.541 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:41.642 INFO:teuthology.orchestra.run.smithi167.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 638 kB/s | 245 kB 00:00 2024-09-17T01:28:41.971 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:41.972 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:42.117 INFO:teuthology.orchestra.run.smithi167.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-09-17T01:28:42.236 INFO:teuthology.orchestra.run.smithi167.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-17T01:28:42.752 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:42.833 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T01:28:42.885 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:28:42.984 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:28:43.020 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T01:28:43.205 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T01:28:43.235 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T01:28:43.313 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T01:28:43.634 INFO:teuthology.orchestra.run.smithi167.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.0 MB/s | 4.9 MB 00:02 2024-09-17T01:28:43.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T01:28:44.081 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T01:28:45.201 INFO:teuthology.orchestra.run.smithi167.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.4 MB/s | 5.1 MB 00:03 2024-09-17T01:28:45.319 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:28:46.339 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T01:28:46.368 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T01:28:49.036 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T01:28:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T01:28:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T01:28:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:28:49.037 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:28:49.442 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:49.443 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:49.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-rook 2024-09-17T01:28:50.426 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:15 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:50.558 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:50.559 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:50.559 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:28:50.559 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:28:50.560 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout:Install 13 Packages 2024-09-17T01:28:50.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:50.562 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 2.2 M 2024-09-17T01:28:50.562 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 26 M 2024-09-17T01:28:50.562 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:50.687 INFO:teuthology.orchestra.run.smithi082.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 658 kB/s | 49 kB 00:00 2024-09-17T01:28:50.721 INFO:teuthology.orchestra.run.smithi082.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 177 kB/s | 19 kB 00:00 2024-09-17T01:28:50.746 INFO:teuthology.orchestra.run.smithi082.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 192 kB/s | 26 kB 00:00 2024-09-17T01:28:50.838 INFO:teuthology.orchestra.run.smithi082.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-17T01:28:50.897 INFO:teuthology.orchestra.run.smithi082.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-09-17T01:28:50.922 INFO:teuthology.orchestra.run.smithi082.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-17T01:28:50.939 INFO:teuthology.orchestra.run.smithi082.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 532 kB/s | 54 kB 00:00 2024-09-17T01:28:50.981 INFO:teuthology.orchestra.run.smithi082.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 385 kB/s | 32 kB 00:00 2024-09-17T01:28:50.998 INFO:teuthology.orchestra.run.smithi082.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-17T01:28:51.023 INFO:teuthology.orchestra.run.smithi082.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T01:28:51.049 INFO:teuthology.orchestra.run.smithi082.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-17T01:28:51.074 INFO:teuthology.orchestra.run.smithi082.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-17T01:28:51.107 INFO:teuthology.orchestra.run.smithi082.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.2 MB/s | 1.0 MB 00:00 2024-09-17T01:28:51.110 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:51.110 INFO:teuthology.orchestra.run.smithi082.stdout:Total 4.0 MB/s | 2.2 MB 00:00 2024-09-17T01:28:51.173 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:51.188 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:51.189 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:51.279 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:51.280 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:51.782 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:51.966 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T01:28:52.026 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T01:28:52.090 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T01:28:52.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T01:28:52.168 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T01:28:52.280 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T01:28:52.388 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T01:28:52.445 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T01:28:53.172 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T01:28:53.225 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T01:28:53.259 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T01:28:53.307 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T01:28:53.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T01:28:54.115 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T01:28:54.115 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T01:28:54.116 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T01:28:54.491 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:28:54.492 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:28:54.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:28:54.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:28:54.493 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:28:54.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:54.493 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:54.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T01:28:55.333 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:55.464 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:28:55.465 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout:Install 6 Packages 2024-09-17T01:28:55.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:55.467 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 7.0 M 2024-09-17T01:28:55.467 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 33 M 2024-09-17T01:28:55.467 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:28:55.801 INFO:teuthology.orchestra.run.smithi082.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.1 MB/s | 146 kB 00:00 2024-09-17T01:28:55.852 INFO:teuthology.orchestra.run.smithi082.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-17T01:28:55.877 INFO:teuthology.orchestra.run.smithi082.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T01:28:55.902 INFO:teuthology.orchestra.run.smithi082.stdout:(4/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-17T01:28:55.927 INFO:teuthology.orchestra.run.smithi082.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-17T01:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.8 MB/s | 6.0 MB 00:00 2024-09-17T01:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout:Total 6.8 MB/s | 7.0 MB 00:01 2024-09-17T01:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:28:56.685 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:28:56.685 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T01:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T01:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T01:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T01:28:57.912 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T01:28:57.942 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T01:28:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T01:28:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-17T01:28:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T01:28:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T01:28:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T01:28:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T01:28:58.962 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:58.963 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:28:59.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-fuse 2024-09-17T01:28:59.800 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:28:59.931 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:28:59.932 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:28:59.933 INFO:teuthology.orchestra.run.smithi082.stdout:Install 2 Packages 2024-09-17T01:28:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:28:59.933 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 976 k 2024-09-17T01:28:59.933 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 2.9 M 2024-09-17T01:28:59.933 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:00.072 INFO:teuthology.orchestra.run.smithi082.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 9.8 MB/s | 896 kB 00:00 2024-09-17T01:29:00.097 INFO:teuthology.orchestra.run.smithi082.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 695 kB/s | 80 kB 00:00 2024-09-17T01:29:00.097 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:00.097 INFO:teuthology.orchestra.run.smithi082.stdout:Total 5.8 MB/s | 976 kB 00:00 2024-09-17T01:29:00.109 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:00.131 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:00.213 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:00.213 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:00.401 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T01:29:00.603 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T01:29:01.269 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T01:29:01.269 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-17T01:29:01.563 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T01:29:01.563 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:01.563 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:01.563 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T01:29:01.564 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:01.564 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:01.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados-devel 2024-09-17T01:29:02.468 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:02.604 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 126 k 2024-09-17T01:29:02.605 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 456 k 2024-09-17T01:29:02.606 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:02.668 INFO:teuthology.orchestra.run.smithi082.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 2.0 MB/s | 126 kB 00:00 2024-09-17T01:29:02.669 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:02.669 INFO:teuthology.orchestra.run.smithi082.stdout:Total 1.9 MB/s | 126 kB 00:00 2024-09-17T01:29:02.669 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:02.674 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:02.675 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:02.738 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:02.739 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:02.899 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:03.002 INFO:teuthology.orchestra.run.smithi167.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 801 kB/s | 16 MB 00:20 2024-09-17T01:29:03.002 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:03.002 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.7 MB/s | 38 MB 00:22 2024-09-17T01:29:03.007 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:03.363 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:03.390 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:03.390 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:03.408 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:03.662 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:03.663 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:03.824 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:03.824 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:03.928 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs2 2024-09-17T01:29:04.521 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:04.584 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:04.612 INFO:teuthology.orchestra.run.smithi082.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:04.657 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:04.658 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:04.658 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:04.662 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T01:29:04.707 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:29:04.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install libcephfs-devel 2024-09-17T01:29:04.818 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:29:04.850 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T01:29:05.035 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T01:29:05.057 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T01:29:05.140 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T01:29:05.320 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:05.453 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:05.453 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 32 k 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 142 k 2024-09-17T01:29:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:05.522 INFO:teuthology.orchestra.run.smithi082.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 467 kB/s | 32 kB 00:00 2024-09-17T01:29:05.523 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:05.523 INFO:teuthology.orchestra.run.smithi082.stdout:Total 456 kB/s | 32 kB 00:00 2024-09-17T01:29:05.523 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:05.527 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:05.527 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:05.544 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:05.544 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:05.640 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:05.736 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:05.797 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T01:29:05.913 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T01:29:06.084 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:06.318 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:06.319 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:06.319 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:06.319 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:06.319 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:06.319 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:06.520 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librados2 2024-09-17T01:29:07.098 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:07.155 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:29:07.187 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:07.230 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:07.231 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:07.231 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:07.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install librbd1 2024-09-17T01:29:07.889 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:07.977 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:08.020 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:08.021 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:08.021 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:08.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rados 2024-09-17T01:29:08.205 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T01:29:08.313 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T01:29:08.678 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:08.768 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:08.812 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:08.813 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:08.813 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:08.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rgw 2024-09-17T01:29:09.474 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:09.605 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:09.606 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:09.606 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:09.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-cephfs 2024-09-17T01:29:10.269 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:10.358 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:10.401 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:10.402 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:10.402 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:10.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install python3-rbd 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 12/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarc 1/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T01:29:10.544 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T01:29:10.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T01:29:10.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T01:29:10.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T01:29:10.545 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T01:29:10.977 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.2.0-0.el9.noarch 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T01:29:10.978 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T01:29:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T01:29:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T01:29:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T01:29:10.979 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:10.979 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:11.149 INFO:teuthology.orchestra.run.smithi082.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:11.192 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:11.193 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-09-17T01:29:11.193 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:11.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-fuse 2024-09-17T01:29:11.352 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-rook 2024-09-17T01:29:11.859 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:11.947 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:11.990 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:11.991 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 85 k 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 231 k 2024-09-17T01:29:11.992 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:12.080 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.2.0-0.el9 ceph-noarch 49 k 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:29:12.081 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T01:29:12.082 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:Install 13 Packages 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 2.2 M 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 26 M 2024-09-17T01:29:12.083 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:12.100 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 791 kB/s | 85 kB 00:00 2024-09-17T01:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout:Total 782 kB/s | 85 kB 00:00 2024-09-17T01:29:12.101 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:12.107 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:12.108 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:12.170 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:12.170 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:12.322 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:12.361 INFO:teuthology.orchestra.run.smithi167.stdout:(1/13): ceph-mgr-rook-19.2.0-0.el9.noarch.rpm 918 kB/s | 49 kB 00:00 2024-09-17T01:29:12.430 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:12.794 INFO:teuthology.orchestra.run.smithi167.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 39 kB/s | 19 kB 00:00 2024-09-17T01:29:12.845 INFO:teuthology.orchestra.run.smithi167.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 48 kB/s | 26 kB 00:00 2024-09-17T01:29:12.849 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:13.109 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:13.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:13.110 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:13.110 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:13.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:13.110 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:13.270 INFO:teuthology.orchestra.run.smithi167.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 244 kB/s | 222 kB 00:00 2024-09-17T01:29:13.385 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-mirror 2024-09-17T01:29:13.562 INFO:teuthology.orchestra.run.smithi167.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-09-17T01:29:13.619 INFO:teuthology.orchestra.run.smithi167.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 577 kB/s | 32 kB 00:00 2024-09-17T01:29:13.646 INFO:teuthology.orchestra.run.smithi167.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 534 kB/s | 14 kB 00:00 2024-09-17T01:29:13.671 INFO:teuthology.orchestra.run.smithi167.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.7 MB/s | 220 kB 00:00 2024-09-17T01:29:13.713 INFO:teuthology.orchestra.run.smithi167.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 25 MB/s | 1.0 MB 00:00 2024-09-17T01:29:13.746 INFO:teuthology.orchestra.run.smithi167.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 309 kB/s | 279 kB 00:00 2024-09-17T01:29:13.772 INFO:teuthology.orchestra.run.smithi167.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T01:29:13.805 INFO:teuthology.orchestra.run.smithi167.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-17T01:29:13.897 INFO:teuthology.orchestra.run.smithi167.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 86 kB/s | 54 kB 00:00 2024-09-17T01:29:13.901 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:13.901 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-09-17T01:29:13.972 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:13.978 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:13.989 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:13.989 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:14.084 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:14.084 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:14.114 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:14.115 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 3.1 M 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 13 M 2024-09-17T01:29:14.116 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:14.270 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 20 MB/s | 3.1 MB 00:00 2024-09-17T01:29:14.270 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:14.271 INFO:teuthology.orchestra.run.smithi082.stdout:Total 20 MB/s | 3.1 MB 00:00 2024-09-17T01:29:14.271 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:14.279 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:14.280 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:14.363 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:14.364 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:14.608 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:14.773 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T01:29:14.796 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:14.834 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T01:29:14.854 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:14.879 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:14.880 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:29:14.880 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:29:14.880 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:29:14.880 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:29:14.880 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:14.889 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T01:29:14.934 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T01:29:14.975 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T01:29:15.087 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T01:29:15.197 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T01:29:15.253 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T01:29:15.983 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T01:29:15.987 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:15.987 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:15.987 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:15.987 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:15.988 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:15.988 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:16.033 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T01:29:16.066 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T01:29:16.115 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T01:29:16.145 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T01:29:16.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install rbd-nbd 2024-09-17T01:29:16.885 INFO:teuthology.orchestra.run.smithi082.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 01:27:35 AM UTC. 2024-09-17T01:29:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.0-0.el9.noarch 13/13 2024-09-17T01:29:16.909 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.2.0-0.el9.noarch 1/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T01:29:16.910 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T01:29:17.016 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-09-17T01:29:17.017 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:17.017 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:17.017 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Install 1 Package 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 170 k 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 494 k 2024-09-17T01:29:17.018 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-09-17T01:29:17.099 INFO:teuthology.orchestra.run.smithi082.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 2.1 MB/s | 170 kB 00:00 2024-09-17T01:29:17.100 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:17.100 INFO:teuthology.orchestra.run.smithi082.stdout:Total 2.0 MB/s | 170 kB 00:00 2024-09-17T01:29:17.100 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-09-17T01:29:17.108 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-09-17T01:29:17.108 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-09-17T01:29:17.174 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-09-17T01:29:17.174 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.2.0-0.el9.noarch 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T01:29:17.251 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:17.252 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:17.335 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-09-17T01:29:17.437 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:17.498 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T01:29:17.967 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:18.083 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:18.216 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:18.217 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:18.217 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-17T01:29:18.217 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:18.217 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:18.217 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.2.0-0.el9 ceph-noarch 146 k 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T01:29:18.218 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T01:29:18.219 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:18.219 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:18.219 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:18.219 INFO:teuthology.orchestra.run.smithi167.stdout:Install 6 Packages 2024-09-17T01:29:18.219 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:18.220 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 7.0 M 2024-09-17T01:29:18.220 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 33 M 2024-09-17T01:29:18.220 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:29:18.246 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-09-17T01:29:18.326 INFO:teuthology.orchestra.run.smithi167.stdout:(1/6): ceph-mgr-cephadm-19.2.0-0.el9.noarch.rpm 2.6 MB/s | 146 kB 00:00 2024-09-17T01:29:18.385 INFO:teuthology.orchestra.run.smithi167.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T01:29:18.410 INFO:teuthology.orchestra.run.smithi167.stdout:(3/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-17T01:29:18.436 INFO:teuthology.orchestra.run.smithi167.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T01:29:18.486 INFO:teuthology.orchestra.run.smithi167.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 988 kB/s | 74 kB 00:00 2024-09-17T01:29:18.512 DEBUG:teuthology.parallel:result is None 2024-09-17T01:29:18.705 INFO:teuthology.orchestra.run.smithi167.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-17T01:29:18.705 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:18.705 INFO:teuthology.orchestra.run.smithi167.stdout:Total 14 MB/s | 7.0 MB 00:00 2024-09-17T01:29:18.775 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:18.786 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:18.786 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:18.886 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:18.886 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:19.199 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:19.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T01:29:19.430 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T01:29:19.947 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T01:29:20.031 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T01:29:20.096 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T01:29:20.125 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 6/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 1/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T01:29:20.950 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.2.0-0.el9.noarch 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T01:29:21.214 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T01:29:21.215 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T01:29:21.215 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T01:29:21.215 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:21.215 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:21.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-fuse 2024-09-17T01:29:22.047 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.2.0-0.el9 ceph 896 k 2024-09-17T01:29:22.181 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:Install 2 Packages 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 976 k 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 2.9 M 2024-09-17T01:29:22.182 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:22.530 INFO:teuthology.orchestra.run.smithi167.stdout:(1/2): ceph-fuse-19.2.0-0.el9.x86_64.rpm 12 MB/s | 896 kB 00:00 2024-09-17T01:29:22.622 INFO:teuthology.orchestra.run.smithi167.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 492 kB/s | 80 kB 00:00 2024-09-17T01:29:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:22.623 INFO:teuthology.orchestra.run.smithi167.stdout:Total 2.2 MB/s | 976 kB 00:00 2024-09-17T01:29:22.634 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:22.656 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:22.737 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:22.737 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:22.923 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:23.066 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T01:29:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T01:29:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-fuse-2:19.2.0-0.el9.x86_64 2/2 2024-09-17T01:29:23.863 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.2.0-0.el9.x86_64 1/2 2024-09-17T01:29:24.143 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T01:29:24.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:24.144 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:24.144 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.2.0-0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T01:29:24.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:24.144 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:24.466 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librados-devel 2024-09-17T01:29:25.074 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:25.207 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:25.208 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.2.0-0.el9 ceph 126 k 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:29:25.209 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:25.210 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 126 k 2024-09-17T01:29:25.210 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 456 k 2024-09-17T01:29:25.210 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:25.261 INFO:teuthology.orchestra.run.smithi167.stdout:librados-devel-19.2.0-0.el9.x86_64.rpm 2.4 MB/s | 126 kB 00:00 2024-09-17T01:29:25.262 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:25.262 INFO:teuthology.orchestra.run.smithi167.stdout:Total 2.3 MB/s | 126 kB 00:00 2024-09-17T01:29:25.263 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:25.268 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:25.268 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:25.332 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:25.332 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:25.482 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:25.585 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:26.010 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:26.255 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:26.256 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:26.256 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:26.256 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:26.473 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install libcephfs2 2024-09-17T01:29:27.066 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:27.156 INFO:teuthology.orchestra.run.smithi167.stdout:Package libcephfs2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:27.201 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:27.202 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:27.202 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:27.302 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install libcephfs-devel 2024-09-17T01:29:27.899 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:28.039 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:28.040 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:28.040 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:28.040 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:28.040 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.2.0-0.el9 ceph 32 k 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 32 k 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 142 k 2024-09-17T01:29:28.041 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:28.083 INFO:teuthology.orchestra.run.smithi167.stdout:libcephfs-devel-19.2.0-0.el9.x86_64.rpm 747 kB/s | 32 kB 00:00 2024-09-17T01:29:28.084 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:28.085 INFO:teuthology.orchestra.run.smithi167.stdout:Total 717 kB/s | 32 kB 00:00 2024-09-17T01:29:28.085 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:28.088 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:28.088 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:28.107 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:28.107 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:28.197 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:28.298 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:28.689 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:28.912 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:28.913 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:28.913 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:28.913 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:28.913 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:28.913 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:29.098 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librados2 2024-09-17T01:29:29.674 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:53 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:29.763 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:29.806 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:29.807 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:29.807 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:29.879 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install librbd1 2024-09-17T01:29:30.458 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:54 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:30.547 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:30.591 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:30.592 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:30.592 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:30.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rados 2024-09-17T01:29:31.241 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:55 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:31.330 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rados-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:31.373 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:31.374 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:31.374 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:31.446 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rgw 2024-09-17T01:29:32.031 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:56 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:32.119 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rgw-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:32.163 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:32.164 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:32.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-cephfs 2024-09-17T01:29:32.822 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:56 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:32.912 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-cephfs-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:32.955 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:32.956 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:33.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install python3-rbd 2024-09-17T01:29:33.611 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:57 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:33.700 INFO:teuthology.orchestra.run.smithi167.stdout:Package python3-rbd-2:19.2.0-0.el9.x86_64 is already installed. 2024-09-17T01:29:33.744 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:Nothing to do. 2024-09-17T01:29:33.745 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:33.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-fuse 2024-09-17T01:29:34.406 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:01:58 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:34.538 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.2.0-0.el9 ceph 85 k 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:34.539 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:29:34.540 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:34.540 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 85 k 2024-09-17T01:29:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 231 k 2024-09-17T01:29:34.541 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:34.587 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-fuse-19.2.0-0.el9.x86_64.rpm 1.8 MB/s | 85 kB 00:00 2024-09-17T01:29:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:Total 1.7 MB/s | 85 kB 00:00 2024-09-17T01:29:34.588 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:34.595 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:34.660 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:34.823 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:34.910 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:35.345 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:35.613 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:35.613 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:35.613 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:35.613 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:35.614 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:35.614 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:35.821 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-mirror 2024-09-17T01:29:36.416 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:00 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:36.552 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:36.553 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:36.553 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:36.553 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.2.0-0.el9 ceph 3.1 M 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 3.1 M 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 13 M 2024-09-17T01:29:36.554 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:36.650 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-mirror-19.2.0-0.el9.x86_64.rpm 32 MB/s | 3.1 MB 00:00 2024-09-17T01:29:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:Total 32 MB/s | 3.1 MB 00:00 2024-09-17T01:29:36.651 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:36.660 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:36.742 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:36.743 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:37.176 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:37.234 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T01:29:37.261 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:38.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install rbd-nbd 2024-09-17T01:29:39.175 INFO:teuthology.orchestra.run.smithi167.stdout:Last metadata expiration check: 0:02:03 ago on Tue 17 Sep 2024 01:27:36 AM UTC. 2024-09-17T01:29:39.311 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-17T01:29:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:39.312 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-17T01:29:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:39.312 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-17T01:29:39.312 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.2.0-0.el9 ceph 170 k 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:Install 1 Package 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 170 k 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 494 k 2024-09-17T01:29:39.313 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-17T01:29:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:rbd-nbd-19.2.0-0.el9.x86_64.rpm 3.2 MB/s | 170 kB 00:00 2024-09-17T01:29:39.365 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:29:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:Total 3.2 MB/s | 170 kB 00:00 2024-09-17T01:29:39.366 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-17T01:29:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-17T01:29:39.373 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-17T01:29:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-17T01:29:39.437 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-17T01:29:39.603 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-17T01:29:39.703 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:40.133 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:40.387 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.2.0-0.el9.x86_64 1/1 2024-09-17T01:29:40.387 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-17T01:29:40.388 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.2.0-0.el9.x86_64 2024-09-17T01:29:40.388 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:29:40.388 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-17T01:29:40.648 DEBUG:teuthology.parallel:result is None 2024-09-17T01:29:40.648 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:29:40.648 INFO:teuthology.packaging:ref: None 2024-09-17T01:29:40.648 INFO:teuthology.packaging:tag: None 2024-09-17T01:29:40.648 INFO:teuthology.packaging:branch: squid 2024-09-17T01:29:40.649 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:29:40.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T01:29:40.897 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:29:40.923 INFO:teuthology.orchestra.run.smithi082.stdout:19.2.0-0.el9 2024-09-17T01:29:40.924 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-17T01:29:40.924 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-17T01:29:40.926 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T01:29:40.926 INFO:teuthology.packaging:ref: None 2024-09-17T01:29:40.926 INFO:teuthology.packaging:tag: None 2024-09-17T01:29:40.926 INFO:teuthology.packaging:branch: squid 2024-09-17T01:29:40.926 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:29:40.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T01:29:41.162 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T01:29:41.184 INFO:teuthology.orchestra.run.smithi167.stdout:19.2.0-0.el9 2024-09-17T01:29:41.184 INFO:teuthology.packaging:The installed version of ceph is 19.2.0-0.el9 2024-09-17T01:29:41.184 INFO:teuthology.task.install:The correct ceph version 19.2.0-0 is installed. 2024-09-17T01:29:41.186 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T01:29:41.186 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:29:41.186 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:29:41.218 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:29:41.218 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T01:29:41.250 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T01:29:41.251 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:29:41.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:29:41.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:29:41.357 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:29:41.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T01:29:41.382 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T01:29:41.447 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T01:29:41.447 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:29:41.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:29:41.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:29:41.542 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:29:41.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T01:29:41.567 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T01:29:41.631 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T01:29:41.632 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:29:41.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:29:41.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:29:41.726 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:29:41.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T01:29:41.751 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T01:29:41.816 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:29:41.826 INFO:teuthology.task.print:**** done install task... 2024-09-17T01:29:41.827 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T01:29:42.263 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T01:29:42.264 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-17T01:29:42.264 INFO:tasks.cephadm:Cluster fsid is 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:29:42.264 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T01:29:42.264 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-17T01:29:42.265 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi082': '172.21.15.82', 'mon.smithi167': '172.21.15.167'} 2024-09-17T01:29:42.265 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T01:29:42.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-09-17T01:29:42.295 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-09-17T01:29:42.322 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-17T01:29:42.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:29:42.463 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83084/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4989-gce1b342b', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4989.gce1b342b'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-16 22:35:34.483762', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240916.200549-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-17T01:29:42.669 INFO:tasks.util.chacra:got chacra host chacra.ceph.com, ref squid, sha1 8e98666cb045318799c9328f1ae906cc2d724fd2 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-17T01:29:42.670 INFO:tasks.cephadm:Discovered cachra url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-17T01:29:42.670 INFO:tasks.cephadm:Downloading cephadm from url: https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm 2024-09-17T01:29:42.671 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.044 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 17 01:29 /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.044 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://chacra.ceph.com/binaries/ceph/squid/8e98666cb045318799c9328f1ae906cc2d724fd2/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.328 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 784488 Sep 17 01:29 /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.328 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.349 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T01:29:43.379 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-17T01:29:43.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-17T01:29:43.392 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-17T01:29:44.893 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T01:29:45.137 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T01:31:34.205 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-17T01:31:34.205 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-17T01:31:34.205 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-17T01:31:34.205 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-09-17T01:31:34.206 INFO:teuthology.orchestra.run.smithi167.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-17T01:31:34.206 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-17T01:31:34.206 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-17T01:31:46.367 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:31:46.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)", 2024-09-17T01:31:46.368 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b", 2024-09-17T01:31:46.368 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-09-17T01:31:46.368 INFO:teuthology.orchestra.run.smithi082.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3" 2024-09-17T01:31:46.368 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-09-17T01:31:46.368 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:31:46.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-09-17T01:31:46.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-09-17T01:31:46.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-09-17T01:31:46.493 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-09-17T01:31:46.533 INFO:tasks.cephadm:Writing seed config... 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-17T01:31:46.535 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T01:31:46.536 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T01:31:46.537 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-17T01:31:46.537 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:31:46.537 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T01:31:46.552 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5047e42a-7494-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-17T01:31:46.552 DEBUG:teuthology.orchestra.run.smithi082:mon.smithi082> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service 2024-09-17T01:31:46.594 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T01:31:46.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 5047e42a-7494-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:31:46.799 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-09-17T01:31:46.799 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-09-17T01:31:46.799 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T01:31:46.799 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-09-17T01:31:46.825 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 5.2.2 2024-09-17T01:31:46.825 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-09-17T01:31:46.825 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-09-17T01:31:46.834 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T01:31:46.834 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T01:31:46.841 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T01:31:46.841 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:31:46.848 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-09-17T01:31:46.855 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-09-17T01:31:46.855 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-09-17T01:31:46.855 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-09-17T01:31:46.885 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 5.2.2 2024-09-17T01:31:46.885 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T01:31:46.885 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-09-17T01:31:46.886 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-09-17T01:31:46.892 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T01:31:46.892 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T01:31:46.898 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T01:31:46.898 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:31:46.905 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 139951275480928 on /run/cephadm/5047e42a-7494-11ef-bceb-c7b262605968.lock 2024-09-17T01:31:46.912 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 139951275480928 acquired on /run/cephadm/5047e42a-7494-11ef-bceb-c7b262605968.lock 2024-09-17T01:31:46.913 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-09-17T01:31:46.913 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-09-17T01:31:46.913 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-09-17T01:31:46.916 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-09-17T01:31:46.916 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-09-17T01:31:46.918 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T01:31:46.918 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-17T01:31:46.919 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-17T01:31:46.921 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T01:31:46.921 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T01:31:46.921 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T01:31:46.921 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-17T01:31:46.922 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link noprefixroute 2024-09-17T01:31:46.922 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T01:31:46.922 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-09-17T01:31:46.922 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-09-17T01:31:46.922 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T01:31:46.923 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T01:31:46.923 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T01:31:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-17T01:31:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-17T01:31:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T01:31:47.737 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:83d928f919f2c1e0c1bd6bccd6df0f26dec4d40362b4c5deccad70d7b002219d 2024-09-17T01:31:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T01:31:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b 2024-09-17T01:31:47.738 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T01:31:48.724 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-17T01:31:48.725 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable) 2024-09-17T01:31:48.725 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T01:31:49.554 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-09-17T01:31:49.554 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-09-17T01:31:50.444 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAF3OhmWyaJNBAAnL/tHV24MpKSbxr7+GU9Ug== 2024-09-17T01:31:51.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAG3OhmvUdrLhAANnS2SDvyHDNdNVJPv2t/yQ== 2024-09-17T01:31:52.245 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAH3Ohm5tHMKRAApuv4GBZksezcQn9XtOu3Hg== 2024-09-17T01:31:52.246 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for smithi082 [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:31:53.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T01:31:53.170 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:31:53.170 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-09-17T01:31:54.241 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.smithi082 on 2024-09-17T01:31:54.465 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-17T01:31:54.608 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T01:31:54.786 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target. 2024-09-17T01:31:54.786 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target. 2024-09-17T01:31:55.016 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082 2024-09-17T01:31:55.016 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service: Unit ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service not loaded. 2024-09-17T01:31:55.179 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target.wants/ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service → /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968@.service. 2024-09-17T01:31:55.701 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:55 smithi082 ceph-mon[27706]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-09-17T01:31:55.702 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:55 smithi082 bash[27687]: fb3a9ae83d255bb796c3edf2ea6340f6b0133d32d93ebb334ddf28387074763c 2024-09-17T01:31:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:31:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-09-17T01:31:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-09-17T01:31:55.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:55 smithi082 systemd[1]: Started Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:31:56.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T01:31:56.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:31:56.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi082 (age 0.549055s) 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:31:56.703 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-09-17T01:31:56.704 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: monmap epoch 1 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: last_changed 2024-09-17T01:31:52.621485+0000 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: min_mon_release 19 (squid) 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: election_strategy: 1 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:31:56.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: fsmap 2024-09-17T01:31:56.825 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T01:31:56.825 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: mgrmap e1: no daemons active 2024-09-17T01:31:56.825 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:56 smithi082 ceph-mon[27706]: from='client.? 172.21.15.82:0/1149139590' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T01:31:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:57 smithi082 ceph-mon[27706]: from='client.? 172.21.15.82:0/1166897351' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T01:31:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:31:57 smithi082 ceph-mon[27706]: from='client.? 172.21.15.82:0/1166897351' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T01:32:03.095 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T01:32:03.096 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-09-17T01:32:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:06 smithi082 ceph-mon[27706]: from='client.? 172.21.15.82:0/3608192383' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:32:07.439 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-09-17T01:32:07.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:07 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:32:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:07 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[27702]: 2024-09-17T01:32:07.715+0000 7f2b79d64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:32:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:07 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[27702]: 2024-09-17T01:32:07.715+0000 7f2b79d64640 -1 mon.smithi082@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T01:32:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:07 smithi082 podman[27950]: 2024-09-17 01:32:07.736454767 +0000 UTC m=+0.125879138 container died fb3a9ae83d255bb796c3edf2ea6340f6b0133d32d93ebb334ddf28387074763c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:32:08.342 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[27950]: 2024-09-17 01:32:08.073595743 +0000 UTC m=+0.463020112 container cleanup fb3a9ae83d255bb796c3edf2ea6340f6b0133d32d93ebb334ddf28387074763c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97) 2024-09-17T01:32:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 bash[27950]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082 2024-09-17T01:32:08.343 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[27962]: 2024-09-17 01:32:08.241055309 +0000 UTC m=+0.504382268 container remove fb3a9ae83d255bb796c3edf2ea6340f6b0133d32d93ebb334ddf28387074763c (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-c2ddf97, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-17T01:32:08.671 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service: Deactivated successfully. 2024-09-17T01:32:08.671 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 systemd[1]: Stopped Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:32:08.671 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 systemd[1]: Starting Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:32:08.923 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[28058]: 2024-09-17 01:32:08.576423267 +0000 UTC m=+0.015560350 image pull ebb0615149def4a3179c82c0cc47af75808300abb9f1142788e5e605a7ac0e5b quay.ceph.io/ceph-ci/ceph:squid 2024-09-17T01:32:08.923 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[28058]: 2024-09-17 01:32:08.675010118 +0000 UTC m=+0.114147187 container create 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97) 2024-09-17T01:32:08.923 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[28058]: 2024-09-17 01:32:08.902305961 +0000 UTC m=+0.341443036 container init 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:32:08.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 podman[28058]: 2024-09-17 01:32:08.905313184 +0000 UTC m=+0.344450260 container start 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:32:09.004 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: pidfile_write: ignore empty --pid-file 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: load: jerasure load: lrc 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:32:09.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Git sha 0 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: DB SUMMARY 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: DB Session ID: YNMO93DHE2Y9QFRC9EXG 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000009.log size: 94969 ; 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:32:09.212 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.env: 0x5596425e1940 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.info_log: 0x5596444c38c0 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.statistics: (nil) 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.use_fsync: 0 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:32:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.db_log_dir: 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.wal_dir: 2024-09-17T01:32:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:32:09.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.write_buffer_manager: 0x5596444d2dc0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.unordered_write: 0 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:32:09.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.row_cache: None 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.wal_filter: None 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.wal_compression: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:32:09.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:32:09.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_open_files: -1 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:32:09.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Compression algorithms supported: 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kZSTD supported: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:32:09.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000010 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.merge_operator: 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_filter: None 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5596444c3520) 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:32:09.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 4 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x5596444b71f0 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-09-17T01:32:09.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: bloomfilter 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 5 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-09-17T01:32:09.224 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_auto_readahead_size: 262144 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: prepopulate_block_cache: 0 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression: NoCompression 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:32:09.225 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.num_levels: 7 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:32:09.226 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:32:09.227 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:32:09.228 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:32:09.229 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.ttl: 2592000 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:32:09.230 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T01:32:09.231 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 98d5634c-6893-407f-9da7-3e5914246905 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536728931827, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536728933166, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91008, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89072, "index_size": 256, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11690, "raw_average_key_size": 48, "raw_value_size": 82581, "raw_average_value_size": 339, "num_data_blocks": 11, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726536728, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "98d5634c-6893-407f-9da7-3e5914246905", "db_session_id": "YNMO93DHE2Y9QFRC9EXG", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536728933291, "job": 1, "event": "recovery_finished"} 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5596444e4e00 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: DB pointer 0x5596445e0000 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:32:09.232 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:32:09.233 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 2/0 90.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 90.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:32:09.234 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 20.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 20.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache BinnedLRUCache@0x5596444b71f0#2 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:32:09.235 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: starting mon.smithi082 rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???) e1 preinit fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).mds e1 new map 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).mds e1 print_map 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e1 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: btime 2024-09-17T01:31:55:651443+0000 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: -1 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: No filesystems configured 2024-09-17T01:32:09.236 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mon.smithi082 is new leader, mons smithi082 in quorum (ranks 0) 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: monmap epoch 1 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: last_changed 2024-09-17T01:31:52.621485+0000 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: min_mon_release 19 (squid) 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: election_strategy: 1 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: fsmap 2024-09-17T01:32:09.237 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T01:32:09.238 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:08 smithi082 ceph-mon[28077]: mgrmap e1: no daemons active 2024-09-17T01:32:09.238 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:09 smithi082 bash[28058]: 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf 2024-09-17T01:32:09.238 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:09 smithi082 systemd[1]: Started Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:32:10.009 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T01:32:10.030 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:32:10.030 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-09-17T01:32:10.030 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T01:32:10.031 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T01:32:10.031 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-17T01:32:10.284 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5047e42a-7494-11ef-bceb-c7b262605968@mgr.smithi082.oppacm 2024-09-17T01:32:10.284 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5047e42a-7494-11ef-bceb-c7b262605968@mgr.smithi082.oppacm.service: Unit ceph-5047e42a-7494-11ef-bceb-c7b262605968@mgr.smithi082.oppacm.service not loaded. 2024-09-17T01:32:10.430 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968.target.wants/ceph-5047e42a-7494-11ef-bceb-c7b262605968@mgr.smithi082.oppacm.service → /etc/systemd/system/ceph-5047e42a-7494-11ef-bceb-c7b262605968@.service. 2024-09-17T01:32:10.660 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:10 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/897367213' entity='client.admin' 2024-09-17T01:32:10.982 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:32:10.982 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-09-17T01:32:10.990 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:32:10.990 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:32:10.990 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-09-17T01:32:10.990 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T01:32:10.999 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:32:10.999 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-09-17T01:32:11.006 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:32:11.006 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:32:11.006 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-09-17T01:32:11.006 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-17T01:32:11.006 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-09-17T01:32:11.007 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-09-17T01:32:11.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:11 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2827334202' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "5047e42a-7494-11ef-bceb-c7b262605968", 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:32:12.858 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T01:32:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:32:12.860 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:32:12.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:12.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T01:31:55:651443+0000", 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:31:55.652087+0000", 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-09-17T01:32:15.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/358634024' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:32:16.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "5047e42a-7494-11ef-bceb-c7b262605968", 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:32:16.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:32:16.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:32:16.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T01:31:55:651443+0000", 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:16.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:31:55.652087+0000", 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:16.026 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: Activating manager daemon smithi082.oppacm 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: mgrmap e2: smithi082.oppacm(active, starting, since 0.00302246s) 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:32:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:32:16.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:32:16.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:16.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:16.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:16 smithi082 ceph-mon[28077]: from='mgr.14100 172.21.15.82:0/3316152758' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:18.148 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:17 smithi082 ceph-mon[28077]: mgrmap e3: smithi082.oppacm(active, since 1.00864s) 2024-09-17T01:32:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:18 smithi082 ceph-mon[28077]: mgrmap e4: smithi082.oppacm(active, since 2s) 2024-09-17T01:32:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:18 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/84513984' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "5047e42a-7494-11ef-bceb-c7b262605968", 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T01:32:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "smithi082" 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:19.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T01:32:19.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "btime": "2024-09-17T01:31:55:651443+0000", 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T01:32:19.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T01:32:19.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T01:31:55.652087+0000", 2024-09-17T01:32:19.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T01:32:19.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-09-17T01:32:19.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T01:32:19.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:19.725 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-09-17T01:32:20.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:20 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/645037612' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T01:32:20.846 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T01:32:20.847 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-09-17T01:32:21.797 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:21 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2043566232' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T01:32:22.759 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:22 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2043566232' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T01:32:22.759 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:22 smithi082 ceph-mon[28077]: mgrmap e5: smithi082.oppacm(active, since 5s) 2024-09-17T01:32:23.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:23.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T01:32:23.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:32:23.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "smithi082.oppacm", 2024-09-17T01:32:23.400 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T01:32:23.400 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:23.400 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-09-17T01:32:23.400 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-09-17T01:32:23.650 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:23 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/616513343' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T01:32:26.716 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: Active manager daemon smithi082.oppacm restarted 2024-09-17T01:32:26.716 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: Activating manager daemon smithi082.oppacm 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: mgrmap e6: smithi082.oppacm(active, starting, since 0.00373778s) 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:26.717 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:32:26.718 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:26 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:32:27.651 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:27 smithi082 ceph-mon[28077]: Found migration_current of "None". Setting to last migration. 2024-09-17T01:32:27.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:27 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:27.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:27 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:27.652 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:27 smithi082 ceph-mon[28077]: mgrmap e7: smithi082.oppacm(active, since 1.00561s) 2024-09-17T01:32:27.946 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T01:32:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T01:32:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-09-17T01:32:27.947 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-09-17T01:32:28.555 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:28 smithi082 ceph-mon[28077]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T01:32:28.555 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:28 smithi082 ceph-mon[28077]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T01:32:28.556 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:28 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:27] ENGINE Bus STARTING 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:27] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:27] ENGINE Error in HTTPServer.serve 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Traceback (most recent call last): 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:32:29.561 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._run(expiration_interval) 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s = self.context.wrap_socket( 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: return self.sslsocket_class._create( 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self.do_handshake() 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:32:29.562 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._sslobj.do_handshake() 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:27] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:27] ENGINE Bus STARTED 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: mgrmap e8: smithi082.oppacm(active, since 2s) 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:29.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:29 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:30.243 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T01:32:30.243 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-09-17T01:32:30.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:30 smithi082 ceph-mon[28077]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:31.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:31 smithi082 ceph-mon[28077]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:31.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:31 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:31.461 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:31 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:32.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:32 smithi082 ceph-mon[28077]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:32.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:32 smithi082 ceph-mon[28077]: Generating ssh key... 2024-09-17T01:32:32.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8Q5QUxIZ7fs49GIkV8m9q1P0OScIRaiYQLItybBy/V4Q9UrJ5IsilIzGsabLT67sEy/2KVtk7VSHUYi+JlkUzSrcvMFcddVDsHhwYLWRLZjf3UknP8z84VmPR2Se/bcX10MMT8lhtejIAypJI9TR2pMXeFd13PT+mwLNoE/kpY2uuTrK+2hMjdhS8tCxgE68fFUBZ9RLlV4UIb8vuUtnRBIJCsO6Cr41gqXCOWXtHw+xUKnk9j/TsrJVU75vqR+eVnlWgd6Sqr4lVNf0YPSffEOiObhEf4Qeh1xFaS8yOKJmPyoQiIFHFPQ2eYoHPCa+oBdBT3Zy3uMTh2RolgLAyU3kOG5KfBWTJoRD/XsD16Q6xQtlxXVJw+5lfq/q5aI3jnoROdjKZbvNay+4q+uXpGBO4mSQ1yrzvALi0ONFpfunnvgQxJ44Oia0EFK45eNhKLxsXQGx99Z0ymcJCzcpXApOilgQjz4xMcheRR0+jHOqPVxuCEo7YUs6lmbuvpEs= ceph-5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:32:32.888 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:32:32.888 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T01:32:32.890 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-09-17T01:32:33.649 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:33 smithi082 ceph-mon[28077]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:34.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:34 smithi082 ceph-mon[28077]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:35.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:35 smithi082 ceph-mon[28077]: Deploying cephadm binary to smithi082 2024-09-17T01:32:37.254 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-09-17T01:32:37.254 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying mon service with default placement... 2024-09-17T01:32:37.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:37 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:37.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:37 smithi082 ceph-mon[28077]: Added host smithi082 2024-09-17T01:32:37.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:37 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:38.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T01:32:38.427 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying mgr service with default placement... 2024-09-17T01:32:39.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:38 smithi082 ceph-mon[28077]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:39.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:38 smithi082 ceph-mon[28077]: Saving service mon spec with placement count:5 2024-09-17T01:32:39.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:38 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:40.441 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T01:32:40.441 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying crash service with default placement... 2024-09-17T01:32:40.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:40 smithi082 ceph-mon[28077]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:40.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:40 smithi082 ceph-mon[28077]: Saving service mgr spec with placement count:2 2024-09-17T01:32:40.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:40 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:40.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:40 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:41.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:41 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:41.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:41 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:41.892 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-17T01:32:41.893 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying ceph-exporter service with default placement... 2024-09-17T01:32:42.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:42 smithi082 ceph-mon[28077]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:42.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:42 smithi082 ceph-mon[28077]: Saving service crash spec with placement * 2024-09-17T01:32:42.642 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:42 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:43.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-17T01:32:43.457 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying prometheus service with default placement... 2024-09-17T01:32:43.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:43 smithi082 ceph-mon[28077]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:43.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:43 smithi082 ceph-mon[28077]: Saving service ceph-exporter spec with placement * 2024-09-17T01:32:43.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:43 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:43.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:43 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:45 smithi082 ceph-mon[28077]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:45 smithi082 ceph-mon[28077]: Saving service prometheus spec with placement count:1 2024-09-17T01:32:45.358 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:45 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:45.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-17T01:32:45.361 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying grafana service with default placement... 2024-09-17T01:32:46.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-17T01:32:46.517 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying node-exporter service with default placement... 2024-09-17T01:32:47.191 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:46 smithi082 ceph-mon[28077]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:47.191 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:46 smithi082 ceph-mon[28077]: Saving service grafana spec with placement count:1 2024-09-17T01:32:47.191 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:46 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:47.191 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:46 smithi082 ceph-mon[28077]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:32:47.689 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-17T01:32:47.690 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying alertmanager service with default placement... 2024-09-17T01:32:48.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:48 smithi082 ceph-mon[28077]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:48.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:48 smithi082 ceph-mon[28077]: Saving service node-exporter spec with placement * 2024-09-17T01:32:48.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:48 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:48.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-17T01:32:49.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:49 smithi082 ceph-mon[28077]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:32:49.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:49 smithi082 ceph-mon[28077]: Saving service alertmanager spec with placement count:1 2024-09-17T01:32:49.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:49 smithi082 ceph-mon[28077]: from='mgr.14118 172.21.15.82:0/2320391339' entity='mgr.smithi082.oppacm' 2024-09-17T01:32:49.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:49 smithi082 ceph-mon[28077]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:32:50.684 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:50 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/224305239' entity='client.admin' 2024-09-17T01:32:51.199 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-09-17T01:32:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:51 smithi082 ceph-mon[28077]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:32:51.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:51 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3311335029' entity='client.admin' 2024-09-17T01:32:52.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:52 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3328783704' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T01:32:53.823 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:53 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3328783704' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T01:32:53.823 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:53 smithi082 ceph-mon[28077]: mgrmap e9: smithi082.oppacm(active, since 26s) 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "smithi082.oppacm", 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-09-17T01:32:54.446 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-09-17T01:32:54.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1039303477' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: Active manager daemon smithi082.oppacm restarted 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: Activating manager daemon smithi082.oppacm 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: mgrmap e10: smithi082.oppacm(active, starting, since 0.00548036s) 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:32:57.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:32:57.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:32:57.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:32:57.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:57 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:32:58.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-09-17T01:32:58.995 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T01:32:58.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T01:32:58.996 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-09-17T01:32:58.996 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-09-17T01:32:58.996 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-09-17T01:32:59.397 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:59 smithi082 ceph-mon[28077]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T01:32:59.397 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:59 smithi082 ceph-mon[28077]: mgrmap e11: smithi082.oppacm(active, since 1.00568s) 2024-09-17T01:32:59.397 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:59 smithi082 ceph-mon[28077]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T01:32:59.397 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:32:59 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:00.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T01:33:00.345 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:59] ENGINE Bus STARTING 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:59] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:00.644 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:00 smithi082 ceph-mon[28077]: mgrmap e12: smithi082.oppacm(active, since 2s) 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:01 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:59] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:01 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:59] ENGINE Bus STARTED 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:01 smithi082 ceph-mon[28077]: [17/Sep/2024:01:32:59] ENGINE Error in HTTPServer.serve 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Traceback (most recent call last): 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._run(expiration_interval) 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:33:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s = self.context.wrap_socket( 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: return self.sslsocket_class._create( 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self.do_handshake() 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._sslobj.do_handshake() 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:33:01.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:01 smithi082 ceph-mon[28077]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:33:01.716 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:01 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:01.752 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$U.HfHBXkyWdkMewdUKEdD.KOsAGgnWNm8NazeyeVpQRXWBNTEMN02", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726536781, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T01:33:01.752 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-09-17T01:33:02.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:02 smithi082 ceph-mon[28077]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:33:02.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:02 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3184861990' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T01:33:03.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T01:33:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T01:33:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-09-17T01:33:03.590 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T01:33:03.590 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-09-17T01:33:03.590 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-09-17T01:33:03.590 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: Password: pn1bhkmqkm 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:03.593 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config directory 2024-09-17T01:33:04.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:04 smithi082 ceph-mon[28077]: mgrmap e13: smithi082.oppacm(active, since 6s) 2024-09-17T01:33:04.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:04 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/945064886' entity='client.admin' 2024-09-17T01:33:04.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T01:33:04.916 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T01:33:04.916 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.916 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:33:04.916 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:04.917 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-09-17T01:33:04.954 INFO:tasks.cephadm:Fetching config... 2024-09-17T01:33:04.954 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:33:04.954 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T01:33:04.970 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T01:33:04.970 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:33:04.970 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T01:33:05.027 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T01:33:05.027 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:33:05.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/keyring of=/dev/stdout 2024-09-17T01:33:05.092 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T01:33:05.092 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:33:05.092 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T01:33:05.148 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T01:33:05.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8Q5QUxIZ7fs49GIkV8m9q1P0OScIRaiYQLItybBy/V4Q9UrJ5IsilIzGsabLT67sEy/2KVtk7VSHUYi+JlkUzSrcvMFcddVDsHhwYLWRLZjf3UknP8z84VmPR2Se/bcX10MMT8lhtejIAypJI9TR2pMXeFd13PT+mwLNoE/kpY2uuTrK+2hMjdhS8tCxgE68fFUBZ9RLlV4UIb8vuUtnRBIJCsO6Cr41gqXCOWXtHw+xUKnk9j/TsrJVU75vqR+eVnlWgd6Sqr4lVNf0YPSffEOiObhEf4Qeh1xFaS8yOKJmPyoQiIFHFPQ2eYoHPCa+oBdBT3Zy3uMTh2RolgLAyU3kOG5KfBWTJoRD/XsD16Q6xQtlxXVJw+5lfq/q5aI3jnoROdjKZbvNay+4q+uXpGBO4mSQ1yrzvALi0ONFpfunnvgQxJ44Oia0EFK45eNhKLxsXQGx99Z0ymcJCzcpXApOilgQjz4xMcheRR0+jHOqPVxuCEo7YUs6lmbuvpEs= ceph-5047e42a-7494-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T01:33:05.223 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8Q5QUxIZ7fs49GIkV8m9q1P0OScIRaiYQLItybBy/V4Q9UrJ5IsilIzGsabLT67sEy/2KVtk7VSHUYi+JlkUzSrcvMFcddVDsHhwYLWRLZjf3UknP8z84VmPR2Se/bcX10MMT8lhtejIAypJI9TR2pMXeFd13PT+mwLNoE/kpY2uuTrK+2hMjdhS8tCxgE68fFUBZ9RLlV4UIb8vuUtnRBIJCsO6Cr41gqXCOWXtHw+xUKnk9j/TsrJVU75vqR+eVnlWgd6Sqr4lVNf0YPSffEOiObhEf4Qeh1xFaS8yOKJmPyoQiIFHFPQ2eYoHPCa+oBdBT3Zy3uMTh2RolgLAyU3kOG5KfBWTJoRD/XsD16Q6xQtlxXVJw+5lfq/q5aI3jnoROdjKZbvNay+4q+uXpGBO4mSQ1yrzvALi0ONFpfunnvgQxJ44Oia0EFK45eNhKLxsXQGx99Z0ymcJCzcpXApOilgQjz4xMcheRR0+jHOqPVxuCEo7YUs6lmbuvpEs= ceph-5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:33:05.241 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8Q5QUxIZ7fs49GIkV8m9q1P0OScIRaiYQLItybBy/V4Q9UrJ5IsilIzGsabLT67sEy/2KVtk7VSHUYi+JlkUzSrcvMFcddVDsHhwYLWRLZjf3UknP8z84VmPR2Se/bcX10MMT8lhtejIAypJI9TR2pMXeFd13PT+mwLNoE/kpY2uuTrK+2hMjdhS8tCxgE68fFUBZ9RLlV4UIb8vuUtnRBIJCsO6Cr41gqXCOWXtHw+xUKnk9j/TsrJVU75vqR+eVnlWgd6Sqr4lVNf0YPSffEOiObhEf4Qeh1xFaS8yOKJmPyoQiIFHFPQ2eYoHPCa+oBdBT3Zy3uMTh2RolgLAyU3kOG5KfBWTJoRD/XsD16Q6xQtlxXVJw+5lfq/q5aI3jnoROdjKZbvNay+4q+uXpGBO4mSQ1yrzvALi0ONFpfunnvgQxJ44Oia0EFK45eNhKLxsXQGx99Z0ymcJCzcpXApOilgQjz4xMcheRR0+jHOqPVxuCEo7YUs6lmbuvpEs= ceph-5047e42a-7494-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T01:33:05.337 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8Q5QUxIZ7fs49GIkV8m9q1P0OScIRaiYQLItybBy/V4Q9UrJ5IsilIzGsabLT67sEy/2KVtk7VSHUYi+JlkUzSrcvMFcddVDsHhwYLWRLZjf3UknP8z84VmPR2Se/bcX10MMT8lhtejIAypJI9TR2pMXeFd13PT+mwLNoE/kpY2uuTrK+2hMjdhS8tCxgE68fFUBZ9RLlV4UIb8vuUtnRBIJCsO6Cr41gqXCOWXtHw+xUKnk9j/TsrJVU75vqR+eVnlWgd6Sqr4lVNf0YPSffEOiObhEf4Qeh1xFaS8yOKJmPyoQiIFHFPQ2eYoHPCa+oBdBT3Zy3uMTh2RolgLAyU3kOG5KfBWTJoRD/XsD16Q6xQtlxXVJw+5lfq/q5aI3jnoROdjKZbvNay+4q+uXpGBO4mSQ1yrzvALi0ONFpfunnvgQxJ44Oia0EFK45eNhKLxsXQGx99Z0ymcJCzcpXApOilgQjz4xMcheRR0+jHOqPVxuCEo7YUs6lmbuvpEs= ceph-5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:33:05.351 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T01:33:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:33:06.905 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T01:33:06.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T01:33:07.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:07 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/935180745' entity='client.admin' 2024-09-17T01:33:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:33:09.172 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-09-17T01:33:09.173 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:33:09.173 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-09-17T01:33:09.192 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:33:09.192 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:33:09.251 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-09-17T01:33:09.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch host add smithi167 2024-09-17T01:33:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:33:09.797 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:09 smithi082 ceph-mon[28077]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:33:09.797 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:09 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.909 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:33:10.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:33:10.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:10 smithi082 ceph-mon[28077]: Deploying daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:33:11.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:11 smithi082 ceph-mon[28077]: Deploying cephadm binary to smithi167 2024-09-17T01:33:13.703 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:33:14.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:33:14.423 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: Deploying daemon crash.smithi082 on smithi082 2024-09-17T01:33:14.423 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:13 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:14.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T01:33:14.978 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:33:15.141 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:14 smithi082 ceph-mon[28077]: Added host smithi167 2024-09-17T01:33:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:33:15.731 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-09-17T01:33:16.714 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T01:33:16.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T01:33:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:33:17.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:33:17.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:17.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:17.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:17.293 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:17.294 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:17 smithi082 ceph-mon[28077]: Deploying daemon node-exporter.smithi082 on smithi082 2024-09-17T01:33:18.412 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-09-17T01:33:18.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:18 smithi082 ceph-mon[28077]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:18.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:18 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:18.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:18 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/323691208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T01:33:19.559 INFO:tasks.cephadm:Adding mon.smithi082 on smithi082 2024-09-17T01:33:19.560 INFO:tasks.cephadm:Adding mon.smithi167 on smithi167 2024-09-17T01:33:19.560 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167' 2024-09-17T01:33:19.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:19 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/323691208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T01:33:19.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:19 smithi082 ceph-mon[28077]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T01:33:19.876 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:19.923 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:20.494 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mon update... 2024-09-17T01:33:20.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:20 smithi082 ceph-mon[28077]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:21.088 DEBUG:teuthology.orchestra.run.smithi167:mon.smithi167> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi167.service 2024-09-17T01:33:21.091 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:21.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:21.361 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:21.410 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: Saving service mon spec with placement smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167;count:2 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:21 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:22.015 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:22.015 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:22.016 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:22.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:22 smithi082 ceph-mon[28077]: Deploying daemon alertmanager.smithi082 on smithi082 2024-09-17T01:33:22.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:22 smithi082 ceph-mon[28077]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:22.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:22 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2632335063' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:22.772 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:22 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:23.621 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:23.622 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:23.860 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:23.904 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:24.595 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:24.595 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:24.596 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:24.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:24 smithi082 ceph-mon[28077]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:25.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:25 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2523265198' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:26.260 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:26.260 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:26.503 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:26.547 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:26.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:26 smithi082 ceph-mon[28077]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:27.128 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:27.128 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:27.128 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:27.781 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:27 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/4219571356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:28.660 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:28 smithi082 ceph-mon[28077]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:28.698 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:28.699 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:28.940 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:28.984 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:29.649 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:29.649 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:29.649 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:30.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:33:30.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:33:30.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:30.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: Deploying daemon grafana.smithi082 on smithi082 2024-09-17T01:33:30.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:30.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:29 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/1528270694' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:31.172 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:31.173 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:31.418 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:31.461 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:32.418 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:32.418 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:32.418 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:32.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:32 smithi082 ceph-mon[28077]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:32.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:32 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:32.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:32 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3319573209' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:33.930 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:33.930 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:34.177 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:34.221 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:34.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:34 smithi082 ceph-mon[28077]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:35.014 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:35.015 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:35.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3444193973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:36.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:36 smithi082 ceph-mon[28077]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:36.591 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:36.591 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:36.829 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:36.872 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:37.473 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:37.473 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:37.473 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:38.701 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:38 smithi082 ceph-mon[28077]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:38.701 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:38 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2370788705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:39.053 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:39.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:39.299 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:39.343 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:39.988 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:39.988 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: Deploying daemon prometheus.smithi082 on smithi082 2024-09-17T01:33:40.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:39 smithi082 ceph-mon[28077]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:40 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/622233176' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:41.542 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:41.543 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:41.787 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:41.831 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:42.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:41 smithi082 ceph-mon[28077]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:42.459 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:42.459 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:42.459 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:43.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:43 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:43 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2934480735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:44.023 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:44.023 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:44.268 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:44.312 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:44.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:44 smithi082 ceph-mon[28077]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:45.060 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:45.061 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:45.061 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:45.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:45 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2356365775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:46.663 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:46.663 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:46.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:46 smithi082 ceph-mon[28077]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:46.898 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:46.942 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:47.596 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:47.597 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:48.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:48 smithi082 ceph-mon[28077]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:48.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:48 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/80110510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:49.179 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:49.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:49.420 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:49.465 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:50.171 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:50.171 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:50.171 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:50.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:50 smithi082 ceph-mon[28077]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:50.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:50 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3645219255' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:51.785 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:51.785 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:52.030 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:52.074 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:52.690 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:52.690 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:52.691 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:52.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:33:52.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T01:33:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:52 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:53.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:53 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/4088049907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:53.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:53 smithi082 ceph-mon[28077]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T01:33:53.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:53 smithi082 ceph-mon[28077]: mgrmap e14: smithi082.oppacm(active, since 55s) 2024-09-17T01:33:54.397 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:54.397 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:54.641 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:54.685 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:55.327 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:55.327 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:55.327 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:55.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:55 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/626403324' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:56.899 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:56.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:57.145 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:57.189 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:33:57.772 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:33:57.773 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: Active manager daemon smithi082.oppacm restarted 2024-09-17T01:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: Activating manager daemon smithi082.oppacm 2024-09-17T01:33:57.961 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: mgrmap e15: smithi082.oppacm(active, starting, since 0.00325215s) 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:33:57.962 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:33:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:33:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:58 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3091761434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:33:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:33:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:58 smithi082 ceph-mon[28077]: mgrmap e16: smithi082.oppacm(active, since 1.00768s) 2024-09-17T01:33:59.391 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:33:59.391 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:33:59.633 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:33:59.684 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: [17/Sep/2024:01:33:58] ENGINE Bus STARTING 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: [17/Sep/2024:01:33:58] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: [17/Sep/2024:01:33:58] ENGINE Error in HTTPServer.serve 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Traceback (most recent call last): 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:34:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._run(expiration_interval) 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s = self.context.wrap_socket( 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: return self.sslsocket_class._create( 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:34:00.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self.do_handshake() 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._sslobj.do_handshake() 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: [17/Sep/2024:01:33:58] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: [17/Sep/2024:01:33:58] ENGINE Bus STARTED 2024-09-17T01:34:00.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:33:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:00.337 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:00.337 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:00.338 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:00 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2590709677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:00 smithi082 ceph-mon[28077]: mgrmap e17: smithi082.oppacm(active, since 2s) 2024-09-17T01:34:02.391 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:02.392 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:03.182 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:34:03.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:34:03.230 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-17T01:34:03.974 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:03.974 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:03.975 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:04.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/834251654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:04.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:34:04.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:05.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:05 smithi082 ceph-mon[28077]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:34:05.549 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:05.549 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:05.795 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:06.632 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:06.633 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:06.633 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:06 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2894076905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:08.234 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:08.235 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:09.110 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:08 smithi082 ceph-mon[28077]: Deploying daemon crash.smithi167 on smithi167 2024-09-17T01:34:09.940 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:09.940 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:09.940 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:10.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/701719670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:11 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:11 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:11 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:11 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:11 smithi082 ceph-mon[28077]: Deploying daemon node-exporter.smithi167 on smithi167 2024-09-17T01:34:11.836 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:11.837 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:12.081 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:12.887 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:12.887 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:12.887 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:13 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/143405913' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:15.340 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:15.340 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:16.053 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T01:34:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:34:16.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:16.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:15 smithi082 ceph-mon[28077]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:34:16.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:16.952 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:16.952 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:17.033 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:17 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3962827494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: Deploying daemon mon.smithi167 on smithi167 2024-09-17T01:34:18.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:18.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:19.021 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:19.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:20.110 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:34:21.051 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:21.051 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:31:52.621485Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T01:34:21.051 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-17T01:34:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:20 smithi082 ceph-mon[28077]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:21.938 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 podman[35608]: 2024-09-17 01:34:21.919120465 +0000 UTC m=+0.986829504 container start 3fc15257bb15069770eb1e9b7635092a85813a82fdd8c41f66ed7f8fa5306566 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-17T01:34:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:21 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/462347286' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable), process ceph-mon, pid 2 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pidfile_write: ignore empty --pid-file 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: load: jerasure load: lrc 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:34:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Git sha 0 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Compile date 2024-09-16 15:09:42 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: DB SUMMARY 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: DB Session ID: 08A7NM2TOOW96D46L2BX 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi167/store.db dir, Total Num: 0, files: 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi167/store.db: 000004.log size: 511 ; 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:34:22.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.env: 0x55cc12dcb940 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.info_log: 0x55cc13ed58c0 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.statistics: (nil) 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.use_fsync: 0 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:34:22.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.db_log_dir: 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.wal_dir: 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:34:22.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.write_buffer_manager: 0x55cc13ee4dc0 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:34:22.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.unordered_write: 0 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.row_cache: None 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.wal_filter: None 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:34:22.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.wal_compression: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:34:22.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:34:22.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:34:22.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:34:22.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_open_files: -1 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Compression algorithms supported: 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kZSTD supported: 0 2024-09-17T01:34:22.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi167/store.db/MANIFEST-000005 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.merge_operator: 2024-09-17T01:34:22.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_filter: None 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cc13ed5520) 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_type: 0 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: data_block_index_type: 0 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_shortening: 1 2024-09-17T01:34:22.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: checksum: 4 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: no_block_cache: 0 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache: 0x55cc13ec91f0 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_options: 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: capacity : 536870912 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: num_shard_bits : 4 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: strict_capacity_limit : 0 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_compressed: (nil) 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: persistent_cache: (nil) 2024-09-17T01:34:22.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_size: 4096 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_size_deviation: 10 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_restart_interval: 16 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_block_restart_interval: 1 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: metadata_block_size: 4096 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: partition_filters: 0 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: use_delta_encoding: 1 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: filter_policy: bloomfilter 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: whole_key_filtering: 1 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: verify_compression: 0 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: format_version: 5 2024-09-17T01:34:22.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: enable_index_compression: 1 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_align: 0 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: max_auto_readahead_size: 262144 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: prepopulate_block_cache: 0 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression: NoCompression 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.num_levels: 7 2024-09-17T01:34:22.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:34:22.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:34:22.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:34:22.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:34:22.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:34:22.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.ttl: 2592000 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:34:22.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi167/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3318cc77-6367-425b-8da2-15138e2e6f56 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536861946205, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536861946627, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726536861, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3318cc77-6367-425b-8da2-15138e2e6f56", "db_session_id": "08A7NM2TOOW96D46L2BX", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726536861946733, "job": 1, "event": "recovery_finished"} 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi167/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:34:22.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cc13ef6e00 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: DB pointer 0x55cc13ff2000 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** DB Stats ** 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:34:22.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Block cache BinnedLRUCache@0x55cc13ec91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167 does not exist in monmap, will attempt to join an existing cluster 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: starting mon.smithi167 rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi167 fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(???) e0 preinit fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).mds e1 new map 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).mds e1 print_map 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: e1 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: btime 2024-09-17T01:31:55:651443+0000 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: legacy client fscid: -1 2024-09-17T01:34:22.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: No filesystems configured 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T01:34:22.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon crash.smithi082 on smithi082 2024-09-17T01:34:22.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Added host smithi167 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon node-exporter.smithi082 on smithi082 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/323691208' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/323691208' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T01:34:22.283 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Saving service mon spec with placement smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167;count:2 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon alertmanager.smithi082 on smithi082 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2632335063' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.284 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2523265198' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.285 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.285 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/4219571356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.285 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.285 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.285 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.289 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.289 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.289 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.289 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon grafana.smithi082 on smithi082 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/1528270694' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.290 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3319573209' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3444193973' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2370788705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.291 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon prometheus.smithi082 on smithi082 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/622233176' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2934480735' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2356365775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.292 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/80110510' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3645219255' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/4088049907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14162 172.21.15.82:0/3591249010' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mgrmap e14: smithi082.oppacm(active, since 55s) 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/626403324' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.293 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Active manager daemon smithi082.oppacm restarted 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Activating manager daemon smithi082.oppacm 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mgrmap e15: smithi082.oppacm(active, starting, since 0.00325215s) 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:22.294 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3091761434' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mgrmap e16: smithi082.oppacm(active, since 1.00768s) 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: [17/Sep/2024:01:33:58] ENGINE Bus STARTING 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: [17/Sep/2024:01:33:58] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: [17/Sep/2024:01:33:58] ENGINE Error in HTTPServer.serve 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Traceback (most recent call last): 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:34:22.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._run(expiration_interval) 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s = self.context.wrap_socket( 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: return self.sslsocket_class._create( 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self.do_handshake() 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._sslobj.do_handshake() 2024-09-17T01:34:22.296 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: [17/Sep/2024:01:33:58] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: [17/Sep/2024:01:33:58] ENGINE Bus STARTED 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2590709677' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mgrmap e17: smithi082.oppacm(active, since 2s) 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:34:22.297 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:22.298 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/834251654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2894076905' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.299 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon crash.smithi167 on smithi167 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/701719670' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.300 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon node-exporter.smithi167 on smithi167 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/143405913' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.301 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3962827494' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: Deploying daemon mon.smithi167 on smithi167 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/462347286' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 ceph-mon[35643]: mon.smithi167@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-17T01:34:22.302 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 bash[35608]: 3fc15257bb15069770eb1e9b7635092a85813a82fdd8c41f66ed7f8fa5306566 2024-09-17T01:34:22.303 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:21 smithi167 systemd[1]: Started Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:34:22.817 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-17T01:34:22.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T01:34:23.062 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:34:27.317 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:34:27.317 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","modified":"2024-09-17T01:34:21.979662Z","created":"2024-09-17T01:31:52.621485Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi082","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi167","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T01:34:27.318 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-09-17T01:34:27.318 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:34:27.318 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: mon.smithi082 calling monitor election 2024-09-17T01:34:27.318 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.318 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:34:27.318 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: mon.smithi167 calling monitor election 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: monmap epoch 2 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:34:27.319 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: min_mon_release 19 (squid) 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: election_strategy: 1 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: fsmap 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: mgrmap e17: smithi082.oppacm(active, since 29s) 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: overall HEALTH_OK 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:34:27.321 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.321 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.321 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:34:27.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: mon.smithi082 calling monitor election 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: mon.smithi167 calling monitor election 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:27.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: monmap epoch 2 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: min_mon_release 19 (squid) 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: election_strategy: 1 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: fsmap 2024-09-17T01:34:27.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: osdmap e5: 0 total, 0 up, 0 in 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: mgrmap e17: smithi082.oppacm(active, since 29s) 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: overall HEALTH_OK 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/1512981856' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:27.467 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:28.080 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T01:34:28.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T01:34:28.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: mgrmap e18: smithi082.oppacm(active, since 29s), standbys: smithi167.ysmbcy 2024-09-17T01:34:28.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:34:28.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:34:28.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3591358130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:28.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:28.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:28.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:28.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:28.331 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:28.396 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: mgrmap e18: smithi082.oppacm(active, since 29s), standbys: smithi167.ysmbcy 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3591358130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:28.397 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:34:28.917 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:28.917 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-09-17T01:34:28.917 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:34:28.917 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-17T01:34:29.337 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:29 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3869010686' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:29.438 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:29 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3869010686' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:29.484 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T01:34:29.485 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:34:29.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:34:29.512 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:34:29.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:29.577 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:34:29.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T01:34:29.606 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:34:29.606 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:34:29.672 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-17T01:34:29.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-17T01:34:29.678 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-17T01:34:29.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-17T01:34:29.721 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-17T01:34:29.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-17T01:34:29.765 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-17T01:34:29.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-17T01:34:29.808 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-17T01:34:29.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-17T01:34:29.852 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-17T01:34:29.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-17T01:34:29.896 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-17T01:34:29.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-17T01:34:29.939 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-17T01:34:29.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-17T01:34:29.993 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-17T01:34:29.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-17T01:34:30.045 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-17T01:34:30.045 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-17T01:34:30.095 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-17T01:34:30.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-17T01:34:30.149 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-17T01:34:30.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-17T01:34:30.150 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:30.188 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:30.191 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-17T01:34:30.191 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-17T01:34:30.236 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T01:34:30.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-17T01:34:30.284 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T01:34:30.285 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-17T01:34:30.337 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-17T01:34:30.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr client_mount_timeout 30 2024-09-17T01:34:30.383 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-17T01:34:30.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr debug_client 20 2024-09-17T01:34:30.432 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-17T01:34:30.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr debug_mgr 20 2024-09-17T01:34:30.482 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-17T01:34:30.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr debug_ms 1 2024-09-17T01:34:30.550 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T01:34:30.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T01:34:30.612 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-17T01:34:30.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-17T01:34:30.664 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-17T01:34:30.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-17T01:34:30.710 DEBUG:tasks.cephadm:set 22 configs 2024-09-17T01:34:30.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi082') 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:34:30.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:30.934 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3167753498' entity='client.admin' 2024-09-17T01:34:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:31 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1961804828' entity='client.admin' 2024-09-17T01:34:32.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3167753498' entity='client.admin' 2024-09-17T01:34:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:31 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1961804828' entity='client.admin' 2024-09-17T01:34:32.073 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi082') 2024-09-17T01:34:32.592 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:32.609 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi082') 2024-09-17T01:34:33.102 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:33.116 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:33.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:32 smithi082 ceph-mon[28077]: Reconfiguring mon.smithi082 (unknown last config time)... 2024-09-17T01:34:33.124 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:32 smithi082 ceph-mon[28077]: Reconfiguring daemon mon.smithi082 on smithi082 2024-09-17T01:34:33.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:32 smithi082 ceph-mon[28077]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:32 smithi167 ceph-mon[35643]: Reconfiguring mon.smithi082 (unknown last config time)... 2024-09-17T01:34:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:32 smithi167 ceph-mon[35643]: Reconfiguring daemon mon.smithi082 on smithi082 2024-09-17T01:34:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:32 smithi167 ceph-mon[35643]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:33.447 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:34.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:34 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1021723065' entity='client.admin' 2024-09-17T01:34:34.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:34 smithi082 ceph-mon[28077]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:34 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1021723065' entity='client.admin' 2024-09-17T01:34:35.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:34 smithi167 ceph-mon[35643]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f38bc06e280 msgr2=0x7f38bc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 --2- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f38bc06e280 0x7f38bc070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38c402f9b0 tx=0x7f38c402f4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d4101a60 msgr2=0x7f38d4197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 --2- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d4101a60 0x7f38d4197990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f38c800c8f0 tx=0x7f38c800cdb0 comp rx=0 tx=0).stop 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 shutdown_connections 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 --2- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38d4101a60 0x7f38d4197990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 --2- 172.21.15.82:0/1958872930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f38bc06e280 0x7f38bc070740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 --2- 172.21.15.82:0/1958872930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d4100860 0x7f38d4197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 >> 172.21.15.82:0/1958872930 conn(0x7f38d40fc010 msgr2=0x7f38d4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 shutdown_connections 2024-09-17T01:34:35.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:35.927+0000 7f38d8bd2640 1 -- 172.21.15.82:0/1958872930 wait complete. 2024-09-17T01:34:36.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/335532113' entity='client.admin' 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: Reconfiguring mgr.smithi082.oppacm (unknown last config time)... 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: Reconfiguring daemon mgr.smithi082.oppacm on smithi082 2024-09-17T01:34:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3322369200' entity='client.admin' 2024-09-17T01:34:36.105 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/335532113' entity='client.admin' 2024-09-17T01:34:36.105 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:36.105 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:36.105 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: Reconfiguring mgr.smithi082.oppacm (unknown last config time)... 2024-09-17T01:34:36.106 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:34:36.106 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:34:36.106 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:36.106 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: Reconfiguring daemon mgr.smithi082.oppacm on smithi082 2024-09-17T01:34:36.106 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3322369200' entity='client.admin' 2024-09-17T01:34:37.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:36 smithi082 ceph-mon[28077]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:37.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:36 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1958872930' entity='client.admin' 2024-09-17T01:34:37.227 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:36 smithi167 ceph-mon[35643]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:37.227 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:36 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1958872930' entity='client.admin' 2024-09-17T01:34:37.229 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.230 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.230 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.231 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.243 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: Reconfiguring ceph-exporter.smithi082 (monmap changed)... 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: Reconfiguring daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:34:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:38 smithi082 ceph-mon[28077]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:38.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: Reconfiguring ceph-exporter.smithi082 (monmap changed)... 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: Reconfiguring daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:34:38.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:38 smithi167 ceph-mon[35643]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:39.226 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:39.261 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-09-17T01:34:39.261 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-09-17T01:34:39.261 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi082') 2024-09-17T01:34:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 -- 172.21.15.82:0/3282769082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100260 msgr2=0x7fab20100660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 --2- 172.21.15.82:0/3282769082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100260 0x7fab20100660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fab10009880 tx=0x7fab1002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 -- 172.21.15.82:0/3282769082 shutdown_connections 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 --2- 172.21.15.82:0/3282769082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100ba0 0x7fab20101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 --2- 172.21.15.82:0/3282769082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100260 0x7fab20100660 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.327+0000 7fab24ec3640 1 -- 172.21.15.82:0/3282769082 >> 172.21.15.82:0/3282769082 conn(0x7fab200fc030 msgr2=0x7fab200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.328+0000 7fab24ec3640 1 -- 172.21.15.82:0/3282769082 shutdown_connections 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.328+0000 7fab24ec3640 1 -- 172.21.15.82:0/3282769082 wait complete. 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 Processor -- start 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 -- start start 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 0x7fab20199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab2010c990 con 0x7fab20100ba0 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab24ec3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab2010c810 con 0x7fab20100260 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab1dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 0x7fab20199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.329+0000 7fab1e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.330+0000 7fab1e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:37350/0 (socket says 172.21.15.82:37350) 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.330+0000 7fab1e59c640 1 -- 172.21.15.82:0/1325179761 learned_addr learned my addr 172.21.15.82:0/1325179761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.330+0000 7fab1e59c640 1 -- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 msgr2=0x7fab20199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab1e59c640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 0x7fab20199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab1e59c640 1 -- 172.21.15.82:0/1325179761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2019a2c0 con 0x7fab20100260 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab1dd9b640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 0x7fab20199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab1e59c640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fab10009230 tx=0x7fab100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab1003f070 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab10004b80 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.336+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab10035030 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.337+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2019ec50 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.337+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2019f190 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.338+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab20100660 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.338+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fab10042070 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.339+0000 7fab0f7fe640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 0x7fab08070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.339+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fab100adb20 con 0x7fab20100260 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.339+0000 7fab1dd9b640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 0x7fab08070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.339+0000 7fab1dd9b640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 0x7fab08070740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab14005d00 tx=0x7fab14005ed0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.344+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab1007c5e0 con 0x7fab20100260 2024-09-17T01:34:40.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 -- 172.21.15.82:0/3113763516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950102450 msgr2=0x7f5950104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 --2- 172.21.15.82:0/3113763516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950102450 0x7f5950104840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f594c009880 tx=0x7f594c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 -- 172.21.15.82:0/3113763516 shutdown_connections 2024-09-17T01:34:40.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 --2- 172.21.15.82:0/3113763516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950104d80 0x7f5950107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 --2- 172.21.15.82:0/3113763516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950102450 0x7f5950104840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 -- 172.21.15.82:0/3113763516 >> 172.21.15.82:0/3113763516 conn(0x7f59500fc010 msgr2=0x7f59500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:40.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 -- 172.21.15.82:0/3113763516 shutdown_connections 2024-09-17T01:34:40.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.253+0000 7f595726c640 1 -- 172.21.15.82:0/3113763516 wait complete. 2024-09-17T01:34:40.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 Processor -- start 2024-09-17T01:34:40.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 -- start start 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950102450 0x7f5950101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f595010a750 con 0x7f5950104d80 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f595726c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f595010a5d0 con 0x7f5950102450 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f5954807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.254+0000 7f5954807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58864/0 (socket says 172.21.15.82:58864) 2024-09-17T01:34:40.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5954807640 1 -- 172.21.15.82:0/1029726010 learned_addr learned my addr 172.21.15.82:0/1029726010 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5955008640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950102450 0x7f5950101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5954807640 1 -- 172.21.15.82:0/1029726010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950102450 msgr2=0x7f5950101d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5954807640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950102450 0x7f5950101d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5954807640 1 -- 172.21.15.82:0/1029726010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5950100940 con 0x7f5950104d80 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f5954807640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f594000c8f0 tx=0x7f594000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5940014070 con 0x7f5950104d80 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5940007c60 con 0x7f5950104d80 2024-09-17T01:34:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5950100c30 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5940003c30 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.255+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59501011c0 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.257+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5950102830 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.257+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5940017070 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.258+0000 7f59467fc640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 0x7f593c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.258+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f594008cd00 con 0x7f5950104d80 2024-09-17T01:34:40.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.258+0000 7f5955008640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 0x7f593c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.258+0000 7f5955008640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 0x7f593c070740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f594c000c00 tx=0x7f594c009620 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.262+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f594005b7c0 con 0x7f5950104d80 2024-09-17T01:34:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.448+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f595019f4b0 con 0x7f5950104d80 2024-09-17T01:34:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.452+0000 7f59467fc640 1 -- 172.21.15.82:0/1029726010 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f594005f470 con 0x7f5950104d80 2024-09-17T01:34:40.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 msgr2=0x7f593c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 0x7f593c070740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f594c000c00 tx=0x7f594c009620 comp rx=0 tx=0).stop 2024-09-17T01:34:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 msgr2=0x7f5950100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f594000c8f0 tx=0x7f594000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 shutdown_connections 2024-09-17T01:34:40.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5950104d80 0x7f5950100400 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f593c06e280 0x7f593c070740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 --2- 172.21.15.82:0/1029726010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5950102450 0x7f5950101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.454+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 >> 172.21.15.82:0/1029726010 conn(0x7f59500fc010 msgr2=0x7f59500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:40.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.455+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 shutdown_connections 2024-09-17T01:34:40.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.455+0000 7f595726c640 1 -- 172.21.15.82:0/1029726010 wait complete. 2024-09-17T01:34:40.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.522+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fab2019f3c0 con 0x7fab20100260 2024-09-17T01:34:40.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.530+0000 7fab0f7fe640 1 -- 172.21.15.82:0/1325179761 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7fab10080290 con 0x7fab20100260 2024-09-17T01:34:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 msgr2=0x7fab08070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 0x7fab08070740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab14005d00 tx=0x7fab14005ed0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 msgr2=0x7fab20199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fab10009230 tx=0x7fab100046c0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 shutdown_connections 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab20100ba0 0x7fab20199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fab0806e280 0x7fab08070740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 --2- 172.21.15.82:0/1325179761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab20100260 0x7fab20199700 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 >> 172.21.15.82:0/1325179761 conn(0x7fab200fc030 msgr2=0x7fab200fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 shutdown_connections 2024-09-17T01:34:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.532+0000 7fab24ec3640 1 -- 172.21.15.82:0/1325179761 wait complete. 2024-09-17T01:34:41.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:40 smithi167 ceph-mon[35643]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:41.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:40 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1029726010' entity='client.admin' 2024-09-17T01:34:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:40 smithi167 ceph-mon[35643]: from='client.? ' entity='client.admin' 2024-09-17T01:34:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:40 smithi082 ceph-mon[28077]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:40 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1029726010' entity='client.admin' 2024-09-17T01:34:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:40 smithi082 ceph-mon[28077]: from='client.? ' entity='client.admin' 2024-09-17T01:34:41.251 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi082') 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 -- 172.21.15.82:0/4238031939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 msgr2=0x7fb0c8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/4238031939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c8102fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009880 tx=0x7fb0bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 -- 172.21.15.82:0/4238031939 shutdown_connections 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/4238031939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c8102fe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/4238031939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 0x7fb0c8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 -- 172.21.15.82:0/4238031939 >> 172.21.15.82:0/4238031939 conn(0x7fb0c80fd0f0 msgr2=0x7fb0c80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 -- 172.21.15.82:0/4238031939 shutdown_connections 2024-09-17T01:34:41.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.415+0000 7fb0cddbd640 1 -- 172.21.15.82:0/4238031939 wait complete. 2024-09-17T01:34:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 Processor -- start 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 -- start start 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 0x7fb0c8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c810a780 con 0x7fb0c8102b60 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0cddbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c810a600 con 0x7fb0c8101960 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0c6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0c6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58912/0 (socket says 172.21.15.82:58912) 2024-09-17T01:34:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.416+0000 7fb0c6ffd640 1 -- 172.21.15.82:0/1446700772 learned_addr learned my addr 172.21.15.82:0/1446700772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c77fe640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 0x7fb0c8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c6ffd640 1 -- 172.21.15.82:0/1446700772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 msgr2=0x7fb0c8197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c6ffd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 0x7fb0c8197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c6ffd640 1 -- 172.21.15.82:0/1446700772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c8197fa0 con 0x7fb0c8102b60 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c6ffd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc03f070 con 0x7fb0c8102b60 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0bc0044d0 con 0x7fb0c8102b60 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c819c9b0 con 0x7fb0c8102b60 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0bc035030 con 0x7fb0c8102b60 2024-09-17T01:34:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.417+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c819ceb0 con 0x7fb0c8102b60 2024-09-17T01:34:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.418+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c8101d60 con 0x7fb0c8102b60 2024-09-17T01:34:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.419+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb0bc042070 con 0x7fb0c8102b60 2024-09-17T01:34:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.419+0000 7fb0c4ff9640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 0x7fb0b00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.419+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb0bc0adca0 con 0x7fb0c8102b60 2024-09-17T01:34:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.419+0000 7fb0c77fe640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 0x7fb0b00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:41.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.419+0000 7fb0c77fe640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 0x7fb0b00706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0c81029c0 tx=0x7fb0b8005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.423+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0bc080390 con 0x7fb0c8102b60 2024-09-17T01:34:41.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.592+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb0c802db70 con 0x7fb0c8102b60 2024-09-17T01:34:41.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.595+0000 7fb0c4ff9640 1 -- 172.21.15.82:0/1446700772 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fb0c802db70 con 0x7fb0c8102b60 2024-09-17T01:34:41.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.597+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 msgr2=0x7fb0b00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.597+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 0x7fb0b00706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0c81029c0 tx=0x7fb0b8005f90 comp rx=0 tx=0).stop 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.597+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 msgr2=0x7fb0c81979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.597+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 shutdown_connections 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0c8102b60 0x7fb0c81979b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb0b006e230 0x7fb0b00706f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 --2- 172.21.15.82:0/1446700772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0c8101960 0x7fb0c8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 >> 172.21.15.82:0/1446700772 conn(0x7fb0c80fd0f0 msgr2=0x7fb0c8106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 shutdown_connections 2024-09-17T01:34:41.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:41.598+0000 7fb0cddbd640 1 -- 172.21.15.82:0/1446700772 wait complete. 2024-09-17T01:34:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 -- 172.21.15.82:0/470037929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 msgr2=0x7f9858100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:42.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 --2- 172.21.15.82:0/470037929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858100020 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9854009880 tx=0x7f985402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 -- 172.21.15.82:0/470037929 shutdown_connections 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 --2- 172.21.15.82:0/470037929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 0x7f9858103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 --2- 172.21.15.82:0/470037929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858100020 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 -- 172.21.15.82:0/470037929 >> 172.21.15.82:0/470037929 conn(0x7f98580fb770 msgr2=0x7f98580fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 -- 172.21.15.82:0/470037929 shutdown_connections 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.152+0000 7f9860722640 1 -- 172.21.15.82:0/470037929 wait complete. 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 Processor -- start 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 -- start start 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 0x7f9858197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f985810a7b0 con 0x7f98580ffc20 2024-09-17T01:34:42.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f9860722640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f985810a630 con 0x7f9858102c00 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58848/0 (socket says 172.21.15.82:58848) 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 -- 172.21.15.82:0/541808460 learned_addr learned my addr 172.21.15.82:0/541808460 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985dcbd640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 0x7f9858197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 -- 172.21.15.82:0/541808460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 msgr2=0x7f9858197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 0x7f9858197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.153+0000 7f985e4be640 1 -- 172.21.15.82:0/541808460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9858198140 con 0x7f98580ffc20 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f985e4be640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9854009230 tx=0x7f98540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f985403f070 con 0x7f98580ffc20 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98540044d0 con 0x7f98580ffc20 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985819cab0 con 0x7f98580ffc20 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9854035030 con 0x7f98580ffc20 2024-09-17T01:34:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.154+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985819d040 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.155+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9858100020 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.155+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f9854042070 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.156+0000 7f984f7fe640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 0x7f9844070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.156+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f98540adc60 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.156+0000 7f985dcbd640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 0x7f9844070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.156+0000 7f985dcbd640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 0x7f9844070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9848005fd0 tx=0x7f9848005e20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.160+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f985407c720 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.345+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f9858062df0 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.345+0000 7f984f7fe640 1 -- 172.21.15.82:0/541808460 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v16)=0 v16) ==== 108+0+0 (secure 0 0 0) 0x7f98540803d0 con 0x7f98580ffc20 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 msgr2=0x7f9844070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 0x7f9844070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9848005fd0 tx=0x7f9848005e20 comp rx=0 tx=0).stop 2024-09-17T01:34:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 msgr2=0x7f9858197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9854009230 tx=0x7f98540048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 shutdown_connections 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f984406e280 0x7f9844070740 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9858102c00 0x7f9858197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 --2- 172.21.15.82:0/541808460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98580ffc20 0x7f9858197580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 >> 172.21.15.82:0/541808460 conn(0x7f98580fb770 msgr2=0x7f9858106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 shutdown_connections 2024-09-17T01:34:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:40.348+0000 7f9860722640 1 -- 172.21.15.82:0/541808460 wait complete. 2024-09-17T01:34:42.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:42 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1446700772' entity='client.admin' 2024-09-17T01:34:42.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:42 smithi167 ceph-mon[35643]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:42.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:42 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1820234646' entity='client.admin' 2024-09-17T01:34:42.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:42 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1446700772' entity='client.admin' 2024-09-17T01:34:42.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:42 smithi082 ceph-mon[28077]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:42.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:42 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1820234646' entity='client.admin' 2024-09-17T01:34:43.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 -- 172.21.15.82:0/2270894255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98100860 msgr2=0x7fda98100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/2270894255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98100860 0x7fda98100c60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda90009880 tx=0x7fda9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 -- 172.21.15.82:0/2270894255 shutdown_connections 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/2270894255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda98101a60 0x7fda98101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/2270894255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98100860 0x7fda98100c60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 -- 172.21.15.82:0/2270894255 >> 172.21.15.82:0/2270894255 conn(0x7fda980fc010 msgr2=0x7fda980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 -- 172.21.15.82:0/2270894255 shutdown_connections 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.066+0000 7fda9fcf8640 1 -- 172.21.15.82:0/2270894255 wait complete. 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 Processor -- start 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 -- start start 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda98100860 0x7fda98197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda98109700 con 0x7fda98101a60 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9fcf8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda98109580 con 0x7fda98100860 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58952/0 (socket says 172.21.15.82:58952) 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 -- 172.21.15.82:0/3525417466 learned_addr learned my addr 172.21.15.82:0/3525417466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 -- 172.21.15.82:0/3525417466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda98100860 msgr2=0x7fda98197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda98100860 0x7fda98197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.067+0000 7fda9d293640 1 -- 172.21.15.82:0/3525417466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda98198130 con 0x7fda98101a60 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda9d293640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b420 tx=0x7fda8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda8c011630 con 0x7fda98101a60 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda8c016070 con 0x7fda98101a60 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9819cb70 con 0x7fda98101a60 2024-09-17T01:34:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda8c010d40 con 0x7fda98101a60 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.068+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9819d180 con 0x7fda98101a60 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.069+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda98100c60 con 0x7fda98101a60 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.069+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fda8c01b460 con 0x7fda98101a60 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.070+0000 7fda96ffd640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 0x7fda80070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.070+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fda8c08c880 con 0x7fda98101a60 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.070+0000 7fda9da94640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 0x7fda80070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.070+0000 7fda9da94640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 0x7fda80070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda900096c0 tx=0x7fda90000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.074+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda8c05b340 con 0x7fda98101a60 2024-09-17T01:34:43.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.243+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fda9819d470 con 0x7fda98101a60 2024-09-17T01:34:43.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.243+0000 7fda96ffd640 1 -- 172.21.15.82:0/3525417466 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7fda8c05eff0 con 0x7fda98101a60 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 msgr2=0x7fda80070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 0x7fda80070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fda900096c0 tx=0x7fda90000bc0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 msgr2=0x7fda98197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00b420 tx=0x7fda8c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 shutdown_connections 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda98101a60 0x7fda98197ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fda8006e280 0x7fda80070740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 --2- 172.21.15.82:0/3525417466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda98100860 0x7fda98197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 >> 172.21.15.82:0/3525417466 conn(0x7fda980fc010 msgr2=0x7fda9806a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 shutdown_connections 2024-09-17T01:34:43.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.245+0000 7fda9fcf8640 1 -- 172.21.15.82:0/3525417466 wait complete. 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 -- 172.21.15.82:0/3482221664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 msgr2=0x7f2878107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 --2- 172.21.15.82:0/3482221664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878107110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f286c0098b0 tx=0x7f286c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 -- 172.21.15.82:0/3482221664 shutdown_connections 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 --2- 172.21.15.82:0/3482221664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878107110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 --2- 172.21.15.82:0/3482221664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 0x7f28781047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 -- 172.21.15.82:0/3482221664 >> 172.21.15.82:0/3482221664 conn(0x7f28780fc010 msgr2=0x7f28780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 -- 172.21.15.82:0/3482221664 shutdown_connections 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.188+0000 7f287e8ac640 1 -- 172.21.15.82:0/3482221664 wait complete. 2024-09-17T01:34:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 Processor -- start 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 -- start start 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 0x7f2878197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f287810a7b0 con 0x7f2878104d20 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.189+0000 7f287e8ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f287810a630 con 0x7f28781023f0 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58934/0 (socket says 172.21.15.82:58934) 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 -- 172.21.15.82:0/1820234646 learned_addr learned my addr 172.21.15.82:0/1820234646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f2877fff640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 0x7f2878197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 -- 172.21.15.82:0/1820234646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 msgr2=0x7f2878197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 0x7f2878197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 -- 172.21.15.82:0/1820234646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28781981c0 con 0x7f2878104d20 2024-09-17T01:34:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28777fe640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f286c009230 tx=0x7f286c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f286c03f070 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287819cba0 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f286c0044d0 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f286c035030 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.190+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287819d130 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.191+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28781027d0 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.192+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f286c042070 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.192+0000 7f28757fa640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 0x7f28600706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.192+0000 7f2877fff640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 0x7f28600706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.192+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f286c0adc70 con 0x7f2878104d20 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.193+0000 7f2877fff640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 0x7f28600706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868005e20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.197+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f286c07c650 con 0x7f2878104d20 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.367+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f287819d360 con 0x7f2878104d20 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.370+0000 7f28757fa640 1 -- 172.21.15.82:0/1820234646 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f286c080300 con 0x7f2878104d20 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 msgr2=0x7f28600706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 0x7f28600706f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868005e20 comp rx=0 tx=0).stop 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 msgr2=0x7f2878197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f286c009230 tx=0x7f286c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 shutdown_connections 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2878104d20 0x7f2878197b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f286006e230 0x7f28600706f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 --2- 172.21.15.82:0/1820234646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28781023f0 0x7f2878197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 >> 172.21.15.82:0/1820234646 conn(0x7f28780fc010 msgr2=0x7f28780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 shutdown_connections 2024-09-17T01:34:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:42.373+0000 7f287e8ac640 1 -- 172.21.15.82:0/1820234646 wait complete. 2024-09-17T01:34:43.815 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 -- 172.21.15.82:0/3979400340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0104d20 msgr2=0x7f60b0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3979400340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0104d20 0x7f60b0107110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f60a00098b0 tx=0x7f60a002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 -- 172.21.15.82:0/3979400340 shutdown_connections 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3979400340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b0104d20 0x7f60b0107110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3979400340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b01023f0 0x7f60b01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 -- 172.21.15.82:0/3979400340 >> 172.21.15.82:0/3979400340 conn(0x7f60b00fbff0 msgr2=0x7f60b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 -- 172.21.15.82:0/3979400340 shutdown_connections 2024-09-17T01:34:43.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.904+0000 7f60b7db9640 1 -- 172.21.15.82:0/3979400340 wait complete. 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.905+0000 7f60b7db9640 1 Processor -- start 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.905+0000 7f60b7db9640 1 -- start start 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b7db9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b7db9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b0104d20 0x7f60b0197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b7db9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60b010a7b0 con 0x7f60b01023f0 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b7db9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60b010a630 con 0x7f60b0104d20 2024-09-17T01:34:43.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58970/0 (socket says 172.21.15.82:58970) 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 -- 172.21.15.82:0/3682171979 learned_addr learned my addr 172.21.15.82:0/3682171979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5354640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b0104d20 0x7f60b0197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 -- 172.21.15.82:0/3682171979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b0104d20 msgr2=0x7f60b0197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b0104d20 0x7f60b0197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 -- 172.21.15.82:0/3682171979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b0198100 con 0x7f60b01023f0 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.906+0000 7f60b5b55640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00d6f0 tx=0x7f60ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.907+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ac017070 con 0x7f60b01023f0 2024-09-17T01:34:43.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.907+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60ac00de00 con 0x7f60b01023f0 2024-09-17T01:34:43.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.907+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60ac004bb0 con 0x7f60b01023f0 2024-09-17T01:34:43.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.907+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b019cb40 con 0x7f60b01023f0 2024-09-17T01:34:43.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.907+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b019d0a0 con 0x7f60b01023f0 2024-09-17T01:34:43.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.908+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b010af90 con 0x7f60b01023f0 2024-09-17T01:34:43.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.909+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f60ac009a30 con 0x7f60b01023f0 2024-09-17T01:34:43.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.910+0000 7f60a6ffd640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 0x7f609c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:43.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.910+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f60ac08caf0 con 0x7f60b01023f0 2024-09-17T01:34:43.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.910+0000 7f60b5354640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 0x7f609c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:43.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.910+0000 7f60b5354640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 0x7f609c070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60a0005ab0 tx=0x7f60a0005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:43.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:43.918+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60ac05f260 con 0x7f60b01023f0 2024-09-17T01:34:44.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.090+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f60b01027d0 con 0x7f60b01023f0 2024-09-17T01:34:44.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.097+0000 7f60a6ffd640 1 -- 172.21.15.82:0/3682171979 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f60ac063a90 con 0x7f60b01023f0 2024-09-17T01:34:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 msgr2=0x7f609c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 0x7f609c070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f60a0005ab0 tx=0x7f60a0005a20 comp rx=0 tx=0).stop 2024-09-17T01:34:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 msgr2=0x7f60b0197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00d6f0 tx=0x7f60ac00dbb0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 shutdown_connections 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f609c06e280 0x7f609c070740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60b0104d20 0x7f60b0197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 --2- 172.21.15.82:0/3682171979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60b01023f0 0x7f60b0197540 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 >> 172.21.15.82:0/3682171979 conn(0x7f60b00fbff0 msgr2=0x7f60b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 shutdown_connections 2024-09-17T01:34:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.099+0000 7f60b7db9640 1 -- 172.21.15.82:0/3682171979 wait complete. 2024-09-17T01:34:44.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 -- 172.21.15.82:0/370469515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 msgr2=0x7f9dc0100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/370469515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0100020 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009880 tx=0x7f9dbc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 -- 172.21.15.82:0/370469515 shutdown_connections 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/370469515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/370469515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0100020 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 -- 172.21.15.82:0/370469515 >> 172.21.15.82:0/370469515 conn(0x7f9dc00fb770 msgr2=0x7f9dc00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 -- 172.21.15.82:0/370469515 shutdown_connections 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.538+0000 7f9dc6f46640 1 -- 172.21.15.82:0/370469515 wait complete. 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 Processor -- start 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 -- start start 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc010a800 con 0x7f9dc00ffc20 2024-09-17T01:34:44.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc6f46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc010a680 con 0x7f9dc0102c00 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58982/0 (socket says 172.21.15.82:58982) 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 -- 172.21.15.82:0/270587462 learned_addr learned my addr 172.21.15.82:0/270587462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 -- 172.21.15.82:0/270587462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 msgr2=0x7f9dc0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9db7fff640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9dc4ce2640 1 -- 172.21.15.82:0/270587462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc01980f0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.539+0000 7f9db7fff640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:34:44.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.540+0000 7f9dc4ce2640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc006010 tx=0x7f9dbc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.540+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc03f070 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.540+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc019cad0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.540+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dbc0044d0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.540+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc035030 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.541+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc019d060 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.542+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0100020 con 0x7f9dc00ffc20 2024-09-17T01:34:44.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.542+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f9dbc042070 con 0x7f9dc00ffc20 2024-09-17T01:34:44.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.542+0000 7f9db5ffb640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 0x7f9da8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:44.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.543+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9dbc0adc30 con 0x7f9dc00ffc20 2024-09-17T01:34:44.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.543+0000 7f9db7fff640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 0x7f9da8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:44.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.543+0000 7f9db7fff640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 0x7f9da8070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:44.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.547+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9dbc07c6f0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:44 smithi082 ceph-mon[28077]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:44.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:44 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3682171979' entity='client.admin' 2024-09-17T01:34:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.719+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f9dc019d2c0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.725+0000 7f9db5ffb640 1 -- 172.21.15.82:0/270587462 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7f9dbc0803a0 con 0x7f9dc00ffc20 2024-09-17T01:34:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 msgr2=0x7f9da8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 0x7f9da8070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9db0008040 comp rx=0 tx=0).stop 2024-09-17T01:34:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 msgr2=0x7f9dc0197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc006010 tx=0x7f9dbc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 shutdown_connections 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9da806e280 0x7f9da8070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc0102c00 0x7f9dc0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 --2- 172.21.15.82:0/270587462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc00ffc20 0x7f9dc0197530 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 >> 172.21.15.82:0/270587462 conn(0x7f9dc00fb770 msgr2=0x7f9dc00fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 shutdown_connections 2024-09-17T01:34:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:44.727+0000 7f9dc6f46640 1 -- 172.21.15.82:0/270587462 wait complete. 2024-09-17T01:34:45.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:44 smithi167 ceph-mon[35643]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:45.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:44 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3682171979' entity='client.admin' 2024-09-17T01:34:45.906 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:45 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/270587462' entity='client.admin' 2024-09-17T01:34:46.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:45 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/270587462' entity='client.admin' 2024-09-17T01:34:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 -- 172.21.15.82:0/1419315742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 msgr2=0x7f4198100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 --2- 172.21.15.82:0/1419315742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f4198100c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4188009880 tx=0x7f418802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 -- 172.21.15.82:0/1419315742 shutdown_connections 2024-09-17T01:34:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 --2- 172.21.15.82:0/1419315742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f4198101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 --2- 172.21.15.82:0/1419315742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f4198100c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 -- 172.21.15.82:0/1419315742 >> 172.21.15.82:0/1419315742 conn(0x7f41980fc010 msgr2=0x7f41980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 -- 172.21.15.82:0/1419315742 shutdown_connections 2024-09-17T01:34:46.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.402+0000 7f419ca9d640 1 -- 172.21.15.82:0/1419315742 wait complete. 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 Processor -- start 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 -- start start 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41981096a0 con 0x7f4198101a60 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419ca9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4198109520 con 0x7f4198100860 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f418ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f418ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59008/0 (socket says 172.21.15.82:59008) 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f418ffff640 1 -- 172.21.15.82:0/906671453 learned_addr learned my addr 172.21.15.82:0/906671453 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:46.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.403+0000 7f419659c640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418ffff640 1 -- 172.21.15.82:0/906671453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 msgr2=0x7f4198197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418ffff640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418ffff640 1 -- 172.21.15.82:0/906671453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41981980e0 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418ffff640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f418000d6f0 tx=0x7f418000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4180017070 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f418000de00 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4180004bb0 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419819cb20 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.404+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419819d0b0 con 0x7f4198101a60 2024-09-17T01:34:46.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.405+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4198100c60 con 0x7f4198101a60 2024-09-17T01:34:46.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.406+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f4180009a30 con 0x7f4198101a60 2024-09-17T01:34:46.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.406+0000 7f418f7fe640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 0x7f4184070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.406+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f418008cb90 con 0x7f4198101a60 2024-09-17T01:34:46.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.406+0000 7f419659c640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 0x7f4184070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.407+0000 7f419659c640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 0x7f4184070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4188009230 tx=0x7f41880058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.414+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f418005f260 con 0x7f4198101a60 2024-09-17T01:34:46.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.593+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f419819d340 con 0x7f4198101a60 2024-09-17T01:34:46.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.597+0000 7f418f7fe640 1 -- 172.21.15.82:0/906671453 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f4180063a90 con 0x7f4198101a60 2024-09-17T01:34:46.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.600+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 msgr2=0x7f4184070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.600+0000 7f419ca9d640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 0x7f4184070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4188009230 tx=0x7f41880058d0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.600+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 msgr2=0x7f4198197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.600+0000 7f419ca9d640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f418000d6f0 tx=0x7f418000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 shutdown_connections 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198197a60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f418406e280 0x7f4184070740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 --2- 172.21.15.82:0/906671453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 >> 172.21.15.82:0/906671453 conn(0x7f41980fc010 msgr2=0x7f4198069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 shutdown_connections 2024-09-17T01:34:46.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.601+0000 7f419ca9d640 1 -- 172.21.15.82:0/906671453 wait complete. 2024-09-17T01:34:46.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 -- 172.21.15.82:0/3493860300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c102490 msgr2=0x7fdb0c104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 --2- 172.21.15.82:0/3493860300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c102490 0x7fdb0c104880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009880 tx=0x7fdb0802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 -- 172.21.15.82:0/3493860300 shutdown_connections 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 --2- 172.21.15.82:0/3493860300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 --2- 172.21.15.82:0/3493860300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c102490 0x7fdb0c104880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.657+0000 7fdb1381b640 1 -- 172.21.15.82:0/3493860300 >> 172.21.15.82:0/3493860300 conn(0x7fdb0c0fc010 msgr2=0x7fdb0c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.658+0000 7fdb1381b640 1 -- 172.21.15.82:0/3493860300 shutdown_connections 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.658+0000 7fdb1381b640 1 -- 172.21.15.82:0/3493860300 wait complete. 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.658+0000 7fdb1381b640 1 Processor -- start 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.658+0000 7fdb1381b640 1 -- start start 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb1381b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c102490 0x7fdb0c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb1381b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb1381b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c10a7d0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb1381b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c10a650 con 0x7fdb0c102490 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59042/0 (socket says 172.21.15.82:59042) 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 -- 172.21.15.82:0/1424885817 learned_addr learned my addr 172.21.15.82:0/1424885817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb115b7640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c102490 0x7fdb0c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 -- 172.21.15.82:0/1424885817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c102490 msgr2=0x7fdb0c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c102490 0x7fdb0c197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 -- 172.21.15.82:0/1424885817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c1980e0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb10db6640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e970 tx=0x7fdafc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdafc00cac0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.659+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c19cb20 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.660+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdafc0054e0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.660+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdafc010430 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.660+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c19d0b0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.661+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c102870 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.662+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fdafc004ec0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.662+0000 7fdb027fc640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 0x7fdaf8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.662+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdafc08d740 con 0x7fdb0c104dc0 2024-09-17T01:34:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.662+0000 7fdb115b7640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 0x7fdaf8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.663+0000 7fdb115b7640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 0x7fdaf8070700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb08000c00 tx=0x7fdb08009620 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.671+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdafc05c180 con 0x7fdb0c104dc0 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 -- 172.21.15.82:0/2819903158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 msgr2=0x7f9664074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 --2- 172.21.15.82:0/2819903158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664074fa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9654009880 tx=0x7f965402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 -- 172.21.15.82:0/2819903158 shutdown_connections 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 --2- 172.21.15.82:0/2819903158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664074fa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 --2- 172.21.15.82:0/2819903158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 -- 172.21.15.82:0/2819903158 >> 172.21.15.82:0/2819903158 conn(0x7f96640fd110 msgr2=0x7f96640ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 -- 172.21.15.82:0/2819903158 shutdown_connections 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.561+0000 7f966b3e5640 1 -- 172.21.15.82:0/2819903158 wait complete. 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.562+0000 7f966b3e5640 1 Processor -- start 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.562+0000 7f966b3e5640 1 -- start start 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.562+0000 7f966b3e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.562+0000 7f966b3e5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f966b3e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f966410c990 con 0x7f9664074b40 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f966b3e5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f966410c810 con 0x7f96640761a0 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59026/0 (socket says 172.21.15.82:59026) 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 -- 172.21.15.82:0/772409646 learned_addr learned my addr 172.21.15.82:0/772409646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9668980640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 -- 172.21.15.82:0/772409646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 msgr2=0x7f9664199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 -- 172.21.15.82:0/772409646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966419a250 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9668980640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f9669181640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f966000c8f0 tx=0x7f966000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96600079b0 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966419ec90 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.563+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96600054e0 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.564+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966419f170 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.564+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9660004dd0 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.565+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96480052c0 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.565+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f966000f500 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.566+0000 7f965a7fc640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 0x7f9650070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.566+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f966008d060 con 0x7f9664074b40 2024-09-17T01:34:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.566+0000 7f9668980640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 0x7f9650070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.566+0000 7f9668980640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 0x7f9650070680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f966419ab40 tx=0x7f9654005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.570+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9660014030 con 0x7f9664074b40 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.771+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f96480055b0 con 0x7f9664074b40 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.775+0000 7f965a7fc640 1 -- 172.21.15.82:0/772409646 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f966005baa0 con 0x7f9664074b40 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 msgr2=0x7f9650070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 0x7f9650070680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f966419ab40 tx=0x7f9654005a20 comp rx=0 tx=0).stop 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 msgr2=0x7f9664199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f966000c8f0 tx=0x7f966000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 shutdown_connections 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f965006e1c0 0x7f9650070680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96640761a0 0x7f9664199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 --2- 172.21.15.82:0/772409646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9664074b40 0x7f9664199690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 >> 172.21.15.82:0/772409646 conn(0x7f96640fd110 msgr2=0x7f9664107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 shutdown_connections 2024-09-17T01:34:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.778+0000 7f966b3e5640 1 -- 172.21.15.82:0/772409646 wait complete. 2024-09-17T01:34:46.849 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:46 smithi082 ceph-mon[28077]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:46.849 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:46 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/906671453' entity='client.admin' 2024-09-17T01:34:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.852+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fdb0c19d2e0 con 0x7fdb0c104dc0 2024-09-17T01:34:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.855+0000 7fdb027fc640 1 -- 172.21.15.82:0/1424885817 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v25)=0 v25) ==== 125+0+0 (secure 0 0 0) 0x7fdafc05fe30 con 0x7fdb0c104dc0 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 msgr2=0x7fdaf8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 0x7fdaf8070700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdb08000c00 tx=0x7fdb08009620 comp rx=0 tx=0).stop 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 msgr2=0x7fdb0c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e970 tx=0x7fdafc00ee30 comp rx=0 tx=0).stop 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 shutdown_connections 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb0c104dc0 0x7fdb0c197a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdaf806e240 0x7fdaf8070700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 --2- 172.21.15.82:0/1424885817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb0c102490 0x7fdb0c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:46.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 >> 172.21.15.82:0/1424885817 conn(0x7fdb0c0fc010 msgr2=0x7fdb0c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 shutdown_connections 2024-09-17T01:34:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:46.858+0000 7fdb1381b640 1 -- 172.21.15.82:0/1424885817 wait complete. 2024-09-17T01:34:47.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:46 smithi167 ceph-mon[35643]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:47.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:46 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/906671453' entity='client.admin' 2024-09-17T01:34:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 -- 172.21.15.82:0/2756851721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 msgr2=0x7f4428101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 --2- 172.21.15.82:0/2756851721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428101ee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4418009880 tx=0x7f441802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 -- 172.21.15.82:0/2756851721 shutdown_connections 2024-09-17T01:34:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 --2- 172.21.15.82:0/2756851721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428101ee0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 --2- 172.21.15.82:0/2756851721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 0x7f4428100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.374+0000 7f4430771640 1 -- 172.21.15.82:0/2756851721 >> 172.21.15.82:0/2756851721 conn(0x7f44280fc010 msgr2=0x7f44280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 -- 172.21.15.82:0/2756851721 shutdown_connections 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 -- 172.21.15.82:0/2756851721 wait complete. 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 Processor -- start 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 -- start start 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 0x7f4428197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44281096a0 con 0x7f4428101a60 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f4430771640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4428109520 con 0x7f4428100860 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f442dd0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f442dd0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38750/0 (socket says 172.21.15.82:38750) 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f442dd0c640 1 -- 172.21.15.82:0/1290422054 learned_addr learned my addr 172.21.15.82:0/1290422054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.375+0000 7f442e50d640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 0x7f4428197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f442dd0c640 1 -- 172.21.15.82:0/1290422054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 msgr2=0x7f4428197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f442dd0c640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 0x7f4428197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f442dd0c640 1 -- 172.21.15.82:0/1290422054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44281980d0 con 0x7f4428101a60 2024-09-17T01:34:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f442dd0c640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4418006010 tx=0x7f44180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f441803f070 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442819cab0 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f44180044d0 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4418035030 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.376+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442819d040 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.377+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4428100c60 con 0x7f4428101a60 2024-09-17T01:34:47.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.378+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f4418042070 con 0x7f4428101a60 2024-09-17T01:34:47.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.378+0000 7f441f7fe640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 0x7f44140706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.378+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f44180adca0 con 0x7f4428101a60 2024-09-17T01:34:47.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.378+0000 7f442e50d640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 0x7f44140706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.379+0000 7f442e50d640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 0x7f44140706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f44240058c0 tx=0x7f442400a2d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.382+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4418080390 con 0x7f4428101a60 2024-09-17T01:34:47.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.554+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f442819d270 con 0x7f4428101a60 2024-09-17T01:34:47.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.557+0000 7f441f7fe640 1 -- 172.21.15.82:0/1290422054 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v26)=0 v26) ==== 111+0+0 (secure 0 0 0) 0x7f4418084bc0 con 0x7f4428101a60 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 msgr2=0x7f44140706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 0x7f44140706f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f44240058c0 tx=0x7f442400a2d0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 msgr2=0x7f4428197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4418006010 tx=0x7f44180048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 shutdown_connections 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428101a60 0x7f4428197a50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f441406e230 0x7f44140706f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 --2- 172.21.15.82:0/1290422054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4428100860 0x7f4428197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 >> 172.21.15.82:0/1290422054 conn(0x7f44280fc010 msgr2=0x7f4428069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 shutdown_connections 2024-09-17T01:34:47.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.559+0000 7f4430771640 1 -- 172.21.15.82:0/1290422054 wait complete. 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.568+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/4034399159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 msgr2=0x7f5d78107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.568+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/4034399159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78107110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0098b0 tx=0x7f5d6c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/4034399159 shutdown_connections 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/4034399159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78107110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/4034399159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 0x7f5d781047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/4034399159 >> 172.21.15.82:0/4034399159 conn(0x7f5d780fc010 msgr2=0x7f5d780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/4034399159 shutdown_connections 2024-09-17T01:34:47.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/4034399159 wait complete. 2024-09-17T01:34:47.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.569+0000 7f5d7e4c5640 1 Processor -- start 2024-09-17T01:34:47.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d7e4c5640 1 -- start start 2024-09-17T01:34:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d7e4c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 0x7f5d78197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d7e4c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d7e4c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7810a790 con 0x7f5d78104d20 2024-09-17T01:34:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d7e4c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7810a610 con 0x7f5d781023f0 2024-09-17T01:34:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38780/0 (socket says 172.21.15.82:38780) 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d777fe640 1 -- 172.21.15.82:0/2957395942 learned_addr learned my addr 172.21.15.82:0/2957395942 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d77fff640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 0x7f5d78197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d777fe640 1 -- 172.21.15.82:0/2957395942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 msgr2=0x7f5d78197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.570+0000 7f5d777fe640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 0x7f5d78197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d777fe640 1 -- 172.21.15.82:0/2957395942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d78198130 con 0x7f5d78104d20 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d777fe640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009230 tx=0x7f5d6c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d6c03f070 con 0x7f5d78104d20 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7819cb10 con 0x7f5d78104d20 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d6c004a50 con 0x7f5d78104d20 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d6c035030 con 0x7f5d78104d20 2024-09-17T01:34:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.571+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7819d0a0 con 0x7f5d78104d20 2024-09-17T01:34:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.572+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d781027d0 con 0x7f5d78104d20 2024-09-17T01:34:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.573+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5d6c042070 con 0x7f5d78104d20 2024-09-17T01:34:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.573+0000 7f5d757fa640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 0x7f5d600706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.573+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5d6c0adae0 con 0x7f5d78104d20 2024-09-17T01:34:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.573+0000 7f5d77fff640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 0x7f5d600706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.574+0000 7f5d77fff640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 0x7f5d600706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800bbc0 tx=0x7f5d6800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.578+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d6c0801d0 con 0x7f5d78104d20 2024-09-17T01:34:47.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.749+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f5d7819d490 con 0x7f5d78104d20 2024-09-17T01:34:47.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.753+0000 7f5d757fa640 1 -- 172.21.15.82:0/2957395942 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v27)=0 v27) ==== 119+0+0 (secure 0 0 0) 0x7f5d6c084a00 con 0x7f5d78104d20 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 msgr2=0x7f5d600706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 0x7f5d600706f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800bbc0 tx=0x7f5d6800b390 comp rx=0 tx=0).stop 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 msgr2=0x7f5d78197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009230 tx=0x7f5d6c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 shutdown_connections 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d78104d20 0x7f5d78197ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d6006e230 0x7f5d600706f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 --2- 172.21.15.82:0/2957395942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d781023f0 0x7f5d78197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:47.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 >> 172.21.15.82:0/2957395942 conn(0x7f5d780fc010 msgr2=0x7f5d780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:47.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 shutdown_connections 2024-09-17T01:34:47.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:47.755+0000 7f5d7e4c5640 1 -- 172.21.15.82:0/2957395942 wait complete. 2024-09-17T01:34:47.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/772409646' entity='client.admin' 2024-09-17T01:34:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1424885817' entity='client.admin' 2024-09-17T01:34:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1290422054' entity='client.admin' 2024-09-17T01:34:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2957395942' entity='client.admin' 2024-09-17T01:34:48.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/772409646' entity='client.admin' 2024-09-17T01:34:48.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1424885817' entity='client.admin' 2024-09-17T01:34:48.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1290422054' entity='client.admin' 2024-09-17T01:34:48.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2957395942' entity='client.admin' 2024-09-17T01:34:48.941 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:48 smithi082 ceph-mon[28077]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:49.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:48 smithi167 ceph-mon[35643]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:50.027 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi082') 2024-09-17T01:34:50.027 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi082') 2024-09-17T01:34:50.027 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi082') 2024-09-17T01:34:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:50 smithi082 ceph-mon[28077]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:51.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:50 smithi167 ceph-mon[35643]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:34:53.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:52 smithi082 ceph-mon[28077]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:53.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:52 smithi167 ceph-mon[35643]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:53.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 -- 172.21.15.82:0/2627748635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 msgr2=0x7fa4d8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/2627748635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d8100040 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009880 tx=0x7fa4c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 -- 172.21.15.82:0/2627748635 shutdown_connections 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/2627748635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 0x7fa4d8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/2627748635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d8100040 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 -- 172.21.15.82:0/2627748635 >> 172.21.15.82:0/2627748635 conn(0x7fa4d80fb770 msgr2=0x7fa4d80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 -- 172.21.15.82:0/2627748635 shutdown_connections 2024-09-17T01:34:53.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.706+0000 7fa4dca8e640 1 -- 172.21.15.82:0/2627748635 wait complete. 2024-09-17T01:34:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.707+0000 7fa4dca8e640 1 Processor -- start 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.707+0000 7fa4dca8e640 1 -- start start 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.707+0000 7fa4dca8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.707+0000 7fa4dca8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 0x7fa4d8100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4dca8e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d810a800 con 0x7fa4d80ffc40 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4dca8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d810a680 con 0x7fa4d8102cc0 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38806/0 (socket says 172.21.15.82:38806) 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 -- 172.21.15.82:0/3570522136 learned_addr learned my addr 172.21.15.82:0/3570522136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4cdd9b640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 0x7fa4d8100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 -- 172.21.15.82:0/3570522136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 msgr2=0x7fa4d8100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 0x7fa4d8100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 -- 172.21.15.82:0/3570522136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d81011b0 con 0x7fa4d80ffc40 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4d659c640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8006010 tx=0x7fa4c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:53.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4c803f070 con 0x7fa4d80ffc40 2024-09-17T01:34:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4c80044d0 con 0x7fa4d80ffc40 2024-09-17T01:34:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d8101440 con 0x7fa4d80ffc40 2024-09-17T01:34:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4c8035030 con 0x7fa4d80ffc40 2024-09-17T01:34:53.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.708+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d81019f0 con 0x7fa4d80ffc40 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.710+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d8100040 con 0x7fa4d80ffc40 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.710+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fa4c8042070 con 0x7fa4d80ffc40 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.710+0000 7fa4cffff640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 0x7fa4c40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.710+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa4c80add40 con 0x7fa4d80ffc40 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.710+0000 7fa4cdd9b640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 0x7fa4c40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:53.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.711+0000 7fa4cdd9b640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 0x7fa4c40706f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8102330 tx=0x7fa4c0008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:53.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.715+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4c807c780 con 0x7fa4d80ffc40 2024-09-17T01:34:53.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.883+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa4d802db70 con 0x7fa4d80ffc40 2024-09-17T01:34:53.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.886+0000 7fa4cffff640 1 -- 172.21.15.82:0/3570522136 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fa4d802db70 con 0x7fa4d80ffc40 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 msgr2=0x7fa4c40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 0x7fa4c40706f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8102330 tx=0x7fa4c0008040 comp rx=0 tx=0).stop 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 msgr2=0x7fa4d81025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8006010 tx=0x7fa4c80048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 shutdown_connections 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa4c406e230 0x7fa4c40706f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4d8102cc0 0x7fa4d8100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 --2- 172.21.15.82:0/3570522136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4d80ffc40 0x7fa4d81025b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 >> 172.21.15.82:0/3570522136 conn(0x7fa4d80fb770 msgr2=0x7fa4d8106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 shutdown_connections 2024-09-17T01:34:53.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:53.888+0000 7fa4dca8e640 1 -- 172.21.15.82:0/3570522136 wait complete. 2024-09-17T01:34:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 -- 172.21.15.82:0/2602770204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 msgr2=0x7f5cd8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2602770204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8101ee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009880 tx=0x7f5ccc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 -- 172.21.15.82:0/2602770204 shutdown_connections 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2602770204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8101ee0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2602770204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 0x7f5cd8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 -- 172.21.15.82:0/2602770204 >> 172.21.15.82:0/2602770204 conn(0x7f5cd80fc010 msgr2=0x7f5cd80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.395+0000 7f5cdd124640 1 -- 172.21.15.82:0/2602770204 shutdown_connections 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.396+0000 7f5cdd124640 1 -- 172.21.15.82:0/2602770204 wait complete. 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.396+0000 7f5cdd124640 1 Processor -- start 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.396+0000 7f5cdd124640 1 -- start start 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 0x7f5cd8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8109720 con 0x7f5cd8101a60 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd81095a0 con 0x7f5cd8100860 2024-09-17T01:34:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38830/0 (socket says 172.21.15.82:38830) 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 -- 172.21.15.82:0/2226938707 learned_addr learned my addr 172.21.15.82:0/2226938707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd6d9d640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 0x7f5cd8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 -- 172.21.15.82:0/2226938707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 msgr2=0x7f5cd8104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 0x7f5cd8104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 -- 172.21.15.82:0/2226938707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd8103380 con 0x7f5cd8101a60 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cd659c640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc006010 tx=0x7f5ccc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ccc03f070 con 0x7f5cd8101a60 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ccc0044d0 con 0x7f5cd8101a60 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd8103610 con 0x7f5cd8101a60 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ccc035030 con 0x7f5cd8101a60 2024-09-17T01:34:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.397+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd8103bc0 con 0x7f5cd8101a60 2024-09-17T01:34:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.398+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd8100c40 con 0x7f5cd8101a60 2024-09-17T01:34:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.399+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5ccc042070 con 0x7f5cd8101a60 2024-09-17T01:34:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.399+0000 7f5cbffff640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 0x7f5cc00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.399+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5ccc0adce0 con 0x7f5cd8101a60 2024-09-17T01:34:54.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.399+0000 7f5cd6d9d640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 0x7f5cc00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:54.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.400+0000 7f5cd6d9d640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 0x7f5cc00706f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5cd81018c0 tx=0x7f5cc8009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:54.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.404+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ccc07c720 con 0x7f5cd8101a60 2024-09-17T01:34:54.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.580+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f5cd819f810 con 0x7f5cd8101a60 2024-09-17T01:34:54.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.584+0000 7f5cbffff640 1 -- 172.21.15.82:0/2226938707 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f5ccc0803d0 con 0x7f5cd8101a60 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 msgr2=0x7f5cc00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 0x7f5cc00706f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5cd81018c0 tx=0x7f5cc8009110 comp rx=0 tx=0).stop 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 msgr2=0x7f5cd8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc006010 tx=0x7f5ccc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 shutdown_connections 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cd8101a60 0x7f5cd8102e40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5cc006e230 0x7f5cc00706f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 --2- 172.21.15.82:0/2226938707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cd8100860 0x7f5cd8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:54.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 >> 172.21.15.82:0/2226938707 conn(0x7f5cd80fc010 msgr2=0x7f5cd806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:54.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 shutdown_connections 2024-09-17T01:34:54.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:54.586+0000 7f5cdd124640 1 -- 172.21.15.82:0/2226938707 wait complete. 2024-09-17T01:34:55.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:55.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3570522136' entity='client.admin' 2024-09-17T01:34:55.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:55.210 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:55.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:34:55.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:55.211 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2226938707' entity='client.admin' 2024-09-17T01:34:55.237 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-09-17T01:34:55.237 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi082') 2024-09-17T01:34:55.237 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-09-17T01:34:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3570522136' entity='client.admin' 2024-09-17T01:34:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:34:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:34:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:54 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2226938707' entity='client.admin' 2024-09-17T01:34:56.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:55 smithi082 ceph-mon[28077]: Reconfiguring crash.smithi082 (monmap changed)... 2024-09-17T01:34:56.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:55 smithi082 ceph-mon[28077]: Reconfiguring daemon crash.smithi082 on smithi082 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 -- 172.21.15.82:0/2182437591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 msgr2=0x7f5d5c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 --2- 172.21.15.82:0/2182437591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c107110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0098b0 tx=0x7f5d4c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 -- 172.21.15.82:0/2182437591 shutdown_connections 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 --2- 172.21.15.82:0/2182437591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c107110 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 --2- 172.21.15.82:0/2182437591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 -- 172.21.15.82:0/2182437591 >> 172.21.15.82:0/2182437591 conn(0x7f5d5c0fc010 msgr2=0x7f5d5c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 -- 172.21.15.82:0/2182437591 shutdown_connections 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.064+0000 7f5d64797640 1 -- 172.21.15.82:0/2182437591 wait complete. 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 Processor -- start 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 -- start start 2024-09-17T01:34:56.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c10a790 con 0x7f5d5c104d20 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d64797640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c10a610 con 0x7f5d5c1023f0 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38844/0 (socket says 172.21.15.82:38844) 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 -- 172.21.15.82:0/3831169502 learned_addr learned my addr 172.21.15.82:0/3831169502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d62533640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 -- 172.21.15.82:0/3831169502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 msgr2=0x7f5d5c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d61d32640 1 -- 172.21.15.82:0/3831169502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c198040 con 0x7f5d5c104d20 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.065+0000 7f5d62533640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d61d32640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009230 tx=0x7f5d4c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c03f070 con 0x7f5d5c104d20 2024-09-17T01:34:56.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d4c0044d0 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5c19ca50 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d4c035030 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.066+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5c19cf50 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.067+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5c1027d0 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.067+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5d4c042070 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.067+0000 7f5d537fe640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 0x7f5d48070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.068+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5d4c0adc00 con 0x7f5d5c104d20 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.068+0000 7f5d62533640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 0x7f5d48070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.068+0000 7f5d62533640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 0x7f5d48070740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800abe0 tx=0x7f5d5800a5c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:34:56.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.073+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d4c0b4080 con 0x7f5d5c104d20 2024-09-17T01:34:56.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.245+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f5d5c19d200 con 0x7f5d5c104d20 2024-09-17T01:34:56.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.250+0000 7f5d537fe640 1 -- 172.21.15.82:0/3831169502 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f5d4c07c6c0 con 0x7f5d5c104d20 2024-09-17T01:34:56.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 msgr2=0x7f5d48070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 0x7f5d48070740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800abe0 tx=0x7f5d5800a5c0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 msgr2=0x7f5d5c197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:34:56.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009230 tx=0x7f5d4c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 shutdown_connections 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d5c104d20 0x7f5d5c197a50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.252+0000 7f5d64797640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5d4806e280 0x7f5d48070740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.253+0000 7f5d64797640 1 --2- 172.21.15.82:0/3831169502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d5c1023f0 0x7f5d5c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.253+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 >> 172.21.15.82:0/3831169502 conn(0x7f5d5c0fc010 msgr2=0x7f5d5c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.253+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 shutdown_connections 2024-09-17T01:34:56.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:34:56.253+0000 7f5d64797640 1 -- 172.21.15.82:0/3831169502 wait complete. 2024-09-17T01:34:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:55 smithi167 ceph-mon[35643]: Reconfiguring crash.smithi082 (monmap changed)... 2024-09-17T01:34:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:55 smithi167 ceph-mon[35643]: Reconfiguring daemon crash.smithi082 on smithi082 2024-09-17T01:34:56.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:56 smithi082 ceph-mon[28077]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:56.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:56 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3831169502' entity='client.admin' 2024-09-17T01:34:56.946 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:56.947 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:57.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:56 smithi167 ceph-mon[35643]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:56 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3831169502' entity='client.admin' 2024-09-17T01:34:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:34:57.379 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.379 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.379 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.379 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.379 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.380 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.380 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.380 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.380 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '5047e42a-7494-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-09-17T01:34:57.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config dump 2024-09-17T01:34:58.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:57 smithi082 ceph-mon[28077]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-09-17T01:34:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:57 smithi082 ceph-mon[28077]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-09-17T01:34:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:58.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:57 smithi167 ceph-mon[35643]: Reconfiguring alertmanager.smithi082 (dependencies changed)... 2024-09-17T01:34:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:57 smithi167 ceph-mon[35643]: Reconfiguring daemon alertmanager.smithi082 on smithi082 2024-09-17T01:34:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:34:59.123 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:34:58 smithi082 ceph-mon[28077]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:34:58 smithi167 ceph-mon[35643]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:34:59.707 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:35:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.215+0000 7f10404bd640 1 -- 172.21.15.82:0/2220747522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 msgr2=0x7f10380750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.215+0000 7f10404bd640 1 --2- 172.21.15.82:0/2220747522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10380750b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f102c009880 tx=0x7f102c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- 172.21.15.82:0/2220747522 shutdown_connections 2024-09-17T01:35:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 --2- 172.21.15.82:0/2220747522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10380750b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 --2- 172.21.15.82:0/2220747522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- 172.21.15.82:0/2220747522 >> 172.21.15.82:0/2220747522 conn(0x7f10380fd0f0 msgr2=0x7f10380ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- 172.21.15.82:0/2220747522 shutdown_connections 2024-09-17T01:35:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- 172.21.15.82:0/2220747522 wait complete. 2024-09-17T01:35:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 Processor -- start 2024-09-17T01:35:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- start start 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f103810c9a0 con 0x7f1038074c50 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.216+0000 7f10404bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f103810c820 con 0x7f1038076220 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47266/0 (socket says 172.21.15.82:47266) 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 -- 172.21.15.82:0/2783476242 learned_addr learned my addr 172.21.15.82:0/2783476242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103da58640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 -- 172.21.15.82:0/2783476242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 msgr2=0x7f1038199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 -- 172.21.15.82:0/2783476242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103819a290 con 0x7f1038074c50 2024-09-17T01:35:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103da58640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f103e259640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f102800db70 tx=0x7f102800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1028017070 con 0x7f1038074c50 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f102800be00 con 0x7f1038074c50 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103819ecd0 con 0x7f1038074c50 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1028004480 con 0x7f1038074c50 2024-09-17T01:35:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.217+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103819f1b0 con 0x7f1038074c50 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.218+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10380750b0 con 0x7f1038074c50 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.219+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1028003970 con 0x7f1038074c50 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.219+0000 7f10377fe640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 0x7f1020070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.219+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f102808d2a0 con 0x7f1038074c50 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.219+0000 7f103da58640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 0x7f1020070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:00.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.220+0000 7f103da58640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 0x7f1020070740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f103819ab80 tx=0x7f102c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:00.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.224+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1028020020 con 0x7f1038074c50 2024-09-17T01:35:00.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.392+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f10381937b0 con 0x7f1038074c50 2024-09-17T01:35:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.393+0000 7f10377fe640 1 -- 172.21.15.82:0/2783476242 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) ==== 59+0+18512 (secure 0 0 0) 0x7f102805bd60 con 0x7f1038074c50 2024-09-17T01:35:00.391 INFO:teuthology.orchestra.run.smithi082.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T01:35:00.391 INFO:teuthology.orchestra.run.smithi082.stdout:global dev auth_debug true 2024-09-17T01:35:00.391 INFO:teuthology.orchestra.run.smithi082.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3 * 2024-09-17T01:35:00.391 INFO:teuthology.orchestra.run.smithi082.stdout:global dev debug_asserts_on_shutdown true 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global basic log_to_file true 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global basic log_to_journald false 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global basic log_to_stderr false 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_allow_pool_delete true 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_cluster_log_file_level debug 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_cluster_log_to_file true 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_pg_warn_min_per_osd 0 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-17T01:35:00.392 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global dev ms_die_on_bug true 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global dev ms_die_on_old_message true 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced debug_mon 20/20 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced debug_ms 1/1 2024-09-17T01:35:00.393 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced debug_paxos 20/20 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_data_avail_warn 5 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced client_mount_timeout 30 2024-09-17T01:35:00.394 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced debug_client 20/20 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced debug_mgr 20/20 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced debug_ms 1/1 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/dashboard/GRAFANA_API_SSL_VERIFY false * 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced bdev_async_discard true 2024-09-17T01:35:00.395 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev bdev_debug_aio true 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced bdev_enable_discard true 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced bluestore_allocator bitmap * 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev bluestore_fsck_on_mount true 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced debug_bluefs 1/20 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced debug_bluestore 1/20 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced debug_ms 1/1 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced debug_osd 20/20 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced debug_rocksdb 4/10 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_class_default_list * * 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_class_load_list * * 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_misdirected_ops true 2024-09-17T01:35:00.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_op_order true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_shutdown true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_memory_target_autotune true 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_objectstore bluestore * 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_op_queue debug_random * 2024-09-17T01:35:00.397 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_recover_clone_overlap true 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced debug_mds 20/20 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced debug_ms 2/2 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds dev mds_debug_frag true 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds dev mds_debug_scatterstat true 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds dev mds_verify_scatter true 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T01:35:00.398 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client advanced client_mount_timeout 600 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client advanced debug_client 20/20 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client advanced debug_ms 1/1 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-17T01:35:00.399 INFO:teuthology.orchestra.run.smithi082.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-17T01:35:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 msgr2=0x7f1020070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 0x7f1020070740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f103819ab80 tx=0x7f102c005a20 comp rx=0 tx=0).stop 2024-09-17T01:35:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 msgr2=0x7f10381996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f102800db70 tx=0x7f102800b630 comp rx=0 tx=0).stop 2024-09-17T01:35:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 shutdown_connections 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f102006e280 0x7f1020070740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1038076220 0x7f1038199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 --2- 172.21.15.82:0/2783476242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038074c50 0x7f10381996d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 >> 172.21.15.82:0/2783476242 conn(0x7f10380fd0f0 msgr2=0x7f10381079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 shutdown_connections 2024-09-17T01:35:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:00.395+0000 7f10404bd640 1 -- 172.21.15.82:0/2783476242 wait complete. 2024-09-17T01:35:01.144 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:00 smithi082 ceph-mon[28077]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:01.144 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:00 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2783476242' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-17T01:35:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:00 smithi167 ceph-mon[35643]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:00 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2783476242' entity='client.admin' cmd=[{"prefix": "config dump"}]: dispatch 2024-09-17T01:35:01.442 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T01:35:01.443 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:35:01.443 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:35:01.459 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:35:01.459 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-09-17T01:35:01.514 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:35:01.514 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:01.514 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T01:35:01.514 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:01.515 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:01.515 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-17 01:33:51.303969969 +0000 2024-09-17T01:35:01.515 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-17 01:26:56.084908664 +0000 2024-09-17T01:35:01.515 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-17 01:26:56.084908664 +0000 2024-09-17T01:35:01.515 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-17 01:26:56.084908664 +0000 2024-09-17T01:35:01.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:35:01.579 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-17T01:35:01.579 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-17T01:35:01.579 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000204051 s, 2.5 MB/s 2024-09-17T01:35:01.580 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:35:01.638 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-17 01:33:51.303969969 +0000 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-17 01:26:56.409902306 +0000 2024-09-17T01:35:01.694 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-17 01:26:56.409902306 +0000 2024-09-17T01:35:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-17 01:26:56.409902306 +0000 2024-09-17T01:35:01.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:35:01.757 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-17T01:35:01.757 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-17T01:35:01.757 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000187866 s, 2.7 MB/s 2024-09-17T01:35:01.759 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:35:01.815 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-09-17T01:35:01.870 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-17 01:33:51.303969969 +0000 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-17 01:26:56.726896106 +0000 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-17 01:26:56.726896106 +0000 2024-09-17T01:35:01.871 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-17 01:26:56.726896106 +0000 2024-09-17T01:35:01.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:35:01.934 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-17T01:35:01.934 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-17T01:35:01.934 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000171767 s, 3.0 MB/s 2024-09-17T01:35:01.935 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:35:01.991 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-09-17 01:33:51.304969949 +0000 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-17 01:26:57.040889964 +0000 2024-09-17T01:35:02.048 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-17 01:26:57.040889964 +0000 2024-09-17T01:35:02.049 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-09-17 01:26:57.040889964 +0000 2024-09-17T01:35:02.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:35:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-09-17T01:35:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-09-17T01:35:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000179342 s, 2.9 MB/s 2024-09-17T01:35:02.113 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:35:02.169 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:35:02.169 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T01:35:02.189 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T01:35:02.190 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 01:34:20.522338284 +0000 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 01:26:56.088530143 +0000 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 01:26:56.088530143 +0000 2024-09-17T01:35:02.249 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 01:26:56.088530143 +0000 2024-09-17T01:35:02.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T01:35:02.319 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T01:35:02.319 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T01:35:02.319 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00023494 s, 2.2 MB/s 2024-09-17T01:35:02.320 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T01:35:02.379 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-17T01:35:02.436 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T01:35:02.436 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 01:34:20.522338284 +0000 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 01:26:56.418524109 +0000 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 01:26:56.418524109 +0000 2024-09-17T01:35:02.437 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 01:26:56.418524109 +0000 2024-09-17T01:35:02.437 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T01:35:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T01:35:02.501 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T01:35:02.502 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000232892 s, 2.2 MB/s 2024-09-17T01:35:02.503 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T01:35:02.561 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-17T01:35:02.617 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 01:34:20.522338284 +0000 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 01:26:56.742518184 +0000 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 01:26:56.742518184 +0000 2024-09-17T01:35:02.618 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 01:26:56.742518184 +0000 2024-09-17T01:35:02.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T01:35:02.683 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T01:35:02.683 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T01:35:02.683 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00023162 s, 2.2 MB/s 2024-09-17T01:35:02.684 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T01:35:02.741 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-17T01:35:02.797 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-17 01:34:20.523338265 +0000 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 01:26:57.055512461 +0000 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 01:26:57.055512461 +0000 2024-09-17T01:35:02.798 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-17 01:26:57.055512461 +0000 2024-09-17T01:35:02.799 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T01:35:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-17T01:35:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-17T01:35:02.861 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00029109 s, 1.8 MB/s 2024-09-17T01:35:02.862 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T01:35:02.918 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-09-17T01:35:02.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:35:03.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:02 smithi167 ceph-mon[35643]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:03.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:02 smithi082 ceph-mon[28077]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:35:04.313 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:04.313 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:04.313 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:04 smithi082 ceph-mon[28077]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-09-17T01:35:04.313 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:04 smithi082 ceph-mon[28077]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-09-17T01:35:04.313 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:04 smithi082 ceph-mon[28077]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:04.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:04.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:04.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:04 smithi167 ceph-mon[35643]: Reconfiguring grafana.smithi082 (dependencies changed)... 2024-09-17T01:35:04.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:04 smithi167 ceph-mon[35643]: Reconfiguring daemon grafana.smithi082 on smithi082 2024-09-17T01:35:04.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:04 smithi167 ceph-mon[35643]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:06.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:06 smithi082 ceph-mon[28077]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:07.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:06 smithi167 ceph-mon[35643]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:08 smithi082 ceph-mon[28077]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:08 smithi082 ceph-mon[28077]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:35:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:08 smithi167 ceph-mon[35643]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:08 smithi167 ceph-mon[35643]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:35:09.393 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:35:09.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-09-17T01:35:10.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:09 smithi082 ceph-mon[28077]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:35:10.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:09 smithi167 ceph-mon[35643]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:35:11.135 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:10 smithi082 ceph-mon[28077]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:11.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:10 smithi167 ceph-mon[35643]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:11.836 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 -- 172.21.15.82:0/805339931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4101960 msgr2=0x7fb2d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/805339931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4101960 0x7fb2d4101d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009c20 tx=0x7fb2d002a970 comp rx=0 tx=0).stop 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 -- 172.21.15.82:0/805339931 shutdown_connections 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/805339931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4102b60 0x7fb2d4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/805339931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4101960 0x7fb2d4101d60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 -- 172.21.15.82:0/805339931 >> 172.21.15.82:0/805339931 conn(0x7fb2d40fd0f0 msgr2=0x7fb2d40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 -- 172.21.15.82:0/805339931 shutdown_connections 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.295+0000 7fb2db2e0640 1 -- 172.21.15.82:0/805339931 wait complete. 2024-09-17T01:35:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 Processor -- start 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 -- start start 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4101960 0x7fb2d4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410a800 con 0x7fb2d4102b60 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2db2e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d410a680 con 0x7fb2d4101960 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2d887b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2d887b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50288/0 (socket says 172.21.15.82:50288) 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.296+0000 7fb2d887b640 1 -- 172.21.15.82:0/905533399 learned_addr learned my addr 172.21.15.82:0/905533399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2d907c640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4101960 0x7fb2d4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2d887b640 1 -- 172.21.15.82:0/905533399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4101960 msgr2=0x7fb2d4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2d887b640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4101960 0x7fb2d4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2d887b640 1 -- 172.21.15.82:0/905533399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d4074b20 con 0x7fb2d4102b60 2024-09-17T01:35:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2d887b640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b420 tx=0x7fb2c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c4011630 con 0x7fb2d4102b60 2024-09-17T01:35:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2c4016070 con 0x7fb2d4102b60 2024-09-17T01:35:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d4074e10 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb2c4010d40 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.297+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d4075420 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.298+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d4101de0 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.299+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb2c401b460 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.299+0000 7fb2ca7fc640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 0x7fb2c00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.299+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb2c408c900 con 0x7fb2d4102b60 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.299+0000 7fb2d907c640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 0x7fb2c00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.300+0000 7fb2d907c640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 0x7fb2c00706f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0000f80 tx=0x7fb2d002f9f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:12.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.304+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2c405b340 con 0x7fb2d4102b60 2024-09-17T01:35:12.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:12.497+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb2d4062630 con 0x7fb2c006e230 2024-09-17T01:35:13.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:12 smithi082 ceph-mon[28077]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:13.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:35:13.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:35:13.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:13.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:12 smithi167 ceph-mon[35643]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:13.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:35:13.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:35:13.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:13.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:14.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:13 smithi082 ceph-mon[28077]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:35:14.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:13 smithi167 ceph-mon[35643]: from='client.14350 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:35:15.040 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:14 smithi082 ceph-mon[28077]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:15.040 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:15.040 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:15.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:35:15.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:14 smithi167 ceph-mon[35643]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:35:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: Reconfiguring ceph-exporter.smithi167 (monmap changed)... 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: Reconfiguring daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3949567498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03ff4c08-397d-49ac-bf57-3c6e64d6bef5"}]: dispatch 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3949567498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03ff4c08-397d-49ac-bf57-3c6e64d6bef5"}]': finished 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:35:16.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:15 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: Reconfiguring ceph-exporter.smithi167 (monmap changed)... 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: Reconfiguring daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3949567498' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03ff4c08-397d-49ac-bf57-3c6e64d6bef5"}]: dispatch 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3949567498' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03ff4c08-397d-49ac-bf57-3c6e64d6bef5"}]': finished 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T01:35:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:17.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:35:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:16 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/27895095' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:16 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/27895095' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: Reconfiguring crash.smithi167 (monmap changed)... 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: Reconfiguring daemon crash.smithi167 on smithi167 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:35:18.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:17 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:18.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: Reconfiguring crash.smithi167 (monmap changed)... 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: Reconfiguring daemon crash.smithi167 on smithi167 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:35:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:17 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: Reconfiguring mgr.smithi167.ysmbcy (monmap changed)... 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: Reconfiguring daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:35:19.212 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:18 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: Reconfiguring mgr.smithi167.ysmbcy (monmap changed)... 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: Reconfiguring daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:35:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:18 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:20.184 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:19 smithi167 ceph-mon[35643]: Reconfiguring mon.smithi167 (monmap changed)... 2024-09-17T01:35:20.184 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:19 smithi167 ceph-mon[35643]: Reconfiguring daemon mon.smithi167 on smithi167 2024-09-17T01:35:20.263 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:19 smithi082 ceph-mon[28077]: Reconfiguring mon.smithi167 (monmap changed)... 2024-09-17T01:35:20.263 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:19 smithi082 ceph-mon[28077]: Reconfiguring daemon mon.smithi167 on smithi167 2024-09-17T01:35:21.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:21.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:35:21.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.206 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:21.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:35:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:21.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:22.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:35:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:35:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:35:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:35:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:35:22.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:22 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:35:22.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:35:22.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi082.front.sepia.ceph.com:9093"}]: dispatch 2024-09-17T01:35:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:35:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi082.front.sepia.ceph.com:3000"}]: dispatch 2024-09-17T01:35:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:35:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:22 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi082.front.sepia.ceph.com:9095"}]: dispatch 2024-09-17T01:35:23.083 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:23 smithi082 ceph-mon[28077]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:23.083 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:23 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:23.083 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:23 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:23 smithi167 ceph-mon[35643]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:23 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:23 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:24.407 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:24 smithi082 ceph-mon[28077]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:24.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:24 smithi167 ceph-mon[35643]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:26.703 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:26.703 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:26.703 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:26.703 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:26.704 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:26.704 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:26.757 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:27.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:35:27.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:27.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:27 smithi167 ceph-mon[35643]: Deploying daemon osd.0 on smithi082 2024-09-17T01:35:27.827 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T01:35:27.827 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:27.827 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:27 smithi082 ceph-mon[28077]: Deploying daemon osd.0 on smithi082 2024-09-17T01:35:28.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:28 smithi082 ceph-mon[28077]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:28.636 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:28 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:28.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:28 smithi167 ceph-mon[35643]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:28.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:28 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:31.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:30 smithi167 ceph-mon[35643]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:30 smithi082 ceph-mon[28077]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:33.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:32 smithi167 ceph-mon[35643]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:33.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:32 smithi082 ceph-mon[28077]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:33.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:33.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:33.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:34.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:34.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:34.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:34.912 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:34 smithi082 ceph-mon[28077]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:34 smithi167 ceph-mon[35643]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:36.085 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:36.085 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:36.916 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:36 smithi082 ceph-mon[28077]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:37.154 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:36 smithi167 ceph-mon[35643]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:37.204 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-09-17T01:35:37.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.205+0000 7fb2ca7fc640 1 -- 172.21.15.82:0/905533399 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb2d4062630 con 0x7fb2c006e230 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 msgr2=0x7fb2c00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 0x7fb2c00706f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0000f80 tx=0x7fb2d002f9f0 comp rx=0 tx=0).stop 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 msgr2=0x7fb2d40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b420 tx=0x7fb2c400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 shutdown_connections 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2d4102b60 0x7fb2d40745e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb2c006e230 0x7fb2c00706f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 --2- 172.21.15.82:0/905533399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2d4101960 0x7fb2d4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 >> 172.21.15.82:0/905533399 conn(0x7fb2d40fd0f0 msgr2=0x7fb2d4106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 shutdown_connections 2024-09-17T01:35:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:37.208+0000 7fb2db2e0640 1 -- 172.21.15.82:0/905533399 wait complete. 2024-09-17T01:35:38.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:38.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:38.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:38 smithi082 ceph-mon[28077]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:38.248 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T01:35:38.251 INFO:tasks.cephadm:Deploying osd.1 on smithi082 with /dev/vg_nvme/lv_3... 2024-09-17T01:35:38.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:35:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:38 smithi167 ceph-mon[35643]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:38.657 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:35:38.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:35:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:35:38.768+0000 7fc5239c3640 -1 osd.0 0 log_to_monitors true 2024-09-17T01:35:39.394 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:39 smithi082 ceph-mon[28077]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:35:39.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:39 smithi167 ceph-mon[35643]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T01:35:40.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:40 smithi167 ceph-mon[35643]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:35:40.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:40 smithi167 ceph-mon[35643]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:35:40.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:40 smithi167 ceph-mon[35643]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:35:40.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:40.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:40 smithi167 ceph-mon[35643]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:40.539 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:40 smithi082 ceph-mon[28077]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:35:40.539 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:40 smithi082 ceph-mon[28077]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T01:35:40.539 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:40 smithi082 ceph-mon[28077]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:35:40.540 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:40.540 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:40 smithi082 ceph-mon[28077]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:41.214 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:35:41.063+0000 7fc51f123640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T01:35:41.214 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:35:41.071+0000 7fc517755640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:35:41.500 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-mon[28077]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:35:41.500 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-mon[28077]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:35:41.500 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:41.500 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:41.500 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:41 smithi082 ceph-mon[28077]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' 2024-09-17T01:35:41.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:35:41.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:41 smithi167 ceph-mon[35643]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:35:41.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:41 smithi167 ceph-mon[35643]: osdmap e8: 1 total, 0 up, 1 in 2024-09-17T01:35:41.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:41 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:41.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:41 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:41.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:41 smithi167 ceph-mon[35643]: from='osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635]' entity='osd.0' 2024-09-17T01:35:41.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-09-17T01:35:41.792 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 -- 172.21.15.82:0/2228391795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 msgr2=0x7f51f0104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 --2- 172.21.15.82:0/2228391795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0104840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009880 tx=0x7f51e002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 -- 172.21.15.82:0/2228391795 shutdown_connections 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 --2- 172.21.15.82:0/2228391795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 --2- 172.21.15.82:0/2228391795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0104840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 -- 172.21.15.82:0/2228391795 >> 172.21.15.82:0/2228391795 conn(0x7f51f00fc010 msgr2=0x7f51f00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 -- 172.21.15.82:0/2228391795 shutdown_connections 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.290+0000 7f51f5abd640 1 -- 172.21.15.82:0/2228391795 wait complete. 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 Processor -- start 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 -- start start 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51f010a7c0 con 0x7f51f0102450 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51f5abd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51f010a640 con 0x7f51f0104d80 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51ef7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50396/0 (socket says 172.21.15.82:50396) 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51ef7fe640 1 -- 172.21.15.82:0/1940602813 learned_addr learned my addr 172.21.15.82:0/1940602813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.291+0000 7f51eeffd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ef7fe640 1 -- 172.21.15.82:0/1940602813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 msgr2=0x7f51f0197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ef7fe640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ef7fe640 1 -- 172.21.15.82:0/1940602813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f01980e0 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51eeffd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ef7fe640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51e0006010 tx=0x7f51e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51e003f070 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51e00044d0 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f019cb20 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51e0035030 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.292+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f019d0b0 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.293+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f0102830 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.293+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f51e0042070 con 0x7f51f0102450 2024-09-17T01:35:42.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.294+0000 7f51ecff9640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 0x7f51d80706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:35:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.294+0000 7f51eeffd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 0x7f51d80706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:35:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.294+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1982+0+0 (secure 0 0 0) 0x7f51e00adfd0 con 0x7f51f0102450 2024-09-17T01:35:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.294+0000 7f51eeffd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 0x7f51d80706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51e4006fd0 tx=0x7f51e4008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:35:42.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.299+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51e007c7b0 con 0x7f51f0102450 2024-09-17T01:35:42.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] boot 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:35:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:42.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:35:42.496+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f51f0105760 con 0x7f51d806e230 2024-09-17T01:35:42.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: osd.0 [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] boot 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T01:35:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:35:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:43 smithi082 ceph-mon[28077]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:35:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:35:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:35:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:43.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:43 smithi167 ceph-mon[35643]: from='client.14368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:35:43.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:35:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:35:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:44.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:44 smithi082 ceph-mon[28077]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:35:44.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:44 smithi082 ceph-mon[28077]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:44 smithi167 ceph-mon[35643]: osdmap e10: 1 total, 1 up, 1 in 2024-09-17T01:35:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:44 smithi167 ceph-mon[35643]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:46.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi082 2024-09-17T01:35:46.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.592 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi082 to 11840M 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:46.593 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:46 smithi082 ceph-mon[28077]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:46.653 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi082 2024-09-17T01:35:46.653 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.653 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.653 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi082 to 11840M 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:46.654 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:35:46.655 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:46 smithi167 ceph-mon[35643]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:47.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1181521918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f3aef62-e035-4cf4-987d-38627317e3c3"}]: dispatch 2024-09-17T01:35:47.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1181521918' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f3aef62-e035-4cf4-987d-38627317e3c3"}]': finished 2024-09-17T01:35:47.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:35:47.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:35:47.528 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:47.529 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:47 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:47.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1181521918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f3aef62-e035-4cf4-987d-38627317e3c3"}]: dispatch 2024-09-17T01:35:47.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1181521918' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f3aef62-e035-4cf4-987d-38627317e3c3"}]': finished 2024-09-17T01:35:47.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T01:35:47.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:35:47.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:47.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:47 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:48 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/582207993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:35:48.375 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:48 smithi082 ceph-mon[28077]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:48.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:48 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/582207993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:35:48.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:48 smithi167 ceph-mon[35643]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:35:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:35:52.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:52 smithi082 ceph-mon[28077]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:53.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:52 smithi167 ceph-mon[35643]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:54.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:54 smithi082 ceph-mon[28077]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:55.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:54 smithi167 ceph-mon[35643]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:56.009 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:55 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:35:56.009 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:55 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:55 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T01:35:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:55 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:35:56.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:56 smithi082 ceph-mon[28077]: Deploying daemon osd.1 on smithi082 2024-09-17T01:35:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:56 smithi082 ceph-mon[28077]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:57.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:56 smithi167 ceph-mon[35643]: Deploying daemon osd.1 on smithi082 2024-09-17T01:35:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:56 smithi167 ceph-mon[35643]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:57.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:58.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:35:59.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:35:58 smithi082 ceph-mon[28077]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:35:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:35:58 smithi167 ceph-mon[35643]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:00.847 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:00 smithi082 ceph-mon[28077]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:00 smithi167 ceph-mon[35643]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:02.175 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:01 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:02.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:01 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:02.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:01 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:01 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:01 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:01 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:03.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:02 smithi082 ceph-mon[28077]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:03.129 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:02 smithi167 ceph-mon[35643]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:04.699 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:04.699 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:04.699 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:04 smithi082 ceph-mon[28077]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:05.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:04 smithi167 ceph-mon[35643]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:05.725 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 1 on host 'smithi082' 2024-09-17T01:36:05.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.727+0000 7f51ecff9640 1 -- 172.21.15.82:0/1940602813 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51f0105760 con 0x7f51d806e230 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 msgr2=0x7f51d80706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 0x7f51d80706f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51e4006fd0 tx=0x7f51e4008040 comp rx=0 tx=0).stop 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 msgr2=0x7f51f0197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f51e0006010 tx=0x7f51e00048f0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 shutdown_connections 2024-09-17T01:36:05.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f51d806e230 0x7f51d80706f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51f0104d80 0x7f51f0197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 --2- 172.21.15.82:0/1940602813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51f0102450 0x7f51f0197520 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 >> 172.21.15.82:0/1940602813 conn(0x7f51f00fc010 msgr2=0x7f51f00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 shutdown_connections 2024-09-17T01:36:05.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:05.730+0000 7f51f5abd640 1 -- 172.21.15.82:0/1940602813 wait complete. 2024-09-17T01:36:06.376 DEBUG:teuthology.orchestra.run.smithi082:osd.1> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T01:36:06.379 INFO:tasks.cephadm:Deploying osd.2 on smithi082 with /dev/vg_nvme/lv_2... 2024-09-17T01:36:06.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:36:06.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:06 smithi082 ceph-mon[28077]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:06 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:06 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:07.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:06 smithi167 ceph-mon[35643]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:07.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:06 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:07.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:06 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:07.091 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:36:08.412 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:08 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:36:08.029+0000 7f31dba29640 -1 osd.1 0 log_to_monitors true 2024-09-17T01:36:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:08 smithi167 ceph-mon[35643]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:08 smithi167 ceph-mon[35643]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:36:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:08 smithi082 ceph-mon[28077]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:09.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:08 smithi082 ceph-mon[28077]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T01:36:10.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:09 smithi167 ceph-mon[35643]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:10.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:09 smithi082 ceph-mon[28077]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:36:10.698 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:36:10.515+0000 7f31d81c0640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T01:36:10.698 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:36:10.520+0000 7f31cf7bb640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' 2024-09-17T01:36:10.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:10 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:11.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:11.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: osdmap e13: 2 total, 1 up, 2 in 2024-09-17T01:36:11.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: from='osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994]' entity='osd.1' 2024-09-17T01:36:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:10 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:36:11.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-09-17T01:36:11.915 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:11 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:36:11.915 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:11 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:36:11.915 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:11 smithi082 ceph-mon[28077]: osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] boot 2024-09-17T01:36:11.915 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:11 smithi082 ceph-mon[28077]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:36:11.915 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:11 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:12.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:11 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:36:12.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:11 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:36:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:11 smithi167 ceph-mon[35643]: osd.1 [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] boot 2024-09-17T01:36:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:11 smithi167 ceph-mon[35643]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T01:36:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:11 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:36:12.144 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:36:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 -- 172.21.15.82:0/782821202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440102470 msgr2=0x7f7440104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 --2- 172.21.15.82:0/782821202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440102470 0x7f7440104860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7430009c20 tx=0x7f743002a970 comp rx=0 tx=0).stop 2024-09-17T01:36:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 -- 172.21.15.82:0/782821202 shutdown_connections 2024-09-17T01:36:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 --2- 172.21.15.82:0/782821202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440104da0 0x7f7440107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 --2- 172.21.15.82:0/782821202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440102470 0x7f7440104860 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 -- 172.21.15.82:0/782821202 >> 172.21.15.82:0/782821202 conn(0x7f74400fc010 msgr2=0x7f74400fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 -- 172.21.15.82:0/782821202 shutdown_connections 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.659+0000 7f7446f18640 1 -- 172.21.15.82:0/782821202 wait complete. 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 Processor -- start 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 -- start start 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440102470 0x7f74401974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f744010a790 con 0x7f7440104da0 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7446f18640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f744010a610 con 0x7f7440102470 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f743ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f743ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49962/0 (socket says 172.21.15.82:49962) 2024-09-17T01:36:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f743ffff640 1 -- 172.21.15.82:0/3871285676 learned_addr learned my addr 172.21.15.82:0/3871285676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.660+0000 7f7444cb4640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440102470 0x7f74401974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743ffff640 1 -- 172.21.15.82:0/3871285676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440102470 msgr2=0x7f74401974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743ffff640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440102470 0x7f74401974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743ffff640 1 -- 172.21.15.82:0/3871285676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7440198070 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743ffff640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f743400d6c0 tx=0x7f743400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7434017070 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744019cab0 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74340054e0 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7434004b70 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.661+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744019d0c0 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.662+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7440102850 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.663+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f7434010460 con 0x7f7440104da0 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.663+0000 7f743dffb640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 0x7f7428070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.663+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2414+0+0 (secure 0 0 0) 0x7f743408cf20 con 0x7f7440104da0 2024-09-17T01:36:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.663+0000 7f7444cb4640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 0x7f7428070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.664+0000 7f7444cb4640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 0x7f7428070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7430004af0 tx=0x7f743003c040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.670+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f743405f280 con 0x7f7440104da0 2024-09-17T01:36:12.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:12 smithi082 ceph-mon[28077]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:12.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:12.855+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7440105720 con 0x7f742806e280 2024-09-17T01:36:13.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:12 smithi167 ceph-mon[35643]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-17T01:36:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='client.14386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:13.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:13.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:13.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:13.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:13.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:13.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:14.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: osdmap e15: 2 total, 2 up, 2 in 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='client.14386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:14.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:14.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:14.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:15.061 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:14 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi082 2024-09-17T01:36:15.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:14 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi082 to 5920M 2024-09-17T01:36:15.062 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:14 smithi082 ceph-mon[28077]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:14 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi082 2024-09-17T01:36:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:14 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi082 to 5920M 2024-09-17T01:36:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:14 smithi167 ceph-mon[35643]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:16.011 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3939899292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908e9713-c4f0-46d5-b936-7624a57b9d89"}]: dispatch 2024-09-17T01:36:16.011 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3939899292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908e9713-c4f0-46d5-b936-7624a57b9d89"}]': finished 2024-09-17T01:36:16.012 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:15 smithi082 ceph-mon[28077]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:36:16.012 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:15 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:16.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:15 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3939899292' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908e9713-c4f0-46d5-b936-7624a57b9d89"}]: dispatch 2024-09-17T01:36:16.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:15 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3939899292' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908e9713-c4f0-46d5-b936-7624a57b9d89"}]': finished 2024-09-17T01:36:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:15 smithi167 ceph-mon[35643]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T01:36:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:15 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:16 smithi082 ceph-mon[28077]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:16 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1034185740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:36:17.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:16 smithi167 ceph-mon[35643]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:16 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1034185740' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:36:19.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:18 smithi167 ceph-mon[35643]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:18 smithi082 ceph-mon[28077]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:20.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:19 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:20.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:19 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:20.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:19 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:20.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:19 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:20.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:19 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:20.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:19 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:20.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:19 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:20.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:19 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:20.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:19 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:20.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:19 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:21.167 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:20 smithi082 ceph-mon[28077]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:21.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:20 smithi167 ceph-mon[35643]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:23.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:22 smithi082 ceph-mon[28077]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:22 smithi167 ceph-mon[35643]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:25.119 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:24 smithi082 ceph-mon[28077]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:25.120 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:24 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:36:25.120 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:24 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:24 smithi167 ceph-mon[35643]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:24 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T01:36:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:24 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:26.065 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:25 smithi082 ceph-mon[28077]: Deploying daemon osd.2 on smithi082 2024-09-17T01:36:26.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:25 smithi167 ceph-mon[35643]: Deploying daemon osd.2 on smithi082 2024-09-17T01:36:26.955 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:26 smithi082 ceph-mon[28077]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:27.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:26 smithi167 ceph-mon[35643]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:27.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:28.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:29.137 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:28 smithi082 ceph-mon[28077]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:29.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:28 smithi167 ceph-mon[35643]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:31.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:30 smithi082 ceph-mon[28077]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:31.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:31.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:31.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:30 smithi167 ceph-mon[35643]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:33.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:32 smithi082 ceph-mon[28077]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:32 smithi167 ceph-mon[35643]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.557+0000 7f743dffb640 1 -- 172.21.15.82:0/3871285676 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7440105720 con 0x7f742806e280 2024-09-17T01:36:33.555 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 2 on host 'smithi082' 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 msgr2=0x7f7428070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 0x7f7428070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7430004af0 tx=0x7f743003c040 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 msgr2=0x7f74401979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f743400d6c0 tx=0x7f743400db80 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 shutdown_connections 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7440104da0 0x7f74401979f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f742806e280 0x7f7428070740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 --2- 172.21.15.82:0/3871285676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7440102470 0x7f74401974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 >> 172.21.15.82:0/3871285676 conn(0x7f74400fc010 msgr2=0x7f74400fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 shutdown_connections 2024-09-17T01:36:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:36:33.560+0000 7f7446f18640 1 -- 172.21.15.82:0/3871285676 wait complete. 2024-09-17T01:36:34.214 DEBUG:teuthology.orchestra.run.smithi082:osd.2> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T01:36:34.216 INFO:tasks.cephadm:Deploying osd.3 on smithi167 with /dev/vg_nvme/lv_4... 2024-09-17T01:36:34.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-17T01:36:34.470 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:36:34.802 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:34 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:34.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:34 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:34.803 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:34 smithi082 ceph-mon[28077]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:34.827 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:34 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:34.828 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:34 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:34.828 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:34 smithi167 ceph-mon[35643]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:36.913 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:36 smithi082 ceph-mon[28077]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:36.914 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:36 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:36:36.850+0000 7fcc713c2640 -1 osd.2 0 log_to_monitors true 2024-09-17T01:36:36.948 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:36 smithi167 ceph-mon[35643]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:36.952 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:36:36.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-09-17T01:36:37.235 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:36:37.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- 172.21.15.167:0/879522096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14101a60 msgr2=0x7fea14101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:37.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 --2- 172.21.15.167:0/879522096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14101a60 0x7fea14101ee0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fea00009880 tx=0x7fea0002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:36:37.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- 172.21.15.167:0/879522096 shutdown_connections 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 --2- 172.21.15.167:0/879522096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14101a60 0x7fea14101ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 --2- 172.21.15.167:0/879522096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14100860 0x7fea14100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- 172.21.15.167:0/879522096 >> 172.21.15.167:0/879522096 conn(0x7fea140fbff0 msgr2=0x7fea140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- 172.21.15.167:0/879522096 shutdown_connections 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- 172.21.15.167:0/879522096 wait complete. 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 Processor -- start 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 -- start start 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.663+0000 7fea1b08a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea1b08a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14101a60 0x7fea14196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea1b08a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fea141096a0 con 0x7fea14101a60 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea1b08a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fea14109520 con 0x7fea14100860 2024-09-17T01:36:37.664 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:33830/0 (socket says 172.21.15.167:33830) 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 -- 172.21.15.167:0/2035179562 learned_addr learned my addr 172.21.15.167:0/2035179562 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea13fff640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14101a60 0x7fea14196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 -- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14101a60 msgr2=0x7fea14196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14101a60 0x7fea14196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 -- 172.21.15.167:0/2035179562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea14196fb0 con 0x7fea14100860 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea18e26640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e940 tx=0x7fea0800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea0800cac0 con 0x7fea14100860 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea0800cc60 con 0x7fea14100860 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1419b9f0 con 0x7fea14100860 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.664+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea08003e30 con 0x7fea14100860 2024-09-17T01:36:37.665 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.665+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1419bf50 con 0x7fea14100860 2024-09-17T01:36:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.665+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea14109e80 con 0x7fea14100860 2024-09-17T01:36:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.666+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fea08004000 con 0x7fea14100860 2024-09-17T01:36:37.666 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.666+0000 7fea11ffb640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 0x7fea04070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:36:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.667+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2529+0+0 (secure 0 0 0) 0x7fea0808d9a0 con 0x7fea14100860 2024-09-17T01:36:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.667+0000 7fea13fff640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 0x7fea04070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:36:37.667 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.667+0000 7fea13fff640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 0x7fea04070740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea00000c00 tx=0x7fea000058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:36:37.669 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.671+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea0805bfd0 con 0x7fea14100860 2024-09-17T01:36:37.844 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:37.846+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fea14062630 con 0x7fea0406e280 2024-09-17T01:36:37.845 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:37 smithi167 ceph-mon[35643]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:36:37.845 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:37 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:37.845 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:37 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:38.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:37 smithi082 ceph-mon[28077]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T01:36:38.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:37 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:38.006 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:37 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:38.887 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:36:38.775+0000 7fcc6cb22640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T01:36:38.887 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:36:38.778+0000 7fcc6915c640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:36:38.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:38.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:38.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:36:38.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:39 smithi082 ceph-mon[28077]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:36:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:39 smithi082 ceph-mon[28077]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:36:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:39 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:39 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:39 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:40.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:39 smithi167 ceph-mon[35643]: from='osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-09-17T01:36:40.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:39 smithi167 ceph-mon[35643]: osdmap e18: 3 total, 2 up, 3 in 2024-09-17T01:36:40.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:39 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:40.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:39 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:40.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:39 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] boot 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/804045178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]: dispatch 2024-09-17T01:36:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]': finished 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: osdmap e20: 4 total, 3 up, 4 in 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:41.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:40 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3540365145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: osd.2 [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] boot 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:36:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/804045178' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1f2821a-8707-4d26-b7d0-cd992a7f1666"}]': finished 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: osdmap e20: 4 total, 3 up, 4 in 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:41.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:41.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:40 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3540365145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:36:42.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:41 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi082 2024-09-17T01:36:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:41 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi082 to 3946M 2024-09-17T01:36:42.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:41 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi082 2024-09-17T01:36:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:41 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi082 to 3946M 2024-09-17T01:36:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: pgmap v90: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: osdmap e21: 4 total, 3 up, 4 in 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:36:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: pgmap v90: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: osdmap e21: 4 total, 3 up, 4 in 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T01:36:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:44.393 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70784]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:36:44.393 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:44.393 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:44.393 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70784]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:44.393 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:36:44.393 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:44 smithi082 ceph-mon[28077]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T01:36:44.393 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:44.394 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:44 smithi082 ceph-mon[28077]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:44.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T01:36:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:44 smithi167 ceph-mon[35643]: osdmap e22: 4 total, 3 up, 4 in 2024-09-17T01:36:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:44 smithi167 ceph-mon[35643]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:44.661 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:36:44.661 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:44.661 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:44.661 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70787]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:44.925 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70790]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:36:44.926 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:44.926 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:44.926 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70790]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:45.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70796]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:36:45.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70796]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:45.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:45.188 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70796]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:45.188 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 ceph-mon[28077]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:36:45.189 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:45.189 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:45.189 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70793]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:36:45.189 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70793]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:45.189 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:45.189 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:36:44 smithi082 sudo[70793]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:45.444 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70799]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:36:45.445 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70799]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:45.445 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:45.445 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70799]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:45.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:45 smithi167 ceph-mon[35643]: osdmap e23: 4 total, 3 up, 4 in 2024-09-17T01:36:45.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:45 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:36:45.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:45 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:45.699 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70803]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:36:45.699 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70803]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:45.700 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:45.700 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70803]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:45.950 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70814]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:36:46.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:46.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:46.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:45 smithi082 sudo[70814]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:46.470 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T01:36:46.470 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:46.470 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:46.470 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40880]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:46.487 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:46.488+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fea08057f40 con 0x7fea14100860 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40956]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40956]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 sudo[40956]: pam_unix(sudo:session): session closed for user root 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:36:46.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:46 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:36:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:46 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:36:47.485 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:47 smithi082 ceph-mon[28077]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:36:47.485 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:47 smithi082 ceph-mon[28077]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:36:47.485 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:47 smithi082 ceph-mon[28077]: mgrmap e19: smithi082.oppacm(active, since 2m), standbys: smithi167.ysmbcy 2024-09-17T01:36:47.485 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:47 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:47.533 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:47 smithi167 ceph-mon[35643]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T01:36:47.533 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:47 smithi167 ceph-mon[35643]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T01:36:47.533 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:47 smithi167 ceph-mon[35643]: mgrmap e19: smithi082.oppacm(active, since 2m), standbys: smithi167.ysmbcy 2024-09-17T01:36:47.533 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:47 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:48.639 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:48 smithi167 ceph-mon[35643]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:48.760 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:48 smithi082 ceph-mon[28077]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:49.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:49 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:36:49.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:49 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:49.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:49 smithi167 ceph-mon[35643]: Deploying daemon osd.3 on smithi167 2024-09-17T01:36:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:49 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-17T01:36:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:49 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:49 smithi082 ceph-mon[28077]: Deploying daemon osd.3 on smithi167 2024-09-17T01:36:50.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:50 smithi167 ceph-mon[35643]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:50 smithi082 ceph-mon[28077]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:53.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:52 smithi082 ceph-mon[28077]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:53.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:52 smithi167 ceph-mon[35643]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:55.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:54 smithi167 ceph-mon[35643]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:54 smithi082 ceph-mon[28077]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:55.946 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:55 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:55.947 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:55 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:55.947 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:55 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:56.168 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:55 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:56.168 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:55 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:56.168 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:55 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:56 smithi167 ceph-mon[35643]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:56 smithi082 ceph-mon[28077]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:58.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:58.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:36:59.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.054 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.057+0000 7fea11ffb640 1 -- 172.21.15.167:0/2035179562 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fea14062630 con 0x7fea0406e280 2024-09-17T01:36:59.055 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 3 on host 'smithi167' 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 msgr2=0x7fea04070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 0x7fea04070740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea00000c00 tx=0x7fea000058d0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 msgr2=0x7fea141963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fea0800e940 tx=0x7fea0800ee00 comp rx=0 tx=0).stop 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 shutdown_connections 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea14101a60 0x7fea14196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fea0406e280 0x7fea04070740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 --2- 172.21.15.167:0/2035179562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea14100860 0x7fea141963f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 >> 172.21.15.167:0/2035179562 conn(0x7fea140fbff0 msgr2=0x7fea14104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 shutdown_connections 2024-09-17T01:36:59.057 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:36:59.059+0000 7fea1b08a640 1 -- 172.21.15.167:0/2035179562 wait complete. 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:36:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.675 DEBUG:teuthology.orchestra.run.smithi167:osd.3> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.3.service 2024-09-17T01:36:59.678 INFO:tasks.cephadm:Deploying osd.4 on smithi167 with /dev/vg_nvme/lv_3... 2024-09-17T01:36:59.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-17T01:36:59.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:59 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:36:59.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:59 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:36:59.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:36:59 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:00.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:00.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:00.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:36:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:00.476 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:37:01.149 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:00 smithi167 ceph-mon[35643]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:01.150 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:37:00 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:37:00.910+0000 7f5d20056640 -1 osd.3 0 log_to_monitors true 2024-09-17T01:37:01.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:00 smithi082 ceph-mon[28077]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:02.199 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:01 smithi167 ceph-mon[35643]: from='osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:37:02.199 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:01 smithi167 ceph-mon[35643]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:37:02.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:01 smithi082 ceph-mon[28077]: from='osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:37:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:01 smithi082 ceph-mon[28077]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: from='osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:03.078 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:02 smithi167 ceph-mon[35643]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: from='osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: osdmap e24: 4 total, 3 up, 4 in 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:02 smithi082 ceph-mon[28077]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:03.679 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:37:03.666+0000 7f5d1b7b6640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T01:37:03.679 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:37:03.671+0000 7f5d13de8640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:37:03.990 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:03.991 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:03 smithi167 ceph-mon[35643]: from='osd.3 ' entity='osd.3' 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: osdmap e25: 4 total, 3 up, 4 in 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:04.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:03 smithi082 ceph-mon[28077]: from='osd.3 ' entity='osd.3' 2024-09-17T01:37:04.864 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:37:04.893 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-09-17T01:37:05.143 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:37:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:37:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:37:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi167 2024-09-17T01:37:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi167 to 14912M 2024-09-17T01:37:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:05.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:05.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] boot 2024-09-17T01:37:05.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:37:05.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:05.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:04 smithi082 ceph-mon[28077]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:37:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:37:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi167 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi167 to 14912M 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: osd.3 [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] boot 2024-09-17T01:37:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: osdmap e26: 4 total, 4 up, 4 in 2024-09-17T01:37:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:37:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:04 smithi167 ceph-mon[35643]: osdmap e27: 4 total, 4 up, 4 in 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- 172.21.15.167:0/3869459969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c1024b0 msgr2=0x7ff67c1048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 --2- 172.21.15.167:0/3869459969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c1024b0 0x7ff67c1048a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009c20 tx=0x7ff66c02a970 comp rx=0 tx=0).stop 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- 172.21.15.167:0/3869459969 shutdown_connections 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 --2- 172.21.15.167:0/3869459969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c104de0 0x7ff67c1071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 --2- 172.21.15.167:0/3869459969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c1024b0 0x7ff67c1048a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- 172.21.15.167:0/3869459969 >> 172.21.15.167:0/3869459969 conn(0x7ff67c0fc010 msgr2=0x7ff67c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- 172.21.15.167:0/3869459969 shutdown_connections 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- 172.21.15.167:0/3869459969 wait complete. 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 Processor -- start 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- start start 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 0x7ff67c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10a7d0 con 0x7ff67c1024b0 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.600+0000 7ff682a76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10a650 con 0x7ff67c104de0 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:53966/0 (socket says 172.21.15.167:53966) 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 -- 172.21.15.167:0/612826857 learned_addr learned my addr 172.21.15.167:0/612826857 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T01:37:05.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff680812640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 0x7ff67c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 -- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 msgr2=0x7ff67c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 0x7ff67c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 -- 172.21.15.167:0/612826857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c19a2e0 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff680812640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 0x7ff67c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff67bfff640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff66400d6c0 tx=0x7ff66400db80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff664017070 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6640054e0 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c19ed20 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff664004b70 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.601+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c19f2d0 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.602+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c102890 con 0x7ff67c104de0 2024-09-17T01:37:05.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.603+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff664009820 con 0x7ff67c104de0 2024-09-17T01:37:05.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.603+0000 7ff679ffb640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 0x7ff668070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:05.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.603+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3803+0+0 (secure 0 0 0) 0x7ff66408d730 con 0x7ff67c104de0 2024-09-17T01:37:05.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.603+0000 7ff680812640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 0x7ff668070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:05.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.604+0000 7ff680812640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 0x7ff668070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff66c006010 tx=0x7ff66c0093f0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:05.618 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.608+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff66405b710 con 0x7ff67c104de0 2024-09-17T01:37:05.781 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:05.784+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff67c0626f0 con 0x7ff66806e2b0 2024-09-17T01:37:06.195 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:05 smithi167 ceph-mon[35643]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:37:06.196 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:05 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:37:06.196 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:05 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:37:06.196 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:05 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:05 smithi082 ceph-mon[28077]: osdmap e28: 4 total, 4 up, 4 in 2024-09-17T01:37:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:05 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:37:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:05 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:37:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:05 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:07.130 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:07 smithi167 ceph-mon[35643]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:07.130 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:07 smithi167 ceph-mon[35643]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:37:07.130 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:07 smithi167 ceph-mon[35643]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:37:07.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:07 smithi082 ceph-mon[28077]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:07.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:07 smithi082 ceph-mon[28077]: from='client.24195 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:37:07.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:07 smithi082 ceph-mon[28077]: osdmap e29: 4 total, 4 up, 4 in 2024-09-17T01:37:08.338 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:08 smithi167 ceph-mon[35643]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:37:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:08 smithi082 ceph-mon[28077]: osdmap e30: 4 total, 4 up, 4 in 2024-09-17T01:37:09.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3220497660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]: dispatch 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]: dispatch 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]': finished 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/4118547233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:37:09.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 151 KiB/s, 0 objects/s recovering 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3220497660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]: dispatch 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]: dispatch 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d085d4ea-eed4-4c73-aa6f-11405ff3d7c0"}]': finished 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: osdmap e31: 5 total, 4 up, 5 in 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:09.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:09 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/4118547233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:37:10.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:10 smithi082 ceph-mon[28077]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-17T01:37:10.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:10 smithi167 ceph-mon[35643]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-17T01:37:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:12 smithi082 ceph-mon[28077]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T01:37:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:13.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:12 smithi167 ceph-mon[35643]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-17T01:37:13.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:14.903 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:14 smithi167 ceph-mon[35643]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-17T01:37:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:14 smithi082 ceph-mon[28077]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-17T01:37:17.063 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:16 smithi167 ceph-mon[35643]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:17.064 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:37:17.064 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:16 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:17.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:16 smithi082 ceph-mon[28077]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:17.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-17T01:37:17.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:16 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:18.131 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:17 smithi167 ceph-mon[35643]: Deploying daemon osd.4 on smithi167 2024-09-17T01:37:18.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:17 smithi082 ceph-mon[28077]: Deploying daemon osd.4 on smithi167 2024-09-17T01:37:19.133 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:18 smithi167 ceph-mon[35643]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:19.184 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:18 smithi082 ceph-mon[28077]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:21.109 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:20 smithi167 ceph-mon[35643]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:21.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:20 smithi082 ceph-mon[28077]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:23.060 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:22 smithi167 ceph-mon[35643]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:23.060 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:22 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:23.060 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:22 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:23.060 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:22 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:22 smithi082 ceph-mon[28077]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:22 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:22 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:22 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:24.859 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:24 smithi167 ceph-mon[35643]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:24 smithi082 ceph-mon[28077]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:26.366 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.367+0000 7ff679ffb640 1 -- 172.21.15.167:0/612826857 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff67c0626f0 con 0x7ff66806e2b0 2024-09-17T01:37:26.366 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 4 on host 'smithi167' 2024-09-17T01:37:26.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 msgr2=0x7ff668070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:26.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 0x7ff668070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff66c006010 tx=0x7ff66c0093f0 comp rx=0 tx=0).stop 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 msgr2=0x7ff67c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff66400d6c0 tx=0x7ff66400db80 comp rx=0 tx=0).stop 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 shutdown_connections 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff66806e2b0 0x7ff668070770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff67c104de0 0x7ff67c199c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 --2- 172.21.15.167:0/612826857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff67c1024b0 0x7ff67c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 >> 172.21.15.167:0/612826857 conn(0x7ff67c0fc010 msgr2=0x7ff67c101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 shutdown_connections 2024-09-17T01:37:26.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:26.370+0000 7ff682a76640 1 -- 172.21.15.167:0/612826857 wait complete. 2024-09-17T01:37:27.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:27.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:26 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.055 DEBUG:teuthology.orchestra.run.smithi167:osd.4> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.4.service 2024-09-17T01:37:27.057 INFO:tasks.cephadm:Deploying osd.5 on smithi167 with /dev/vg_nvme/lv_2... 2024-09-17T01:37:27.057 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-17T01:37:27.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:26 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:27.936 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:28.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:28.722 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:37:29.117 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:28 smithi167 ceph-mon[35643]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:29.118 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:37:28 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:37:28.829+0000 7f47679ce640 -1 osd.4 0 log_to_monitors true 2024-09-17T01:37:29.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:28 smithi082 ceph-mon[28077]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:29 smithi167 ceph-mon[35643]: from='osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:37:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:29 smithi167 ceph-mon[35643]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:37:30.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:29 smithi082 ceph-mon[28077]: from='osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:37:30.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:29 smithi082 ceph-mon[28077]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-17T01:37:31.003 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:37:30.812+0000 7f476312e640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T01:37:31.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:37:30.819+0000 7f475f768640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:30 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: osdmap e32: 5 total, 4 up, 5 in 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:31.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:30 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:31.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-17T01:37:31.839 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-09-17T01:37:32.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi167 2024-09-17T01:37:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi167 to 7456M 2024-09-17T01:37:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:37:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:31 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:32.088 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi167 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi167 to 7456M 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: osdmap e33: 5 total, 4 up, 5 in 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:31 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 -- 172.21.15.167:0/3059727201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988100860 msgr2=0x7f1988100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 --2- 172.21.15.167:0/3059727201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988100860 0x7f1988100c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1978009880 tx=0x7f197802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:37:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 -- 172.21.15.167:0/3059727201 shutdown_connections 2024-09-17T01:37:32.507 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 --2- 172.21.15.167:0/3059727201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988101a60 0x7f1988101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 --2- 172.21.15.167:0/3059727201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988100860 0x7f1988100c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 -- 172.21.15.167:0/3059727201 >> 172.21.15.167:0/3059727201 conn(0x7f19880fc010 msgr2=0x7f19880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 -- 172.21.15.167:0/3059727201 shutdown_connections 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.503+0000 7f198ce80640 1 -- 172.21.15.167:0/3059727201 wait complete. 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 Processor -- start 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 -- start start 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 0x7f1988197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1988109680 con 0x7f1988100860 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.504+0000 7f198ce80640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1988109500 con 0x7f1988101a60 2024-09-17T01:37:32.508 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:50354/0 (socket says 172.21.15.167:50354) 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 -- 172.21.15.167:0/2065960202 learned_addr learned my addr 172.21.15.167:0/2065960202 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f198659c640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 0x7f1988197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 -- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 msgr2=0x7f1988197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 0x7f1988197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 -- 172.21.15.167:0/2065960202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19881980b0 con 0x7f1988101a60 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f198659c640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 0x7f1988197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f1985d9b640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c8a0 tx=0x7f197c00cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f197c0079b0 con 0x7f1988101a60 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198819cb20 con 0x7f1988101a60 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f197c007b50 con 0x7f1988101a60 2024-09-17T01:37:32.509 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f197c018700 con 0x7f1988101a60 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.505+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198819d080 con 0x7f1988101a60 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.507+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1988100c60 con 0x7f1988101a60 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.508+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f197c007d00 con 0x7f1988101a60 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.508+0000 7f19777fe640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 0x7f1970070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.508+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4206+0+0 (secure 0 0 0) 0x7f197c08e020 con 0x7f1988101a60 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.509+0000 7f198659c640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 0x7f1970070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:32.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.509+0000 7f198659c640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 0x7f1970070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978004ea0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:32.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.512+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f197c014030 con 0x7f1988101a60 2024-09-17T01:37:32.685 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:32.687+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f198806a950 con 0x7f197006e2b0 2024-09-17T01:37:33.103 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] boot 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:37:33.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:32 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: osd.4 [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] boot 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: osdmap e34: 5 total, 5 up, 5 in 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T01:37:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:32 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:34.125 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:33 smithi167 ceph-mon[35643]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:37:34.125 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:33 smithi167 ceph-mon[35643]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:37:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:33 smithi082 ceph-mon[28077]: from='client.24213 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:37:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:33 smithi082 ceph-mon[28077]: osdmap e35: 5 total, 5 up, 5 in 2024-09-17T01:37:35.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:34 smithi082 ceph-mon[28077]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:35.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:34 smithi167 ceph-mon[35643]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:36.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/3864565470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]: dispatch 2024-09-17T01:37:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]: dispatch 2024-09-17T01:37:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]': finished 2024-09-17T01:37:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:37:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/2290463949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/3864565470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]: dispatch 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]: dispatch 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3936a65-f8a9-4a0e-a424-c79118f7001c"}]': finished 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: osdmap e36: 6 total, 5 up, 6 in 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:36.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/2290463949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T01:37:37.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:36 smithi082 ceph-mon[28077]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:36 smithi167 ceph-mon[35643]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:39.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:38 smithi082 ceph-mon[28077]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:39.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:38 smithi167 ceph-mon[35643]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:41.129 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:40 smithi167 ceph-mon[35643]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:41.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:40 smithi082 ceph-mon[28077]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:43.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:42 smithi167 ceph-mon[35643]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:43.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:42 smithi082 ceph-mon[28077]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:44.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:37:44.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-17T01:37:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:44 smithi082 ceph-mon[28077]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:44 smithi082 ceph-mon[28077]: Deploying daemon osd.5 on smithi167 2024-09-17T01:37:45.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:44 smithi167 ceph-mon[35643]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:44 smithi167 ceph-mon[35643]: Deploying daemon osd.5 on smithi167 2024-09-17T01:37:47.164 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:46 smithi167 ceph-mon[35643]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:47.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:46 smithi082 ceph-mon[28077]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:49.130 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:48 smithi167 ceph-mon[35643]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:48 smithi082 ceph-mon[28077]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:49 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:49 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:49 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:50.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:49 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:50.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:49 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:50.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:49 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:51.148 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:50 smithi167 ceph-mon[35643]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:50 smithi082 ceph-mon[28077]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:52.900 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.902+0000 7f19777fe640 1 -- 172.21.15.167:0/2065960202 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f198806a950 con 0x7f197006e2b0 2024-09-17T01:37:52.900 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 5 on host 'smithi167' 2024-09-17T01:37:52.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 msgr2=0x7f1970070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 0x7f1970070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978004ea0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 msgr2=0x7f1988197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:52.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f197c00c8a0 tx=0x7f197c00cd60 comp rx=0 tx=0).stop 2024-09-17T01:37:52.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 shutdown_connections 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f197006e2b0 0x7f1970070770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1988101a60 0x7f1988197ac0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 --2- 172.21.15.167:0/2065960202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1988100860 0x7f1988197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 >> 172.21.15.167:0/2065960202 conn(0x7f19880fc010 msgr2=0x7f198806a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 shutdown_connections 2024-09-17T01:37:52.903 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:37:52.905+0000 7f198ce80640 1 -- 172.21.15.167:0/2065960202 wait complete. 2024-09-17T01:37:53.200 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:52 smithi167 ceph-mon[35643]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:53.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:52 smithi082 ceph-mon[28077]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:53.895 DEBUG:teuthology.orchestra.run.smithi167:osd.5> sudo journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.5.service 2024-09-17T01:37:53.897 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-17T01:37:53.897 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:37:54.156 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:37:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:53 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:53 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:54.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:53 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:53 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- 172.21.15.82:0/344473511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 msgr2=0x7f37d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 --2- 172.21.15.82:0/344473511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8100c60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009880 tx=0x7f37d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- 172.21.15.82:0/344473511 shutdown_connections 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 --2- 172.21.15.82:0/344473511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 0x7f37d8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 --2- 172.21.15.82:0/344473511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8100c60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- 172.21.15.82:0/344473511 >> 172.21.15.82:0/344473511 conn(0x7f37d80fc010 msgr2=0x7f37d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- 172.21.15.82:0/344473511 shutdown_connections 2024-09-17T01:37:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- 172.21.15.82:0/344473511 wait complete. 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 Processor -- start 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- start start 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 0x7f37d8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37d81096a0 con 0x7f37d8100860 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.613+0000 7f37df107640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8109520 con 0x7f37d8101a60 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56992/0 (socket says 172.21.15.82:56992) 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 -- 172.21.15.82:0/2476702128 learned_addr learned my addr 172.21.15.82:0/2476702128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37cffff640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 0x7f37d8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 -- 172.21.15.82:0/2476702128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 msgr2=0x7f37d8102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 0x7f37d8102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 -- 172.21.15.82:0/2476702128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8103380 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37dcea3640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006010 tx=0x7f37d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37d403f070 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d8103610 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37d4004a50 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.614+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37d4035030 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.615+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d8103b40 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.615+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d8100c60 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.616+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f37d4042070 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.617+0000 7f37cdffb640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 0x7f37c0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.617+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4321+0+0 (secure 0 0 0) 0x7f37d40ae800 con 0x7f37d8100860 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.617+0000 7f37cffff640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 0x7f37c0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:54.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.617+0000 7f37cffff640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 0x7f37c0070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37d8104500 tx=0x7f37c800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:54.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.622+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37d4004c00 con 0x7f37d8100860 2024-09-17T01:37:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.794+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f37d819fa70 con 0x7f37d8100860 2024-09-17T01:37:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.795+0000 7f37cdffb640 1 -- 172.21.15.82:0/2476702128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f37d4080280 con 0x7f37d8100860 2024-09-17T01:37:54.793 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:37:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 msgr2=0x7f37c0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 0x7f37c0070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37d8104500 tx=0x7f37c800b390 comp rx=0 tx=0).stop 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 msgr2=0x7f37d8104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f37d4006010 tx=0x7f37d40045e0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 shutdown_connections 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f37c006e2b0 0x7f37c0070770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37d8101a60 0x7f37d8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 --2- 172.21.15.82:0/2476702128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37d8100860 0x7f37d8104780 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 >> 172.21.15.82:0/2476702128 conn(0x7f37d80fc010 msgr2=0x7f37d8069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 shutdown_connections 2024-09-17T01:37:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:54.798+0000 7f37df107640 1 -- 172.21.15.82:0/2476702128 wait complete. 2024-09-17T01:37:55.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:54 smithi167 ceph-mon[35643]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:55.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:55.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:55.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:54 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2476702128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:37:55.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:54 smithi082 ceph-mon[28077]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:55.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2476702128' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:37:55.559 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726537051,"num_in_osds":6,"osd_in_since":1726537055,"num_remapped_pgs":0} 2024-09-17T01:37:56.360 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:37:56 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:37:56.105+0000 7f75c44d4640 -1 osd.5 0 log_to_monitors true 2024-09-17T01:37:56.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:37:56.815 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:37:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:56 smithi167 ceph-mon[35643]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:56 smithi167 ceph-mon[35643]: from='osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:37:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:56 smithi167 ceph-mon[35643]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:37:57.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:56 smithi082 ceph-mon[28077]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:57.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:56 smithi082 ceph-mon[28077]: from='osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:37:57.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:56 smithi082 ceph-mon[28077]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-17T01:37:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 -- 172.21.15.82:0/692637760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc100860 msgr2=0x7ff7fc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 --2- 172.21.15.82:0/692637760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc100860 0x7ff7fc100c60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009880 tx=0x7ff7ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 -- 172.21.15.82:0/692637760 shutdown_connections 2024-09-17T01:37:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 --2- 172.21.15.82:0/692637760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc101a60 0x7ff7fc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 --2- 172.21.15.82:0/692637760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc100860 0x7ff7fc100c60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 -- 172.21.15.82:0/692637760 >> 172.21.15.82:0/692637760 conn(0x7ff7fc0fc010 msgr2=0x7ff7fc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 -- 172.21.15.82:0/692637760 shutdown_connections 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 -- 172.21.15.82:0/692637760 wait complete. 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.283+0000 7ff8011ce640 1 Processor -- start 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff8011ce640 1 -- start start 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff8011ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc100860 0x7ff7fc196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff8011ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff8011ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc109700 con 0x7ff7fc101a60 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff8011ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7fc109580 con 0x7ff7fc100860 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34748/0 (socket says 172.21.15.82:34748) 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 -- 172.21.15.82:0/640026267 learned_addr learned my addr 172.21.15.82:0/640026267 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:37:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fad9d640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc100860 0x7ff7fc196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 -- 172.21.15.82:0/640026267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc100860 msgr2=0x7ff7fc196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc100860 0x7ff7fc196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 -- 172.21.15.82:0/640026267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7fc196ff0 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.284+0000 7ff7fa59c640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b420 tx=0x7ff7f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.285+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0011630 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.285+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7fc19ba30 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.285+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7f0016070 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.285+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0010d40 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.285+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7fc19c040 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.286+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7fc100c60 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.286+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff7f00117d0 con 0x7ff7fc101a60 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.287+0000 7ff7e3fff640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 0x7ff7e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.287+0000 7ff7fad9d640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 0x7ff7e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.287+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4342+0+0 (secure 0 0 0) 0x7ff7f008d550 con 0x7ff7fc101a60 2024-09-17T01:37:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.287+0000 7ff7fad9d640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 0x7ff7e4070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009230 tx=0x7ff7ec0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.291+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7f005b310 con 0x7ff7fc101a60 2024-09-17T01:37:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.454+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff7fc062df0 con 0x7ff7fc101a60 2024-09-17T01:37:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.454+0000 7ff7e3fff640 1 -- 172.21.15.82:0/640026267 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7ff7f005efc0 con 0x7ff7fc101a60 2024-09-17T01:37:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 msgr2=0x7ff7e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 0x7ff7e4070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009230 tx=0x7ff7ec0058d0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 msgr2=0x7ff7fc196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b420 tx=0x7ff7f000b8e0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 shutdown_connections 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7fc101a60 0x7ff7fc196970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff7e406e2b0 0x7ff7e4070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 --2- 172.21.15.82:0/640026267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc100860 0x7ff7fc196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 >> 172.21.15.82:0/640026267 conn(0x7ff7fc0fc010 msgr2=0x7ff7fc104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 shutdown_connections 2024-09-17T01:37:57.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:57.457+0000 7ff8011ce640 1 -- 172.21.15.82:0/640026267 wait complete. 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:58.071 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/640026267' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:58.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:57 smithi082 ceph-mon[28077]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:58.098 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726537051,"num_in_osds":6,"osd_in_since":1726537055,"num_remapped_pgs":0} 2024-09-17T01:37:58.253 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:37:57.913+0000 7f75bfc34640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T01:37:58.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:37:57.920+0000 7f75bc26e640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:37:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:37:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: osdmap e37: 6 total, 5 up, 6 in 2024-09-17T01:37:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:58.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/640026267' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:37:58.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:58.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:58.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:58.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:57 smithi167 ceph-mon[35643]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-17T01:37:59.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: Detected new or changed devices on smithi167 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi167 to 4970M 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: Detected new or changed devices on smithi167 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi167 to 4970M 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: osdmap e38: 6 total, 5 up, 6 in 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:37:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 -- 172.21.15.82:0/1574661343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54101a60 msgr2=0x7f7b54101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/1574661343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54101a60 0x7f7b54101ee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009880 tx=0x7f7b4402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 -- 172.21.15.82:0/1574661343 shutdown_connections 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/1574661343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54101a60 0x7f7b54101ee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/1574661343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54100860 0x7f7b54100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 -- 172.21.15.82:0/1574661343 >> 172.21.15.82:0/1574661343 conn(0x7f7b540fc010 msgr2=0x7f7b540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 -- 172.21.15.82:0/1574661343 shutdown_connections 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.821+0000 7f7b59bc2640 1 -- 172.21.15.82:0/1574661343 wait complete. 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 Processor -- start 2024-09-17T01:37:59.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 -- start start 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54101a60 0x7f7b541969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b54109720 con 0x7f7b54100860 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b59bc2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7b541095a0 con 0x7f7b54101a60 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.822+0000 7f7b537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34754/0 (socket says 172.21.15.82:34754) 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 -- 172.21.15.82:0/2901593923 learned_addr learned my addr 172.21.15.82:0/2901593923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b52ffd640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54101a60 0x7f7b541969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 -- 172.21.15.82:0/2901593923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54101a60 msgr2=0x7f7b541969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54101a60 0x7f7b541969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 -- 172.21.15.82:0/2901593923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b54197020 con 0x7f7b54100860 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b537fe640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800b3d0 tx=0x7f7b4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b48015020 con 0x7f7b54100860 2024-09-17T01:37:59.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b48011af0 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5419ba60 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b48010da0 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.823+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5419c070 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.824+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b54100c60 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.825+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7b48018020 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.825+0000 7f7b50ff9640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 0x7f7b3c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.825+0000 7f7b52ffd640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 0x7f7b3c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.825+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f7b4808d9e0 con 0x7f7b54100860 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.826+0000 7f7b52ffd640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 0x7f7b3c070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b54197910 tx=0x7f7b44005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:37:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.830+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b4801f020 con 0x7f7b54100860 2024-09-17T01:37:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.999+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7b54190530 con 0x7f7b54100860 2024-09-17T01:37:59.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:59 smithi082 ceph-mon[28077]: purged_snaps scrub starts 2024-09-17T01:37:59.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:59 smithi082 ceph-mon[28077]: purged_snaps scrub ok 2024-09-17T01:37:59.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:59 smithi082 ceph-mon[28077]: osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] boot 2024-09-17T01:37:59.998 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:59 smithi082 ceph-mon[28077]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:37:59.999 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:37:59 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:37:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:37:59.999+0000 7f7b50ff9640 1 -- 172.21.15.82:0/2901593923 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7f7b4805b680 con 0x7f7b54100860 2024-09-17T01:37:59.999 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.001+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 msgr2=0x7f7b3c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.001+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 0x7f7b3c070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7b54197910 tx=0x7f7b44005a20 comp rx=0 tx=0).stop 2024-09-17T01:38:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.001+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 msgr2=0x7f7b54196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.001+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800b3d0 tx=0x7f7b4800b890 comp rx=0 tx=0).stop 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 shutdown_connections 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7b3c06e2b0 0x7f7b3c070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b54101a60 0x7f7b541969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 --2- 172.21.15.82:0/2901593923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b54100860 0x7f7b54196460 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 >> 172.21.15.82:0/2901593923 conn(0x7f7b540fc010 msgr2=0x7f7b54104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 shutdown_connections 2024-09-17T01:38:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:00.002+0000 7f7b59bc2640 1 -- 172.21.15.82:0/2901593923 wait complete. 2024-09-17T01:38:00.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:59 smithi167 ceph-mon[35643]: purged_snaps scrub starts 2024-09-17T01:38:00.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:59 smithi167 ceph-mon[35643]: purged_snaps scrub ok 2024-09-17T01:38:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:59 smithi167 ceph-mon[35643]: osd.5 [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] boot 2024-09-17T01:38:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:59 smithi167 ceph-mon[35643]: osdmap e39: 6 total, 6 up, 6 in 2024-09-17T01:38:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:37:59 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:38:00.682 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726537078,"num_in_osds":6,"osd_in_since":1726537055,"num_remapped_pgs":0} 2024-09-17T01:38:00.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:38:00.933 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:01.186 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:00 smithi082 ceph-mon[28077]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:38:01.186 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:00 smithi082 ceph-mon[28077]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:38:01.186 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:00 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2901593923' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:38:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:00 smithi167 ceph-mon[35643]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-17T01:38:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:00 smithi167 ceph-mon[35643]: osdmap e40: 6 total, 6 up, 6 in 2024-09-17T01:38:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:00 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2901593923' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T01:38:01.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.369+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2293900566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c1033d0 msgr2=0x7f3b9c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.369+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2293900566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c10b8c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3b84009880 tx=0x7f3b8402a530 comp rx=0 tx=0).stop 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2293900566 shutdown_connections 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2293900566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c10b8c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2293900566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2293900566 >> 172.21.15.82:0/2293900566 conn(0x7f3b9c0fc550 msgr2=0x7f3b9c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2293900566 shutdown_connections 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2293900566 wait complete. 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 Processor -- start 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 -- start start 2024-09-17T01:38:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.370+0000 7f3ba1a63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3ba1a63640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3ba1a63640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c10ee40 con 0x7f3b9c102ab0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3ba1a63640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c10ecc0 con 0x7f3b9c1033d0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34764/0 (socket says 172.21.15.82:34764) 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 -- 172.21.15.82:0/2267728269 learned_addr learned my addr 172.21.15.82:0/2267728269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b92ffd640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 -- 172.21.15.82:0/2267728269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c1033d0 msgr2=0x7f3b9c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 -- 172.21.15.82:0/2267728269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9c101190 con 0x7f3b9c102ab0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b9b7fe640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b420 tx=0x7f3b8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c011630 con 0x7f3b9c102ab0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9c101480 con 0x7f3b9c102ab0 2024-09-17T01:38:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b8c016070 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b8c010d40 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.371+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9c1a3eb0 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.372+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9c06a580 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.373+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3b8c0117d0 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.373+0000 7f3b997fa640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 0x7f3b88070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.373+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3b8c08d6c0 con 0x7f3b9c102ab0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.373+0000 7f3b92ffd640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 0x7f3b88070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.374+0000 7f3b92ffd640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 0x7f3b88070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c1021a0 tx=0x7f3b84031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.378+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b8c05b360 con 0x7f3b9c102ab0 2024-09-17T01:38:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.548+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b9c105f50 con 0x7f3b9c102ab0 2024-09-17T01:38:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.549+0000 7f3b997fa640 1 -- 172.21.15.82:0/2267728269 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11379 (secure 0 0 0) 0x7f3b8c05f010 con 0x7f3b9c102ab0 2024-09-17T01:38:01.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:01.549 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","created":"2024-09-17T01:31:55.651630+0000","modified":"2024-09-17T01:37:59.928862+0000","last_up_change":"2024-09-17T01:37:58.922945+0000","last_in_change":"2024-09-17T01:37:35.113358+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:36:41.984837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03ff4c08-397d-49ac-bf57-3c6e64d6bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6803","nonce":30662635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6805","nonce":30662635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6809","nonce":30662635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6807","nonce":30662635}]},"public_addr":"172.21.15.82:6803/30662635","cluster_addr":"172.21.15.82:6805/30662635","heartbeat_back_addr":"172.21.15.82:6809/30662635","heartbeat_front_addr":"172.21.15.82:6807/30662635","state":["exists","up"]},{"osd":1,"uuid":"1f3aef62-e035-4cf4-987d-38627317e3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6811","nonce":1048454994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6813","nonce":1048454994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6817","nonce":1048454994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6815","nonce":1048454994}]},"public_addr":"172.21.15.82:6811/1048454994","cluster_addr":"172.21.15.82:6813/1048454994","heartbeat_back_addr":"172.21.15.82:6817/1048454994","heartbeat_front_addr":"172.21.15.82:6815/1048454994","state":["exists","up"]},{"osd":2,"uuid":"908e9713-c4f0-46d5-b936-7624a57b9d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6819","nonce":1028719015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6821","nonce":1028719015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6825","nonce":1028719015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6823","nonce":1028719015}]},"public_addr":"172.21.15.82:6819/1028719015","cluster_addr":"172.21.15.82:6821/1028719015","heartbeat_back_addr":"172.21.15.82:6825/1028719015","heartbeat_front_addr":"172.21.15.82:6823/1028719015","state":["exists","up"]},{"osd":3,"uuid":"c1f2821a-8707-4d26-b7d0-cd992a7f1666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6801","nonce":2675572651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6803","nonce":2675572651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6807","nonce":2675572651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6805","nonce":2675572651}]},"public_addr":"172.21.15.167:6801/2675572651","cluster_addr":"172.21.15.167:6803/2675572651","heartbeat_back_addr":"172.21.15.167:6807/2675572651","heartbeat_front_addr":"172.21.15.167:6805/2675572651","state":["exists","up"]},{"osd":4,"uuid":"d085d4ea-eed4-4c73-aa6f-11405ff3d7c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6809","nonce":1328422628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6811","nonce":1328422628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6815","nonce":1328422628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6813","nonce":1328422628}]},"public_addr":"172.21.15.167:6809/1328422628","cluster_addr":"172.21.15.167:6811/1328422628","heartbeat_back_addr":"172.21.15.167:6815/1328422628","heartbeat_front_addr":"172.21.15.167:6813/1328422628","state":["exists","up"]},{"osd":5,"uuid":"a3936a65-f8a9-4a0e-a424-c79118f7001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6817","nonce":3021386234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6819","nonce":3021386234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6823","nonce":3021386234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6821","nonce":3021386234}]},"public_addr":"172.21.15.167:6817/3021386234","cluster_addr":"172.21.15.167:6819/3021386234","heartbeat_back_addr":"172.21.15.167:6823/3021386234","heartbeat_front_addr":"172.21.15.167:6821/3021386234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:35:39.797241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:09.017486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:37.894244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:01.951295+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:29.881677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:57.142088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3909622984":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/2272978570":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/3700370565":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3743181164":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/826200596":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/1750461309":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3572739181":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/198027229":"2024-09-18T01:32:57.360758+0000","172.21.15.82:6801/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:0/3595010788":"2024-09-18T01:33:57.671331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 msgr2=0x7f3b88070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 0x7f3b88070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c1021a0 tx=0x7f3b84031400 comp rx=0 tx=0).stop 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 msgr2=0x7f3b9c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00b420 tx=0x7f3b8c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 shutdown_connections 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f3b8806e2b0 0x7f3b88070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b9c1033d0 0x7f3b9c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 --2- 172.21.15.82:0/2267728269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b9c102ab0 0x7f3b9c100710 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 >> 172.21.15.82:0/2267728269 conn(0x7f3b9c0fc550 msgr2=0x7f3b9c108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 shutdown_connections 2024-09-17T01:38:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:01.552+0000 7f3ba1a63640 1 -- 172.21.15.82:0/2267728269 wait complete. 2024-09-17T01:38:02.209 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:01 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2267728269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:02.237 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T01:36:41.984837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T01:38:02.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T01:38:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:01 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2267728269' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:02.483 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:02.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- 172.21.15.82:0/3549230741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101900 msgr2=0x7f83dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 --2- 172.21.15.82:0/3549230741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101900 0x7f83dc101d60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009880 tx=0x7f83c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- 172.21.15.82:0/3549230741 shutdown_connections 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 --2- 172.21.15.82:0/3549230741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc101900 0x7f83dc101d60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 --2- 172.21.15.82:0/3549230741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc107900 0x7f83dc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- 172.21.15.82:0/3549230741 >> 172.21.15.82:0/3549230741 conn(0x7f83dc0fd600 msgr2=0x7f83dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- 172.21.15.82:0/3549230741 shutdown_connections 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- 172.21.15.82:0/3549230741 wait complete. 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 Processor -- start 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.980+0000 7f83e2f44640 1 -- start start 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e2f44640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 0x7f83dc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e2f44640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e2f44640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10ee30 con 0x7f83dc107900 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e2f44640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc10ecb0 con 0x7f83dc101900 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34794/0 (socket says 172.21.15.82:34794) 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 -- 172.21.15.82:0/478061164 learned_addr learned my addr 172.21.15.82:0/478061164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e0ce0640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 0x7f83dc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 -- 172.21.15.82:0/478061164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 msgr2=0x7f83dc19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 0x7f83dc19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 -- 172.21.15.82:0/478061164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc197840 con 0x7f83dc107900 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e0ce0640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 0x7f83dc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83dbfff640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f83c8031460 tx=0x7f83c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83c803f070 con 0x7f83dc107900 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83c8004cf0 con 0x7f83dc107900 2024-09-17T01:38:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc197ad0 con 0x7f83dc107900 2024-09-17T01:38:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.981+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83c8035030 con 0x7f83dc107900 2024-09-17T01:38:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.982+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc198000 con 0x7f83dc107900 2024-09-17T01:38:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.983+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc103040 con 0x7f83dc107900 2024-09-17T01:38:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.983+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f83c8042070 con 0x7f83dc107900 2024-09-17T01:38:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.983+0000 7f83d9ffb640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.984+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f83c80ae910 con 0x7f83dc107900 2024-09-17T01:38:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.984+0000 7f83e0ce0640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.984+0000 7f83e0ce0640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 0x7f83cc070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009930 tx=0x7f83d0008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:02.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:02.988+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83c807c5b0 con 0x7f83dc107900 2024-09-17T01:38:03.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.151+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f83dc198d70 con 0x7f83dc107900 2024-09-17T01:38:03.151 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:02 smithi082 ceph-mon[28077]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:03.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.152+0000 7f83d9ffb640 1 -- 172.21.15.82:0/478061164 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f83c8080260 con 0x7f83dc107900 2024-09-17T01:38:03.151 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-09-17T01:38:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 msgr2=0x7f83cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 0x7f83cc070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009930 tx=0x7f83d0008040 comp rx=0 tx=0).stop 2024-09-17T01:38:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 msgr2=0x7f83dc19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f83c8031460 tx=0x7f83c80048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 shutdown_connections 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83dc107900 0x7f83dc19dc00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f83cc06e2b0 0x7f83cc070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 --2- 172.21.15.82:0/478061164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc101900 0x7f83dc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 >> 172.21.15.82:0/478061164 conn(0x7f83dc0fd600 msgr2=0x7f83dc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 shutdown_connections 2024-09-17T01:38:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:03.155+0000 7f83e2f44640 1 -- 172.21.15.82:0/478061164 wait complete. 2024-09-17T01:38:03.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:02 smithi167 ceph-mon[35643]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:03.843 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T01:38:03.844 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:38:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:04.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:03 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/478061164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:38:04.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:03 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/478061164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T01:38:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- 172.21.15.82:0/3198404563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c102b50 msgr2=0x7f7d4c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 --2- 172.21.15.82:0/3198404563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c102b50 0x7f7d4c102fd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009880 tx=0x7f7d3402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- 172.21.15.82:0/3198404563 shutdown_connections 2024-09-17T01:38:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 --2- 172.21.15.82:0/3198404563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c102b50 0x7f7d4c102fd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 --2- 172.21.15.82:0/3198404563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c101950 0x7f7d4c101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- 172.21.15.82:0/3198404563 >> 172.21.15.82:0/3198404563 conn(0x7f7d4c0fd100 msgr2=0x7f7d4c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- 172.21.15.82:0/3198404563 shutdown_connections 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- 172.21.15.82:0/3198404563 wait complete. 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 Processor -- start 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- start start 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 0x7f7d4c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c10a790 con 0x7f7d4c101950 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.525+0000 7f7d52f04640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c10a610 con 0x7f7d4c102b50 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34822/0 (socket says 172.21.15.82:34822) 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 -- 172.21.15.82:0/4067008574 learned_addr learned my addr 172.21.15.82:0/4067008574 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:04.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d4bfff640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 0x7f7d4c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 -- 172.21.15.82:0/4067008574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 msgr2=0x7f7d4c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 0x7f7d4c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 -- 172.21.15.82:0/4067008574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c198060 con 0x7f7d4c101950 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d4bfff640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 0x7f7d4c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d50ca0640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00cc30 tx=0x7f7d3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d3c00cd20 con 0x7f7d4c101950 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d3c003990 con 0x7f7d4c101950 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c19caa0 con 0x7f7d4c101950 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d3c004740 con 0x7f7d4c101950 2024-09-17T01:38:04.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.526+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c19d030 con 0x7f7d4c101950 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.527+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c101d50 con 0x7f7d4c101950 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.528+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7d3c003b40 con 0x7f7d4c101950 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.528+0000 7f7d49ffb640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 0x7f7d38070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.528+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f7d3c08e110 con 0x7f7d4c101950 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.528+0000 7f7d4bfff640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 0x7f7d38070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:04.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.529+0000 7f7d4bfff640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 0x7f7d38070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d340096c0 tx=0x7f7d34009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:04.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.533+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d3c014030 con 0x7f7d4c101950 2024-09-17T01:38:04.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.761+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7d4c1915a0 con 0x7f7d4c101950 2024-09-17T01:38:04.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.762+0000 7f7d49ffb640 1 -- 172.21.15.82:0/4067008574 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f7d3c05bdb0 con 0x7f7d4c101950 2024-09-17T01:38:04.761 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-09-17T01:38:04.761 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQB83ehmfMx/LRAAsi3ls8tmur1YBrh5apAdbQ== 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 msgr2=0x7f7d38070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 0x7f7d38070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7d340096c0 tx=0x7f7d34009650 comp rx=0 tx=0).stop 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 msgr2=0x7f7d4c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00cc30 tx=0x7f7d3c00a620 comp rx=0 tx=0).stop 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 shutdown_connections 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7d3806e2b0 0x7f7d38070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d4c102b50 0x7f7d4c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 --2- 172.21.15.82:0/4067008574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d4c101950 0x7f7d4c1974a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 >> 172.21.15.82:0/4067008574 conn(0x7f7d4c0fd100 msgr2=0x7f7d4c105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:04.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 shutdown_connections 2024-09-17T01:38:04.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:04.765+0000 7f7d52f04640 1 -- 172.21.15.82:0/4067008574 wait complete. 2024-09-17T01:38:05.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:04 smithi082 ceph-mon[28077]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:05.138 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:04 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4067008574' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:05.139 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:04 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4067008574' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:38:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:04 smithi167 ceph-mon[35643]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:04 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4067008574' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:04 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4067008574' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:38:05.508 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:38:05.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T01:38:05.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T01:38:05.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T01:38:05.814 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi167/config 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 -- 172.21.15.167:0/2384378415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8101a60 msgr2=0x7fdec8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 --2- 172.21.15.167:0/2384378415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8101a60 0x7fdec8101ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009880 tx=0x7fdebc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 -- 172.21.15.167:0/2384378415 shutdown_connections 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 --2- 172.21.15.167:0/2384378415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8101a60 0x7fdec8101ee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 --2- 172.21.15.167:0/2384378415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8100860 0x7fdec8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 -- 172.21.15.167:0/2384378415 >> 172.21.15.167:0/2384378415 conn(0x7fdec80fc010 msgr2=0x7fdec80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 -- 172.21.15.167:0/2384378415 shutdown_connections 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.259+0000 7fdece70d640 1 -- 172.21.15.167:0/2384378415 wait complete. 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 Processor -- start 2024-09-17T01:38:06.259 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 -- start start 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8101a60 0x7fdec819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdec81096a0 con 0x7fdec8101a60 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdece70d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8109520 con 0x7fdec8100860 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:49696/0 (socket says 172.21.15.167:49696) 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec7fff640 1 -- 172.21.15.167:0/358367379 learned_addr learned my addr 172.21.15.167:0/358367379 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec77fe640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8101a60 0x7fdec819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec7fff640 1 -- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8101a60 msgr2=0x7fdec819c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.260+0000 7fdec7fff640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8101a60 0x7fdec819c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdec7fff640 1 -- 172.21.15.167:0/358367379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec819c800 con 0x7fdec8100860 2024-09-17T01:38:06.260 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdec7fff640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800d900 tx=0x7fdeb800ddc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb8017070 con 0x7fdec8100860 2024-09-17T01:38:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdeb8010460 con 0x7fdec8100860 2024-09-17T01:38:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec819caf0 con 0x7fdec8100860 2024-09-17T01:38:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdeb800f5f0 con 0x7fdec8100860 2024-09-17T01:38:06.261 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.261+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec819d050 con 0x7fdec8100860 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.262+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec8100c60 con 0x7fdec8100860 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.262+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdeb801a070 con 0x7fdec8100860 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.263+0000 7fdec57fa640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 0x7fdeb0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.263+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fdeb808da80 con 0x7fdec8100860 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.263+0000 7fdec77fe640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 0x7fdeb0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:06.262 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.263+0000 7fdec77fe640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 0x7fdeb0070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdebc000c00 tx=0x7fdebc0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.267+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdeb805f340 con 0x7fdec8100860 2024-09-17T01:38:06.494 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.496+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdec81904b0 con 0x7fdec8100860 2024-09-17T01:38:06.501 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.503+0000 7fdec57fa640 1 -- 172.21.15.167:0/358367379 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7fdeb8063b70 con 0x7fdec8100860 2024-09-17T01:38:06.501 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2024-09-17T01:38:06.501 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB+3ehmqIqzHRAAJeQmchfZ48HqUHbueOsevg== 2024-09-17T01:38:06.504 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 msgr2=0x7fdeb0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 0x7fdeb0070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdebc000c00 tx=0x7fdebc0058d0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 msgr2=0x7fdec806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800d900 tx=0x7fdeb800ddc0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 shutdown_connections 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdec8101a60 0x7fdec819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdeb006e2b0 0x7fdeb0070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 --2- 172.21.15.167:0/358367379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec8100860 0x7fdec806aca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 >> 172.21.15.167:0/358367379 conn(0x7fdec80fc010 msgr2=0x7fdec8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 shutdown_connections 2024-09-17T01:38:06.505 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:38:06.507+0000 7fdece70d640 1 -- 172.21.15.167:0/358367379 wait complete. 2024-09-17T01:38:07.154 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:06 smithi167 ceph-mon[35643]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:07.154 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:06 smithi167 ceph-mon[35643]: from='client.? 172.21.15.167:0/358367379' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:07.154 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:06 smithi167 ceph-mon[35643]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:07.154 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:06 smithi167 ceph-mon[35643]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:38:07.182 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:38:07.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T01:38:07.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T01:38:07.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:06 smithi082 ceph-mon[28077]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:06 smithi082 ceph-mon[28077]: from='client.? 172.21.15.167:0/358367379' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:06 smithi082 ceph-mon[28077]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T01:38:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:06 smithi082 ceph-mon[28077]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T01:38:07.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-17T01:38:07.473 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 -- 172.21.15.82:0/4284935865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701067f0 msgr2=0x7f0870106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 --2- 172.21.15.82:0/4284935865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701067f0 0x7f0870106bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0860009880 tx=0x7f086002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 -- 172.21.15.82:0/4284935865 shutdown_connections 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 --2- 172.21.15.82:0/4284935865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701007f0 0x7f0870100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 --2- 172.21.15.82:0/4284935865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701067f0 0x7f0870106bd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 -- 172.21.15.82:0/4284935865 >> 172.21.15.82:0/4284935865 conn(0x7f08700fc550 msgr2=0x7f08700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 -- 172.21.15.82:0/4284935865 shutdown_connections 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.915+0000 7f0875ba7640 1 -- 172.21.15.82:0/4284935865 wait complete. 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 Processor -- start 2024-09-17T01:38:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 -- start start 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 0x7f087019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f087010dd20 con 0x7f08701007f0 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0875ba7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f087010dba0 con 0x7f08701067f0 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39904/0 (socket says 172.21.15.82:39904) 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 -- 172.21.15.82:0/1698905534 learned_addr learned my addr 172.21.15.82:0/1698905534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0867fff640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 0x7f087019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 -- 172.21.15.82:0/1698905534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 msgr2=0x7f087019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 0x7f087019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 -- 172.21.15.82:0/1698905534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870199a20 con 0x7f08701007f0 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f0867fff640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 0x7f087019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086f7fe640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0860031460 tx=0x7f08600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.916+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f086003f070 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.917+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0860004cf0 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.917+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0870199cb0 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.917+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0860035030 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.917+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087019a1e0 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.918+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0870101f30 con 0x7f08701007f0 2024-09-17T01:38:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.918+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0860042070 con 0x7f08701007f0 2024-09-17T01:38:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.919+0000 7f086d7fa640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 0x7f085c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.919+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f08600ae840 con 0x7f08701007f0 2024-09-17T01:38:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.919+0000 7f0867fff640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 0x7f085c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.919+0000 7f0867fff640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 0x7f085c0707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0870105dd0 tx=0x7f0858008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:07.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:07.923+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f086007c560 con 0x7f08701007f0 2024-09-17T01:38:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.093+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f087019afe0 con 0x7f08701007f0 2024-09-17T01:38:08.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.093+0000 7f086d7fa640 1 -- 172.21.15.82:0/1698905534 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v42) ==== 86+0+187 (secure 0 0 0) 0x7f0860080210 con 0x7f08701007f0 2024-09-17T01:38:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:08.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.095+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 msgr2=0x7f085c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:08.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.095+0000 7f0875ba7640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 0x7f085c0707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0870105dd0 tx=0x7f0858008040 comp rx=0 tx=0).stop 2024-09-17T01:38:08.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.095+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 msgr2=0x7f087019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.095+0000 7f0875ba7640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0860031460 tx=0x7f08600048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 shutdown_connections 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f085c06e310 0x7f085c0707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08701067f0 0x7f087019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 --2- 172.21.15.82:0/1698905534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08701007f0 0x7f087019f860 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 >> 172.21.15.82:0/1698905534 conn(0x7f08700fc550 msgr2=0x7f0870069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 shutdown_connections 2024-09-17T01:38:08.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:08.096+0000 7f0875ba7640 1 -- 172.21.15.82:0/1698905534 wait complete. 2024-09-17T01:38:08.830 INFO:teuthology.orchestra.run.smithi082.stdout:[{"version":42,"timestamp":"2024-09-17T01:37:57.900901+0000","name":"","changes":[{"name":"osd/host:smithi167/osd_memory_target","previous_value":"7818245939","new_value":"5212163959"}]}] 2024-09-17T01:38:08.831 INFO:tasks.ceph_manager:config epoch is 42 2024-09-17T01:38:08.831 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T01:38:08.831 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T01:38:08.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T01:38:09.080 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:09.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:08 smithi082 ceph-mon[28077]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:09.201 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:08 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1698905534' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-17T01:38:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:08 smithi167 ceph-mon[35643]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:08 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1698905534' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-17T01:38:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 -- 172.21.15.82:0/2212452372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 msgr2=0x7fb144106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/2212452372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144106be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb140009880 tx=0x7fb14002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 -- 172.21.15.82:0/2212452372 shutdown_connections 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/2212452372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/2212452372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144106be0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 -- 172.21.15.82:0/2212452372 >> 172.21.15.82:0/2212452372 conn(0x7fb1440fc520 msgr2=0x7fb1440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 -- 172.21.15.82:0/2212452372 shutdown_connections 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.512+0000 7fb14bc9d640 1 -- 172.21.15.82:0/2212452372 wait complete. 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 Processor -- start 2024-09-17T01:38:09.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 -- start start 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410dd30 con 0x7fb144106800 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb14bc9d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb14410dbb0 con 0x7fb144100800 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39922/0 (socket says 172.21.15.82:39922) 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 -- 172.21.15.82:0/3978414415 learned_addr learned my addr 172.21.15.82:0/3978414415 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149a39640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 -- 172.21.15.82:0/3978414415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 msgr2=0x7fb144198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149238640 1 -- 172.21.15.82:0/3978414415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb144199380 con 0x7fb144106800 2024-09-17T01:38:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.513+0000 7fb149a39640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb149238640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b420 tx=0x7fb13400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb134011630 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb134016070 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb144199670 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb134010d40 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.514+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1441a1c70 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.515+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb144101f40 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.515+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb13401b460 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.516+0000 7fb13affd640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 0x7fb130070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.516+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fb13408d680 con 0x7fb144106800 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.516+0000 7fb149a39640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 0x7fb130070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.516+0000 7fb149a39640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 0x7fb130070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb140031460 tx=0x7fb140004280 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.520+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb144199670 con 0x7fb144106800 2024-09-17T01:38:09.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.729+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb144108d70 con 0x7fb144106800 2024-09-17T01:38:09.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.732+0000 7fb13affd640 1 -- 172.21.15.82:0/3978414415 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176564 (secure 0 0 0) 0x7fb13405b320 con 0x7fb144106800 2024-09-17T01:38:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 msgr2=0x7fb130070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 0x7fb130070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb140031460 tx=0x7fb140004280 comp rx=0 tx=0).stop 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 msgr2=0x7fb144198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb13400b420 tx=0x7fb13400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 shutdown_connections 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb144106800 0x7fb144198d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb13006e2b0 0x7fb130070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 --2- 172.21.15.82:0/3978414415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb144100800 0x7fb144198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 >> 172.21.15.82:0/3978414415 conn(0x7fb1440fc520 msgr2=0x7fb1440fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 shutdown_connections 2024-09-17T01:38:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:09.735+0000 7fb14bc9d640 1 -- 172.21.15.82:0/3978414415 wait complete. 2024-09-17T01:38:10.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3978414415' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:38:10.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:09 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3978414415' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T01:38:10.361 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"flags":0,"active_gid":14221,"active_name":"smithi082.oppacm","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2005389412},{"type":"v1","addr":"172.21.15.82:6801","nonce":2005389412}]},"active_addr":"172.21.15.82:6801/2005389412","active_change":"2024-09-17T01:33:57.671483+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14246,"name":"smithi167.ysmbcy","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/","prometheus":"http://172.21.15.82:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2107408052}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1573881497}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1654346047}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":91177004}]}]} 2024-09-17T01:38:10.367 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T01:38:10.368 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T01:38:10.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:38:10.615 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:11.029 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:10 smithi082 ceph-mon[28077]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 -- 172.21.15.82:0/901195508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41067f0 msgr2=0x7ff8d4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/901195508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41067f0 0x7ff8d4106bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009880 tx=0x7ff8c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 -- 172.21.15.82:0/901195508 shutdown_connections 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/901195508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41007f0 0x7ff8d4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/901195508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41067f0 0x7ff8d4106bd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 -- 172.21.15.82:0/901195508 >> 172.21.15.82:0/901195508 conn(0x7ff8d40fc550 msgr2=0x7ff8d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 -- 172.21.15.82:0/901195508 shutdown_connections 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.110+0000 7ff8d9e39640 1 -- 172.21.15.82:0/901195508 wait complete. 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 Processor -- start 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 -- start start 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41067f0 0x7ff8d4198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410dd20 con 0x7ff8d41007f0 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d9e39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d410dba0 con 0x7ff8d41067f0 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39946/0 (socket says 172.21.15.82:39946) 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d37fe640 1 -- 172.21.15.82:0/4066946183 learned_addr learned my addr 172.21.15.82:0/4066946183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.111+0000 7ff8d2ffd640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41067f0 0x7ff8d4198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d37fe640 1 -- 172.21.15.82:0/4066946183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41067f0 msgr2=0x7ff8d4198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d37fe640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41067f0 0x7ff8d4198e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d37fe640 1 -- 172.21.15.82:0/4066946183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d41994c0 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d37fe640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4031460 tx=0x7ff8c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8c403f070 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8c4004cf0 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d4199750 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8c4035030 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.112+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d41a1d00 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.113+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4101f30 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.113+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff8c4042070 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.114+0000 7ff8d0ff9640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 0x7ff8bc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.114+0000 7ff8d2ffd640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 0x7ff8bc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.114+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7ff8c40ae890 con 0x7ff8d41007f0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.114+0000 7ff8d2ffd640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 0x7ff8bc0707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8d406a830 tx=0x7ff8c8008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.118+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c407c5b0 con 0x7ff8d41007f0 2024-09-17T01:38:11.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:10 smithi167 ceph-mon[35643]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:11.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.285+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8d406a2d0 con 0x7ff8d41007f0 2024-09-17T01:38:11.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.285+0000 7ff8d0ff9640 1 -- 172.21.15.82:0/4066946183 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11379 (secure 0 0 0) 0x7ff8c4080260 con 0x7ff8d41007f0 2024-09-17T01:38:11.283 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:11.283 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","created":"2024-09-17T01:31:55.651630+0000","modified":"2024-09-17T01:37:59.928862+0000","last_up_change":"2024-09-17T01:37:58.922945+0000","last_in_change":"2024-09-17T01:37:35.113358+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:36:41.984837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03ff4c08-397d-49ac-bf57-3c6e64d6bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6803","nonce":30662635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6805","nonce":30662635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6809","nonce":30662635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6807","nonce":30662635}]},"public_addr":"172.21.15.82:6803/30662635","cluster_addr":"172.21.15.82:6805/30662635","heartbeat_back_addr":"172.21.15.82:6809/30662635","heartbeat_front_addr":"172.21.15.82:6807/30662635","state":["exists","up"]},{"osd":1,"uuid":"1f3aef62-e035-4cf4-987d-38627317e3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6811","nonce":1048454994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6813","nonce":1048454994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6817","nonce":1048454994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6815","nonce":1048454994}]},"public_addr":"172.21.15.82:6811/1048454994","cluster_addr":"172.21.15.82:6813/1048454994","heartbeat_back_addr":"172.21.15.82:6817/1048454994","heartbeat_front_addr":"172.21.15.82:6815/1048454994","state":["exists","up"]},{"osd":2,"uuid":"908e9713-c4f0-46d5-b936-7624a57b9d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6819","nonce":1028719015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6821","nonce":1028719015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6825","nonce":1028719015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6823","nonce":1028719015}]},"public_addr":"172.21.15.82:6819/1028719015","cluster_addr":"172.21.15.82:6821/1028719015","heartbeat_back_addr":"172.21.15.82:6825/1028719015","heartbeat_front_addr":"172.21.15.82:6823/1028719015","state":["exists","up"]},{"osd":3,"uuid":"c1f2821a-8707-4d26-b7d0-cd992a7f1666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6801","nonce":2675572651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6803","nonce":2675572651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6807","nonce":2675572651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6805","nonce":2675572651}]},"public_addr":"172.21.15.167:6801/2675572651","cluster_addr":"172.21.15.167:6803/2675572651","heartbeat_back_addr":"172.21.15.167:6807/2675572651","heartbeat_front_addr":"172.21.15.167:6805/2675572651","state":["exists","up"]},{"osd":4,"uuid":"d085d4ea-eed4-4c73-aa6f-11405ff3d7c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6809","nonce":1328422628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6811","nonce":1328422628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6815","nonce":1328422628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6813","nonce":1328422628}]},"public_addr":"172.21.15.167:6809/1328422628","cluster_addr":"172.21.15.167:6811/1328422628","heartbeat_back_addr":"172.21.15.167:6815/1328422628","heartbeat_front_addr":"172.21.15.167:6813/1328422628","state":["exists","up"]},{"osd":5,"uuid":"a3936a65-f8a9-4a0e-a424-c79118f7001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6817","nonce":3021386234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6819","nonce":3021386234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6823","nonce":3021386234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6821","nonce":3021386234}]},"public_addr":"172.21.15.167:6817/3021386234","cluster_addr":"172.21.15.167:6819/3021386234","heartbeat_back_addr":"172.21.15.167:6823/3021386234","heartbeat_front_addr":"172.21.15.167:6821/3021386234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:35:39.797241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:09.017486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:37.894244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:01.951295+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:29.881677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:57.142088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3909622984":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/2272978570":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/3700370565":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3743181164":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/826200596":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/1750461309":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3572739181":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/198027229":"2024-09-18T01:32:57.360758+0000","172.21.15.82:6801/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:0/3595010788":"2024-09-18T01:33:57.671331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 msgr2=0x7ff8bc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 0x7ff8bc0707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8d406a830 tx=0x7ff8c8008040 comp rx=0 tx=0).stop 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 msgr2=0x7ff8d4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4031460 tx=0x7ff8c40048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 shutdown_connections 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8bc06e310 0x7ff8bc0707d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8d41067f0 0x7ff8d4198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 --2- 172.21.15.82:0/4066946183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8d41007f0 0x7ff8d4198930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 >> 172.21.15.82:0/4066946183 conn(0x7ff8d40fc550 msgr2=0x7ff8d40fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 shutdown_connections 2024-09-17T01:38:11.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:11.288+0000 7ff8d9e39640 1 -- 172.21.15.82:0/4066946183 wait complete. 2024-09-17T01:38:11.986 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T01:38:11.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T01:38:12.008 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:11 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4066946183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:12.233 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:12.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:11 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4066946183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 -- 172.21.15.82:0/2899013996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc101900 msgr2=0x7f24bc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 --2- 172.21.15.82:0/2899013996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc101900 0x7f24bc101d60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009880 tx=0x7f24ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 -- 172.21.15.82:0/2899013996 shutdown_connections 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 --2- 172.21.15.82:0/2899013996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc101900 0x7f24bc101d60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 --2- 172.21.15.82:0/2899013996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc107900 0x7f24bc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 -- 172.21.15.82:0/2899013996 >> 172.21.15.82:0/2899013996 conn(0x7f24bc0fd600 msgr2=0x7f24bc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 -- 172.21.15.82:0/2899013996 shutdown_connections 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.684+0000 7f24c12d1640 1 -- 172.21.15.82:0/2899013996 wait complete. 2024-09-17T01:38:12.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 Processor -- start 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 -- start start 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc101900 0x7f24bc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10edb0 con 0x7f24bc107900 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24c12d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10ec30 con 0x7f24bc101900 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39970/0 (socket says 172.21.15.82:39970) 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 -- 172.21.15.82:0/3018944577 learned_addr learned my addr 172.21.15.82:0/3018944577 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24baffd640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc101900 0x7f24bc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 -- 172.21.15.82:0/3018944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc101900 msgr2=0x7f24bc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc101900 0x7f24bc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.685+0000 7f24ba7fc640 1 -- 172.21.15.82:0/3018944577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc197800 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24ba7fc640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24ac031460 tx=0x7f24ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24ac03f070 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24ac004cf0 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc197a90 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24ac035030 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.686+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc197fc0 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.687+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc103040 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.687+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f24ac042070 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.688+0000 7f24b3fff640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 0x7f24a8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.688+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f24ac0ae8a0 con 0x7f24bc107900 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.688+0000 7f24baffd640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 0x7f24a8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.688+0000 7f24baffd640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 0x7f24a8070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24a40058c0 tx=0x7f24a400a4c0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:12.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.692+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24ac07c540 con 0x7f24bc107900 2024-09-17T01:38:12.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.860+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24bc109e90 con 0x7f24bc107900 2024-09-17T01:38:12.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.860+0000 7f24b3fff640 1 -- 172.21.15.82:0/3018944577 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11379 (secure 0 0 0) 0x7f24ac0801f0 con 0x7f24bc107900 2024-09-17T01:38:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:12.859 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"fsid":"5047e42a-7494-11ef-bceb-c7b262605968","created":"2024-09-17T01:31:55.651630+0000","modified":"2024-09-17T01:37:59.928862+0000","last_up_change":"2024-09-17T01:37:58.922945+0000","last_in_change":"2024-09-17T01:37:35.113358+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T01:36:41.984837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"03ff4c08-397d-49ac-bf57-3c6e64d6bef5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6803","nonce":30662635}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6805","nonce":30662635}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6809","nonce":30662635}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":30662635},{"type":"v1","addr":"172.21.15.82:6807","nonce":30662635}]},"public_addr":"172.21.15.82:6803/30662635","cluster_addr":"172.21.15.82:6805/30662635","heartbeat_back_addr":"172.21.15.82:6809/30662635","heartbeat_front_addr":"172.21.15.82:6807/30662635","state":["exists","up"]},{"osd":1,"uuid":"1f3aef62-e035-4cf4-987d-38627317e3c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6811","nonce":1048454994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6813","nonce":1048454994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6817","nonce":1048454994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":1048454994},{"type":"v1","addr":"172.21.15.82:6815","nonce":1048454994}]},"public_addr":"172.21.15.82:6811/1048454994","cluster_addr":"172.21.15.82:6813/1048454994","heartbeat_back_addr":"172.21.15.82:6817/1048454994","heartbeat_front_addr":"172.21.15.82:6815/1048454994","state":["exists","up"]},{"osd":2,"uuid":"908e9713-c4f0-46d5-b936-7624a57b9d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6819","nonce":1028719015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6821","nonce":1028719015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6825","nonce":1028719015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1028719015},{"type":"v1","addr":"172.21.15.82:6823","nonce":1028719015}]},"public_addr":"172.21.15.82:6819/1028719015","cluster_addr":"172.21.15.82:6821/1028719015","heartbeat_back_addr":"172.21.15.82:6825/1028719015","heartbeat_front_addr":"172.21.15.82:6823/1028719015","state":["exists","up"]},{"osd":3,"uuid":"c1f2821a-8707-4d26-b7d0-cd992a7f1666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6801","nonce":2675572651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6803","nonce":2675572651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6807","nonce":2675572651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2675572651},{"type":"v1","addr":"172.21.15.167:6805","nonce":2675572651}]},"public_addr":"172.21.15.167:6801/2675572651","cluster_addr":"172.21.15.167:6803/2675572651","heartbeat_back_addr":"172.21.15.167:6807/2675572651","heartbeat_front_addr":"172.21.15.167:6805/2675572651","state":["exists","up"]},{"osd":4,"uuid":"d085d4ea-eed4-4c73-aa6f-11405ff3d7c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6809","nonce":1328422628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6811","nonce":1328422628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6815","nonce":1328422628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1328422628},{"type":"v1","addr":"172.21.15.167:6813","nonce":1328422628}]},"public_addr":"172.21.15.167:6809/1328422628","cluster_addr":"172.21.15.167:6811/1328422628","heartbeat_back_addr":"172.21.15.167:6815/1328422628","heartbeat_front_addr":"172.21.15.167:6813/1328422628","state":["exists","up"]},{"osd":5,"uuid":"a3936a65-f8a9-4a0e-a424-c79118f7001c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6817","nonce":3021386234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6819","nonce":3021386234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6823","nonce":3021386234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3021386234},{"type":"v1","addr":"172.21.15.167:6821","nonce":3021386234}]},"public_addr":"172.21.15.167:6817/3021386234","cluster_addr":"172.21.15.167:6819/3021386234","heartbeat_back_addr":"172.21.15.167:6823/3021386234","heartbeat_front_addr":"172.21.15.167:6821/3021386234","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:35:39.797241+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:09.017486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:36:37.894244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:01.951295+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:29.881677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T01:37:57.142088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3909622984":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/2272978570":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/3700370565":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3743181164":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/826200596":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:6801/406672030":"2024-09-18T01:32:26.319084+0000","172.21.15.82:0/1750461309":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/256076123":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/3572739181":"2024-09-18T01:32:57.360758+0000","172.21.15.82:0/198027229":"2024-09-18T01:32:57.360758+0000","172.21.15.82:6801/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:6800/3452228081":"2024-09-18T01:33:57.671331+0000","172.21.15.82:0/3595010788":"2024-09-18T01:33:57.671331+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T01:38:12.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.862+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 msgr2=0x7f24a8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.862+0000 7f24c12d1640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 0x7f24a8070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24a40058c0 tx=0x7f24a400a4c0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.862+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 msgr2=0x7f24bc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.862+0000 7f24c12d1640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f24ac031460 tx=0x7f24ac0048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 shutdown_connections 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24bc107900 0x7f24bc19dbc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f24a806e2b0 0x7f24a8070770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 --2- 172.21.15.82:0/3018944577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24bc101900 0x7f24bc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 >> 172.21.15.82:0/3018944577 conn(0x7f24bc0fd600 msgr2=0x7f24bc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 shutdown_connections 2024-09-17T01:38:12.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:12.863+0000 7f24c12d1640 1 -- 172.21.15.82:0/3018944577 wait complete. 2024-09-17T01:38:13.173 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:12 smithi082 ceph-mon[28077]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:13.173 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:13.173 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:12 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3018944577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:12 smithi167 ceph-mon[35643]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:12 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3018944577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T01:38:13.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T01:38:13.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T01:38:13.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T01:38:13.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-17T01:38:13.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-17T01:38:13.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-17T01:38:13.900 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 -- 172.21.15.82:0/771430899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4100800 msgr2=0x7ff8b4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/771430899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4100800 0x7ff8b4100c60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009880 tx=0x7ff8a402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 -- 172.21.15.82:0/771430899 shutdown_connections 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/771430899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4100800 0x7ff8b4100c60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/771430899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4106800 0x7ff8b4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 -- 172.21.15.82:0/771430899 >> 172.21.15.82:0/771430899 conn(0x7ff8b40fc520 msgr2=0x7ff8b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 -- 172.21.15.82:0/771430899 shutdown_connections 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.559+0000 7ff8bb59a640 1 -- 172.21.15.82:0/771430899 wait complete. 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 Processor -- start 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 -- start start 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4100800 0x7ff8b419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b410dcd0 con 0x7ff8b4106800 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8bb59a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b410db50 con 0x7ff8b4100800 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.560+0000 7ff8b8b35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39988/0 (socket says 172.21.15.82:39988) 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 -- 172.21.15.82:0/3652573077 learned_addr learned my addr 172.21.15.82:0/3652573077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b9336640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4100800 0x7ff8b419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 -- 172.21.15.82:0/3652573077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4100800 msgr2=0x7ff8b419c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4100800 0x7ff8b419c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b41966a0 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8b8b35640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4031460 tx=0x7ff8a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a403f070 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8a4004cf0 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b4196930 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8a4035030 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.561+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b4196e30 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.562+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8b41973f0 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff8a4042070 con 0x7ff8b4106800 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 0x7ff8a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8b9336640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 0x7ff8a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7ff8a40ae7f0 con 0x7ff8b4106800 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 0x7ff8a00764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8a0076b70 con 0x7ff8a00740a0 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff8a40b32a0 con 0x7ff8b4106800 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.563+0000 7ff8b9b37640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 0x7ff8a00764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.564+0000 7ff8b9336640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 0x7ff8a0070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00058c0 tx=0x7ff8b000a250 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.564+0000 7ff8b9b37640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 0x7ff8a00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.564+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== osd.2 v2:172.21.15.82:6818/1028719015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8a0076b70 con 0x7ff8a00740a0 2024-09-17T01:38:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 --> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8b4062880 con 0x7ff8a00740a0 2024-09-17T01:38:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8aa7fc640 1 -- 172.21.15.82:0/3652573077 <== osd.2 v2:172.21.15.82:6818/1028719015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff8b4062880 con 0x7ff8a00740a0 2024-09-17T01:38:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 msgr2=0x7ff8a00764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 0x7ff8a00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 msgr2=0x7ff8a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 0x7ff8a0070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8b00058c0 tx=0x7ff8b000a250 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 msgr2=0x7ff8b419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4031460 tx=0x7ff8a40048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 shutdown_connections 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6818/1028719015,v1:172.21.15.82:6819/1028719015] conn(0x7ff8a00740a0 0x7ff8a00764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8b4106800 0x7ff8b419cb10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7ff8a006e2b0 0x7ff8a0070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 --2- 172.21.15.82:0/3652573077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8b4100800 0x7ff8b419c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 >> 172.21.15.82:0/3652573077 conn(0x7ff8b40fc520 msgr2=0x7ff8b40fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 shutdown_connections 2024-09-17T01:38:14.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:14.578+0000 7ff8bb59a640 1 -- 172.21.15.82:0/3652573077 wait complete. 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 -- 172.21.15.82:0/3864007548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc1069a0 msgr2=0x7efebc106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 --2- 172.21.15.82:0/3864007548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc1069a0 0x7efebc106d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efeac009880 tx=0x7efeac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 -- 172.21.15.82:0/3864007548 shutdown_connections 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 --2- 172.21.15.82:0/3864007548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc0ffdc0 0x7efebc100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 --2- 172.21.15.82:0/3864007548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc1069a0 0x7efebc106d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 -- 172.21.15.82:0/3864007548 >> 172.21.15.82:0/3864007548 conn(0x7efebc0fbc90 msgr2=0x7efebc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 -- 172.21.15.82:0/3864007548 shutdown_connections 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.137+0000 7efec236a640 1 -- 172.21.15.82:0/3864007548 wait complete. 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 Processor -- start 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 -- start start 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc1069a0 0x7efebc19dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efebc10efa0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efec236a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efebc10ee20 con 0x7efebc1069a0 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40008/0 (socket says 172.21.15.82:40008) 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 -- 172.21.15.82:0/2011119484 learned_addr learned my addr 172.21.15.82:0/2011119484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:15.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebb7fe640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc1069a0 0x7efebc19dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 -- 172.21.15.82:0/2011119484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc1069a0 msgr2=0x7efebc19dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc1069a0 0x7efebc19dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.138+0000 7efebbfff640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efebc197930 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efebbfff640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efeac031460 tx=0x7efeac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efeac03f070 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efeac004cf0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efebc197bc0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efeac035030 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.139+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efebc1980f0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.140+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efebc1985f0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.140+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efeac042070 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efeb97fa640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 0x7efea4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7efeac0aefb0 con 0x7efebc0ffdc0 2024-09-17T01:38:15.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efebb7fe640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 0x7efea4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efeb97fa640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 0x7efea40764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efeac032e50 con 0x7efea40740a0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efeac0af450 con 0x7efebc0ffdc0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efec0907640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 0x7efea40764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efebb7fe640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 0x7efea4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efebc0fe250 tx=0x7efeb0008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.141+0000 7efec0907640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 0x7efea40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:15.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.142+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== osd.0 v2:172.21.15.82:6802/30662635 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efeac032e50 con 0x7efea40740a0 2024-09-17T01:38:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.155+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 --> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efebc0fcee0 con 0x7efea40740a0 2024-09-17T01:38:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efeb97fa640 1 -- 172.21.15.82:0/2011119484 <== osd.0 v2:172.21.15.82:6802/30662635 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efebc0fcee0 con 0x7efea40740a0 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 msgr2=0x7efea40764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 0x7efea40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 msgr2=0x7efea4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 0x7efea4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efebc0fe250 tx=0x7efeb0008040 comp rx=0 tx=0).stop 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 msgr2=0x7efebc19d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efeac031460 tx=0x7efeac0048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 shutdown_connections 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7efea406e2b0 0x7efea4070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efebc1069a0 0x7efebc19dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:6802/30662635,v1:172.21.15.82:6803/30662635] conn(0x7efea40740a0 0x7efea40764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 --2- 172.21.15.82:0/2011119484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efebc0ffdc0 0x7efebc19d770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 >> 172.21.15.82:0/2011119484 conn(0x7efebc0fbc90 msgr2=0x7efebc0fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 shutdown_connections 2024-09-17T01:38:15.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:15.156+0000 7efec236a640 1 -- 172.21.15.82:0/2011119484 wait complete. 2024-09-17T01:38:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:14 smithi167 ceph-mon[35643]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:15.434 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:14 smithi082 ceph-mon[28077]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:15.837 INFO:teuthology.orchestra.run.smithi082.stdout:38654705698 2024-09-17T01:38:15.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T01:38:16.280 INFO:teuthology.orchestra.run.smithi082.stdout:81604378646 2024-09-17T01:38:16.280 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T01:38:16.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:16.287 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:17.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:16 smithi167 ceph-mon[35643]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:17.271 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:16 smithi082 ceph-mon[28077]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- 172.21.15.82:0/1081619307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 msgr2=0x7f6160102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 --2- 172.21.15.82:0/1081619307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f6160102ef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f615c0098b0 tx=0x7f615c02a560 comp rx=0 tx=0).stop 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- 172.21.15.82:0/1081619307 shutdown_connections 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 --2- 172.21.15.82:0/1081619307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 --2- 172.21.15.82:0/1081619307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f6160102ef0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- 172.21.15.82:0/1081619307 >> 172.21.15.82:0/1081619307 conn(0x7f61600fc550 msgr2=0x7f61600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- 172.21.15.82:0/1081619307 shutdown_connections 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- 172.21.15.82:0/1081619307 wait complete. 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 Processor -- start 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.480+0000 7f616732a640 1 -- start start 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f616732a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f616732a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f616732a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f616010ede0 con 0x7f6160102b10 2024-09-17T01:38:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f616732a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f616010ec60 con 0x7f6160103430 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42688/0 (socket says 172.21.15.82:42688) 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 -- 172.21.15.82:0/3632012449 learned_addr learned my addr 172.21.15.82:0/3632012449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61648c5640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 -- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 msgr2=0x7f616019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6160197870 con 0x7f6160102b10 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61648c5640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61650c6640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f615c031460 tx=0x7f615c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f615c03f070 con 0x7f6160102b10 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f615c0035f0 con 0x7f6160102b10 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6160197b00 con 0x7f6160102b10 2024-09-17T01:38:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.481+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f615c035030 con 0x7f6160102b10 2024-09-17T01:38:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.482+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6160198030 con 0x7f6160102b10 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.482+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6160198630 con 0x7f6160102b10 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.483+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f615c042070 con 0x7f6160102b10 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.483+0000 7f61567fc640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 0x7f614c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.483+0000 7f61648c5640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 0x7f614c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.483+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f615c0ae7a0 con 0x7f6160102b10 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61567fc640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 0x7f614c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f615c041ec0 con 0x7f614c0740a0 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f615c0b32a0 con 0x7f6160102b10 2024-09-17T01:38:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61648c5640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 0x7f614c070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6160108970 tx=0x7f6150005e50 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61658c7640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 0x7f614c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.484+0000 7f61658c7640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 0x7f614c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.485+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== osd.3 v2:172.21.15.167:6800/2675572651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f615c041ec0 con 0x7f614c0740a0 2024-09-17T01:38:17.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 --> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6160062880 con 0x7f614c0740a0 2024-09-17T01:38:17.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f61567fc640 1 -- 172.21.15.82:0/3632012449 <== osd.3 v2:172.21.15.167:6800/2675572651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6160062880 con 0x7f614c0740a0 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 msgr2=0x7f614c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 0x7f614c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 msgr2=0x7f614c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 0x7f614c070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6160108970 tx=0x7f6150005e50 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 msgr2=0x7f616019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.499+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f615c031460 tx=0x7f615c0045c0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 shutdown_connections 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f614c06e2b0 0x7f614c070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6160103430 0x7f616019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.167:6800/2675572651,v1:172.21.15.167:6801/2675572651] conn(0x7f614c0740a0 0x7f614c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 --2- 172.21.15.82:0/3632012449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160102b10 0x7f616019d6b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:17.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 >> 172.21.15.82:0/3632012449 conn(0x7f61600fc550 msgr2=0x7f6160107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:17.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 shutdown_connections 2024-09-17T01:38:17.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:17.500+0000 7f616732a640 1 -- 172.21.15.82:0/3632012449 wait complete. 2024-09-17T01:38:18.153 INFO:teuthology.orchestra.run.smithi082.stdout:111669149714 2024-09-17T01:38:18.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-17T01:38:18.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 -- 172.21.15.82:0/2451762435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 msgr2=0x7fcfc4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 --2- 172.21.15.82:0/2451762435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc4102e90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009880 tx=0x7fcfb402a530 comp rx=0 tx=0).stop 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 -- 172.21.15.82:0/2451762435 shutdown_connections 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 --2- 172.21.15.82:0/2451762435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 --2- 172.21.15.82:0/2451762435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc4102e90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 -- 172.21.15.82:0/2451762435 >> 172.21.15.82:0/2451762435 conn(0x7fcfc40fc550 msgr2=0x7fcfc40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 -- 172.21.15.82:0/2451762435 shutdown_connections 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.279+0000 7fcfc9022640 1 -- 172.21.15.82:0/2451762435 wait complete. 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.280+0000 7fcfc9022640 1 Processor -- start 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.280+0000 7fcfc9022640 1 -- start start 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc9022640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc9022640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc9022640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc410ede0 con 0x7fcfc4102ab0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc9022640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc410ec60 con 0x7fcfc41033d0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42714/0 (socket says 172.21.15.82:42714) 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 -- 172.21.15.82:0/3385701991 learned_addr learned my addr 172.21.15.82:0/3385701991 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc259c640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 -- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 msgr2=0x7fcfc419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc41977b0 con 0x7fcfc4102ab0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc259c640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfc2d9d640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4031460 tx=0x7fcfb4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.281+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfb403f070 con 0x7fcfc4102ab0 2024-09-17T01:38:18.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.282+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc4197a40 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.282+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfb4004a90 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.282+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfb4035030 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.282+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc4197f70 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.283+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfc4198590 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.283+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fcfb4042070 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.283+0000 7fcfabfff640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 0x7fcfac074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fcfb40ae930 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfc259c640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 0x7fcfac074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfabfff640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 0x7fcfac07a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfb4039e50 con 0x7fcfac0784b0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fcfb40b32a0 con 0x7fcfc4102ab0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfc259c640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 0x7fcfac074b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfc41088f0 tx=0x7fcfb8005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.284+0000 7fcfc359e640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 0x7fcfac07a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.285+0000 7fcfc359e640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 0x7fcfac07a8d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.286+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== osd.4 v2:172.21.15.167:6808/1328422628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfb4039e50 con 0x7fcfac0784b0 2024-09-17T01:38:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.312+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 --> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfc410b8a0 con 0x7fcfac0784b0 2024-09-17T01:38:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfabfff640 1 -- 172.21.15.82:0/3385701991 <== osd.4 v2:172.21.15.167:6808/1328422628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcfc410b8a0 con 0x7fcfac0784b0 2024-09-17T01:38:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 msgr2=0x7fcfac07a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 0x7fcfac07a8d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 msgr2=0x7fcfac074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 0x7fcfac074b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfc41088f0 tx=0x7fcfb8005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 msgr2=0x7fcfc419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.313+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4031460 tx=0x7fcfb4004530 comp rx=0 tx=0).stop 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 shutdown_connections 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:6808/1328422628,v1:172.21.15.167:6809/1328422628] conn(0x7fcfac0784b0 0x7fcfac07a8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcfac0726c0 0x7fcfac074b80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfc41033d0 0x7fcfc419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 --2- 172.21.15.82:0/3385701991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfc4102ab0 0x7fcfc419d630 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 >> 172.21.15.82:0/3385701991 conn(0x7fcfc40fc550 msgr2=0x7fcfc410aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 shutdown_connections 2024-09-17T01:38:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.314+0000 7fcfc9022640 1 -- 172.21.15.82:0/3385701991 wait complete. 2024-09-17T01:38:18.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 -- 172.21.15.82:0/905642520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 msgr2=0x7faa1c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 --2- 172.21.15.82:0/905642520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c101d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa10009880 tx=0x7faa1002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 -- 172.21.15.82:0/905642520 shutdown_connections 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 --2- 172.21.15.82:0/905642520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c101d60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 --2- 172.21.15.82:0/905642520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c107900 0x7faa1c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 -- 172.21.15.82:0/905642520 >> 172.21.15.82:0/905642520 conn(0x7faa1c0fd620 msgr2=0x7faa1c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 -- 172.21.15.82:0/905642520 shutdown_connections 2024-09-17T01:38:18.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.784+0000 7faa22b18640 1 -- 172.21.15.82:0/905642520 wait complete. 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 Processor -- start 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 -- start start 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c107900 0x7faa1c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c10edb0 con 0x7faa1c101900 2024-09-17T01:38:18.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa22b18640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c10ec30 con 0x7faa1c107900 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42734/0 (socket says 172.21.15.82:42734) 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 -- 172.21.15.82:0/1303331838 learned_addr learned my addr 172.21.15.82:0/1303331838 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 -- 172.21.15.82:0/1303331838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c107900 msgr2=0x7faa1c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c107900 0x7faa1c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.785+0000 7faa208b4640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c1977c0 con 0x7faa1c101900 2024-09-17T01:38:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa208b4640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cc60 tx=0x7faa1400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa1400ce10 con 0x7faa1c101900 2024-09-17T01:38:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c197ab0 con 0x7faa1c101900 2024-09-17T01:38:18.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa1400f910 con 0x7faa1c101900 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa14018ae0 con 0x7faa1c101900 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.786+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c198040 con 0x7faa1c101900 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.787+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa1c198660 con 0x7faa1c101900 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.787+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7faa14018ca0 con 0x7faa1c101900 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa19ffb640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 0x7faa04070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa1bfff640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 0x7faa04070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7faa1408e500 con 0x7faa1c101900 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa19ffb640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 0x7faa040764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa14017ec0 con 0x7faa040740a0 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faa14095050 con 0x7faa1c101900 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa210b5640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 0x7faa040764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.788+0000 7faa1bfff640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 0x7faa04070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa100096c0 tx=0x7faa10000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.789+0000 7faa210b5640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 0x7faa040764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:18.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.789+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== osd.1 v2:172.21.15.82:6810/1048454994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa14017ec0 con 0x7faa040740a0 2024-09-17T01:38:18.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 --> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa1c062900 con 0x7faa040740a0 2024-09-17T01:38:18.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa19ffb640 1 -- 172.21.15.82:0/1303331838 <== osd.1 v2:172.21.15.82:6810/1048454994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa1c062900 con 0x7faa040740a0 2024-09-17T01:38:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 msgr2=0x7faa040764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 0x7faa040764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 msgr2=0x7faa04070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 0x7faa04070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faa100096c0 tx=0x7faa10000bc0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 msgr2=0x7faa1c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cc60 tx=0x7faa1400a620 comp rx=0 tx=0).stop 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 shutdown_connections 2024-09-17T01:38:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6810/1048454994,v1:172.21.15.82:6811/1048454994] conn(0x7faa040740a0 0x7faa040764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7faa0406e2b0 0x7faa04070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c107900 0x7faa1c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 --2- 172.21.15.82:0/1303331838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa1c101900 0x7faa1c19d640 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 >> 172.21.15.82:0/1303331838 conn(0x7faa1c0fd620 msgr2=0x7faa1c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 shutdown_connections 2024-09-17T01:38:18.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:18.803+0000 7faa22b18640 1 -- 172.21.15.82:0/1303331838 wait complete. 2024-09-17T01:38:19.166 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:18 smithi082 ceph-mon[28077]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:19.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:18 smithi167 ceph-mon[35643]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:19.484 INFO:teuthology.orchestra.run.smithi082.stdout:60129542173 2024-09-17T01:38:19.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T01:38:19.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.622+0000 7fd4d8021640 1 -- 172.21.15.82:0/3148271199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 msgr2=0x7fd4d010b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.622+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3148271199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d010b8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009880 tx=0x7fd4c002a530 comp rx=0 tx=0).stop 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 -- 172.21.15.82:0/3148271199 shutdown_connections 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3148271199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d010b8b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3148271199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 0x7fd4d0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 -- 172.21.15.82:0/3148271199 >> 172.21.15.82:0/3148271199 conn(0x7fd4d00fc520 msgr2=0x7fd4d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 -- 172.21.15.82:0/3148271199 shutdown_connections 2024-09-17T01:38:19.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.623+0000 7fd4d8021640 1 -- 172.21.15.82:0/3148271199 wait complete. 2024-09-17T01:38:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 Processor -- start 2024-09-17T01:38:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 -- start start 2024-09-17T01:38:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 0x7fd4d019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:19.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d010edb0 con 0x7fd4d01033c0 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d8021640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d010ec30 con 0x7fd4d0102aa0 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d55bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d55bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42752/0 (socket says 172.21.15.82:42752) 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d55bc640 1 -- 172.21.15.82:0/3029933224 learned_addr learned my addr 172.21.15.82:0/3029933224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.624+0000 7fd4d5dbd640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 0x7fd4d019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d55bc640 1 -- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 msgr2=0x7fd4d019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d55bc640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 0x7fd4d019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d55bc640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d01977c0 con 0x7fd4d01033c0 2024-09-17T01:38:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d55bc640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0031460 tx=0x7fd4c0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4c003f070 con 0x7fd4d01033c0 2024-09-17T01:38:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d0197a50 con 0x7fd4d01033c0 2024-09-17T01:38:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4c0004a90 con 0x7fd4d01033c0 2024-09-17T01:38:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4c0035030 con 0x7fd4d01033c0 2024-09-17T01:38:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.625+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d0197f80 con 0x7fd4d01033c0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.626+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4d0198600 con 0x7fd4d01033c0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.627+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd4c0042070 con 0x7fd4d01033c0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.627+0000 7fd4c6ffd640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 0x7fd4bc0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4d5dbd640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 0x7fd4bc0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd4c00ae7e0 con 0x7fd4d01033c0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4c6ffd640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 0x7fd4bc076510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4c0042e70 con 0x7fd4bc0740f0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd4c00b32a0 con 0x7fd4d01033c0 2024-09-17T01:38:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4d5dbd640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 0x7fd4bc0707c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00bbe0 tx=0x7fd4cc00b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.628+0000 7fd4d65be640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 0x7fd4bc076510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.629+0000 7fd4d65be640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 0x7fd4bc076510 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.629+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== osd.5 v2:172.21.15.167:6816/3021386234 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4c0042e70 con 0x7fd4bc0740f0 2024-09-17T01:38:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.658+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 --> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4d0062900 con 0x7fd4bc0740f0 2024-09-17T01:38:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4c6ffd640 1 -- 172.21.15.82:0/3029933224 <== osd.5 v2:172.21.15.167:6816/3021386234 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd4d0062900 con 0x7fd4bc0740f0 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 msgr2=0x7fd4bc076510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 0x7fd4bc076510 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 msgr2=0x7fd4bc0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 0x7fd4bc0707c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00bbe0 tx=0x7fd4cc00b390 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 msgr2=0x7fd4d019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0031460 tx=0x7fd4c0004530 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 shutdown_connections 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:6816/3021386234,v1:172.21.15.167:6817/3021386234] conn(0x7fd4bc0740f0 0x7fd4bc076510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d01033c0 0x7fd4d019db80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fd4bc06e300 0x7fd4bc0707c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 --2- 172.21.15.82:0/3029933224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4d0102aa0 0x7fd4d019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 >> 172.21.15.82:0/3029933224 conn(0x7fd4d00fc520 msgr2=0x7fd4d0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 shutdown_connections 2024-09-17T01:38:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:19.659+0000 7fd4d8021640 1 -- 172.21.15.82:0/3029933224 wait complete. 2024-09-17T01:38:19.901 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:20.329 INFO:teuthology.orchestra.run.smithi082.stdout:167503724550 2024-09-17T01:38:20.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-17T01:38:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:20.373 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- 172.21.15.82:0/2142086736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478107900 msgr2=0x7fa478107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 --2- 172.21.15.82:0/2142086736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478107900 0x7fa478107ce0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa468009880 tx=0x7fa46802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- 172.21.15.82:0/2142086736 shutdown_connections 2024-09-17T01:38:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 --2- 172.21.15.82:0/2142086736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478101900 0x7fa478101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 --2- 172.21.15.82:0/2142086736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478107900 0x7fa478107ce0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- 172.21.15.82:0/2142086736 >> 172.21.15.82:0/2142086736 conn(0x7fa4780fd5e0 msgr2=0x7fa4780ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- 172.21.15.82:0/2142086736 shutdown_connections 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- 172.21.15.82:0/2142086736 wait complete. 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 Processor -- start 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.061+0000 7fa47feb7640 1 -- start start 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47feb7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47feb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 0x7fa478074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47feb7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa47810edd0 con 0x7fa478101900 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47feb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa47810ec50 con 0x7fa478107900 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42792/0 (socket says 172.21.15.82:42792) 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 -- 172.21.15.82:0/3895055240 learned_addr learned my addr 172.21.15.82:0/3895055240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47d452640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 0x7fa478074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 -- 172.21.15.82:0/3895055240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 msgr2=0x7fa478074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 0x7fa478074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 -- 172.21.15.82:0/3895055240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa478074f70 con 0x7fa478101900 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47d452640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 0x7fa478074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47dc53640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa468031460 tx=0x7fa4680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa46803f070 con 0x7fa478101900 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4680035f0 con 0x7fa478101900 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa478075200 con 0x7fa478101900 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.062+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa468035030 con 0x7fa478101900 2024-09-17T01:38:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.063+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781a3d80 con 0x7fa478101900 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.064+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa478103040 con 0x7fa478101900 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.065+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa468042070 con 0x7fa478101900 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.065+0000 7fa46effd640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 0x7fa4640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.065+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa4680ae720 con 0x7fa478101900 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.065+0000 7fa47d452640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 0x7fa4640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.066+0000 7fa47d452640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 0x7fa4640707d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4740058c0 tx=0x7fa474005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.069+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa46807c440 con 0x7fa478101900 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3955303999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 msgr2=0x7fe96810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3955303999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96810b8c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe950009880 tx=0x7fe95002a530 comp rx=0 tx=0).stop 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3955303999 shutdown_connections 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3955303999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96810b8c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3955303999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 0x7fe968102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3955303999 >> 172.21.15.82:0/3955303999 conn(0x7fe9680fc550 msgr2=0x7fe9680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3955303999 shutdown_connections 2024-09-17T01:38:21.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3955303999 wait complete. 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.978+0000 7fe96d0ce640 1 Processor -- start 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe96d0ce640 1 -- start start 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe96d0ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 0x7fe96819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe96d0ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe96d0ce640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe96810ede0 con 0x7fe9681033d0 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe96d0ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe96810ec60 con 0x7fe968102ab0 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42774/0 (socket says 172.21.15.82:42774) 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 -- 172.21.15.82:0/3609977506 learned_addr learned my addr 172.21.15.82:0/3609977506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe966d9d640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 0x7fe96819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 -- 172.21.15.82:0/3609977506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 msgr2=0x7fe96819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 0x7fe96819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 -- 172.21.15.82:0/3609977506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9681999b0 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.979+0000 7fe95ffff640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe950031460 tx=0x7fe9500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.980+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe95003f070 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.980+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9500035f0 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.980+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe968199c40 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.980+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe950035030 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.980+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96819a170 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.981+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96806a580 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.981+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe950042070 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.982+0000 7fe964d99640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 0x7fe954070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.982+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fe9500ae6f0 con 0x7fe9681033d0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.982+0000 7fe966d9d640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 0x7fe954070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.982+0000 7fe966d9d640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 0x7fe954070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe96819aaf0 tx=0x7fe958005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:21.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:20.986+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe950080040 con 0x7fe9681033d0 2024-09-17T01:38:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.163+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe96810b360 con 0x7fe9681033d0 2024-09-17T01:38:21.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:20 smithi082 ceph-mon[28077]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:21.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.163+0000 7fe964d99640 1 -- 172.21.15.82:0/3609977506 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe950084870 con 0x7fe9681033d0 2024-09-17T01:38:21.164 INFO:teuthology.orchestra.run.smithi082.stdout:81604378647 2024-09-17T01:38:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 msgr2=0x7fe954070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 0x7fe954070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe96819aaf0 tx=0x7fe958005f90 comp rx=0 tx=0).stop 2024-09-17T01:38:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 msgr2=0x7fe96819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe950031460 tx=0x7fe9500045e0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 shutdown_connections 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9681033d0 0x7fe96819fd30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe95406e2b0 0x7fe954070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 --2- 172.21.15.82:0/3609977506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe968102ab0 0x7fe96819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 >> 172.21.15.82:0/3609977506 conn(0x7fe9680fc550 msgr2=0x7fe968100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 shutdown_connections 2024-09-17T01:38:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.165+0000 7fe96d0ce640 1 -- 172.21.15.82:0/3609977506 wait complete. 2024-09-17T01:38:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.245+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa478109e70 con 0x7fa478101900 2024-09-17T01:38:21.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.245+0000 7fa46effd640 1 -- 172.21.15.82:0/3895055240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4680800f0 con 0x7fa478101900 2024-09-17T01:38:21.243 INFO:teuthology.orchestra.run.smithi082.stdout:111669149714 2024-09-17T01:38:21.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.247+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 msgr2=0x7fa4640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.247+0000 7fa47feb7640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 0x7fa4640707d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa4740058c0 tx=0x7fa474005850 comp rx=0 tx=0).stop 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.247+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 msgr2=0x7fa4780744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.247+0000 7fa47feb7640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa468031460 tx=0x7fa4680045e0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 shutdown_connections 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa46406e310 0x7fa4640707d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa478107900 0x7fa478074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 --2- 172.21.15.82:0/3895055240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa478101900 0x7fa4780744f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 >> 172.21.15.82:0/3895055240 conn(0x7fa4780fd5e0 msgr2=0x7fa4780fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 shutdown_connections 2024-09-17T01:38:21.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:21.248+0000 7fa47feb7640 1 -- 172.21.15.82:0/3895055240 wait complete. 2024-09-17T01:38:21.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:20 smithi167 ceph-mon[35643]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:21.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149714 for osd.3 2024-09-17T01:38:21.954 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:22.175 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:21 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3609977506' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:38:22.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:21 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3895055240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:38:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3609977506' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T01:38:22.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:21 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3895055240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-17T01:38:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 -- 172.21.15.82:0/918794113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 msgr2=0x7fe4e8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 --2- 172.21.15.82:0/918794113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8102ea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009880 tx=0x7fe4d802a530 comp rx=0 tx=0).stop 2024-09-17T01:38:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 -- 172.21.15.82:0/918794113 shutdown_connections 2024-09-17T01:38:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 --2- 172.21.15.82:0/918794113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 0x7fe4e810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 --2- 172.21.15.82:0/918794113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8102ea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 -- 172.21.15.82:0/918794113 >> 172.21.15.82:0/918794113 conn(0x7fe4e80fc520 msgr2=0x7fe4e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 -- 172.21.15.82:0/918794113 shutdown_connections 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.374+0000 7fe4ef764640 1 -- 172.21.15.82:0/918794113 wait complete. 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 Processor -- start 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 -- start start 2024-09-17T01:38:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 0x7fe4e8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e810ee50 con 0x7fe4e8102ac0 2024-09-17T01:38:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ef764640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e810ecd0 con 0x7fe4e81033e0 2024-09-17T01:38:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42808/0 (socket says 172.21.15.82:42808) 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 -- 172.21.15.82:0/2733862912 learned_addr learned my addr 172.21.15.82:0/2733862912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4eccff640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 0x7fe4e8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 -- 172.21.15.82:0/2733862912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 msgr2=0x7fe4e8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 0x7fe4e8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 -- 172.21.15.82:0/2733862912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e81011a0 con 0x7fe4e8102ac0 2024-09-17T01:38:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.375+0000 7fe4ed500640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8031460 tx=0x7fe4d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.376+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4d803f070 con 0x7fe4e8102ac0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.376+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4d8004cf0 con 0x7fe4e8102ac0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.376+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e8101430 con 0x7fe4e8102ac0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.376+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4d8035030 con 0x7fe4e8102ac0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.376+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e81a3f20 con 0x7fe4e8102ac0 2024-09-17T01:38:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.377+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e806aa90 con 0x7fe4e8102ac0 2024-09-17T01:38:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.377+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe4d8042070 con 0x7fe4e8102ac0 2024-09-17T01:38:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.378+0000 7fe4de7fc640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 0x7fe4d40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.378+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fe4d80ae840 con 0x7fe4e8102ac0 2024-09-17T01:38:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.378+0000 7fe4eccff640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 0x7fe4d40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.378+0000 7fe4eccff640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 0x7fe4d40707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4e81021b0 tx=0x7fe4e4008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.382+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4d807c560 con 0x7fe4e8102ac0 2024-09-17T01:38:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.555+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe4e8101c50 con 0x7fe4e8102ac0 2024-09-17T01:38:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.555+0000 7fe4de7fc640 1 -- 172.21.15.82:0/2733862912 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4d8080210 con 0x7fe4e8102ac0 2024-09-17T01:38:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:38654705699 2024-09-17T01:38:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 msgr2=0x7fe4d40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 0x7fe4d40707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe4e81021b0 tx=0x7fe4e4008040 comp rx=0 tx=0).stop 2024-09-17T01:38:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 msgr2=0x7fe4e8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8031460 tx=0x7fe4d80048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 shutdown_connections 2024-09-17T01:38:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fe4d406e310 0x7fe4d40707d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4e81033e0 0x7fe4e8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 --2- 172.21.15.82:0/2733862912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4e8102ac0 0x7fe4e8100720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.557+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 >> 172.21.15.82:0/2733862912 conn(0x7fe4e80fc520 msgr2=0x7fe4e8108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.558+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 shutdown_connections 2024-09-17T01:38:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:22.558+0000 7fe4ef764640 1 -- 172.21.15.82:0/2733862912 wait complete. 2024-09-17T01:38:22.817 INFO:teuthology.orchestra.run.smithi082.stdout:146028888077 2024-09-17T01:38:22.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-17T01:38:23.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:22 smithi082 ceph-mon[28077]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:23.125 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:22 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2733862912' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:38:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:22 smithi167 ceph-mon[35643]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:22 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2733862912' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T01:38:23.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2024-09-17T01:38:23.385 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:23.844 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378647 for osd.2 2024-09-17T01:38:23.845 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 -- 172.21.15.82:0/3305957668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8101900 msgr2=0x7f16b8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 --2- 172.21.15.82:0/3305957668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8101900 0x7f16b8101d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16a0009880 tx=0x7f16a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 -- 172.21.15.82:0/3305957668 shutdown_connections 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 --2- 172.21.15.82:0/3305957668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8101900 0x7f16b8101d60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 --2- 172.21.15.82:0/3305957668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8107900 0x7f16b8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.295+0000 7f16bde68640 1 -- 172.21.15.82:0/3305957668 >> 172.21.15.82:0/3305957668 conn(0x7f16b80fd600 msgr2=0x7f16b80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 -- 172.21.15.82:0/3305957668 shutdown_connections 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 -- 172.21.15.82:0/3305957668 wait complete. 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 Processor -- start 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 -- start start 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8101900 0x7f16b819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16b810ee30 con 0x7f16b8107900 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.296+0000 7f16bde68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16b810ecb0 con 0x7f16b8101900 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42830/0 (socket says 172.21.15.82:42830) 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 -- 172.21.15.82:0/2965825346 learned_addr learned my addr 172.21.15.82:0/2965825346 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16b77fe640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8101900 0x7f16b819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 -- 172.21.15.82:0/2965825346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8101900 msgr2=0x7f16b819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8101900 0x7f16b819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 -- 172.21.15.82:0/2965825346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b8197840 con 0x7f16b8107900 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16affff640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16a0031460 tx=0x7f16a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a003f070 con 0x7f16b8107900 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16a0004cf0 con 0x7f16b8107900 2024-09-17T01:38:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b8197ad0 con 0x7f16b8107900 2024-09-17T01:38:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16a0035030 con 0x7f16b8107900 2024-09-17T01:38:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.297+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b8198000 con 0x7f16b8107900 2024-09-17T01:38:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.298+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b8103040 con 0x7f16b8107900 2024-09-17T01:38:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.299+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f16a0042070 con 0x7f16b8107900 2024-09-17T01:38:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.299+0000 7f16b57fa640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 0x7f16a4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.300+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f16a00ae910 con 0x7f16b8107900 2024-09-17T01:38:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.300+0000 7f16b77fe640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 0x7f16a4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.300+0000 7f16b77fe640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 0x7f16a4070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009890 tx=0x7f16a8008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.305+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16a007c5b0 con 0x7f16b8107900 2024-09-17T01:38:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.482+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f16b8198d70 con 0x7f16b8107900 2024-09-17T01:38:24.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.482+0000 7f16b57fa640 1 -- 172.21.15.82:0/2965825346 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f16a0080260 con 0x7f16b8107900 2024-09-17T01:38:24.480 INFO:teuthology.orchestra.run.smithi082.stdout:60129542174 2024-09-17T01:38:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 msgr2=0x7f16a4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 0x7f16a4070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f16a8009890 tx=0x7f16a8008040 comp rx=0 tx=0).stop 2024-09-17T01:38:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 msgr2=0x7f16b819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f16a0031460 tx=0x7f16a00048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 shutdown_connections 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16b8107900 0x7f16b819dc00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f16a406e2b0 0x7f16a4070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 --2- 172.21.15.82:0/2965825346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16b8101900 0x7f16b819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 >> 172.21.15.82:0/2965825346 conn(0x7f16b80fd600 msgr2=0x7f16b80fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 shutdown_connections 2024-09-17T01:38:24.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:24.484+0000 7f16bde68640 1 -- 172.21.15.82:0/2965825346 wait complete. 2024-09-17T01:38:25.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:24 smithi082 ceph-mon[28077]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:25.152 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:24 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2965825346' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:38:25.181 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-17T01:38:25.181 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:24 smithi167 ceph-mon[35643]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:24 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2965825346' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T01:38:25.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 -- 172.21.15.82:0/797358567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8107900 msgr2=0x7fa1c8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/797358567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8107900 0x7fa1c8107ce0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009880 tx=0x7fa1c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 -- 172.21.15.82:0/797358567 shutdown_connections 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/797358567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8101900 0x7fa1c8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/797358567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8107900 0x7fa1c8107ce0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 -- 172.21.15.82:0/797358567 >> 172.21.15.82:0/797358567 conn(0x7fa1c80fd600 msgr2=0x7fa1c80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 -- 172.21.15.82:0/797358567 shutdown_connections 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.604+0000 7fa1cf58c640 1 -- 172.21.15.82:0/797358567 wait complete. 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 Processor -- start 2024-09-17T01:38:25.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 -- start start 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8107900 0x7fa1c819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c810edb0 con 0x7fa1c8101900 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cf58c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c810ec30 con 0x7fa1c8107900 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cd328640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cd328640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42842/0 (socket says 172.21.15.82:42842) 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1cd328640 1 -- 172.21.15.82:0/788022931 learned_addr learned my addr 172.21.15.82:0/788022931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.605+0000 7fa1ccb27640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8107900 0x7fa1c819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cd328640 1 -- 172.21.15.82:0/788022931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8107900 msgr2=0x7fa1c819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cd328640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8107900 0x7fa1c819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cd328640 1 -- 172.21.15.82:0/788022931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c81977e0 con 0x7fa1c8101900 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cd328640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4031460 tx=0x7fa1c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1c403f070 con 0x7fa1c8101900 2024-09-17T01:38:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1c40035f0 con 0x7fa1c8101900 2024-09-17T01:38:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1c4035030 con 0x7fa1c8101900 2024-09-17T01:38:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c8197a70 con 0x7fa1c8101900 2024-09-17T01:38:25.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.606+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c8197fa0 con 0x7fa1c8101900 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.608+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c8103040 con 0x7fa1c8101900 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.608+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa1c4042070 con 0x7fa1c8101900 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.608+0000 7fa1be7fc640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 0x7fa1b40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.608+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa1c40ae720 con 0x7fa1c8101900 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.608+0000 7fa1ccb27640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 0x7fa1b40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.609+0000 7fa1ccb27640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 0x7fa1b40707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.613+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1c407c440 con 0x7fa1c8101900 2024-09-17T01:38:25.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.784+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa1c8104b10 con 0x7fa1c8101900 2024-09-17T01:38:25.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.785+0000 7fa1be7fc640 1 -- 172.21.15.82:0/788022931 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1c40800f0 con 0x7fa1c8101900 2024-09-17T01:38:25.783 INFO:teuthology.orchestra.run.smithi082.stdout:146028888078 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 msgr2=0x7fa1b40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 0x7fa1b40707d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8005fd0 tx=0x7fa1b8005850 comp rx=0 tx=0).stop 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 msgr2=0x7fa1c819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4031460 tx=0x7fa1c40045e0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 shutdown_connections 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa1b406e310 0x7fa1b40707d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1c8107900 0x7fa1c819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 --2- 172.21.15.82:0/788022931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c8101900 0x7fa1c819d660 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 >> 172.21.15.82:0/788022931 conn(0x7fa1c80fd600 msgr2=0x7fa1c80fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 shutdown_connections 2024-09-17T01:38:25.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.787+0000 7fa1cf58c640 1 -- 172.21.15.82:0/788022931 wait complete. 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 -- 172.21.15.82:0/3603004513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc101960 msgr2=0x7fafcc101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/3603004513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc101960 0x7fafcc101dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009880 tx=0x7fafbc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 -- 172.21.15.82:0/3603004513 shutdown_connections 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/3603004513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc101960 0x7fafcc101dc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/3603004513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc107960 0x7fafcc107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 -- 172.21.15.82:0/3603004513 >> 172.21.15.82:0/3603004513 conn(0x7fafcc0fd680 msgr2=0x7fafcc0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 -- 172.21.15.82:0/3603004513 shutdown_connections 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.815+0000 7fafd3f0b640 1 -- 172.21.15.82:0/3603004513 wait complete. 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 Processor -- start 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 -- start start 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc101960 0x7fafcc073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc10ee30 con 0x7fafcc107960 2024-09-17T01:38:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd3f0b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc10ecb0 con 0x7fafcc101960 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd14a6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd14a6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42852/0 (socket says 172.21.15.82:42852) 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd14a6640 1 -- 172.21.15.82:0/1344940088 learned_addr learned my addr 172.21.15.82:0/1344940088 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.816+0000 7fafd1ca7640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc101960 0x7fafcc073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd14a6640 1 -- 172.21.15.82:0/1344940088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc101960 msgr2=0x7fafcc073d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd14a6640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc101960 0x7fafcc073d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd14a6640 1 -- 172.21.15.82:0/1344940088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc06c220 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd14a6640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fafbc031460 tx=0x7fafbc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafbc03f070 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc06c4b0 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafbc004b10 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafbc035030 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.817+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc06c9e0 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.818+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafcc1030a0 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.819+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fafbc042070 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.819+0000 7fafc2ffd640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.819+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fafbc0ae8a0 con 0x7fafcc107960 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.819+0000 7fafd1ca7640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.819+0000 7fafd1ca7640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 0x7fafb8070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.823+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafbc0801f0 con 0x7fafcc107960 2024-09-17T01:38:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.993+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fafcc109ed0 con 0x7fafcc107960 2024-09-17T01:38:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.994+0000 7fafc2ffd640 1 -- 172.21.15.82:0/1344940088 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fafbc084a20 con 0x7fafcc107960 2024-09-17T01:38:25.992 INFO:teuthology.orchestra.run.smithi082.stdout:167503724552 2024-09-17T01:38:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 msgr2=0x7fafb8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 0x7fafb8070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fafc8005fd0 tx=0x7fafc800b390 comp rx=0 tx=0).stop 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 msgr2=0x7fafcc06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fafbc031460 tx=0x7fafbc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 shutdown_connections 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafcc107960 0x7fafcc06bce0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fafb806e2b0 0x7fafb8070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 --2- 172.21.15.82:0/1344940088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fafcc101960 0x7fafcc073d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 >> 172.21.15.82:0/1344940088 conn(0x7fafcc0fd680 msgr2=0x7fafcc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 shutdown_connections 2024-09-17T01:38:25.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:25.996+0000 7fafd3f0b640 1 -- 172.21.15.82:0/1344940088 wait complete. 2024-09-17T01:38:26.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:25 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/788022931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:38:26.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:25 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/788022931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-17T01:38:26.565 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888077 got 146028888078 for osd.4 2024-09-17T01:38:26.565 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:27.135 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:26 smithi082 ceph-mon[28077]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:27.136 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:26 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1344940088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:38:27.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724550 got 167503724552 for osd.5 2024-09-17T01:38:27.162 DEBUG:teuthology.parallel:result is None 2024-09-17T01:38:27.162 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T01:38:27.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:38:27.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:26 smithi167 ceph-mon[35643]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:27.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:26 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1344940088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-17T01:38:27.408 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 -- 172.21.15.82:0/4107813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970100800 msgr2=0x7f6970100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 --2- 172.21.15.82:0/4107813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970100800 0x7f6970100c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6958009880 tx=0x7f695802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 -- 172.21.15.82:0/4107813600 shutdown_connections 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 --2- 172.21.15.82:0/4107813600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970100800 0x7f6970100c60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 --2- 172.21.15.82:0/4107813600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970106800 0x7f6970106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 -- 172.21.15.82:0/4107813600 >> 172.21.15.82:0/4107813600 conn(0x7f69700fc520 msgr2=0x7f69700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 -- 172.21.15.82:0/4107813600 shutdown_connections 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.889+0000 7f6976832640 1 -- 172.21.15.82:0/4107813600 wait complete. 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 Processor -- start 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 -- start start 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970100800 0x7f6970196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f697010dcd0 con 0x7f6970106800 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6976832640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f697010db50 con 0x7f6970100800 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57448/0 (socket says 172.21.15.82:57448) 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 -- 172.21.15.82:0/2325575930 learned_addr learned my addr 172.21.15.82:0/2325575930 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f696ffff640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970100800 0x7f6970196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 -- 172.21.15.82:0/2325575930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970100800 msgr2=0x7f6970196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970100800 0x7f6970196610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 -- 172.21.15.82:0/2325575930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970197090 con 0x7f6970106800 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.890+0000 7f6967fff640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6958031460 tx=0x7f69580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.891+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f695803f070 con 0x7f6970106800 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.891+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6958004cf0 con 0x7f6970106800 2024-09-17T01:38:27.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.891+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6970197320 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.891+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6958035030 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.891+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69701a3e50 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.892+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6970101f40 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.892+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6958042070 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.893+0000 7f696dffb640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 0x7f695c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.893+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f69580ae7e0 con 0x7f6970106800 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.893+0000 7f696ffff640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 0x7f695c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.893+0000 7f696ffff640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 0x7f695c0707d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6960005fd0 tx=0x7f6960005e20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:27.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:27.897+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f695807c500 con 0x7f6970106800 2024-09-17T01:38:28.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.075+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6970062630 con 0x7f695c06e310 2024-09-17T01:38:28.075 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.076+0000 7f696dffb640 1 -- 172.21.15.82:0/2325575930 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f6970062630 con 0x7f695c06e310 2024-09-17T01:38:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 msgr2=0x7f695c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 0x7f695c0707d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6960005fd0 tx=0x7f6960005e20 comp rx=0 tx=0).stop 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 msgr2=0x7f6970196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6958031460 tx=0x7f69580048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 shutdown_connections 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6970106800 0x7f6970196b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f695c06e310 0x7f695c0707d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 --2- 172.21.15.82:0/2325575930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6970100800 0x7f6970196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 >> 172.21.15.82:0/2325575930 conn(0x7f69700fc520 msgr2=0x7f69700fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 shutdown_connections 2024-09-17T01:38:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:28.079+0000 7f6976832640 1 -- 172.21.15.82:0/2325575930 wait complete. 2024-09-17T01:38:28.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:28.683 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-17T01:38:27.724357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178540,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":174518,"kb_avail":562292372,"statfs":{"total":575970213888,"available":575787388928,"internally_reserved":0,"allocated":3969024,"data_stored":2609616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":178707104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001853"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:37:59.935723+0000","last_change":"2024-09-17T01:37:31.817428+0000","last_active":"2024-09-17T01:37:59.935723+0000","last_peered":"2024-09-17T01:37:59.935723+0000","last_clean":"2024-09-17T01:37:59.935723+0000","last_became_active":"2024-09-17T01:37:31.817080+0000","last_became_peered":"2024-09-17T01:37:31.817080+0000","last_unstale":"2024-09-17T01:37:59.935723+0000","last_undegraded":"2024-09-17T01:37:59.935723+0000","last_fullsized":"2024-09-17T01:37:59.935723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:42.034973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:42.034973+0000","last_clean_scrub_stamp":"2024-09-17T01:36:42.034973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:52.673248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:38:28.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T01:38:28.933 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:29.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:28 smithi167 ceph-mon[35643]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:29.300 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:28 smithi082 ceph-mon[28077]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 -- 172.21.15.82:0/4229993091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 msgr2=0x7f9aa4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/4229993091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa4106bd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009c20 tx=0x7f9a9c02a970 comp rx=0 tx=0).stop 2024-09-17T01:38:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 -- 172.21.15.82:0/4229993091 shutdown_connections 2024-09-17T01:38:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/4229993091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 0x7f9aa4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/4229993091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa4106bd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 -- 172.21.15.82:0/4229993091 >> 172.21.15.82:0/4229993091 conn(0x7f9aa40fc550 msgr2=0x7f9aa40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 -- 172.21.15.82:0/4229993091 shutdown_connections 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.380+0000 7f9aabdfd640 1 -- 172.21.15.82:0/4229993091 wait complete. 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 Processor -- start 2024-09-17T01:38:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 -- start start 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 0x7f9aa419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa410dd20 con 0x7f9aa41067f0 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.381+0000 7f9aabdfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa410dba0 con 0x7f9aa41007f0 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57468/0 (socket says 172.21.15.82:57468) 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 -- 172.21.15.82:0/2926970674 learned_addr learned my addr 172.21.15.82:0/2926970674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9b99640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 0x7f9aa419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 -- 172.21.15.82:0/2926970674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 msgr2=0x7f9aa419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 0x7f9aa419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 -- 172.21.15.82:0/2926970674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa41967c0 con 0x7f9aa41067f0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aa9398640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b420 tx=0x7f9a9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a94011630 con 0x7f9aa41067f0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa4196ab0 con 0x7f9aa41067f0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a94016070 con 0x7f9aa41067f0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a94010d40 con 0x7f9aa41067f0 2024-09-17T01:38:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.382+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa4197040 con 0x7f9aa41067f0 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.383+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa4101f30 con 0x7f9aa41067f0 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.384+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9a9401b460 con 0x7f9aa41067f0 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.384+0000 7f9a9affd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 0x7f9a90070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.384+0000 7f9aa9b99640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 0x7f9a90070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.384+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f9a9408d5f0 con 0x7f9aa41067f0 2024-09-17T01:38:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.385+0000 7f9aa9b99640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 0x7f9a90070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009430 tx=0x7f9a9c03c040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.389+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a9405b290 con 0x7f9aa41067f0 2024-09-17T01:38:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.551+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9aa4197350 con 0x7f9a9006e2b0 2024-09-17T01:38:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.552+0000 7f9a9affd640 1 -- 172.21.15.82:0/2926970674 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f9aa4197350 con 0x7f9a9006e2b0 2024-09-17T01:38:29.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-09-17T01:38:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 msgr2=0x7f9a90070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 0x7f9a90070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009430 tx=0x7f9a9c03c040 comp rx=0 tx=0).stop 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 msgr2=0x7f9aa419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400b420 tx=0x7f9a9400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 shutdown_connections 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa41067f0 0x7f9aa419cb80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f9a9006e2b0 0x7f9a90070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 --2- 172.21.15.82:0/2926970674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9aa41007f0 0x7f9aa419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 >> 172.21.15.82:0/2926970674 conn(0x7f9aa40fc550 msgr2=0x7f9aa40fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:29.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 shutdown_connections 2024-09-17T01:38:29.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:29.554+0000 7f9aabdfd640 1 -- 172.21.15.82:0/2926970674 wait complete. 2024-09-17T01:38:30.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:30 smithi082 ceph-mon[28077]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:38:30.156 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-17T01:38:27.724357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178540,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":174518,"kb_avail":562292372,"statfs":{"total":575970213888,"available":575787388928,"internally_reserved":0,"allocated":3969024,"data_stored":2609616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":178707104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001853"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T01:37:59.935723+0000","last_change":"2024-09-17T01:37:31.817428+0000","last_active":"2024-09-17T01:37:59.935723+0000","last_peered":"2024-09-17T01:37:59.935723+0000","last_clean":"2024-09-17T01:37:59.935723+0000","last_became_active":"2024-09-17T01:37:31.817080+0000","last_became_peered":"2024-09-17T01:37:31.817080+0000","last_unstale":"2024-09-17T01:37:59.935723+0000","last_undegraded":"2024-09-17T01:37:59.935723+0000","last_fullsized":"2024-09-17T01:37:59.935723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T01:36:42.034973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T01:36:42.034973+0000","last_clean_scrub_stamp":"2024-09-17T01:36:42.034973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:52.673248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":958464,"data_stored":730120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T01:38:30.157 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T01:38:30.157 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T01:38:30.157 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T01:38:30.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T01:38:30.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:30 smithi167 ceph-mon[35643]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:38:30.408 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 -- 172.21.15.82:0/2330815333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408101900 msgr2=0x7f0408101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 --2- 172.21.15.82:0/2330815333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408101900 0x7f0408101d60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009880 tx=0x7f03f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 -- 172.21.15.82:0/2330815333 shutdown_connections 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 --2- 172.21.15.82:0/2330815333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408101900 0x7f0408101d60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 --2- 172.21.15.82:0/2330815333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408107900 0x7f0408107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 -- 172.21.15.82:0/2330815333 >> 172.21.15.82:0/2330815333 conn(0x7f04080fd600 msgr2=0x7f04080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 -- 172.21.15.82:0/2330815333 shutdown_connections 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.811+0000 7f040d44a640 1 -- 172.21.15.82:0/2330815333 wait complete. 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 Processor -- start 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 -- start start 2024-09-17T01:38:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408101900 0x7f040819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0408111050 con 0x7f0408107900 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f040d44a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0408110ed0 con 0x7f0408101900 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57482/0 (socket says 172.21.15.82:57482) 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 -- 172.21.15.82:0/814650945 learned_addr learned my addr 172.21.15.82:0/814650945 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f0406ffd640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408101900 0x7f040819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 -- 172.21.15.82:0/814650945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408101900 msgr2=0x7f040819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408101900 0x7f040819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.812+0000 7f03fffff640 1 -- 172.21.15.82:0/814650945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0408199a80 con 0x7f0408107900 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f03fffff640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03f0031460 tx=0x7f03f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f003f070 con 0x7f0408107900 2024-09-17T01:38:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0408199d10 con 0x7f0408107900 2024-09-17T01:38:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f03f0004cf0 con 0x7f0408107900 2024-09-17T01:38:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f03f0035030 con 0x7f0408107900 2024-09-17T01:38:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.813+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040819a240 con 0x7f0408107900 2024-09-17T01:38:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.814+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0408103040 con 0x7f0408107900 2024-09-17T01:38:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.814+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f03f0042070 con 0x7f0408107900 2024-09-17T01:38:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.815+0000 7f0404ff9640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 0x7f03f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.815+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f03f00ae910 con 0x7f0408107900 2024-09-17T01:38:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.815+0000 7f0406ffd640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 0x7f03f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.815+0000 7f0406ffd640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 0x7f03f4070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f040819abc0 tx=0x7f03f8008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:30.819+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03f007c5b0 con 0x7f0408107900 2024-09-17T01:38:31.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.024+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f040819afb0 con 0x7f0408107900 2024-09-17T01:38:31.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.024+0000 7f0404ff9640 1 -- 172.21.15.82:0/814650945 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f03f0080260 con 0x7f0408107900 2024-09-17T01:38:31.022 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:31.022 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T01:38:31.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 msgr2=0x7f03f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 0x7f03f4070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f040819abc0 tx=0x7f03f8008040 comp rx=0 tx=0).stop 2024-09-17T01:38:31.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 msgr2=0x7f040819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:31.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f03f0031460 tx=0x7f03f00048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 shutdown_connections 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0408107900 0x7f040819fe00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f03f406e2b0 0x7f03f4070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 --2- 172.21.15.82:0/814650945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0408101900 0x7f040819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.026+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 >> 172.21.15.82:0/814650945 conn(0x7f04080fd600 msgr2=0x7f04080fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.027+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 shutdown_connections 2024-09-17T01:38:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:31.027+0000 7f040d44a640 1 -- 172.21.15.82:0/814650945 wait complete. 2024-09-17T01:38:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:31 smithi082 ceph-mon[28077]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:38:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:31 smithi082 ceph-mon[28077]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:31 smithi167 ceph-mon[35643]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T01:38:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:31 smithi167 ceph-mon[35643]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:31.660 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T01:38:31.660 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T01:38:31.661 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:38:31.670 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-17T01:38:31.670 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:32.029 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:32.029 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-17T01:38:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:32.408 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:32 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/814650945' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:38:32.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:32 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/814650945' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T01:38:32.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.749+0000 7f2f65af4640 1 -- 172.21.15.82:0/2795261174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 msgr2=0x7f2f60100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.749+0000 7f2f65af4640 1 --2- 172.21.15.82:0/2795261174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f60100c60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f50009c20 tx=0x7f2f5002a970 comp rx=0 tx=0).stop 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- 172.21.15.82:0/2795261174 shutdown_connections 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 --2- 172.21.15.82:0/2795261174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 0x7f2f60101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 --2- 172.21.15.82:0/2795261174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f60100c60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- 172.21.15.82:0/2795261174 >> 172.21.15.82:0/2795261174 conn(0x7f2f600fc010 msgr2=0x7f2f600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- 172.21.15.82:0/2795261174 shutdown_connections 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- 172.21.15.82:0/2795261174 wait complete. 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 Processor -- start 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- start start 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 0x7f2f6019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60109680 con 0x7f2f60100860 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.750+0000 7f2f65af4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f60109500 con 0x7f2f60101a60 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57498/0 (socket says 172.21.15.82:57498) 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 -- 172.21.15.82:0/853345721 learned_addr learned my addr 172.21.15.82:0/853345721 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f56ffd640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 0x7f2f6019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 -- 172.21.15.82:0/853345721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 msgr2=0x7f2f6019c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 0x7f2f6019c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 -- 172.21.15.82:0/853345721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6019c740 con 0x7f2f60100860 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5f7fe640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f50006010 tx=0x7f2f5002f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f50047070 con 0x7f2f60100860 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6019c9d0 con 0x7f2f60100860 2024-09-17T01:38:32.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f50003e30 con 0x7f2f60100860 2024-09-17T01:38:32.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f50034070 con 0x7f2f60100860 2024-09-17T01:38:32.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.751+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6019cf80 con 0x7f2f60100860 2024-09-17T01:38:32.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.752+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f60100c60 con 0x7f2f60100860 2024-09-17T01:38:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.753+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2f5004a070 con 0x7f2f60100860 2024-09-17T01:38:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.753+0000 7f2f5d7fa640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 0x7f2f4c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.753+0000 7f2f56ffd640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 0x7f2f4c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.753+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f2f500aebe0 con 0x7f2f60100860 2024-09-17T01:38:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.754+0000 7f2f56ffd640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 0x7f2f4c070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006a550 tx=0x7f2f4800a2d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.757+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f5003f070 con 0x7f2f60100860 2024-09-17T01:38:32.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.922+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f2f6019d1e0 con 0x7f2f60100860 2024-09-17T01:38:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.926+0000 7f2f5d7fa640 1 -- 172.21.15.82:0/853345721 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v43)=0 v43) ==== 143+0+0 (secure 0 0 0) 0x7f2f5007c9a0 con 0x7f2f60100860 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 msgr2=0x7f2f4c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 0x7f2f4c070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f6006a550 tx=0x7f2f4800a2d0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 msgr2=0x7f2f6006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f50006010 tx=0x7f2f5002f730 comp rx=0 tx=0).stop 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 shutdown_connections 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2f4c06e2b0 0x7f2f4c070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f60101a60 0x7f2f6019c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 --2- 172.21.15.82:0/853345721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f60100860 0x7f2f6006a7d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 >> 172.21.15.82:0/853345721 conn(0x7f2f600fc010 msgr2=0x7f2f600fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 shutdown_connections 2024-09-17T01:38:32.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:32.928+0000 7f2f65af4640 1 -- 172.21.15.82:0/853345721 wait complete. 2024-09-17T01:38:33.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:33.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/853345721' entity='client.admin' 2024-09-17T01:38:33.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:33.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:33.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:38:33.205 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:33 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/853345721' entity='client.admin' 2024-09-17T01:38:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:38:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:33 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:33.586 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:38:33.596 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-17T01:38:33.596 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:33.709 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:33.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T01:38:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 -- 172.21.15.82:0/1919419949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 msgr2=0x7fde54107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 --2- 172.21.15.82:0/1919419949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54107110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fde440098b0 tx=0x7fde4402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 -- 172.21.15.82:0/1919419949 shutdown_connections 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 --2- 172.21.15.82:0/1919419949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54107110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 --2- 172.21.15.82:0/1919419949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde541047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 -- 172.21.15.82:0/1919419949 >> 172.21.15.82:0/1919419949 conn(0x7fde540fc010 msgr2=0x7fde540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 -- 172.21.15.82:0/1919419949 shutdown_connections 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.402+0000 7fde5b521640 1 -- 172.21.15.82:0/1919419949 wait complete. 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 Processor -- start 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 -- start start 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde54197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde5410a790 con 0x7fde54104d20 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde5b521640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde5410a610 con 0x7fde541023f0 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde58abc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde58abc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57518/0 (socket says 172.21.15.82:57518) 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde58abc640 1 -- 172.21.15.82:0/935585665 learned_addr learned my addr 172.21.15.82:0/935585665 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde592bd640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde54197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde58abc640 1 -- 172.21.15.82:0/935585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 msgr2=0x7fde54197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.403+0000 7fde58abc640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde54197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde58abc640 1 -- 172.21.15.82:0/935585665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541980d0 con 0x7fde54104d20 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde592bd640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde54197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde58abc640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde44009230 tx=0x7fde440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde4403f070 con 0x7fde54104d20 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5419cab0 con 0x7fde54104d20 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde440044d0 con 0x7fde54104d20 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde44035030 con 0x7fde54104d20 2024-09-17T01:38:34.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.404+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5419d040 con 0x7fde54104d20 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.405+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde541027d0 con 0x7fde54104d20 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.405+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fde44042070 con 0x7fde54104d20 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.406+0000 7fde4a7fc640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 0x7fde40070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.406+0000 7fde592bd640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 0x7fde40070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.406+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fde440aea90 con 0x7fde54104d20 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.406+0000 7fde592bd640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 0x7fde40070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde500058c0 tx=0x7fde50005d30 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:34.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.410+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde4407c730 con 0x7fde54104d20 2024-09-17T01:38:34.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.601+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fde54105780 con 0x7fde4006e2b0 2024-09-17T01:38:34.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.602+0000 7fde4a7fc640 1 -- 172.21.15.82:0/935585665 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fde54105780 con 0x7fde4006e2b0 2024-09-17T01:38:34.599 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-09-17T01:38:34.600 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-09-17T01:38:34.600 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 msgr2=0x7fde40070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 0x7fde40070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde500058c0 tx=0x7fde50005d30 comp rx=0 tx=0).stop 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 msgr2=0x7fde54197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fde44009230 tx=0x7fde440048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 shutdown_connections 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde54104d20 0x7fde54197a50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fde4006e2b0 0x7fde40070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 --2- 172.21.15.82:0/935585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde541023f0 0x7fde54197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 >> 172.21.15.82:0/935585665 conn(0x7fde540fc010 msgr2=0x7fde540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 shutdown_connections 2024-09-17T01:38:34.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:34.604+0000 7fde5b521640 1 -- 172.21.15.82:0/935585665 wait complete. 2024-09-17T01:38:35.202 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:35 smithi082 ceph-mon[28077]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:35.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T01:38:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:35.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:35 smithi167 ceph-mon[35643]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 -- 172.21.15.82:0/3186783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070101a60 msgr2=0x7f4070101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 --2- 172.21.15.82:0/3186783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070101a60 0x7f4070101ee0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4064009880 tx=0x7f406402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 -- 172.21.15.82:0/3186783105 shutdown_connections 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 --2- 172.21.15.82:0/3186783105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070101a60 0x7f4070101ee0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 --2- 172.21.15.82:0/3186783105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070100860 0x7f4070100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 -- 172.21.15.82:0/3186783105 >> 172.21.15.82:0/3186783105 conn(0x7f40700fc010 msgr2=0x7f40700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 -- 172.21.15.82:0/3186783105 shutdown_connections 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.939+0000 7f4077e92640 1 -- 172.21.15.82:0/3186783105 wait complete. 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 Processor -- start 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 -- start start 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070101a60 0x7f4070199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4070109720 con 0x7f4070100860 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40701095a0 con 0x7f4070101a60 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57536/0 (socket says 172.21.15.82:57536) 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 -- 172.21.15.82:0/3714133645 learned_addr learned my addr 172.21.15.82:0/3714133645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 -- 172.21.15.82:0/3714133645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070101a60 msgr2=0x7f4070199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070101a60 0x7f4070199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 -- 172.21.15.82:0/3714133645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407019a310 con 0x7f4070100860 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4075c2e640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f406800b9c0 tx=0x7f406800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4068019070 con 0x7f4070100860 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f406800cde0 con 0x7f4070100860 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.940+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407019ed50 con 0x7f4070100860 2024-09-17T01:38:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.941+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4068012570 con 0x7f4070100860 2024-09-17T01:38:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.941+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407019f330 con 0x7f4070100860 2024-09-17T01:38:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.942+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4070109f00 con 0x7f4070100860 2024-09-17T01:38:35.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.942+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f406801c070 con 0x7f4070100860 2024-09-17T01:38:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.942+0000 7f406effd640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 0x7f40580707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.942+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f406808d720 con 0x7f4070100860 2024-09-17T01:38:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.942+0000 7f407542d640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 0x7f40580707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.943+0000 7f407542d640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 0x7f40580707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40640096c0 tx=0x7f4064000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:35.947+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f406805b440 con 0x7f4070100860 2024-09-17T01:38:36.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.120+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f407002db70 con 0x7f405806e310 2024-09-17T01:38:36.118 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:36 smithi082 ceph-mon[28077]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.129+0000 7f406effd640 1 -- 172.21.15.82:0/3714133645 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f407002db70 con 0x7f405806e310 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (3m) 118s ago 5m 25.8M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (5m) 118s ago 5m 7662k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (4m) 41s ago 4m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 118s ago 5m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (4m) 41s ago 4m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (3m) 118s ago 4m 77.7M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:38:36.127 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (6m) 118s ago 6m 489M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (4m) 41s ago 4m 441M - 19.1.1-330-gc2ddf972 ebb0615149de 79d443bb49e2 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 118s ago 6m 44.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (4m) 41s ago 4m 40.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (5m) 118s ago 5m 13.5M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (4m) 41s ago 4m 16.6M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 118s ago 3m 45.7M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 118s ago 2m 46.3M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 118s ago 2m 11.8M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (101s) 41s ago 101s 49.3M 4970M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (74s) 41s ago 73s 36.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (46s) 41s ago 46s 12.1M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:38:36.128 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 118s ago 4m 43.8M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:38:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 msgr2=0x7f40580707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 0x7f40580707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40640096c0 tx=0x7f4064000bc0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 msgr2=0x7f4070199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f406800b9c0 tx=0x7f406800be80 comp rx=0 tx=0).stop 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 shutdown_connections 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f405806e310 0x7f40580707d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4070101a60 0x7f4070199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 --2- 172.21.15.82:0/3714133645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4070100860 0x7f4070199750 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 >> 172.21.15.82:0/3714133645 conn(0x7f40700fc010 msgr2=0x7f40700fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 shutdown_connections 2024-09-17T01:38:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:36.131+0000 7f4077e92640 1 -- 172.21.15.82:0/3714133645 wait complete. 2024-09-17T01:38:36.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:36 smithi167 ceph-mon[35643]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:36.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T01:38:37.110 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:37.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:37 smithi082 ceph-mon[28077]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:37.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:37 smithi167 ceph-mon[35643]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 -- 172.21.15.82:0/3127853900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8104da0 msgr2=0x7f77b8107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 --2- 172.21.15.82:0/3127853900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8104da0 0x7f77b8107190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009880 tx=0x7f77a002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 -- 172.21.15.82:0/3127853900 shutdown_connections 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 --2- 172.21.15.82:0/3127853900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8104da0 0x7f77b8107190 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 --2- 172.21.15.82:0/3127853900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8102470 0x7f77b8104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 -- 172.21.15.82:0/3127853900 >> 172.21.15.82:0/3127853900 conn(0x7f77b80fc030 msgr2=0x7f77b80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 -- 172.21.15.82:0/3127853900 shutdown_connections 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.554+0000 7f77bcced640 1 -- 172.21.15.82:0/3127853900 wait complete. 2024-09-17T01:38:37.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 Processor -- start 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 -- start start 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8104da0 0x7f77b8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77b810a740 con 0x7f77b8102470 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77bcced640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77b810a5c0 con 0x7f77b8104da0 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77b659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77b659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41452/0 (socket says 172.21.15.82:41452) 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.555+0000 7f77b659c640 1 -- 172.21.15.82:0/1286888146 learned_addr learned my addr 172.21.15.82:0/1286888146 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77affff640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8104da0 0x7f77b8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77b659c640 1 -- 172.21.15.82:0/1286888146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8104da0 msgr2=0x7f77b8197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77b659c640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8104da0 0x7f77b8197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77b659c640 1 -- 172.21.15.82:0/1286888146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b81980c0 con 0x7f77b8102470 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77b659c640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c810 tx=0x7f77a800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:37.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a8004020 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77a80041c0 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b819cb00 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a80047a0 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.556+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b819d060 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.557+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b810af20 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.558+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f77a80049a0 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.558+0000 7f77af7fe640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 0x7f77a4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.558+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f77a808dd90 con 0x7f77b8102470 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.558+0000 7f77affff640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 0x7f77a4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.558+0000 7f77affff640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 0x7f77a4070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000c00 tx=0x7f77a0005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.562+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77a8014030 con 0x7f77b8102470 2024-09-17T01:38:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.736+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f77b81057e0 con 0x7f77a406e2b0 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.740+0000 7f77af7fe640 1 -- 172.21.15.82:0/1286888146 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7f77b81057e0 con 0x7f77a406e2b0 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stdout:crash 2/2 2m ago 5m * 2024-09-17T01:38:37.738 INFO:teuthology.orchestra.run.smithi082.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-17T01:38:37.739 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 2/2 2m ago 5m count:2 2024-09-17T01:38:37.739 INFO:teuthology.orchestra.run.smithi082.stdout:mon 2/2 2m ago 5m smithi082:172.21.15.82=smithi082;smithi167:172.21.15.167=smithi167;count:2 2024-09-17T01:38:37.739 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-17T01:38:37.739 INFO:teuthology.orchestra.run.smithi082.stdout:osd 6 2m ago - 2024-09-17T01:38:37.739 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-17T01:38:37.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.742+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 msgr2=0x7f77a4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 0x7f77a4070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000c00 tx=0x7f77a0005a20 comp rx=0 tx=0).stop 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 msgr2=0x7f77b8197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f77a800c810 tx=0x7f77a800ccd0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 shutdown_connections 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77a406e2b0 0x7f77a4070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77b8104da0 0x7f77b8197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 --2- 172.21.15.82:0/1286888146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77b8102470 0x7f77b8197500 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 >> 172.21.15.82:0/1286888146 conn(0x7f77b80fc030 msgr2=0x7f77b80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 shutdown_connections 2024-09-17T01:38:37.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:37.743+0000 7f77bcced640 1 -- 172.21.15.82:0/1286888146 wait complete. 2024-09-17T01:38:38.452 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:38 smithi082 ceph-mon[28077]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:38.453 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:38 smithi082 ceph-mon[28077]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:38.453 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:38 smithi082 ceph-mon[28077]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:38.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T01:38:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:38 smithi167 ceph-mon[35643]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:38 smithi167 ceph-mon[35643]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:38 smithi167 ceph-mon[35643]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:38.728 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 -- 172.21.15.82:0/3777407812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec100860 msgr2=0x7fcbec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/3777407812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec100860 0x7fcbec100c60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009880 tx=0x7fcbdc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 -- 172.21.15.82:0/3777407812 shutdown_connections 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/3777407812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec101a60 0x7fcbec101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/3777407812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec100860 0x7fcbec100c60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 -- 172.21.15.82:0/3777407812 >> 172.21.15.82:0/3777407812 conn(0x7fcbec0fc010 msgr2=0x7fcbec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:39.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 -- 172.21.15.82:0/3777407812 shutdown_connections 2024-09-17T01:38:39.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.173+0000 7fcbf13dc640 1 -- 172.21.15.82:0/3777407812 wait complete. 2024-09-17T01:38:39.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.174+0000 7fcbf13dc640 1 Processor -- start 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbf13dc640 1 -- start start 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbf13dc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec100860 0x7fcbec06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbf13dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbf13dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec109700 con 0x7fcbec101a60 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbf13dc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec109580 con 0x7fcbec100860 2024-09-17T01:38:39.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41470/0 (socket says 172.21.15.82:41470) 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 -- 172.21.15.82:0/1725402018 learned_addr learned my addr 172.21.15.82:0/1725402018 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbeaffd640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec100860 0x7fcbec06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 -- 172.21.15.82:0/1725402018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec100860 msgr2=0x7fcbec06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec100860 0x7fcbec06aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 -- 172.21.15.82:0/1725402018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec19c850 con 0x7fcbec101a60 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe3fff640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b420 tx=0x7fcbd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.175+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd4011630 con 0x7fcbec101a60 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.176+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec19cb40 con 0x7fcbec101a60 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.176+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbd4016070 con 0x7fcbec101a60 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.176+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd4010d30 con 0x7fcbec101a60 2024-09-17T01:38:39.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.176+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec19d150 con 0x7fcbec101a60 2024-09-17T01:38:39.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.177+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec100c60 con 0x7fcbec101a60 2024-09-17T01:38:39.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.177+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fcbd401b460 con 0x7fcbec101a60 2024-09-17T01:38:39.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.178+0000 7fcbe8ff9640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 0x7fcbd8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:39.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.178+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fcbd408d640 con 0x7fcbec101a60 2024-09-17T01:38:39.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.178+0000 7fcbeaffd640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 0x7fcbd8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:39.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.178+0000 7fcbeaffd640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 0x7fcbd8070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009230 tx=0x7fcbdc0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:39.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.182+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbd405b250 con 0x7fcbec101a60 2024-09-17T01:38:39.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.353+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fcbec062630 con 0x7fcbd806e2b0 2024-09-17T01:38:39.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.354+0000 7fcbe8ff9640 1 -- 172.21.15.82:0/1725402018 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7fcbec062630 con 0x7fcbd806e2b0 2024-09-17T01:38:39.352 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-09-17T01:38:39.352 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-09-17T01:38:39.352 INFO:teuthology.orchestra.run.smithi082.stdout:smithi167 172.21.15.167 2024-09-17T01:38:39.352 INFO:teuthology.orchestra.run.smithi082.stdout:2 hosts in cluster 2024-09-17T01:38:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.356+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 msgr2=0x7fcbd8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.356+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 0x7fcbd8070770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009230 tx=0x7fcbdc0058d0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.356+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 msgr2=0x7fcbec19c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.356+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b420 tx=0x7fcbd400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 shutdown_connections 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbec101a60 0x7fcbec19c290 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fcbd806e2b0 0x7fcbd8070770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 --2- 172.21.15.82:0/1725402018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbec100860 0x7fcbec06aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 >> 172.21.15.82:0/1725402018 conn(0x7fcbec0fc010 msgr2=0x7fcbec104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 shutdown_connections 2024-09-17T01:38:39.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:39.357+0000 7fcbf13dc640 1 -- 172.21.15.82:0/1725402018 wait complete. 2024-09-17T01:38:40.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T01:38:40.258 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 -- 172.21.15.82:0/911844958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4101a60 msgr2=0x7f47d4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 --2- 172.21.15.82:0/911844958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4101a60 0x7f47d4101ee0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009880 tx=0x7f47c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 -- 172.21.15.82:0/911844958 shutdown_connections 2024-09-17T01:38:40.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 --2- 172.21.15.82:0/911844958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4101a60 0x7f47d4101ee0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 --2- 172.21.15.82:0/911844958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4100860 0x7f47d4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 -- 172.21.15.82:0/911844958 >> 172.21.15.82:0/911844958 conn(0x7f47d40fc010 msgr2=0x7f47d40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 -- 172.21.15.82:0/911844958 shutdown_connections 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 -- 172.21.15.82:0/911844958 wait complete. 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.730+0000 7f47dc586640 1 Processor -- start 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 -- start start 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 0x7f47d41969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f47d4109720 con 0x7f47d4100860 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47d41095a0 con 0x7f47d4101a60 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41490/0 (socket says 172.21.15.82:41490) 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 -- 172.21.15.82:0/3753532148 learned_addr learned my addr 172.21.15.82:0/3753532148 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47d9b21640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 0x7f47d41969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 -- 172.21.15.82:0/3753532148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 msgr2=0x7f47d41969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 0x7f47d41969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 -- 172.21.15.82:0/3753532148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d4197020 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47d9b21640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 0x7f47d41969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47da322640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47d000b3d0 tx=0x7f47d000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47d0015020 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47d0011af0 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d419ba60 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.731+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47d0010da0 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.732+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d419c070 con 0x7f47d4100860 2024-09-17T01:38:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.733+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d4100c60 con 0x7f47d4100860 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.733+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f47d0018020 con 0x7f47d4100860 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.733+0000 7f47c77fe640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 0x7f47c00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.734+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f47d008d940 con 0x7f47d4100860 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.734+0000 7f47d9b21640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 0x7f47c00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.734+0000 7f47d9b21640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 0x7f47c00707d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47c80096c0 tx=0x7f47c8009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.738+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47d001f020 con 0x7f47d4100860 2024-09-17T01:38:40.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.911+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f47d4062630 con 0x7f47c006e310 2024-09-17T01:38:40.909 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:40 smithi082 ceph-mon[28077]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:40.909 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:40 smithi082 ceph-mon[28077]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:40.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.913+0000 7f47c77fe640 1 -- 172.21.15.82:0/3753532148 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f47d4062630 con 0x7f47c006e310 2024-09-17T01:38:40.911 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T01:38:40.911 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-17T01:38:40.911 INFO:teuthology.orchestra.run.smithi082.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 43s ago Has a FileSystem, LVM detected 2024-09-17T01:38:40.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 msgr2=0x7f47c00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 0x7f47c00707d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f47c80096c0 tx=0x7f47c8009650 comp rx=0 tx=0).stop 2024-09-17T01:38:40.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 msgr2=0x7f47d4196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:40.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47d000b3d0 tx=0x7f47d000b890 comp rx=0 tx=0).stop 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 shutdown_connections 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.915+0000 7f47dc586640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f47c006e310 0x7f47c00707d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.916+0000 7f47dc586640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47d4101a60 0x7f47d41969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.916+0000 7f47dc586640 1 --2- 172.21.15.82:0/3753532148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47d4100860 0x7f47d4196460 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.916+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 >> 172.21.15.82:0/3753532148 conn(0x7f47d40fc010 msgr2=0x7f47d4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.916+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 shutdown_connections 2024-09-17T01:38:40.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:40.916+0000 7f47dc586640 1 -- 172.21.15.82:0/3753532148 wait complete. 2024-09-17T01:38:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:40 smithi167 ceph-mon[35643]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:41.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:40 smithi167 ceph-mon[35643]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:41.730 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:41.740 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:41.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-17T01:38:41.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:41 smithi082 ceph-mon[28077]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:42.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:41 smithi167 ceph-mon[35643]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:42.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 -- 172.21.15.82:0/3117435677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798101a80 msgr2=0x7f5798101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 --2- 172.21.15.82:0/3117435677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798101a80 0x7f5798101f00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5780009880 tx=0x7f578002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 -- 172.21.15.82:0/3117435677 shutdown_connections 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 --2- 172.21.15.82:0/3117435677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798101a80 0x7f5798101f00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 --2- 172.21.15.82:0/3117435677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798100880 0x7f5798100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 -- 172.21.15.82:0/3117435677 >> 172.21.15.82:0/3117435677 conn(0x7f57980fc030 msgr2=0x7f57980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 -- 172.21.15.82:0/3117435677 shutdown_connections 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.447+0000 7f579e2cd640 1 -- 172.21.15.82:0/3117435677 wait complete. 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 Processor -- start 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 -- start start 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 0x7f579819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5798109740 con 0x7f5798100880 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f579e2cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57981095c0 con 0x7f5798101a80 2024-09-17T01:38:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f5797fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f5797fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41508/0 (socket says 172.21.15.82:41508) 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f5797fff640 1 -- 172.21.15.82:0/1819184450 learned_addr learned my addr 172.21.15.82:0/1819184450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.448+0000 7f578ffff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 0x7f579819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5797fff640 1 -- 172.21.15.82:0/1819184450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 msgr2=0x7f579819c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5797fff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 0x7f579819c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5797fff640 1 -- 172.21.15.82:0/1819184450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579819c890 con 0x7f5798100880 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f578ffff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 0x7f579819c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5797fff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f578800b3d0 tx=0x7f578800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5788015020 con 0x7f5798100880 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579819cb80 con 0x7f5798100880 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5788011af0 con 0x7f5798100880 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5788010d90 con 0x7f5798100880 2024-09-17T01:38:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.449+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579819d110 con 0x7f5798100880 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.450+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5798100c80 con 0x7f5798100880 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.451+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5788018020 con 0x7f5798100880 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.451+0000 7f5795ffb640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 0x7f5784070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.451+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f578808d9e0 con 0x7f5798100880 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.451+0000 7f578ffff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 0x7f5784070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.451+0000 7f578ffff640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 0x7f5784070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5780006010 tx=0x7f5780000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.455+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f578801f020 con 0x7f5798100880 2024-09-17T01:38:42.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:42.643+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f5798062630 con 0x7f578406e2b0 2024-09-17T01:38:42.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:42 smithi082 ceph-mon[28077]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:38:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:42 smithi167 ceph-mon[35643]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-17T01:38:43.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.969+0000 7f5795ffb640 1 -- 172.21.15.82:0/1819184450 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5798062630 con 0x7f578406e2b0 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 msgr2=0x7f5784070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 0x7f5784070770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5780006010 tx=0x7f5780000bc0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 msgr2=0x7f579806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f578800b3d0 tx=0x7f578800b890 comp rx=0 tx=0).stop 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 shutdown_connections 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f578406e2b0 0x7f5784070770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5798101a80 0x7f579819c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 --2- 172.21.15.82:0/1819184450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5798100880 0x7f579806afb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:43.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 >> 172.21.15.82:0/1819184450 conn(0x7f57980fc030 msgr2=0x7f5798104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:43.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 shutdown_connections 2024-09-17T01:38:43.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:43.972+0000 7f579e2cd640 1 -- 172.21.15.82:0/1819184450 wait complete. 2024-09-17T01:38:44.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-mon[28077]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:38:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-mon[28077]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:38:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:38:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:43 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[28073]: 2024-09-17T01:38:43.947+0000 7f7c039cc640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:38:44.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:43 smithi167 ceph-mon[35643]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:38:44.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:44.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-17T01:38:44.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:43 smithi167 ceph-mon[35643]: osdmap e41: 6 total, 6 up, 6 in 2024-09-17T01:38:44.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:43 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:38:44.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:38:45.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: pgmap v172: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:45.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:38:45.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:38:45.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:38:45.110 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: fsmap cephfs:0 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:45.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:44 smithi082 ceph-mon[28077]: Deploying daemon mds.cephfs.smithi082.haarnz on smithi082 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: pgmap v172: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: osdmap e42: 6 total, 6 up, 6 in 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:38:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: osdmap e43: 6 total, 6 up, 6 in 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: fsmap cephfs:0 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: Saving service mds.cephfs spec with placement count:4 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:45.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:45.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:45.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:44 smithi167 ceph-mon[35643]: Deploying daemon mds.cephfs.smithi082.haarnz on smithi082 2024-09-17T01:38:45.919 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:46.129 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:45 smithi082 ceph-mon[28077]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:38:46.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:45 smithi167 ceph-mon[35643]: osdmap e44: 6 total, 6 up, 6 in 2024-09-17T01:38:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 -- 172.21.15.82:0/1696776431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30102b60 msgr2=0x7f7c30102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 --2- 172.21.15.82:0/1696776431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30102b60 0x7f7c30102fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009880 tx=0x7f7c2402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 -- 172.21.15.82:0/1696776431 shutdown_connections 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 --2- 172.21.15.82:0/1696776431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30102b60 0x7f7c30102fe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 --2- 172.21.15.82:0/1696776431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30101960 0x7f7c30101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 -- 172.21.15.82:0/1696776431 >> 172.21.15.82:0/1696776431 conn(0x7f7c300fd0f0 msgr2=0x7f7c300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 -- 172.21.15.82:0/1696776431 shutdown_connections 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.526+0000 7f7c367da640 1 -- 172.21.15.82:0/1696776431 wait complete. 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 Processor -- start 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 -- start start 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 0x7f7c300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3010a780 con 0x7f7c30101960 2024-09-17T01:38:46.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c367da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3010a600 con 0x7f7c30102b60 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41534/0 (socket says 172.21.15.82:41534) 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 -- 172.21.15.82:0/130281298 learned_addr learned my addr 172.21.15.82:0/130281298 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 -- 172.21.15.82:0/130281298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 msgr2=0x7f7c300745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2f7fe640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 0x7f7c300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 0x7f7c300745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2ffff640 1 -- 172.21.15.82:0/130281298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c30074b20 con 0x7f7c30101960 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.527+0000 7f7c2f7fe640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 0x7f7c300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c2ffff640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c8f0 tx=0x7f7c2000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c200079b0 con 0x7f7c30101960 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c30074e10 con 0x7f7c30101960 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c20007b50 con 0x7f7c30101960 2024-09-17T01:38:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c20018610 con 0x7f7c30101960 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.528+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c300753a0 con 0x7f7c30101960 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.529+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30101d60 con 0x7f7c30101960 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.529+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7c20007d00 con 0x7f7c30101960 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.530+0000 7f7c2d7fa640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 0x7f7c18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.530+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f7c2008e420 con 0x7f7c30101960 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.530+0000 7f7c2f7fe640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 0x7f7c18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.530+0000 7f7c2f7fe640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 0x7f7c18070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c240096c0 tx=0x7f7c24009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.534+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c20014030 con 0x7f7c30101960 2024-09-17T01:38:46.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.758+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7c30062df0 con 0x7f7c30101960 2024-09-17T01:38:46.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.758+0000 7f7c2d7fa640 1 -- 172.21.15.82:0/130281298 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f7c2005bd20 con 0x7f7c30101960 2024-09-17T01:38:46.756 INFO:teuthology.orchestra.run.smithi082.stdout:e2 2024-09-17T01:38:46.756 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:43:948403+0000 2024-09-17T01:38:46.756 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 2 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:43.948337+0000 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:38:46.757 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:in 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:up {} 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:38:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:46.759 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 msgr2=0x7f7c18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 0x7f7c18070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c240096c0 tx=0x7f7c24009650 comp rx=0 tx=0).stop 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 msgr2=0x7f7c30075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000c8f0 tx=0x7f7c2000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 shutdown_connections 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f7c1806e2b0 0x7f7c18070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c30102b60 0x7f7c300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 --2- 172.21.15.82:0/130281298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c30101960 0x7f7c30075f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.760+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 >> 172.21.15.82:0/130281298 conn(0x7f7c300fd0f0 msgr2=0x7f7c30106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.761+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 shutdown_connections 2024-09-17T01:38:46.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:46.761+0000 7f7c367da640 1 -- 172.21.15.82:0/130281298 wait complete. 2024-09-17T01:38:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:46 smithi082 ceph-mon[28077]: pgmap v176: 65 pgs: 14 creating+peering, 15 active+clean, 36 unknown; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:46 smithi082 ceph-mon[28077]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:38:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:46 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/130281298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:38:47.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:46 smithi167 ceph-mon[35643]: pgmap v176: 65 pgs: 14 creating+peering, 15 active+clean, 36 unknown; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:46 smithi167 ceph-mon[35643]: osdmap e45: 6 total, 6 up, 6 in 2024-09-17T01:38:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:46 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/130281298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:38:47.546 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:47.555 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:47.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-17T01:38:47.833 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 -- 172.21.15.82:0/4072961395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30101a60 msgr2=0x7f5e30101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/4072961395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30101a60 0x7f5e30101ee0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009880 tx=0x7f5e1c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 -- 172.21.15.82:0/4072961395 shutdown_connections 2024-09-17T01:38:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/4072961395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30101a60 0x7f5e30101ee0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/4072961395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30100860 0x7f5e30100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 -- 172.21.15.82:0/4072961395 >> 172.21.15.82:0/4072961395 conn(0x7f5e300fc010 msgr2=0x7f5e300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 -- 172.21.15.82:0/4072961395 shutdown_connections 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.342+0000 7f5e36c4e640 1 -- 172.21.15.82:0/4072961395 wait complete. 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 Processor -- start 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 -- start start 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 0x7f5e3019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30109720 con 0x7f5e30100860 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e36c4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5e301095a0 con 0x7f5e30101a60 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40308/0 (socket says 172.21.15.82:40308) 2024-09-17T01:38:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 -- 172.21.15.82:0/793486608 learned_addr learned my addr 172.21.15.82:0/793486608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e2ffff640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 0x7f5e3019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 -- 172.21.15.82:0/793486608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 msgr2=0x7f5e3019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 0x7f5e3019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e349ea640 1 -- 172.21.15.82:0/793486608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3019c880 con 0x7f5e30100860 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.343+0000 7f5e2ffff640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 0x7f5e3019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e349ea640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b3d0 tx=0x7f5e2400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e24015020 con 0x7f5e30100860 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3019cb70 con 0x7f5e30100860 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e24011af0 con 0x7f5e30100860 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3019d100 con 0x7f5e30100860 2024-09-17T01:38:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.344+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e24010d90 con 0x7f5e30100860 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.345+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e30100c60 con 0x7f5e30100860 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.345+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5e24018020 con 0x7f5e30100860 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.346+0000 7f5e2dffb640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 0x7f5e20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.346+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f5e2408dd40 con 0x7f5e30100860 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.346+0000 7f5e2ffff640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 0x7f5e20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.347+0000 7f5e2ffff640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 0x7f5e20070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006a510 tx=0x7f5e1c005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:48.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.351+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e2401f020 con 0x7f5e30100860 2024-09-17T01:38:48.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.557+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f5e30190530 con 0x7f5e30100860 2024-09-17T01:38:48.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.974+0000 7f5e2dffb640 1 -- 172.21.15.82:0/793486608 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f5e30190530 con 0x7f5e30100860 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 msgr2=0x7f5e20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 0x7f5e20070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006a510 tx=0x7f5e1c005a20 comp rx=0 tx=0).stop 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 msgr2=0x7f5e3006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400b3d0 tx=0x7f5e2400b890 comp rx=0 tx=0).stop 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 shutdown_connections 2024-09-17T01:38:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5e2006e2b0 0x7f5e20070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e30101a60 0x7f5e3019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 --2- 172.21.15.82:0/793486608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e30100860 0x7f5e3006a790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 >> 172.21.15.82:0/793486608 conn(0x7f5e300fc010 msgr2=0x7f5e30104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 shutdown_connections 2024-09-17T01:38:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:48.977+0000 7f5e36c4e640 1 -- 172.21.15.82:0/793486608 wait complete. 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: pgmap v178: 65 pgs: 14 creating+peering, 45 active+clean, 6 unknown; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: Deploying daemon mds.cephfs.smithi167.vbekqg on smithi167 2024-09-17T01:38:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:boot 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: daemon mds.cephfs.smithi082.haarnz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: Cluster is now healthy 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: fsmap cephfs:0 1 up:standby 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:creating} 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: daemon mds.cephfs.smithi082.haarnz is now active in filesystem cephfs as rank 0 2024-09-17T01:38:49.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:48 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/793486608' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: pgmap v178: 65 pgs: 14 creating+peering, 45 active+clean, 6 unknown; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: Deploying daemon mds.cephfs.smithi167.vbekqg on smithi167 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:boot 2024-09-17T01:38:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: daemon mds.cephfs.smithi082.haarnz assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: Cluster is now healthy 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: fsmap cephfs:0 1 up:standby 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:creating} 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: daemon mds.cephfs.smithi082.haarnz is now active in filesystem cephfs as rank 0 2024-09-17T01:38:49.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:48 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/793486608' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-17T01:38:49.746 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:49.755 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:49.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-17T01:38:50.007 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:50.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:49 smithi082 ceph-mon[28077]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:38:50.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:49 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/793486608' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:38:50.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:49 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:active 2024-09-17T01:38:50.092 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:49 smithi082 ceph-mon[28077]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 2024-09-17T01:38:50.103 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:49 smithi167 ceph-mon[35643]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:38:50.103 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:49 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/793486608' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:38:50.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:49 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:active 2024-09-17T01:38:50.104 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:49 smithi167 ceph-mon[35643]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 -- 172.21.15.82:0/4174829404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c1023f0 msgr2=0x7f554c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 --2- 172.21.15.82:0/4174829404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c1023f0 0x7f554c1047e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f553c0098b0 tx=0x7f553c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 -- 172.21.15.82:0/4174829404 shutdown_connections 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 --2- 172.21.15.82:0/4174829404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c104d20 0x7f554c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 --2- 172.21.15.82:0/4174829404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c1023f0 0x7f554c1047e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 -- 172.21.15.82:0/4174829404 >> 172.21.15.82:0/4174829404 conn(0x7f554c0fc010 msgr2=0x7f554c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 -- 172.21.15.82:0/4174829404 shutdown_connections 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 -- 172.21.15.82:0/4174829404 wait complete. 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.437+0000 7f55524a7640 1 Processor -- start 2024-09-17T01:38:50.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f55524a7640 1 -- start start 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f55524a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c1023f0 0x7f554c197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f55524a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f55524a7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f554c10a830 con 0x7f554c104d20 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f55524a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f554c10a6b0 con 0x7f554c1023f0 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40316/0 (socket says 172.21.15.82:40316) 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f554b7fe640 1 -- 172.21.15.82:0/1898275440 learned_addr learned my addr 172.21.15.82:0/1898275440 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f554bfff640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c1023f0 0x7f554c197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.438+0000 7f554b7fe640 1 -- 172.21.15.82:0/1898275440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c1023f0 msgr2=0x7f554c197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f554b7fe640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c1023f0 0x7f554c197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f554b7fe640 1 -- 172.21.15.82:0/1898275440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554c198110 con 0x7f554c104d20 2024-09-17T01:38:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f554b7fe640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f554000b3d0 tx=0x7f554000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5540015020 con 0x7f554c104d20 2024-09-17T01:38:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554c19cb50 con 0x7f554c104d20 2024-09-17T01:38:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5540011af0 con 0x7f554c104d20 2024-09-17T01:38:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5540010d30 con 0x7f554c104d20 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.439+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554c19d160 con 0x7f554c104d20 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.440+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554c1027d0 con 0x7f554c104d20 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.441+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5540018020 con 0x7f554c104d20 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.441+0000 7f55497fa640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 0x7f5534070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.441+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f554008dbf0 con 0x7f554c104d20 2024-09-17T01:38:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.441+0000 7f554bfff640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 0x7f5534070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.442+0000 7f554bfff640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 0x7f5534070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f553c006010 tx=0x7f553c0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.446+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f554001f020 con 0x7f554c104d20 2024-09-17T01:38:50.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.680+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f554c19d4f0 con 0x7f554c104d20 2024-09-17T01:38:50.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.976+0000 7f55497fa640 1 -- 172.21.15.82:0/1898275440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) ==== 121+0+0 (secure 0 0 0) 0x7f554005b550 con 0x7f554c104d20 2024-09-17T01:38:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 msgr2=0x7f5534070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 0x7f5534070770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f553c006010 tx=0x7f553c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 msgr2=0x7f554c197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f554000b3d0 tx=0x7f554000b890 comp rx=0 tx=0).stop 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 shutdown_connections 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c104d20 0x7f554c197a90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f553406e2b0 0x7f5534070770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 --2- 172.21.15.82:0/1898275440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f554c1023f0 0x7f554c197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.978+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 >> 172.21.15.82:0/1898275440 conn(0x7f554c0fc010 msgr2=0x7f554c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.979+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 shutdown_connections 2024-09-17T01:38:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:50.979+0000 7f55524a7640 1 -- 172.21.15.82:0/1898275440 wait complete. 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: pgmap v179: 65 pgs: 14 creating+peering, 51 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:50 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1898275440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: pgmap v179: 65 pgs: 14 creating+peering, 51 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:51.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:50 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1898275440' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: Deploying daemon mds.cephfs.smithi082.pwukvc on smithi082 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1898275440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:boot 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: daemon mds.cephfs.smithi167.vbekqg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 1 up:standby 2024-09-17T01:38:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:38:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:creating} 2024-09-17T01:38:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:51 smithi082 ceph-mon[28077]: daemon mds.cephfs.smithi167.vbekqg is now active in filesystem cephfs as rank 1 2024-09-17T01:38:52.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: Deploying daemon mds.cephfs.smithi082.pwukvc on smithi082 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1898275440' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:boot 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: daemon mds.cephfs.smithi167.vbekqg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 1 up:standby 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:creating} 2024-09-17T01:38:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:51 smithi167 ceph-mon[35643]: daemon mds.cephfs.smithi167.vbekqg is now active in filesystem cephfs as rank 1 2024-09-17T01:38:52.686 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:52.697 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:52.697 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-17T01:38:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:53.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:52 smithi167 ceph-mon[35643]: pgmap v180: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 395 B/s wr, 3 op/s 2024-09-17T01:38:53.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:52 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:active 2024-09-17T01:38:53.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:52 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2024-09-17T01:38:53.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:52 smithi082 ceph-mon[28077]: pgmap v180: 65 pgs: 65 active+clean; 578 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 395 B/s wr, 3 op/s 2024-09-17T01:38:53.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:52 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:active 2024-09-17T01:38:53.347 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:52 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2024-09-17T01:38:53.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 -- 172.21.15.82:0/3036231243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 msgr2=0x7f0128101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:53.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 --2- 172.21.15.82:0/3036231243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f0128101ee0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f011c009880 tx=0x7f011c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 -- 172.21.15.82:0/3036231243 shutdown_connections 2024-09-17T01:38:53.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 --2- 172.21.15.82:0/3036231243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f0128101ee0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 --2- 172.21.15.82:0/3036231243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 0x7f0128100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 -- 172.21.15.82:0/3036231243 >> 172.21.15.82:0/3036231243 conn(0x7f01280fc010 msgr2=0x7f01280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 -- 172.21.15.82:0/3036231243 shutdown_connections 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.684+0000 7f012ccc8640 1 -- 172.21.15.82:0/3036231243 wait complete. 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 Processor -- start 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 -- start start 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 0x7f012806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01281096a0 con 0x7f0128101a60 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012ccc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0128109520 con 0x7f0128100860 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f0125d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f0125d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40342/0 (socket says 172.21.15.82:40342) 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f0125d9b640 1 -- 172.21.15.82:0/2918055025 learned_addr learned my addr 172.21.15.82:0/2918055025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.685+0000 7f012659c640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 0x7f012806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f0125d9b640 1 -- 172.21.15.82:0/2918055025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 msgr2=0x7f012806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f0125d9b640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 0x7f012806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f0125d9b640 1 -- 172.21.15.82:0/2918055025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012819c7c0 con 0x7f0128101a60 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f0125d9b640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f011c006010 tx=0x7f011c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f011c03f070 con 0x7f0128101a60 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f011c004ac0 con 0x7f0128101a60 2024-09-17T01:38:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012819ca50 con 0x7f0128101a60 2024-09-17T01:38:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f011c035030 con 0x7f0128101a60 2024-09-17T01:38:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.686+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012819cf80 con 0x7f0128101a60 2024-09-17T01:38:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.687+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0128100c60 con 0x7f0128101a60 2024-09-17T01:38:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.688+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f011c042070 con 0x7f0128101a60 2024-09-17T01:38:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.688+0000 7f01177fe640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 0x7f0110070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.688+0000 7f012659c640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 0x7f0110070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.688+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f011c0aed70 con 0x7f0128101a60 2024-09-17T01:38:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.689+0000 7f012659c640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 0x7f0110070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0118005fd0 tx=0x7f011800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.693+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f011c0802f0 con 0x7f0128101a60 2024-09-17T01:38:53.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.894+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0128062fb0 con 0x7f0128101a60 2024-09-17T01:38:53.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.987+0000 7f01177fe640 1 -- 172.21.15.82:0/2918055025 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7f011c084b20 con 0x7f0128101a60 2024-09-17T01:38:53.987 INFO:teuthology.orchestra.run.smithi082.stderr:inline data enabled 2024-09-17T01:38:53.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 msgr2=0x7f0110070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 0x7f0110070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0118005fd0 tx=0x7f011800b390 comp rx=0 tx=0).stop 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 msgr2=0x7f012819c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f011c006010 tx=0x7f011c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 shutdown_connections 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0128101a60 0x7f012819c200 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f011006e2b0 0x7f0110070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 --2- 172.21.15.82:0/2918055025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0128100860 0x7f012806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 >> 172.21.15.82:0/2918055025 conn(0x7f01280fc010 msgr2=0x7f0128104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 shutdown_connections 2024-09-17T01:38:53.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:53.991+0000 7f012ccc8640 1 -- 172.21.15.82:0/2918055025 wait complete. 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: Deploying daemon mds.cephfs.smithi167.ypfdyj on smithi167 2024-09-17T01:38:54.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2918055025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2918055025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] up:boot 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:38:54.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:54 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby-replay 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: Deploying daemon mds.cephfs.smithi167.ypfdyj on smithi167 2024-09-17T01:38:54.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2918055025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2918055025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] up:boot 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:38:54.611 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:54 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby-replay 2024-09-17T01:38:54.637 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:38:54.649 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:38:54.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:38:54.901 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:55.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 -- 172.21.15.82:0/2865787147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8101a60 msgr2=0x7fdbe8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:55.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 --2- 172.21.15.82:0/2865787147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8101a60 0x7fdbe8101ee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009880 tx=0x7fdbd002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 -- 172.21.15.82:0/2865787147 shutdown_connections 2024-09-17T01:38:55.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 --2- 172.21.15.82:0/2865787147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8101a60 0x7fdbe8101ee0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 --2- 172.21.15.82:0/2865787147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8100860 0x7fdbe8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 -- 172.21.15.82:0/2865787147 >> 172.21.15.82:0/2865787147 conn(0x7fdbe80fc010 msgr2=0x7fdbe80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 -- 172.21.15.82:0/2865787147 shutdown_connections 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 -- 172.21.15.82:0/2865787147 wait complete. 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.362+0000 7fdbede83640 1 Processor -- start 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 -- start start 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 0x7fdbe8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8109680 con 0x7fdbe8100860 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8109500 con 0x7fdbe8101a60 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40346/0 (socket says 172.21.15.82:40346) 2024-09-17T01:38:55.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 -- 172.21.15.82:0/2174490349 learned_addr learned my addr 172.21.15.82:0/2174490349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbdffff640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 0x7fdbe8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 -- 172.21.15.82:0/2174490349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 msgr2=0x7fdbe8197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 0x7fdbe8197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 -- 172.21.15.82:0/2174490349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe81980b0 con 0x7fdbe8100860 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbdffff640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 0x7fdbe8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe77fe640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800d6f0 tx=0x7fdbd800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8017070 con 0x7fdbe8100860 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe819caf0 con 0x7fdbe8100860 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdbd800de00 con 0x7fdbe8100860 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd8003bc0 con 0x7fdbe8100860 2024-09-17T01:38:55.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.363+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe819d080 con 0x7fdbe8100860 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.365+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe8100c60 con 0x7fdbe8100860 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.365+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdbd8003e70 con 0x7fdbe8100860 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.365+0000 7fdbe57fa640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 0x7fdbd4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.366+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fdbd808dd60 con 0x7fdbe8100860 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.366+0000 7fdbdffff640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 0x7fdbd4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:55.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.366+0000 7fdbdffff640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 0x7fdbd4070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00096c0 tx=0x7fdbd0009650 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.370+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdbd805b6c0 con 0x7fdbe8100860 2024-09-17T01:38:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.572+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fdbe819d4d0 con 0x7fdbe8100860 2024-09-17T01:38:55.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.572+0000 7fdbe57fa640 1 -- 172.21.15.82:0/2174490349 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 10 v10) ==== 76+0+1821 (secure 0 0 0) 0x7fdbd805f370 con 0x7fdbe8100860 2024-09-17T01:38:55.571 INFO:teuthology.orchestra.run.smithi082.stdout:e10 2024-09-17T01:38:55.571 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:53:993040+0000 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 10 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:38:55.572 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:53.993028+0000 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:38:55.573 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 2 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:38:55.574 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:38:55.575 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 2 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:38:55.575 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:55.575 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:38:55.575 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 msgr2=0x7fdbd4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 0x7fdbd4070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00096c0 tx=0x7fdbd0009650 comp rx=0 tx=0).stop 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 msgr2=0x7fdbe81974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800d6f0 tx=0x7fdbd800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 shutdown_connections 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fdbd406e2b0 0x7fdbd4070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdbe8101a60 0x7fdbe8197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 --2- 172.21.15.82:0/2174490349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe8100860 0x7fdbe81974f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 >> 172.21.15.82:0/2174490349 conn(0x7fdbe80fc010 msgr2=0x7fdbe8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:55.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 shutdown_connections 2024-09-17T01:38:55.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:55.574+0000 7fdbede83640 1 -- 172.21.15.82:0/2174490349 wait complete. 2024-09-17T01:38:55.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:55 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2174490349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:38:56.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:55 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2174490349' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:38:56.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-17T01:38:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-17T01:38:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] up:boot 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:active 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:38:56.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:56 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:38:57.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-17T01:38:57.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:57.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:57.206 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] up:boot 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] up:active 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 1 up:standby-replay 1 up:standby 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:38:57.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:56 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:38:57.213 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.687+0000 7f97d059b640 1 -- 172.21.15.82:0/2840609660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8101960 msgr2=0x7f97c8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.687+0000 7f97d059b640 1 --2- 172.21.15.82:0/2840609660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8101960 0x7f97c8101d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009880 tx=0x7f97c402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- 172.21.15.82:0/2840609660 shutdown_connections 2024-09-17T01:38:57.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 --2- 172.21.15.82:0/2840609660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8102b60 0x7f97c8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 --2- 172.21.15.82:0/2840609660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8101960 0x7f97c8101d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- 172.21.15.82:0/2840609660 >> 172.21.15.82:0/2840609660 conn(0x7f97c80fd0f0 msgr2=0x7f97c80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- 172.21.15.82:0/2840609660 shutdown_connections 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- 172.21.15.82:0/2840609660 wait complete. 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 Processor -- start 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- start start 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8101960 0x7f97c81996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:57.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810a7a0 con 0x7f97c8102b60 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.688+0000 7f97d059b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810a620 con 0x7f97c8101960 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50248/0 (socket says 172.21.15.82:50248) 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97ce337640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8101960 0x7f97c81996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 -- 172.21.15.82:0/1709717569 learned_addr learned my addr 172.21.15.82:0/1709717569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 -- 172.21.15.82:0/1709717569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8101960 msgr2=0x7f97c81996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8101960 0x7f97c81996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 -- 172.21.15.82:0/1709717569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c819a2b0 con 0x7f97c8102b60 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97cdb36640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d6f0 tx=0x7f97bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:57.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97bc017070 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c819ecf0 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97bc00de00 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97bc004bb0 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.689+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c819f220 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.691+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c8101d60 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.691+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f97bc004e60 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.691+0000 7f97bb7fe640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 0x7f97b4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.691+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f97bc08dcb0 con 0x7f97c8102b60 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.691+0000 7f97ce337640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 0x7f97b4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:57.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.692+0000 7f97ce337640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 0x7f97b4070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009230 tx=0x7f97c40058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:57.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.695+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97bc05f2c0 con 0x7f97c8102b60 2024-09-17T01:38:57.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.904+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97c819f500 con 0x7f97c8102b60 2024-09-17T01:38:57.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.905+0000 7f97bb7fe640 1 -- 172.21.15.82:0/1709717569 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5350 (secure 0 0 0) 0x7f97bc063af0 con 0x7f97c8102b60 2024-09-17T01:38:57.904 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 msgr2=0x7f97b4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 0x7f97b4070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009230 tx=0x7f97c40058d0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 msgr2=0x7f97c8199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d6f0 tx=0x7f97bc00dbb0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 shutdown_connections 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8102b60 0x7f97c8199c30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f97b406e2b0 0x7f97b4070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 --2- 172.21.15.82:0/1709717569 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97c8101960 0x7f97c81996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 >> 172.21.15.82:0/1709717569 conn(0x7f97c80fd0f0 msgr2=0x7f97c8074700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.907+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 shutdown_connections 2024-09-17T01:38:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:57.908+0000 7f97d059b640 1 -- 172.21.15.82:0/1709717569 wait complete. 2024-09-17T01:38:57.916 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:38:58.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-17T01:38:58.934 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:38:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 957 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:38:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] up:standby-replay 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1709717569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:38:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:59.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 957 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] up:standby-replay 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1709717569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:38:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:38:59.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 -- 172.21.15.82:0/419641853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 msgr2=0x7f6724101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:59.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 --2- 172.21.15.82:0/419641853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724101ee0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6718009880 tx=0x7f671802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 -- 172.21.15.82:0/419641853 shutdown_connections 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 --2- 172.21.15.82:0/419641853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724101ee0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 --2- 172.21.15.82:0/419641853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 0x7f6724100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 -- 172.21.15.82:0/419641853 >> 172.21.15.82:0/419641853 conn(0x7f67240fc010 msgr2=0x7f67240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 -- 172.21.15.82:0/419641853 shutdown_connections 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.703+0000 7f672a9f9640 1 -- 172.21.15.82:0/419641853 wait complete. 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 Processor -- start 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 -- start start 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 0x7f6724197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6724109720 con 0x7f6724101a60 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f672a9f9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f67241095a0 con 0x7f6724100860 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:59.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50264/0 (socket says 172.21.15.82:50264) 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 -- 172.21.15.82:0/1416907872 learned_addr learned my addr 172.21.15.82:0/1416907872 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f6723fff640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 0x7f6724197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 -- 172.21.15.82:0/1416907872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 msgr2=0x7f6724197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 0x7f6724197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.704+0000 7f67237fe640 1 -- 172.21.15.82:0/1416907872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67241980f0 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f67237fe640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6718006010 tx=0x7f67180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f671803f070 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67180044d0 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672419cad0 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6718035030 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.705+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672419d0e0 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.706+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6724100c40 con 0x7f6724101a60 2024-09-17T01:38:59.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.706+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6718042070 con 0x7f6724101a60 2024-09-17T01:38:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.707+0000 7f67217fa640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 0x7f670c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:38:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.707+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f67180aeee0 con 0x7f6724101a60 2024-09-17T01:38:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.707+0000 7f6723fff640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 0x7f670c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:38:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.707+0000 7f6723fff640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 0x7f670c070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67241018c0 tx=0x7f6714008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:38:59.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.711+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f671807c840 con 0x7f6724101a60 2024-09-17T01:38:59.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.951+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f6724106860 con 0x7f6724101a60 2024-09-17T01:38:59.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.951+0000 7f67217fa640 1 -- 172.21.15.82:0/1416907872 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) ==== 78+0+98 (secure 0 0 0) 0x7f67180804f0 con 0x7f6724101a60 2024-09-17T01:38:59.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 msgr2=0x7f670c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:59.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 0x7f670c070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67241018c0 tx=0x7f6714008040 comp rx=0 tx=0).stop 2024-09-17T01:38:59.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 msgr2=0x7f6724197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:38:59.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6718006010 tx=0x7f67180048f0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 shutdown_connections 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6724101a60 0x7f6724197a70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f670c06e2b0 0x7f670c070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 --2- 172.21.15.82:0/1416907872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6724100860 0x7f6724197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 >> 172.21.15.82:0/1416907872 conn(0x7f67240fc010 msgr2=0x7f67240fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 shutdown_connections 2024-09-17T01:38:59.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:38:59.953+0000 7f672a9f9640 1 -- 172.21.15.82:0/1416907872 wait complete. 2024-09-17T01:38:59.960 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:39:00.677 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-17T01:39:00.715 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:39:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:00 smithi082 ceph-mon[28077]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:39:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:00 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:active 2024-09-17T01:39:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:00 smithi082 ceph-mon[28077]: mds.? [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] up:standby-replay 2024-09-17T01:39:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:00 smithi082 ceph-mon[28077]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:39:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:00 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1416907872' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:39:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:00 smithi167 ceph-mon[35643]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-17T01:39:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:00 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] up:active 2024-09-17T01:39:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:00 smithi167 ceph-mon[35643]: mds.? [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] up:standby-replay 2024-09-17T01:39:01.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:00 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:39:01.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:00 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1416907872' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-17T01:39:01.381 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:02.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- 172.21.15.82:0/2251445363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441067f0 msgr2=0x7f7244106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:02.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 --2- 172.21.15.82:0/2251445363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441067f0 0x7f7244106bd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7240009880 tx=0x7f724002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- 172.21.15.82:0/2251445363 shutdown_connections 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 --2- 172.21.15.82:0/2251445363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441007f0 0x7f7244100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 --2- 172.21.15.82:0/2251445363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441067f0 0x7f7244106bd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- 172.21.15.82:0/2251445363 >> 172.21.15.82:0/2251445363 conn(0x7f72440fc550 msgr2=0x7f72440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- 172.21.15.82:0/2251445363 shutdown_connections 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- 172.21.15.82:0/2251445363 wait complete. 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 Processor -- start 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- start start 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441067f0 0x7f7244198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f724410dd20 con 0x7f72441007f0 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.443+0000 7f724aca1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f724410dba0 con 0x7f72441067f0 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:02.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50278/0 (socket says 172.21.15.82:50278) 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 -- 172.21.15.82:0/720811543 learned_addr learned my addr 172.21.15.82:0/720811543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f723bfff640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441067f0 0x7f7244198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 -- 172.21.15.82:0/720811543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441067f0 msgr2=0x7f7244198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441067f0 0x7f7244198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 -- 172.21.15.82:0/720811543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72441994c0 con 0x7f72441007f0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7248a3d640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7240031460 tx=0x7f72400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f724003f070 con 0x7f72441007f0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7244199750 con 0x7f72441007f0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7240004cf0 con 0x7f72441007f0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7240035030 con 0x7f72441007f0 2024-09-17T01:39:02.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.444+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72441a1d00 con 0x7f72441007f0 2024-09-17T01:39:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.445+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7244101f30 con 0x7f72441007f0 2024-09-17T01:39:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.446+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7240042070 con 0x7f72441007f0 2024-09-17T01:39:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.447+0000 7f7239ffb640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 0x7f722c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.447+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f72400aec50 con 0x7f72441007f0 2024-09-17T01:39:02.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.447+0000 7f723bfff640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 0x7f722c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:02.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.447+0000 7f723bfff640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 0x7f722c070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f724406a830 tx=0x7f7234008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:02.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.451+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f724007c5b0 con 0x7f72441007f0 2024-09-17T01:39:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.704+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f724406a2d0 con 0x7f72441007f0 2024-09-17T01:39:02.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.704+0000 7f7239ffb640 1 -- 172.21.15.82:0/720811543 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5348 (secure 0 0 0) 0x7f7240080260 con 0x7f72441007f0 2024-09-17T01:39:02.702 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:02.703 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":14,"btime":"2024-09-17T01:38:59:737794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:38:59.660302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14576,"mds_1":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14576":{"gid":14576,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/981106576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":981106576},{"type":"v1","addr":"172.21.15.82:6827","nonce":981106576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14590":{"gid":14590,"name":"cephfs.smithi082.pwukvc","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.82:6829/1373202472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1373202472},{"type":"v1","addr":"172.21.15.82:6829","nonce":1373202472}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24301":{"gid":24301,"name":"cephfs.smithi167.vbekqg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6825/1713530120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1713530120},{"type":"v1","addr":"172.21.15.167:6825","nonce":1713530120}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24315":{"gid":24315,"name":"cephfs.smithi167.ypfdyj","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.167:6827/85255941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":85255941},{"type":"v1","addr":"172.21.15.167:6827","nonce":85255941}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14576,"qdb_cluster":[14576,24301]},"id":1}]} 2024-09-17T01:39:02.703 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 msgr2=0x7f722c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 0x7f722c070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f724406a830 tx=0x7f7234008040 comp rx=0 tx=0).stop 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 msgr2=0x7f7244198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7240031460 tx=0x7f72400048f0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 shutdown_connections 2024-09-17T01:39:02.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f722c06e2b0 0x7f722c070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72441067f0 0x7f7244198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 --2- 172.21.15.82:0/720811543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72441007f0 0x7f7244198930 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 >> 172.21.15.82:0/720811543 conn(0x7f72440fc550 msgr2=0x7f72440fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 shutdown_connections 2024-09-17T01:39:02.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:02.707+0000 7f724aca1640 1 -- 172.21.15.82:0/720811543 wait complete. 2024-09-17T01:39:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:02 smithi082 ceph-mon[28077]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-17T01:39:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:02 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/720811543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:39:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:02 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:03.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:02 smithi167 ceph-mon[35643]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-17T01:39:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:02 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/720811543' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-17T01:39:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:02 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:02 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:03.376 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2024-09-17T01:39:03.377 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T01:39:03.410 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T01:39:03.410 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-17T01:39:03.410 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T01:39:03.410 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:39:03.410 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:03.410 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T01:39:03.411 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T01:39:03.411 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:03.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:03.411 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-09-17T01:39:03.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:03.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-09-17T01:39:03.496 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-09-17T01:39:03.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:39:03.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:03.498 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T01:39:03.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:03.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-09-17T01:39:03.585 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-09-17T01:39:03.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T01:39:03.587 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T01:39:03.587 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:39:03.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:39:03.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:03.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:03.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:03.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:03 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:03.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:03.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:03.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:03.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:03 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:04.183 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:04.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 -- 172.21.15.82:0/68017361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41007f0 msgr2=0x7f46b4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/68017361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41007f0 0x7f46b4100c50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009880 tx=0x7f46a402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 -- 172.21.15.82:0/68017361 shutdown_connections 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/68017361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41007f0 0x7f46b4100c50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/68017361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41067f0 0x7f46b4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 -- 172.21.15.82:0/68017361 >> 172.21.15.82:0/68017361 conn(0x7f46b40fc550 msgr2=0x7f46b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 -- 172.21.15.82:0/68017361 shutdown_connections 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.669+0000 7f46b8c5a640 1 -- 172.21.15.82:0/68017361 wait complete. 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 Processor -- start 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 -- start start 2024-09-17T01:39:04.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41007f0 0x7f46b41965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46b410dcc0 con 0x7f46b41067f0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b8c5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46b410db40 con 0x7f46b41007f0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50292/0 (socket says 172.21.15.82:50292) 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 -- 172.21.15.82:0/2995280943 learned_addr learned my addr 172.21.15.82:0/2995280943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 -- 172.21.15.82:0/2995280943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41007f0 msgr2=0x7f46b41965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41007f0 0x7f46b41965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.670+0000 7f46b1d9b640 1 -- 172.21.15.82:0/2995280943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b4197060 con 0x7f46b41067f0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46b1d9b640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46a4031460 tx=0x7f46a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46a403f070 con 0x7f46b41067f0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41972f0 con 0x7f46b41067f0 2024-09-17T01:39:04.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46a4004cf0 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46a4035030 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.671+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a3e20 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.672+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4101f30 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.672+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f46a4042070 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.673+0000 7f46ab7fe640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 0x7f46a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.673+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f46a40aebe0 con 0x7f46b41067f0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.673+0000 7f46b259c640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 0x7f46a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.673+0000 7f46b259c640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 0x7f46a0070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f469c00a8f0 tx=0x7f469c005bf0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:04.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.677+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46a407c540 con 0x7f46b41067f0 2024-09-17T01:39:04.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.897+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f46b4108d90 con 0x7f46b41067f0 2024-09-17T01:39:04.895 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:04 smithi082 ceph-mon[28077]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-17T01:39:04.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.897+0000 7f46ab7fe640 1 -- 172.21.15.82:0/2995280943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7f46a40801f0 con 0x7f46b41067f0 2024-09-17T01:39:04.896 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 msgr2=0x7f46a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 0x7f46a0070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f469c00a8f0 tx=0x7f469c005bf0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 msgr2=0x7f46b4196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f46a4031460 tx=0x7f46a40048f0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 shutdown_connections 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b41067f0 0x7f46b4196b20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f46a006e2b0 0x7f46a0070770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 --2- 172.21.15.82:0/2995280943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41007f0 0x7f46b41965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 >> 172.21.15.82:0/2995280943 conn(0x7f46b40fc550 msgr2=0x7f46b40fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 shutdown_connections 2024-09-17T01:39:04.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:04.900+0000 7f46b8c5a640 1 -- 172.21.15.82:0/2995280943 wait complete. 2024-09-17T01:39:05.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:04 smithi167 ceph-mon[35643]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-17T01:39:05.962 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:39:05.963 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:39:05.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:05.963 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-09-17T01:39:05.980 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:39:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:39:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:05.981 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:39:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:39:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42244sec preferred_lft 42244sec 2024-09-17T01:39:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link noprefixroute 2024-09-17T01:39:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:05.982 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:39:05.982 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:39:05.983 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-09-17T01:39:06.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:05 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2995280943' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:39:06.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:05 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:06.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:05 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:06.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:06.077 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:05 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2995280943' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:39:06.077 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:05 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:06.077 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:05 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:06.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:06.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:06.245 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:39:06.272 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-09-17T01:39:06.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:06.274 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-09-17T01:39:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-09-17T01:39:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:39:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:39:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:39:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:39:06.394 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-09-17T01:39:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:06.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:06.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:06.869 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-09-17T01:39:06.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:06.886 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-09-17T01:39:06.942 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:06.942 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-09-17T01:39:06.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:06.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T01:39:06.942 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-09-17T01:39:07.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:06 smithi167 ceph-mon[35643]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-17T01:39:07.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:07.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:06 smithi082 ceph-mon[28077]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-17T01:39:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:07.058 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T01:39:07.059 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-09-17T01:39:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:07.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:07.211 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:07.211 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-09-17T01:39:07.211 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-09-17T01:39:07.211 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:39:07.211 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-09-17T01:39:07.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:07.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:07.292 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T01:39:07.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:39:07.292 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:07.321 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T01:39:07.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:39:07.322 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:07.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-09-17T01:39:07.442 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-09-17T01:39:07.499 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:39:07.500 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b2aaa99c0f2b2a6916ca2b16a5a1878d6f8620373fcc293d184e4e226e2440d6/merged 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5c57cbbe5e1b51ab5c70e87f449acbf3eecace8fa988fbc39a7a34c8e1354caf/merged 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e57df5da498b863f64692e69fc981c8f45c09a3b20440bbd0c30ab6b492e9950/merged 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/298e6c496dd95dc2794cfc990cfc44bef8cac262e0e16915e1ec14d4a7e90341/merged 2024-09-17T01:39:07.501 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e00fd8f45e39ea53ac2e71ae4e303260251402a0022799501c53d7baa9ce1145/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/d16017333d2adfa4856811e6ccc0a850c012bf73025dabc1c87c0a96e902d744/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e841052b17d162101bbb697525d71e5e9d2fef9d1a781b084949936ec7bf532/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/9f053ba080000e6e542f686f18a63c278815fa3e557ecbc4f82de9e17392db23/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a57abe30019b7a02cb2f2f78dcd68dba8789f2333c1bb80de9a83d3e26222411/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/01ae45b0a8e1141cbd18c6687a96ac01a161f0c56a6b99985d08d96ce0fe604f/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/eaea172796dc12c6e7c7c796507c34d0c8111eb29643747382bd9a8e1c1165c7/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/801d2acaf2f44da70b26aa19472d46904ebf8c848931f0d373e220575f3f182e/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/0e9534cfa60e2004bdefc8549540dfa1ed3e8cd8bb0efefa50c0caf83cadad36/merged 2024-09-17T01:39:07.502 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-09-17T01:39:07.503 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:07.503 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:07.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:07.503 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-09-17T01:39:07.555 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:39:07.556 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T01:39:07.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-09-17T01:39:07.624 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-09-17T01:39:07.681 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-09-17T01:39:07.682 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b2aaa99c0f2b2a6916ca2b16a5a1878d6f8620373fcc293d184e4e226e2440d6/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5c57cbbe5e1b51ab5c70e87f449acbf3eecace8fa988fbc39a7a34c8e1354caf/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e57df5da498b863f64692e69fc981c8f45c09a3b20440bbd0c30ab6b492e9950/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/298e6c496dd95dc2794cfc990cfc44bef8cac262e0e16915e1ec14d4a7e90341/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e00fd8f45e39ea53ac2e71ae4e303260251402a0022799501c53d7baa9ce1145/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/d16017333d2adfa4856811e6ccc0a850c012bf73025dabc1c87c0a96e902d744/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e841052b17d162101bbb697525d71e5e9d2fef9d1a781b084949936ec7bf532/merged 2024-09-17T01:39:07.683 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/9f053ba080000e6e542f686f18a63c278815fa3e557ecbc4f82de9e17392db23/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a57abe30019b7a02cb2f2f78dcd68dba8789f2333c1bb80de9a83d3e26222411/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/01ae45b0a8e1141cbd18c6687a96ac01a161f0c56a6b99985d08d96ce0fe604f/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/eaea172796dc12c6e7c7c796507c34d0c8111eb29643747382bd9a8e1c1165c7/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/801d2acaf2f44da70b26aa19472d46904ebf8c848931f0d373e220575f3f182e/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/0e9534cfa60e2004bdefc8549540dfa1ed3e8cd8bb0efefa50c0caf83cadad36/merged 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:07.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:07.684 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-09-17T01:39:07.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:2024-09-17T01:39:07.765+0000 7f583b479480 -1 init, newargv = 0x55bd3ab37ea0 newargc=15 2024-09-17T01:39:07.764 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[78152]: starting ceph client 2024-09-17T01:39:07.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[78152]: starting fuse 2024-09-17T01:39:08.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo modprobe fuse 2024-09-17T01:39:08.867 DEBUG:teuthology.orchestra.run.smithi082:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/proc 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/sys 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/dev 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/security 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/shm 2024-09-17T01:39:08.924 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/pts 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/run 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/cgroup 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/pstore 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/bpf 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/ 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/selinux 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/mqueue 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/dev/hugepages 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/debug 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/tracing 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/fs/fuse/connections 2024-09-17T01:39:08.925 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/sys/kernel/config 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/1000 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/ceph 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/b2aaa99c0f2b2a6916ca2b16a5a1878d6f8620373fcc293d184e4e226e2440d6/merged 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5c57cbbe5e1b51ab5c70e87f449acbf3eecace8fa988fbc39a7a34c8e1354caf/merged 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/run/user/0 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e57df5da498b863f64692e69fc981c8f45c09a3b20440bbd0c30ab6b492e9950/merged 2024-09-17T01:39:08.926 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/298e6c496dd95dc2794cfc990cfc44bef8cac262e0e16915e1ec14d4a7e90341/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/e00fd8f45e39ea53ac2e71ae4e303260251402a0022799501c53d7baa9ce1145/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/d16017333d2adfa4856811e6ccc0a850c012bf73025dabc1c87c0a96e902d744/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/5e841052b17d162101bbb697525d71e5e9d2fef9d1a781b084949936ec7bf532/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/9f053ba080000e6e542f686f18a63c278815fa3e557ecbc4f82de9e17392db23/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/a57abe30019b7a02cb2f2f78dcd68dba8789f2333c1bb80de9a83d3e26222411/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/01ae45b0a8e1141cbd18c6687a96ac01a161f0c56a6b99985d08d96ce0fe604f/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/eaea172796dc12c6e7c7c796507c34d0c8111eb29643747382bd9a8e1c1165c7/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/801d2acaf2f44da70b26aa19472d46904ebf8c848931f0d373e220575f3f182e/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/var/lib/containers/storage/overlay/0e9534cfa60e2004bdefc8549540dfa1ed3e8cd8bb0efefa50c0caf83cadad36/merged 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T01:39:08.927 INFO:teuthology.orchestra.run.smithi082.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:08.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:08.928 DEBUG:teuthology.orchestra.run.smithi082:> ls /sys/fs/fuse/connections 2024-09-17T01:39:08.979 INFO:teuthology.orchestra.run.smithi082.stdout:165 2024-09-17T01:39:08.980 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> import glob 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> import re 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> import os 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> import subprocess 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> def _find_admin_socket(client_name): 2024-09-17T01:39:08.980 DEBUG:teuthology.orchestra.run.smithi082:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> files = glob.glob(asok_path) 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> # Given a non-glob path, it better be there 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> if "*" not in asok_path: 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> assert(len(files) == 1) 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> return files[0] 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> for f in files: 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> contents = proc_f.read() 2024-09-17T01:39:08.981 DEBUG:teuthology.orchestra.run.smithi082:> if mountpoint in contents: 2024-09-17T01:39:08.982 DEBUG:teuthology.orchestra.run.smithi082:> return f 2024-09-17T01:39:08.982 DEBUG:teuthology.orchestra.run.smithi082:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:39:08.982 DEBUG:teuthology.orchestra.run.smithi082:> 2024-09-17T01:39:08.982 DEBUG:teuthology.orchestra.run.smithi082:> print(_find_admin_socket("client.0")) 2024-09-17T01:39:08.982 DEBUG:teuthology.orchestra.run.smithi082:> ' 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:08 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:09.041 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:08 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:09.096 INFO:teuthology.orchestra.run.smithi082.stdout:/var/run/ceph/ceph-client.0.78152.asok 2024-09-17T01:39:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:09.107 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78152.asok 2024-09-17T01:39:09.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:09.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78152.asok status 2024-09-17T01:39:09.239 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:39:09.239 INFO:teuthology.orchestra.run.smithi082.stdout: "metadata": { 2024-09-17T01:39:09.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-17T01:39:09.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "entity_id": "0", 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": "smithi082", 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "pid": "78152", 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "root": "/" 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_count": 0, 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "dentry_pinned_count": 0, 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14622, 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "inst": { 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "name": { 2024-09-17T01:39:09.240 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "client", 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "num": 14622 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2424388004 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": { 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2424388004 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:09.241 INFO:teuthology.orchestra.run.smithi082.stdout: "inst_str": "client.14622 192.168.0.1:0/2424388004", 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "addr_str": "192.168.0.1:0/2424388004", 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "inode_count": 1, 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_epoch": 14, 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch": 45, 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "blocklisted": false, 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs" 2024-09-17T01:39:09.242 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:39:09.247 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T01:39:09.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-17T01:39:09.492 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:09.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 -- 172.21.15.82:0/277667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681008b0 msgr2=0x7f6468100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 --2- 172.21.15.82:0/277667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681008b0 0x7f6468100c90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6464009880 tx=0x7f646402a530 comp rx=0 tx=0).stop 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 -- 172.21.15.82:0/277667848 shutdown_connections 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 --2- 172.21.15.82:0/277667848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681011d0 0x7f64681056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 --2- 172.21.15.82:0/277667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681008b0 0x7f6468100c90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 -- 172.21.15.82:0/277667848 >> 172.21.15.82:0/277667848 conn(0x7f64680fc520 msgr2=0x7f64680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.959+0000 7f646fea5640 1 -- 172.21.15.82:0/277667848 shutdown_connections 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 -- 172.21.15.82:0/277667848 wait complete. 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 Processor -- start 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 -- start start 2024-09-17T01:39:09.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681008b0 0x7f646819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64681153d0 con 0x7f64681011d0 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646fea5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6468115250 con 0x7f64681008b0 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646d440640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646d440640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58680/0 (socket says 172.21.15.82:58680) 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646d440640 1 -- 172.21.15.82:0/419163669 learned_addr learned my addr 172.21.15.82:0/419163669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.960+0000 7f646dc41640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681008b0 0x7f646819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646d440640 1 -- 172.21.15.82:0/419163669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681008b0 msgr2=0x7f646819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:09.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646d440640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681008b0 0x7f646819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646d440640 1 -- 172.21.15.82:0/419163669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64681a2860 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646d440640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f645800d8d0 tx=0x7f645800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6458017030 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f645800be10 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64681a2b50 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6458005580 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.961+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64681a30e0 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.962+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646806aa90 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.962+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6458004020 con 0x7f64681011d0 2024-09-17T01:39:09.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.963+0000 7f645effd640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 0x7f6454070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.963+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f6458018070 con 0x7f64681011d0 2024-09-17T01:39:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.963+0000 7f646dc41640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 0x7f6454070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.963+0000 7f646dc41640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 0x7f6454070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64640096c0 tx=0x7f6464031400 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:09.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:09.967+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f645805b750 con 0x7f64681011d0 2024-09-17T01:39:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.168+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6468102d70 con 0x7f64681011d0 2024-09-17T01:39:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.168+0000 7f645effd640 1 -- 172.21.15.82:0/419163669 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7f645805f400 con 0x7f64681011d0 2024-09-17T01:39:10.166 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 msgr2=0x7f6454070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 0x7f6454070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64640096c0 tx=0x7f6464031400 comp rx=0 tx=0).stop 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 msgr2=0x7f646819e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f645800d8d0 tx=0x7f645800dd90 comp rx=0 tx=0).stop 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 shutdown_connections 2024-09-17T01:39:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64681011d0 0x7f646819e4d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f645406e2b0 0x7f6454070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 --2- 172.21.15.82:0/419163669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64681008b0 0x7f646819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 >> 172.21.15.82:0/419163669 conn(0x7f64680fc520 msgr2=0x7f6468112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 shutdown_connections 2024-09-17T01:39:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:10.170+0000 7f646fea5640 1 -- 172.21.15.82:0/419163669 wait complete. 2024-09-17T01:39:10.798 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:10 smithi082 ceph-mon[28077]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:39:10.798 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:10 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/419163669' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T01:39:10.827 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:39:10.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:10.828 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-09-17T01:39:10.846 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T01:39:10.846 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-09-17T01:39:10.847 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42252sec preferred_lft 42252sec 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link noprefixroute 2024-09-17T01:39:10.848 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-09-17T01:39:10.848 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T01:39:10.848 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:10.848 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T01:39:10.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-09-17T01:39:10.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-09-17T01:39:10.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-09-17T01:39:10.849 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T01:39:10.849 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T01:39:10.937 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:11.013 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:10 smithi167 ceph-mon[35643]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:39:11.013 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:10 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/419163669' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-17T01:39:11.047 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:11.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:11.054 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T01:39:11.078 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-17T01:39:11.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:11.080 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-09-17T01:39:11.169 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-09-17T01:39:11.169 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T01:39:11.169 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T01:39:11.169 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T01:39:11.170 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T01:39:11.170 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T01:39:11.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:11.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:11.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:11.423 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-09-17T01:39:11.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:11.439 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-09-17T01:39:11.495 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:11.495 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T01:39:11.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:39:11.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T01:39:11.496 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T01:39:11.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:11.607 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:11.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T01:39:11.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T01:39:11.614 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T01:39:11.614 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T01:39:11.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:11.734 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:11.739 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T01:39:11.740 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-09-17T01:39:11.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-09-17T01:39:11.740 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T01:39:11.740 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-09-17T01:39:11.789 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T01:39:11.812 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:11.818 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T01:39:11.818 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:39:11.818 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:11.833 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T01:39:11.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T01:39:11.833 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:11.888 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-17T01:39:11.954 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:39:12.010 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2024-09-17T01:39:12.011 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2024-09-17T01:39:12.012 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/0 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/aa7035beaf180403b974ed2dc30e5091f515ca43756d1b55bc891d4c504814f2/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/f5e9bff187d65709f63fea59a9190c2ee17b02f8f1a8e0e1f4570a48123b08c3/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/8822302e50931b9e706a348eabf9d416db4ba7695004ffc75e5fb382e4373847/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/0c74be5c3d9b642c6648586c250ea760c2ab443b66ab32b9079fae1162c7f878/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/3c97ab265085e9d6abac9af1f93e6edb9c9041f4f7570ac2010f739a2f5c3c95/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/d2fd5334a11005960b07dfc52034039f6e10ccc1c6d3082691652bbd12848389/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/a236eaf18b316e947ec174775adceb5a3cd57b1727ceb36c33afa43c25b93cca/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/faa115b65eb1187413f800cfe5cbd7fbaf4d622e419406406d17f8156cd10921/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/47b4ee75357d352d6025083be688a7991385ccb734597fb592d88e9360581275/merged 2024-09-17T01:39:12.013 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/f04eb6fdd0c71309cc4d632ef5d4a0c0b3bc315e50b47c485efa2ff2fa9d1748/merged 2024-09-17T01:39:12.014 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2024-09-17T01:39:12.014 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:39:12.014 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:39:12.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.014 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-17T01:39:12.067 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T01:39:12.067 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T01:39:12.110 DEBUG:teuthology.orchestra.run.smithi167:> sudo modprobe fuse 2024-09-17T01:39:12.134 DEBUG:teuthology.orchestra.run.smithi167:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T01:39:12.190 INFO:teuthology.orchestra.run.smithi167.stdout:/proc 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/dev 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/security 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/shm 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/pts 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/run 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/cgroup 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/pstore 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/bpf 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/ 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/selinux 2024-09-17T01:39:12.191 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/debug 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/mqueue 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/dev/hugepages 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/tracing 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/fs/fuse/connections 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/sys/kernel/config 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/1000 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/ceph 2024-09-17T01:39:12.192 INFO:teuthology.orchestra.run.smithi167.stdout:/run/user/0 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/aa7035beaf180403b974ed2dc30e5091f515ca43756d1b55bc891d4c504814f2/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/f5e9bff187d65709f63fea59a9190c2ee17b02f8f1a8e0e1f4570a48123b08c3/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/8822302e50931b9e706a348eabf9d416db4ba7695004ffc75e5fb382e4373847/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/0c74be5c3d9b642c6648586c250ea760c2ab443b66ab32b9079fae1162c7f878/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/3c97ab265085e9d6abac9af1f93e6edb9c9041f4f7570ac2010f739a2f5c3c95/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/d2fd5334a11005960b07dfc52034039f6e10ccc1c6d3082691652bbd12848389/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/a236eaf18b316e947ec174775adceb5a3cd57b1727ceb36c33afa43c25b93cca/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/faa115b65eb1187413f800cfe5cbd7fbaf4d622e419406406d17f8156cd10921/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/47b4ee75357d352d6025083be688a7991385ccb734597fb592d88e9360581275/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/var/lib/containers/storage/overlay/f04eb6fdd0c71309cc4d632ef5d4a0c0b3bc315e50b47c485efa2ff2fa9d1748/merged 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns 2024-09-17T01:39:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:39:12.194 INFO:teuthology.orchestra.run.smithi167.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T01:39:12.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.194 DEBUG:teuthology.orchestra.run.smithi167:> ls /sys/fs/fuse/connections 2024-09-17T01:39:12.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:2024-09-17T01:39:12.217+0000 7f4b148ff480 -1 init, newargv = 0x560c93ebeeb0 newargc=15 2024-09-17T01:39:12.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[61308]: starting ceph client 2024-09-17T01:39:12.223 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi167.stderr:ceph-fuse[61308]: starting fuse 2024-09-17T01:39:12.232 INFO:teuthology.orchestra.run.smithi167.stdout:129 2024-09-17T01:39:12.233 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo stdin-killer -- python3 -c ' 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> import glob 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> import re 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> import os 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> import subprocess 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-17T01:39:12.233 DEBUG:teuthology.orchestra.run.smithi167:> def _find_admin_socket(client_name): 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> files = glob.glob(asok_path) 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> # Given a non-glob path, it better be there 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> if "*" not in asok_path: 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> assert(len(files) == 1) 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> return files[0] 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> for f in files: 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T01:39:12.234 DEBUG:teuthology.orchestra.run.smithi167:> contents = proc_f.read() 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> if mountpoint in contents: 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> return f 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> print(_find_admin_socket("client.1")) 2024-09-17T01:39:12.235 DEBUG:teuthology.orchestra.run.smithi167:> ' 2024-09-17T01:39:12.350 INFO:teuthology.orchestra.run.smithi167.stdout:/var/run/ceph/ceph-client.1.61308.asok 2024-09-17T01:39:12.353 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-17T01:39:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T01:39:12.361 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61308.asok 2024-09-17T01:39:12.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.361 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61308.asok status 2024-09-17T01:39:12.496 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-17T01:39:12.496 INFO:teuthology.orchestra.run.smithi167.stdout: "metadata": { 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_sha1": "8e98666cb045318799c9328f1ae906cc2d724fd2", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.2.0 (8e98666cb045318799c9328f1ae906cc2d724fd2) squid (stable)", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "entity_id": "1", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "hostname": "smithi167", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "pid": "61308", 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: "root": "/" 2024-09-17T01:39:12.497 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_count": 0, 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "dentry_pinned_count": 0, 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "id": 24333, 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "inst": { 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "name": { 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "client", 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "num": 24333 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:39:12.498 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 2452546215 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": { 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "type": "v1", 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addr": "192.168.0.1:0", 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "nonce": 2452546215 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "inst_str": "client.24333 192.168.0.1:0/2452546215", 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "addr_str": "192.168.0.1:0/2452546215", 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "inode_count": 1, 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_epoch": 14, 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch": 45, 2024-09-17T01:39:12.499 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_epoch_barrier": 0, 2024-09-17T01:39:12.500 INFO:teuthology.orchestra.run.smithi167.stdout: "blocklisted": false, 2024-09-17T01:39:12.500 INFO:teuthology.orchestra.run.smithi167.stdout: "fs_name": "cephfs" 2024-09-17T01:39:12.500 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-17T01:39:12.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.505 DEBUG:teuthology.orchestra.run.smithi082:> stat --file-system '--printf=%T 2024-09-17T01:39:12.506 DEBUG:teuthology.orchestra.run.smithi082:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.527 INFO:teuthology.orchestra.run.smithi082.stdout:fuseblk 2024-09-17T01:39:12.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.602 DEBUG:teuthology.orchestra.run.smithi167:> stat --file-system '--printf=%T 2024-09-17T01:39:12.602 DEBUG:teuthology.orchestra.run.smithi167:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.618 INFO:teuthology.orchestra.run.smithi167.stdout:fuseblk 2024-09-17T01:39:12.618 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:39:12.619 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.694 INFO:teuthology.run_tasks:Running task print... 2024-09-17T01:39:12.705 INFO:teuthology.task.print:**** done client 2024-09-17T01:39:12.705 INFO:teuthology.run_tasks:Running task parallel... 2024-09-17T01:39:12.746 INFO:teuthology.task.parallel:starting parallel... 2024-09-17T01:39:12.746 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:39:12.747 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:39:12.747 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:39:12.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-17T01:39:12.748 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-17T01:39:12.748 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-17T01:39:12.753 INFO:tasks.workunit:Pulling workunits from ref ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:12.753 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T01:39:12.753 INFO:tasks.workunit:timeout=3h 2024-09-17T01:39:12.753 INFO:tasks.workunit:cleanup=True 2024-09-17T01:39:12.753 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-09-17 01:38:47.976351025 +0000 2024-09-17T01:39:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-09-17 01:39:12.601657829 +0000 2024-09-17T01:39:12.774 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-09-17T01:39:12.774 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-17T01:39:12.774 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-17T01:39:12.845 DEBUG:teuthology.orchestra.run.smithi167:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-17 01:39:12.842404654 +0000 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-17 01:39:12.842404654 +0000 2024-09-17T01:39:12.863 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: - 2024-09-17T01:39:12.864 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-17T01:39:12.864 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-17T01:39:12.933 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:12 smithi167 ceph-mon[35643]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-17T01:39:12.933 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:12 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:12.935 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:12.935 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:12.951 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T01:39:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:12 smithi082 ceph-mon[28077]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-17T01:39:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:12 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:12.991 INFO:tasks.workunit.client.1.smithi167.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-17T01:39:13.022 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 -- 172.21.15.82:0/1842644145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 msgr2=0x7f0ad4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 --2- 172.21.15.82:0/1842644145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad4102fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009880 tx=0x7f0ac002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 -- 172.21.15.82:0/1842644145 shutdown_connections 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 --2- 172.21.15.82:0/1842644145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad4102fe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 --2- 172.21.15.82:0/1842644145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 0x7f0ad4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 -- 172.21.15.82:0/1842644145 >> 172.21.15.82:0/1842644145 conn(0x7f0ad40fd0f0 msgr2=0x7f0ad40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 -- 172.21.15.82:0/1842644145 shutdown_connections 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.471+0000 7f0adaa86640 1 -- 172.21.15.82:0/1842644145 wait complete. 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 Processor -- start 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 -- start start 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 0x7f0ad4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410a7a0 con 0x7f0ad4102b60 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0adaa86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad410a620 con 0x7f0ad4101960 2024-09-17T01:39:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58698/0 (socket says 172.21.15.82:58698) 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 -- 172.21.15.82:0/633597904 learned_addr learned my addr 172.21.15.82:0/633597904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad8822640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 0x7f0ad4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 -- 172.21.15.82:0/633597904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 msgr2=0x7f0ad4197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 0x7f0ad4197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.472+0000 7f0ad3fff640 1 -- 172.21.15.82:0/633597904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad4198050 con 0x7f0ad4102b60 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0ad3fff640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ac003f070 con 0x7f0ad4102b60 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad419ca30 con 0x7f0ad4102b60 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ac0004ac0 con 0x7f0ad4102b60 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0ac0035030 con 0x7f0ad4102b60 2024-09-17T01:39:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.473+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad419cfc0 con 0x7f0ad4102b60 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.474+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4101d60 con 0x7f0ad4102b60 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.475+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0ac0042070 con 0x7f0ad4102b60 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.475+0000 7f0ad1ffb640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 0x7f0ac4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.475+0000 7f0ad8822640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 0x7f0ac4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.475+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f0ac00aed20 con 0x7f0ad4102b60 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.476+0000 7f0ad8822640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 0x7f0ac4070770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8005fd0 tx=0x7f0ac800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.480+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ac0080330 con 0x7f0ad4102b60 2024-09-17T01:39:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.647+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f0ad4062df0 con 0x7f0ad4102b60 2024-09-17T01:39:13.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.651+0000 7f0ad1ffb640 1 -- 172.21.15.82:0/633597904 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v45)=0 v45) ==== 126+0+0 (secure 0 0 0) 0x7f0ac0084b60 con 0x7f0ad4102b60 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 msgr2=0x7f0ac4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 0x7f0ac4070770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8005fd0 tx=0x7f0ac800b390 comp rx=0 tx=0).stop 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 msgr2=0x7f0ad41979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac00046c0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 shutdown_connections 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ad4102b60 0x7f0ad41979d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0ac406e2b0 0x7f0ac4070770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 --2- 172.21.15.82:0/633597904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad4101960 0x7f0ad4197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 >> 172.21.15.82:0/633597904 conn(0x7f0ad40fd0f0 msgr2=0x7f0ad4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 shutdown_connections 2024-09-17T01:39:13.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:13.653+0000 7f0adaa86640 1 -- 172.21.15.82:0/633597904 wait complete. 2024-09-17T01:39:14.318 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:39:14.318 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:39:14.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-17T01:39:14.608 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/633597904' entity='client.admin' 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:14 smithi082 ceph-mon[28077]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:39:15.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/633597904' entity='client.admin' 2024-09-17T01:39:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:14 smithi167 ceph-mon[35643]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:39:15.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.071+0000 7f31ce867640 1 -- 172.21.15.82:0/958383421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8101a60 msgr2=0x7f31c8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 --2- 172.21.15.82:0/958383421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8101a60 0x7f31c8101ee0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009880 tx=0x7f31bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 -- 172.21.15.82:0/958383421 shutdown_connections 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 --2- 172.21.15.82:0/958383421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8101a60 0x7f31c8101ee0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 --2- 172.21.15.82:0/958383421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8100860 0x7f31c8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 -- 172.21.15.82:0/958383421 >> 172.21.15.82:0/958383421 conn(0x7f31c80fc010 msgr2=0x7f31c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 -- 172.21.15.82:0/958383421 shutdown_connections 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 -- 172.21.15.82:0/958383421 wait complete. 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 Processor -- start 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.072+0000 7f31ce867640 1 -- start start 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8101a60 0x7f31c81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81096a0 con 0x7f31c8100860 2024-09-17T01:39:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8109520 con 0x7f31c8101a60 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58718/0 (socket says 172.21.15.82:58718) 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 -- 172.21.15.82:0/1280513077 learned_addr learned my addr 172.21.15.82:0/1280513077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c77fe640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8101a60 0x7f31c81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 -- 172.21.15.82:0/1280513077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8101a60 msgr2=0x7f31c81968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8101a60 0x7f31c81968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 -- 172.21.15.82:0/1280513077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c8196f60 con 0x7f31c8100860 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c7fff640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31b8007920 tx=0x7f31b8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31b8019070 con 0x7f31c8100860 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c8069d00 con 0x7f31c8100860 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31b8005020 con 0x7f31c8100860 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31b8004b30 con 0x7f31c8100860 2024-09-17T01:39:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.073+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c806a290 con 0x7f31c8100860 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.074+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c8100c60 con 0x7f31c8100860 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.075+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f31b801c070 con 0x7f31c8100860 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.075+0000 7f31c57fa640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 0x7f31b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.075+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f31b8012050 con 0x7f31c8100860 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.075+0000 7f31c77fe640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 0x7f31b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.076+0000 7f31c77fe640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 0x7f31b0070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31bc006010 tx=0x7f31bc000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:15.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.080+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31b805cd40 con 0x7f31c8100860 2024-09-17T01:39:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.246+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f31c818ff20 con 0x7f31c8100860 2024-09-17T01:39:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.247+0000 7f31c57fa640 1 -- 172.21.15.82:0/1280513077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v45)=0 v45) ==== 155+0+0 (secure 0 0 0) 0x7f31b808de20 con 0x7f31c8100860 2024-09-17T01:39:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.248+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 msgr2=0x7f31b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.248+0000 7f31ce867640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 0x7f31b0070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31bc006010 tx=0x7f31bc000bc0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.248+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 msgr2=0x7f31c81963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.248+0000 7f31ce867640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f31b8007920 tx=0x7f31b8007de0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 shutdown_connections 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f31b006e2b0 0x7f31b0070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c8101a60 0x7f31c81968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 --2- 172.21.15.82:0/1280513077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31c8100860 0x7f31c81963a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 >> 172.21.15.82:0/1280513077 conn(0x7f31c80fc010 msgr2=0x7f31c8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 shutdown_connections 2024-09-17T01:39:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:15.249+0000 7f31ce867640 1 -- 172.21.15.82:0/1280513077 wait complete. 2024-09-17T01:39:15.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-17T01:39:16.134 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 -- 172.21.15.82:0/189056977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0101a60 msgr2=0x7fedd0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:16.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 --2- 172.21.15.82:0/189056977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0101a60 0x7fedd0101ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009880 tx=0x7fedc402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 -- 172.21.15.82:0/189056977 shutdown_connections 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 --2- 172.21.15.82:0/189056977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0101a60 0x7fedd0101ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 --2- 172.21.15.82:0/189056977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0100860 0x7fedd0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 -- 172.21.15.82:0/189056977 >> 172.21.15.82:0/189056977 conn(0x7fedd00fc010 msgr2=0x7fedd00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 -- 172.21.15.82:0/189056977 shutdown_connections 2024-09-17T01:39:16.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 -- 172.21.15.82:0/189056977 wait complete. 2024-09-17T01:39:16.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.620+0000 7fedd6f37640 1 Processor -- start 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 -- start start 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101a60 0x7fedd0102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0109720 con 0x7fedd0100860 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedd01095a0 con 0x7fedd0101a60 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58736/0 (socket says 172.21.15.82:58736) 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 -- 172.21.15.82:0/1091122157 learned_addr learned my addr 172.21.15.82:0/1091122157 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedcffff640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101a60 0x7fedd0102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:16.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 -- 172.21.15.82:0/1091122157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101a60 msgr2=0x7fedd0102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101a60 0x7fedd0102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 -- 172.21.15.82:0/1091122157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd0103380 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd4cd3640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b3d0 tx=0x7fedc000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc0015020 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd0103670 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedc0011af0 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.621+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedc0010da0 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.622+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd0103c80 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.623+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd0100c60 con 0x7fedd0100860 2024-09-17T01:39:16.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.623+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fedc0018020 con 0x7fedd0100860 2024-09-17T01:39:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.623+0000 7fedcdffb640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 0x7fedb8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.624+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fedc008dcb0 con 0x7fedd0100860 2024-09-17T01:39:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.624+0000 7fedcffff640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 0x7fedb8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:16.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.624+0000 7fedcffff640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 0x7fedb8070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fedd0104500 tx=0x7fedc4005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:16.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.628+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fedc001f020 con 0x7fedd0100860 2024-09-17T01:39:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.796+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fedd019f680 con 0x7fedd0100860 2024-09-17T01:39:16.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.796+0000 7fedcdffb640 1 -- 172.21.15.82:0/1091122157 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v45)=0 v45) ==== 163+0+0 (secure 0 0 0) 0x7fedc005b610 con 0x7fedd0100860 2024-09-17T01:39:16.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 msgr2=0x7fedb8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:16.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 0x7fedb8070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fedd0104500 tx=0x7fedc4005a20 comp rx=0 tx=0).stop 2024-09-17T01:39:16.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 msgr2=0x7fedd0104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:16.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fedc000b3d0 tx=0x7fedc000b890 comp rx=0 tx=0).stop 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 shutdown_connections 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fedb806e2b0 0x7fedb8070770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedd0101a60 0x7fedd0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 --2- 172.21.15.82:0/1091122157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd0100860 0x7fedd0104780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 >> 172.21.15.82:0/1091122157 conn(0x7fedd00fc010 msgr2=0x7fedd0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.798+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 shutdown_connections 2024-09-17T01:39:16.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:16.799+0000 7fedd6f37640 1 -- 172.21.15.82:0/1091122157 wait complete. 2024-09-17T01:39:17.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:16 smithi082 ceph-mon[28077]: pgmap v192: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T01:39:17.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:16 smithi167 ceph-mon[35643]: pgmap v192: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-17T01:39:17.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-17T01:39:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 -- 172.21.15.82:0/2151308427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128101a60 msgr2=0x7f9128101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 --2- 172.21.15.82:0/2151308427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128101a60 0x7f9128101ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9118009880 tx=0x7f911802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 -- 172.21.15.82:0/2151308427 shutdown_connections 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 --2- 172.21.15.82:0/2151308427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128101a60 0x7f9128101ee0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 --2- 172.21.15.82:0/2151308427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128100860 0x7f9128100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 -- 172.21.15.82:0/2151308427 >> 172.21.15.82:0/2151308427 conn(0x7f91280fc010 msgr2=0x7f91280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.169+0000 7f9130279640 1 -- 172.21.15.82:0/2151308427 shutdown_connections 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 -- 172.21.15.82:0/2151308427 wait complete. 2024-09-17T01:39:18.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 Processor -- start 2024-09-17T01:39:18.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 -- start start 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128101a60 0x7f9128197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9128109680 con 0x7f9128100860 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f9130279640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9128109500 con 0x7f9128101a60 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.170+0000 7f912e015640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46380/0 (socket says 172.21.15.82:46380) 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 -- 172.21.15.82:0/3940606446 learned_addr learned my addr 172.21.15.82:0/3940606446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:18.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912d814640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128101a60 0x7f9128197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 -- 172.21.15.82:0/3940606446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128101a60 msgr2=0x7f9128197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128101a60 0x7f9128197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 -- 172.21.15.82:0/3940606446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9128197ff0 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f912e015640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f912400c8f0 tx=0x7f912400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9124004020 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912819ca60 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9124007e10 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9124003e10 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.171+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912819cfc0 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.172+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128100c60 con 0x7f9128100860 2024-09-17T01:39:18.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.173+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f91240041c0 con 0x7f9128100860 2024-09-17T01:39:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.173+0000 7f911f7fe640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 0x7f9114070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.173+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f912408e2b0 con 0x7f9128100860 2024-09-17T01:39:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.173+0000 7f912d814640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 0x7f9114070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:18.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.174+0000 7f912d814640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 0x7f9114070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9128198970 tx=0x7f9118005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.177+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9124015330 con 0x7f9128100860 2024-09-17T01:39:18.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.343+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f912819d980 con 0x7f9128100860 2024-09-17T01:39:18.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.343+0000 7f911f7fe640 1 -- 172.21.15.82:0/3940606446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v45)=0 v45) ==== 135+0+0 (secure 0 0 0) 0x7f912405bc10 con 0x7f9128100860 2024-09-17T01:39:18.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 msgr2=0x7f9114070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:18.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 0x7f9114070770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9128198970 tx=0x7f9118005a20 comp rx=0 tx=0).stop 2024-09-17T01:39:18.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 msgr2=0x7f91281974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:18.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f912400c8f0 tx=0x7f912400cdb0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 shutdown_connections 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f911406e2b0 0x7f9114070770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9128101a60 0x7f9128197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 --2- 172.21.15.82:0/3940606446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9128100860 0x7f91281974c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.345+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 >> 172.21.15.82:0/3940606446 conn(0x7f91280fc010 msgr2=0x7f9128069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.346+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 shutdown_connections 2024-09-17T01:39:18.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:18.346+0000 7f9130279640 1 -- 172.21.15.82:0/3940606446 wait complete. 2024-09-17T01:39:18.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:18 smithi082 ceph-mon[28077]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:39:18.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-17T01:39:19.229 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:19.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:18 smithi167 ceph-mon[35643]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:39:19.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 -- 172.21.15.82:0/1757675394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 msgr2=0x7f6508100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 --2- 172.21.15.82:0/1757675394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508100e30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009880 tx=0x7f64fc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 -- 172.21.15.82:0/1757675394 shutdown_connections 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 --2- 172.21.15.82:0/1757675394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508100e30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 --2- 172.21.15.82:0/1757675394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 0x7f6508100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 -- 172.21.15.82:0/1757675394 >> 172.21.15.82:0/1757675394 conn(0x7f65080fb790 msgr2=0x7f65080fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 -- 172.21.15.82:0/1757675394 shutdown_connections 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.693+0000 7f650d6a4640 1 -- 172.21.15.82:0/1757675394 wait complete. 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 Processor -- start 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 -- start start 2024-09-17T01:39:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 0x7f65081997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f650810ca20 con 0x7f65081009b0 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f650d6a4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f650810c8a0 con 0x7f65080ffc40 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f65067fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f65067fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46402/0 (socket says 172.21.15.82:46402) 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.694+0000 7f65067fc640 1 -- 172.21.15.82:0/3719705071 learned_addr learned my addr 172.21.15.82:0/3719705071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f6506ffd640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 0x7f65081997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f65067fc640 1 -- 172.21.15.82:0/3719705071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 msgr2=0x7f65081997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f65067fc640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 0x7f65081997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f65067fc640 1 -- 172.21.15.82:0/3719705071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650819a370 con 0x7f65081009b0 2024-09-17T01:39:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f65067fc640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009230 tx=0x7f64fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64fc03f070 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64fc0044d0 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650819ed50 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64fc035030 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.695+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f650819f2d0 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.696+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6508100040 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.697+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f64fc042070 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.697+0000 7f64effff640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 0x7f64f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.697+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f64fc0aee70 con 0x7f65081009b0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.697+0000 7f6506ffd640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 0x7f64f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.698+0000 7f6506ffd640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 0x7f64f0070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009990 tx=0x7f64f8009110 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.702+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64fc07c7d0 con 0x7f65081009b0 2024-09-17T01:39:19.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.887+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}) -- 0x7f650810a440 con 0x7f64f006e2b0 2024-09-17T01:39:19.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.894+0000 7f64effff640 1 -- 172.21.15.82:0/3719705071 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f650810a440 con 0x7f64f006e2b0 2024-09-17T01:39:19.892 INFO:teuthology.orchestra.run.smithi082.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 msgr2=0x7f64f0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 0x7f64f0070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009990 tx=0x7f64f8009110 comp rx=0 tx=0).stop 2024-09-17T01:39:19.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 msgr2=0x7f6508199cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009230 tx=0x7f64fc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 shutdown_connections 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65081009b0 0x7f6508199cf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f64f006e2b0 0x7f64f0070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 --2- 172.21.15.82:0/3719705071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65080ffc40 0x7f65081997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.896+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 >> 172.21.15.82:0/3719705071 conn(0x7f65080fb790 msgr2=0x7f65080fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.897+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 shutdown_connections 2024-09-17T01:39:19.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:19.897+0000 7f650d6a4640 1 -- 172.21.15.82:0/3719705071 wait complete. 2024-09-17T01:39:20.512 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-17T01:39:20.512 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:39:20.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-17T01:39:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:39:21.121 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:21.122 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:20 smithi082 ceph-mon[28077]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 -- 172.21.15.82:0/3207661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 msgr2=0x7f39f0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 --2- 172.21.15.82:0/3207661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f0102fe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009880 tx=0x7f39e002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 -- 172.21.15.82:0/3207661859 shutdown_connections 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 --2- 172.21.15.82:0/3207661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f0102fe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 --2- 172.21.15.82:0/3207661859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 -- 172.21.15.82:0/3207661859 >> 172.21.15.82:0/3207661859 conn(0x7f39f00fd0f0 msgr2=0x7f39f00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 -- 172.21.15.82:0/3207661859 shutdown_connections 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.217+0000 7f39f7512640 1 -- 172.21.15.82:0/3207661859 wait complete. 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 Processor -- start 2024-09-17T01:39:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 -- start start 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39f010a7a0 con 0x7f39f0102b60 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f7512640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39f010a620 con 0x7f39f0101960 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46428/0 (socket says 172.21.15.82:46428) 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 -- 172.21.15.82:0/371894761 learned_addr learned my addr 172.21.15.82:0/371894761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f52ae640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 -- 172.21.15.82:0/371894761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 msgr2=0x7f39f0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f4aad640 1 -- 172.21.15.82:0/371894761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f0074b20 con 0x7f39f0102b60 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.218+0000 7f39f52ae640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39f4aad640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f39e0006010 tx=0x7f39e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39e003f070 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39e0004ac0 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f0074db0 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39e0035030 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.219+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f00752e0 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.220+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f0101d60 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.220+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f39e0042070 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.221+0000 7f39e67fc640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 0x7f39dc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.221+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f39e00aedf0 con 0x7f39f0102b60 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.221+0000 7f39f52ae640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 0x7f39dc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.221+0000 7f39f52ae640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 0x7f39dc070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39f01029c0 tx=0x7f39ec005e70 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.226+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39e007c750 con 0x7f39f0102b60 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:20 smithi167 ceph-mon[35643]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T01:39:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.441+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f39f0062630 con 0x7f39dc06e2b0 2024-09-17T01:39:21.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.442+0000 7f39e67fc640 1 -- 172.21.15.82:0/371894761 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f39f0062630 con 0x7f39dc06e2b0 2024-09-17T01:39:21.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 msgr2=0x7f39dc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 0x7f39dc070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39f01029c0 tx=0x7f39ec005e70 comp rx=0 tx=0).stop 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 msgr2=0x7f39f00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f39e0006010 tx=0x7f39e00046c0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 shutdown_connections 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39f0102b60 0x7f39f00745e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f39dc06e2b0 0x7f39dc070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 --2- 172.21.15.82:0/371894761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39f0101960 0x7f39f0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 >> 172.21.15.82:0/371894761 conn(0x7f39f00fd0f0 msgr2=0x7f39f0105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 shutdown_connections 2024-09-17T01:39:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.445+0000 7f39f7512640 1 -- 172.21.15.82:0/371894761 wait complete. 2024-09-17T01:39:21.452 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 -- 172.21.15.82:0/4010821835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80101960 msgr2=0x7f2e80101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/4010821835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80101960 0x7f2e80101d60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009880 tx=0x7f2e7402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 -- 172.21.15.82:0/4010821835 shutdown_connections 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/4010821835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80102b60 0x7f2e80102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/4010821835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80101960 0x7f2e80101d60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 -- 172.21.15.82:0/4010821835 >> 172.21.15.82:0/4010821835 conn(0x7f2e800fd110 msgr2=0x7f2e800ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 -- 172.21.15.82:0/4010821835 shutdown_connections 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.538+0000 7f2e86d1d640 1 -- 172.21.15.82:0/4010821835 wait complete. 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 Processor -- start 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 -- start start 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80101960 0x7f2e80075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8010a800 con 0x7f2e80102b60 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e86d1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8010a680 con 0x7f2e80101960 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46434/0 (socket says 172.21.15.82:46434) 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e7ffff640 1 -- 172.21.15.82:0/3463487710 learned_addr learned my addr 172.21.15.82:0/3463487710 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.539+0000 7f2e84ab9640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80101960 0x7f2e80075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7ffff640 1 -- 172.21.15.82:0/3463487710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80101960 msgr2=0x7f2e80075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7ffff640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80101960 0x7f2e80075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7ffff640 1 -- 172.21.15.82:0/3463487710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80074b20 con 0x7f2e80102b60 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7ffff640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00b420 tx=0x7f2e6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c011630 con 0x7f2e80102b60 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80074e10 con 0x7f2e80102b60 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e6c016070 con 0x7f2e80102b60 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c010d40 con 0x7f2e80102b60 2024-09-17T01:39:21.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.540+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80075420 con 0x7f2e80102b60 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.541+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e80101d60 con 0x7f2e80102b60 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.542+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2e6c01b460 con 0x7f2e80102b60 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.542+0000 7f2e7dffb640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 0x7f2e70070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.542+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f2e6c08da80 con 0x7f2e80102b60 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.542+0000 7f2e84ab9640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 0x7f2e70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.543+0000 7f2e84ab9640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 0x7f2e70070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e74000c00 tx=0x7f2e74005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.547+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e6c05b340 con 0x7f2e80102b60 2024-09-17T01:39:21.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.762+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2e80062630 con 0x7f2e7006e2b0 2024-09-17T01:39:21.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.763+0000 7f2e7dffb640 1 -- 172.21.15.82:0/3463487710 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f2e80062630 con 0x7f2e7006e2b0 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 msgr2=0x7f2e70070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 0x7f2e70070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e74000c00 tx=0x7f2e74005a20 comp rx=0 tx=0).stop 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 msgr2=0x7f2e800745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00b420 tx=0x7f2e6c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 shutdown_connections 2024-09-17T01:39:21.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e80102b60 0x7f2e800745e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f2e7006e2b0 0x7f2e70070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 --2- 172.21.15.82:0/3463487710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e80101960 0x7f2e80075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 >> 172.21.15.82:0/3463487710 conn(0x7f2e800fd110 msgr2=0x7f2e80106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 shutdown_connections 2024-09-17T01:39:21.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.765+0000 7f2e86d1d640 1 -- 172.21.15.82:0/3463487710 wait complete. 2024-09-17T01:39:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 -- 172.21.15.82:0/272378239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 msgr2=0x7f89fc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 --2- 172.21.15.82:0/272378239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc102ff0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009880 tx=0x7f89e402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 -- 172.21.15.82:0/272378239 shutdown_connections 2024-09-17T01:39:21.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 --2- 172.21.15.82:0/272378239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc102ff0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 --2- 172.21.15.82:0/272378239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.853+0000 7f8a019f6640 1 -- 172.21.15.82:0/272378239 >> 172.21.15.82:0/272378239 conn(0x7f89fc0fd140 msgr2=0x7f89fc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 -- 172.21.15.82:0/272378239 shutdown_connections 2024-09-17T01:39:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 -- 172.21.15.82:0/272378239 wait complete. 2024-09-17T01:39:21.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 Processor -- start 2024-09-17T01:39:21.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 -- start start 2024-09-17T01:39:21.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc10a790 con 0x7f89fc102b70 2024-09-17T01:39:21.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f8a019f6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc10a610 con 0x7f89fc101970 2024-09-17T01:39:21.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.854+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46444/0 (socket says 172.21.15.82:46444) 2024-09-17T01:39:21.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 -- 172.21.15.82:0/3231702685 learned_addr learned my addr 172.21.15.82:0/3231702685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:21.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89faffd640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 -- 172.21.15.82:0/3231702685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 msgr2=0x7f89fc1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 -- 172.21.15.82:0/3231702685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc198000 con 0x7f89fc102b70 2024-09-17T01:39:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89faffd640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:39:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f89f3fff640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006010 tx=0x7f89e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89e403f070 con 0x7f89fc102b70 2024-09-17T01:39:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89e40044d0 con 0x7f89fc102b70 2024-09-17T01:39:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89e4035030 con 0x7f89fc102b70 2024-09-17T01:39:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc19ca10 con 0x7f89fc102b70 2024-09-17T01:39:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.855+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc19cf10 con 0x7f89fc102b70 2024-09-17T01:39:21.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.856+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc101d70 con 0x7f89fc102b70 2024-09-17T01:39:21.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.857+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f89e4042070 con 0x7f89fc102b70 2024-09-17T01:39:21.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.857+0000 7f8a009f4640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 0x7f89e80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:21.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.858+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f89e40aedf0 con 0x7f89fc102b70 2024-09-17T01:39:21.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.858+0000 7f89faffd640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 0x7f89e80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:21.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.858+0000 7f89faffd640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 0x7f89e80707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89fc1029d0 tx=0x7f89ec00a5e0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:21.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:21.862+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89e407c7d0 con 0x7f89fc102b70 2024-09-17T01:39:22.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.066+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f89fc062630 con 0x7f89e806e310 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.077+0000 7f8a009f4640 1 -- 172.21.15.82:0/3231702685 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f89fc062630 con 0x7f89e806e310 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (4m) 13s ago 5m 25.9M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (6m) 13s ago 6m 8304k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (5m) 16s ago 5m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:39:22.075 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 13s ago 6m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (5m) 16s ago 5m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (4m) 13s ago 5m 79.0M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (35s) 13s ago 34s 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (29s) 13s ago 28s 15.3M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (32s) 16s ago 31s 17.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (26s) 16s ago 26s 15.7M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (7m) 13s ago 7m 499M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (5m) 16s ago 5m 442M - 19.1.1-330-gc2ddf972 ebb0615149de 79d443bb49e2 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 13s ago 7m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (5m) 16s ago 5m 34.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 13s ago 6m 13.6M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (5m) 16s ago 5m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:39:22.076 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 13s ago 3m 55.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (3m) 13s ago 3m 55.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 13s ago 2m 46.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (2m) 16s ago 2m 53.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (119s) 16s ago 119s 41.5M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (92s) 16s ago 92s 42.3M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 13s ago 5m 55.1M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:39:22.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 msgr2=0x7f89e80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 0x7f89e80707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89fc1029d0 tx=0x7f89ec00a5e0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 msgr2=0x7f89fc197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f89e4006010 tx=0x7f89e40048f0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 shutdown_connections 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89fc102b70 0x7f89fc197a10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f89e806e310 0x7f89e80707d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 --2- 172.21.15.82:0/3231702685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89fc101970 0x7f89fc1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 >> 172.21.15.82:0/3231702685 conn(0x7f89fc0fd140 msgr2=0x7f89fc106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.079+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 shutdown_connections 2024-09-17T01:39:22.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.080+0000 7f8a019f6640 1 -- 172.21.15.82:0/3231702685 wait complete. 2024-09-17T01:39:22.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 -- 172.21.15.82:0/4139673166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 msgr2=0x7fa538102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 --2- 172.21.15.82:0/4139673166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa538102fe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009880 tx=0x7fa52c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 -- 172.21.15.82:0/4139673166 shutdown_connections 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 --2- 172.21.15.82:0/4139673166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa538102fe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 --2- 172.21.15.82:0/4139673166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 0x7fa538101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 -- 172.21.15.82:0/4139673166 >> 172.21.15.82:0/4139673166 conn(0x7fa5380fd0d0 msgr2=0x7fa5380ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 -- 172.21.15.82:0/4139673166 shutdown_connections 2024-09-17T01:39:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.167+0000 7fa53ce41640 1 -- 172.21.15.82:0/4139673166 wait complete. 2024-09-17T01:39:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.168+0000 7fa53ce41640 1 Processor -- start 2024-09-17T01:39:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.168+0000 7fa53ce41640 1 -- start start 2024-09-17T01:39:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.168+0000 7fa53ce41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 0x7fa538075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa53ce41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa53ce41640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810a780 con 0x7fa538102b60 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa53ce41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810a600 con 0x7fa538101960 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46454/0 (socket says 172.21.15.82:46454) 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 -- 172.21.15.82:0/189678683 learned_addr learned my addr 172.21.15.82:0/189678683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa53659c640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 0x7fa538075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 -- 172.21.15.82:0/189678683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 msgr2=0x7fa538075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 0x7fa538075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 -- 172.21.15.82:0/189678683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa538074b20 con 0x7fa538102b60 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa535d9b640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009230 tx=0x7fa52c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.169+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa52c03f070 con 0x7fa538102b60 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.170+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa538074db0 con 0x7fa538102b60 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.170+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa52c004b80 con 0x7fa538102b60 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.170+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa52c035030 con 0x7fa538102b60 2024-09-17T01:39:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.170+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5380752e0 con 0x7fa538102b60 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.171+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa538101d60 con 0x7fa538102b60 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.171+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa52c042070 con 0x7fa538102b60 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.172+0000 7fa5277fe640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 0x7fa5200707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.172+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fa52c0aed00 con 0x7fa538102b60 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.172+0000 7fa53659c640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 0x7fa5200707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.172+0000 7fa53659c640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 0x7fa5200707c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa528005fd0 tx=0x7fa528005850 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.177+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa52c0b2030 con 0x7fa538102b60 2024-09-17T01:39:22.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.444+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa538062df0 con 0x7fa538102b60 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.445+0000 7fa5277fe640 1 -- 172.21.15.82:0/189678683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fa52c07c6e0 con 0x7fa538102b60 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:22.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:39:22.444 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 msgr2=0x7fa5200707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 0x7fa5200707c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa528005fd0 tx=0x7fa528005850 comp rx=0 tx=0).stop 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 msgr2=0x7fa5380745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009230 tx=0x7fa52c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 shutdown_connections 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa538102b60 0x7fa5380745e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa52006e300 0x7fa5200707c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 --2- 172.21.15.82:0/189678683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa538101960 0x7fa538075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 >> 172.21.15.82:0/189678683 conn(0x7fa5380fd0d0 msgr2=0x7fa538105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 shutdown_connections 2024-09-17T01:39:22.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.448+0000 7fa53ce41640 1 -- 172.21.15.82:0/189678683 wait complete. 2024-09-17T01:39:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 -- 172.21.15.82:0/4253901441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 msgr2=0x7fc218101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4253901441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc218101ee0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009880 tx=0x7fc20c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 -- 172.21.15.82:0/4253901441 shutdown_connections 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4253901441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc218101ee0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4253901441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 0x7fc218100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 -- 172.21.15.82:0/4253901441 >> 172.21.15.82:0/4253901441 conn(0x7fc2180fc010 msgr2=0x7fc2180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 -- 172.21.15.82:0/4253901441 shutdown_connections 2024-09-17T01:39:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.542+0000 7fc21cd28640 1 -- 172.21.15.82:0/4253901441 wait complete. 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 Processor -- start 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 -- start start 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 0x7fc21806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc218109680 con 0x7fc218101a60 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc21cd28640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc218109500 con 0x7fc218100860 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc215d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc215d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46470/0 (socket says 172.21.15.82:46470) 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.543+0000 7fc215d9b640 1 -- 172.21.15.82:0/4059387996 learned_addr learned my addr 172.21.15.82:0/4059387996 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc21659c640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 0x7fc21806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc215d9b640 1 -- 172.21.15.82:0/4059387996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 msgr2=0x7fc21806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc215d9b640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 0x7fc21806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc215d9b640 1 -- 172.21.15.82:0/4059387996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21819c7e0 con 0x7fc218101a60 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc215d9b640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006010 tx=0x7fc20c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc20c03f070 con 0x7fc218101a60 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc20c004ac0 con 0x7fc218101a60 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc20c035030 con 0x7fc218101a60 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21819ca70 con 0x7fc218101a60 2024-09-17T01:39:22.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.544+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21819cfa0 con 0x7fc218101a60 2024-09-17T01:39:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.546+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218100c60 con 0x7fc218101a60 2024-09-17T01:39:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.546+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc20c042070 con 0x7fc218101a60 2024-09-17T01:39:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.546+0000 7fc2077fe640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 0x7fc2000707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.547+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fc20c0aec90 con 0x7fc218101a60 2024-09-17T01:39:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.547+0000 7fc21659c640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 0x7fc2000707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.547+0000 7fc21659c640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 0x7fc2000707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2181018c0 tx=0x7fc20800b390 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.551+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc20c080290 con 0x7fc218101a60 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.790+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc218062df0 con 0x7fc218101a60 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.790+0000 7fc2077fe640 1 -- 172.21.15.82:0/4059387996 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7fc20c084ac0 con 0x7fc218101a60 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:39:22.788 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:39:22.789 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:39:22.790 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:22.791 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:22.792 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:39:22.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 msgr2=0x7fc2000707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 0x7fc2000707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc2181018c0 tx=0x7fc20800b390 comp rx=0 tx=0).stop 2024-09-17T01:39:22.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 msgr2=0x7fc21819c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc20c006010 tx=0x7fc20c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 shutdown_connections 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc218101a60 0x7fc21819c220 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc20006e310 0x7fc2000707d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 --2- 172.21.15.82:0/4059387996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc218100860 0x7fc21806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.792+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 >> 172.21.15.82:0/4059387996 conn(0x7fc2180fc010 msgr2=0x7fc218104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.793+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 shutdown_connections 2024-09-17T01:39:22.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.793+0000 7fc21cd28640 1 -- 172.21.15.82:0/4059387996 wait complete. 2024-09-17T01:39:22.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 -- 172.21.15.82:0/3066527398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0101a80 msgr2=0x7f5ba0101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 --2- 172.21.15.82:0/3066527398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0101a80 0x7f5ba0101f00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009880 tx=0x7f5b9402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 -- 172.21.15.82:0/3066527398 shutdown_connections 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 --2- 172.21.15.82:0/3066527398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0101a80 0x7f5ba0101f00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 --2- 172.21.15.82:0/3066527398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0100880 0x7f5ba0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 -- 172.21.15.82:0/3066527398 >> 172.21.15.82:0/3066527398 conn(0x7f5ba00fc030 msgr2=0x7f5ba00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 -- 172.21.15.82:0/3066527398 shutdown_connections 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.884+0000 7f5ba6209640 1 -- 172.21.15.82:0/3066527398 wait complete. 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 Processor -- start 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 -- start start 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0101a80 0x7f5ba0102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba01096a0 con 0x7f5ba0100880 2024-09-17T01:39:22.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5ba6209640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba0109520 con 0x7f5ba0101a80 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5b9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5b9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46488/0 (socket says 172.21.15.82:46488) 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5b9f7fe640 1 -- 172.21.15.82:0/2784104401 learned_addr learned my addr 172.21.15.82:0/2784104401 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.885+0000 7f5b9effd640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0101a80 0x7f5ba0102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9f7fe640 1 -- 172.21.15.82:0/2784104401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0101a80 msgr2=0x7f5ba0102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9f7fe640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0101a80 0x7f5ba0102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9f7fe640 1 -- 172.21.15.82:0/2784104401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba01033a0 con 0x7f5ba0100880 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9f7fe640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c8f0 tx=0x7f5b9000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b90004020 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba0103690 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b90007e10 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b90003e10 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.886+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba0103c20 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.887+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba0100c80 con 0x7f5ba0100880 2024-09-17T01:39:22.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.888+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5b900041c0 con 0x7f5ba0100880 2024-09-17T01:39:22.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.888+0000 7f5b9cff9640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 0x7f5b88070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:22.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.888+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f5b9008e2f0 con 0x7f5ba0100880 2024-09-17T01:39:22.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.888+0000 7f5b9effd640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 0x7f5b88070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:22.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.889+0000 7f5b9effd640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 0x7f5b88070770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0104520 tx=0x7f5b94005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:22.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:22.893+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b90015330 con 0x7f5ba0100880 2024-09-17T01:39:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.115+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ba019f550 con 0x7f5b8806e2b0 2024-09-17T01:39:23.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:22 smithi082 ceph-mon[28077]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:23.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:22 smithi082 ceph-mon[28077]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:39:23.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:22 smithi082 ceph-mon[28077]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:23.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:22 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/189678683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:39:23.114 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:22 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4059387996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:39:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.117+0000 7f5b9cff9640 1 -- 172.21.15.82:0/2784104401 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f5ba019f550 con 0x7f5b8806e2b0 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "", 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:ce1b342bf8c6349a8c90cd607f83bff2443f21cf image", 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:39:23.115 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 msgr2=0x7f5b88070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 0x7f5b88070770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ba0104520 tx=0x7f5b94005a20 comp rx=0 tx=0).stop 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 msgr2=0x7f5ba01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c8f0 tx=0x7f5b9000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 shutdown_connections 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f5b8806e2b0 0x7f5b88070770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0101a80 0x7f5ba0102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 --2- 172.21.15.82:0/2784104401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba0100880 0x7f5ba01047a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 >> 172.21.15.82:0/2784104401 conn(0x7f5ba00fc030 msgr2=0x7f5ba006a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 shutdown_connections 2024-09-17T01:39:23.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.119+0000 7f5ba6209640 1 -- 172.21.15.82:0/2784104401 wait complete. 2024-09-17T01:39:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 -- 172.21.15.82:0/2564826692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c101960 msgr2=0x7f0f1c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 --2- 172.21.15.82:0/2564826692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c101960 0x7f0f1c101d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009880 tx=0x7f0f1002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 -- 172.21.15.82:0/2564826692 shutdown_connections 2024-09-17T01:39:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 --2- 172.21.15.82:0/2564826692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f1c102b60 0x7f0f1c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 --2- 172.21.15.82:0/2564826692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c101960 0x7f0f1c101d60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 -- 172.21.15.82:0/2564826692 >> 172.21.15.82:0/2564826692 conn(0x7f0f1c0fd0d0 msgr2=0x7f0f1c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 -- 172.21.15.82:0/2564826692 shutdown_connections 2024-09-17T01:39:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.209+0000 7f0f23123640 1 -- 172.21.15.82:0/2564826692 wait complete. 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 Processor -- start 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 -- start start 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f1c101960 0x7f0f1c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c10a800 con 0x7f0f1c102b60 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f23123640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c10a680 con 0x7f0f1c101960 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46504/0 (socket says 172.21.15.82:46504) 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.210+0000 7f0f1bfff640 1 -- 172.21.15.82:0/1538167996 learned_addr learned my addr 172.21.15.82:0/1538167996 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f1bfff640 1 -- 172.21.15.82:0/1538167996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f1c101960 msgr2=0x7f0f1c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f1bfff640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f1c101960 0x7f0f1c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f1bfff640 1 -- 172.21.15.82:0/1538167996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c074b20 con 0x7f0f1c102b60 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f1bfff640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800b420 tx=0x7f0f0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f08011630 con 0x7f0f1c102b60 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f08016070 con 0x7f0f1c102b60 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c074e10 con 0x7f0f1c102b60 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f08010b30 con 0x7f0f1c102b60 2024-09-17T01:39:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.211+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c075420 con 0x7f0f1c102b60 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.213+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c101d60 con 0x7f0f1c102b60 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.213+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0f08010cd0 con 0x7f0f1c102b60 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.213+0000 7f0f19ffb640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 0x7f0f0c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.214+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f0f0808d840 con 0x7f0f1c102b60 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.214+0000 7f0f20ebf640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 0x7f0f0c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.214+0000 7f0f20ebf640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 0x7f0f0c070770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f1002a9c0 tx=0x7f0f10000bc0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.218+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f08021250 con 0x7f0f1c102b60 2024-09-17T01:39:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:22 smithi167 ceph-mon[35643]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:22 smithi167 ceph-mon[35643]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-17T01:39:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:22 smithi167 ceph-mon[35643]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:22 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/189678683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:39:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:22 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4059387996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:39:23.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.503+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0f1c02d7c0 con 0x7f0f1c102b60 2024-09-17T01:39:23.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.504+0000 7f0f19ffb640 1 -- 172.21.15.82:0/1538167996 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f0f0805b1a0 con 0x7f0f1c102b60 2024-09-17T01:39:23.502 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:39:23.502 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:39:23.502 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 msgr2=0x7f0f0c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 0x7f0f0c070770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f1002a9c0 tx=0x7f0f10000bc0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 msgr2=0x7f0f1c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800b420 tx=0x7f0f0800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 shutdown_connections 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f1c102b60 0x7f0f1c0745e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f0f0c06e2b0 0x7f0f0c070770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 --2- 172.21.15.82:0/1538167996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f1c101960 0x7f0f1c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 >> 172.21.15.82:0/1538167996 conn(0x7f0f1c0fd0d0 msgr2=0x7f0f1c105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 shutdown_connections 2024-09-17T01:39:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:23.506+0000 7f0f23123640 1 -- 172.21.15.82:0/1538167996 wait complete. 2024-09-17T01:39:24.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:23 smithi082 ceph-mon[28077]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:24.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:23 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1538167996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:39:24.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:23 smithi167 ceph-mon[35643]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:24.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:23 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1538167996' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:39:25.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:24 smithi082 ceph-mon[28077]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:24 smithi082 ceph-mon[28077]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T01:39:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:24 smithi167 ceph-mon[35643]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:24 smithi167 ceph-mon[35643]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-17T01:39:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:26 smithi082 ceph-mon[28077]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:39:27.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:26 smithi167 ceph-mon[35643]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-17T01:39:28.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:28.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:28 smithi082 ceph-mon[28077]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:39:29.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:28 smithi167 ceph-mon[35643]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-17T01:39:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:30 smithi082 ceph-mon[28077]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-17T01:39:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:30 smithi167 ceph-mon[35643]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-17T01:39:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:32 smithi082 ceph-mon[28077]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-17T01:39:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:32 smithi167 ceph-mon[35643]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-17T01:39:35.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:34 smithi082 ceph-mon[28077]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-17T01:39:35.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:34 smithi167 ceph-mon[35643]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-17T01:39:37.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:36 smithi082 ceph-mon[28077]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:39:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:36 smithi167 ceph-mon[35643]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-17T01:39:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:38 smithi082 ceph-mon[28077]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:39.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:38 smithi167 ceph-mon[35643]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:40 smithi082 ceph-mon[28077]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:40 smithi167 ceph-mon[35643]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:42 smithi082 ceph-mon[28077]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:42 smithi167 ceph-mon[35643]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:44 smithi082 ceph-mon[28077]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:45.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:44 smithi167 ceph-mon[35643]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:47.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:46 smithi082 ceph-mon[28077]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:47.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:46 smithi167 ceph-mon[35643]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:48.932 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:48 smithi082 ceph-mon[28077]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:49.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:48 smithi167 ceph-mon[35643]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:50 smithi082 ceph-mon[28077]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:51.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:50 smithi167 ceph-mon[35643]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: Upgrade: Target is version 19.3.0-4989-gce1b342b (squid) 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f'] 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: Upgrade: Need to upgrade myself (mgr.smithi082.oppacm) 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:52 smithi082 ceph-mon[28077]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f on smithi167 2024-09-17T01:39:52.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: Upgrade: Target is version 19.3.0-4989-gce1b342b (squid) 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f'] 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: Upgrade: Need to upgrade myself (mgr.smithi082.oppacm) 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:52.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:52 smithi167 ceph-mon[35643]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f on smithi167 2024-09-17T01:39:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 -- 172.21.15.82:0/1056203312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168101a60 msgr2=0x7f5168101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 --2- 172.21.15.82:0/1056203312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168101a60 0x7f5168101ee0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f515c009880 tx=0x7f515c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 -- 172.21.15.82:0/1056203312 shutdown_connections 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 --2- 172.21.15.82:0/1056203312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168101a60 0x7f5168101ee0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 --2- 172.21.15.82:0/1056203312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168100860 0x7f5168100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.633+0000 7f516cd50640 1 -- 172.21.15.82:0/1056203312 >> 172.21.15.82:0/1056203312 conn(0x7f51680fc010 msgr2=0x7f51680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.634+0000 7f516cd50640 1 -- 172.21.15.82:0/1056203312 shutdown_connections 2024-09-17T01:39:53.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.634+0000 7f516cd50640 1 -- 172.21.15.82:0/1056203312 wait complete. 2024-09-17T01:39:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 Processor -- start 2024-09-17T01:39:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 -- start start 2024-09-17T01:39:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 0x7f516819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51681096a0 con 0x7f5168100860 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516cd50640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5168109520 con 0x7f5168101a60 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53534/0 (socket says 172.21.15.82:53534) 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f516659c640 1 -- 172.21.15.82:0/3436844085 learned_addr learned my addr 172.21.15.82:0/3436844085 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f5165d9b640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 0x7f516819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.635+0000 7f5165d9b640 1 -- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 msgr2=0x7f516819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f5165d9b640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f5165d9b640 1 -- 172.21.15.82:0/3436844085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516819e690 con 0x7f5168101a60 2024-09-17T01:39:53.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f516659c640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f5165d9b640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 0x7f516819e010 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f515c009230 tx=0x7f515c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f515c03f070 con 0x7f5168101a60 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51681a3070 con 0x7f5168101a60 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f515c0049d0 con 0x7f5168101a60 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f515c035030 con 0x7f5168101a60 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.636+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681a3600 con 0x7f5168101a60 2024-09-17T01:39:53.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.637+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168100c60 con 0x7f5168101a60 2024-09-17T01:39:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.639+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f515c042070 con 0x7f5168101a60 2024-09-17T01:39:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.640+0000 7f51577fe640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 0x7f51500707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.640+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f515c0af220 con 0x7f5168101a60 2024-09-17T01:39:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.640+0000 7f516659c640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 0x7f51500707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.641+0000 7f516659c640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 0x7f51500707c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51580058c0 tx=0x7f5158005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.644+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f515c07cca0 con 0x7f5168101a60 2024-09-17T01:39:53.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.845+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f51681a3970 con 0x7f515006e300 2024-09-17T01:39:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.846+0000 7f51577fe640 1 -- 172.21.15.82:0/3436844085 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f51681a3970 con 0x7f515006e300 2024-09-17T01:39:53.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 msgr2=0x7f51500707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 0x7f51500707c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f51580058c0 tx=0x7f5158005f90 comp rx=0 tx=0).stop 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 msgr2=0x7f516819e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 0x7f516819e010 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f515c009230 tx=0x7f515c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 shutdown_connections 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f515006e300 0x7f51500707c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5168101a60 0x7f516819e010 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 --2- 172.21.15.82:0/3436844085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5168100860 0x7f516819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.848+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 >> 172.21.15.82:0/3436844085 conn(0x7f51680fc010 msgr2=0x7f51681056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.849+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 shutdown_connections 2024-09-17T01:39:53.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.849+0000 7f516cd50640 1 -- 172.21.15.82:0/3436844085 wait complete. 2024-09-17T01:39:53.855 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.969+0000 7f8d5febb640 1 -- 172.21.15.82:0/927106397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 msgr2=0x7f8d58107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.969+0000 7f8d5febb640 1 --2- 172.21.15.82:0/927106397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58107130 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8d480098b0 tx=0x7f8d4802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 -- 172.21.15.82:0/927106397 shutdown_connections 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 --2- 172.21.15.82:0/927106397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58107130 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 --2- 172.21.15.82:0/927106397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 -- 172.21.15.82:0/927106397 >> 172.21.15.82:0/927106397 conn(0x7f8d580fc010 msgr2=0x7f8d580fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 -- 172.21.15.82:0/927106397 shutdown_connections 2024-09-17T01:39:53.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.970+0000 7f8d5febb640 1 -- 172.21.15.82:0/927106397 wait complete. 2024-09-17T01:39:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 Processor -- start 2024-09-17T01:39:53.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 -- start start 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5810a7d0 con 0x7f8d58104d40 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5febb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5810a650 con 0x7f8d58102410 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5dc57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5d456640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5dc57640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48204/0 (socket says 172.21.15.82:48204) 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5d456640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53556/0 (socket says 172.21.15.82:53556) 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.971+0000 7f8d5dc57640 1 -- 172.21.15.82:0/602647173 learned_addr learned my addr 172.21.15.82:0/602647173 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5dc57640 1 -- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 msgr2=0x7f8d58197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5dc57640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:53.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5dc57640 1 -- 172.21.15.82:0/602647173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d581980f0 con 0x7f8d58102410 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5d456640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5dc57640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d6f0 tx=0x7f8d5400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d54017070 con 0x7f8d58102410 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d58100260 con 0x7f8d58102410 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d581007c0 con 0x7f8d58102410 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d5400de00 con 0x7f8d58102410 2024-09-17T01:39:53.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.972+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d54020060 con 0x7f8d58102410 2024-09-17T01:39:53.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.974+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8d54004900 con 0x7f8d58102410 2024-09-17T01:39:53.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.975+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c0052c0 con 0x7f8d58102410 2024-09-17T01:39:53.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.975+0000 7f8d4effd640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 0x7f8d44070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:53.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.975+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f8d5408eb40 con 0x7f8d58102410 2024-09-17T01:39:53.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.975+0000 7f8d5d456640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 0x7f8d44070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:53.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.976+0000 7f8d5d456640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 0x7f8d44070810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005ab0 tx=0x7f8d48005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:53.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:53.981+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d54060130 con 0x7f8d58102410 2024-09-17T01:39:54.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.213+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8d3c000bf0 con 0x7f8d4406e350 2024-09-17T01:39:54.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.215+0000 7f8d4effd640 1 -- 172.21.15.82:0/602647173 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f8d3c000bf0 con 0x7f8d4406e350 2024-09-17T01:39:54.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 msgr2=0x7f8d44070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 0x7f8d44070810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005ab0 tx=0x7f8d48005a20 comp rx=0 tx=0).stop 2024-09-17T01:39:54.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 msgr2=0x7f8d58197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400d6f0 tx=0x7f8d5400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 shutdown_connections 2024-09-17T01:39:54.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d58104d40 0x7f8d58197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f8d4406e350 0x7f8d44070810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 --2- 172.21.15.82:0/602647173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d58102410 0x7f8d58197530 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 >> 172.21.15.82:0/602647173 conn(0x7f8d580fc010 msgr2=0x7f8d580fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:54.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 shutdown_connections 2024-09-17T01:39:54.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.218+0000 7f8d5febb640 1 -- 172.21.15.82:0/602647173 wait complete. 2024-09-17T01:39:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 -- 172.21.15.82:0/1439096723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124100860 msgr2=0x7f5124100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 --2- 172.21.15.82:0/1439096723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124100860 0x7f5124100c60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5114009880 tx=0x7f511402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 -- 172.21.15.82:0/1439096723 shutdown_connections 2024-09-17T01:39:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 --2- 172.21.15.82:0/1439096723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124101a60 0x7f5124101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 --2- 172.21.15.82:0/1439096723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124100860 0x7f5124100c60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 -- 172.21.15.82:0/1439096723 >> 172.21.15.82:0/1439096723 conn(0x7f51240fc010 msgr2=0x7f51240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:54.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 -- 172.21.15.82:0/1439096723 shutdown_connections 2024-09-17T01:39:54.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.332+0000 7f51288e8640 1 -- 172.21.15.82:0/1439096723 wait complete. 2024-09-17T01:39:54.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.333+0000 7f51288e8640 1 Processor -- start 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.333+0000 7f51288e8640 1 -- start start 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f51288e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f51288e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124101a60 0x7f512419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f51288e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51241096a0 con 0x7f5124101a60 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f51288e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5124109520 con 0x7f5124100860 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48216/0 (socket says 172.21.15.82:48216) 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 -- 172.21.15.82:0/1542218933 learned_addr learned my addr 172.21.15.82:0/1542218933 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f5121d9b640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124101a60 0x7f512419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 -- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124101a60 msgr2=0x7f512419e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124101a60 0x7f512419e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 -- 172.21.15.82:0/1542218933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512419eb30 con 0x7f5124100860 2024-09-17T01:39:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.334+0000 7f512259c640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5114006010 tx=0x7f51140045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.335+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f511403f070 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.335+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512419ed00 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.335+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51140049d0 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.335+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5114035030 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.335+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512419f1b0 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.336+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5124100c60 con 0x7f5124100860 2024-09-17T01:39:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.337+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5114042070 con 0x7f5124100860 2024-09-17T01:39:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.337+0000 7f51137fe640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 0x7f510c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.338+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f51140aecb0 con 0x7f5124100860 2024-09-17T01:39:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.338+0000 7f5121d9b640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 0x7f510c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.338+0000 7f5121d9b640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 0x7f510c070770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f512406a550 tx=0x7f5118005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.343+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51140801d0 con 0x7f5124100860 2024-09-17T01:39:54.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.544+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5124062630 con 0x7f510c06e2b0 2024-09-17T01:39:54.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.561+0000 7f51137fe640 1 -- 172.21.15.82:0/1542218933 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f5124062630 con 0x7f510c06e2b0 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (4m) 46s ago 6m 25.9M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (6m) 46s ago 6m 8304k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (5m) 49s ago 5m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 46s ago 6m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (5m) 49s ago 5m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (4m) 46s ago 6m 79.0M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (67s) 46s ago 66s 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (61s) 46s ago 61s 15.3M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:39:54.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (64s) 49s ago 64s 17.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (59s) 49s ago 58s 15.7M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (7m) 46s ago 7m 499M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (5m) 49s ago 5m 442M - 19.1.1-330-gc2ddf972 ebb0615149de 79d443bb49e2 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 46s ago 7m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (5m) 49s ago 5m 34.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (6m) 46s ago 6m 13.6M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (5m) 49s ago 5m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 46s ago 4m 55.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (3m) 46s ago 3m 55.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 46s ago 3m 46.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (3m) 49s ago 2m 53.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (2m) 49s ago 2m 41.5M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:39:54.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (2m) 49s ago 2m 42.3M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 46s ago 6m 55.1M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 msgr2=0x7f510c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 0x7f510c070770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f512406a550 tx=0x7f5118005f90 comp rx=0 tx=0).stop 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 msgr2=0x7f512406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5114006010 tx=0x7f51140045e0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 shutdown_connections 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5124101a60 0x7f512419e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f510c06e2b0 0x7f510c070770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 --2- 172.21.15.82:0/1542218933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124100860 0x7f512406a7d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.564+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 >> 172.21.15.82:0/1542218933 conn(0x7f51240fc010 msgr2=0x7f5124104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.565+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 shutdown_connections 2024-09-17T01:39:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.565+0000 7f51288e8640 1 -- 172.21.15.82:0/1542218933 wait complete. 2024-09-17T01:39:54.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 -- 172.21.15.82:0/930245647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb580104d20 msgr2=0x7fb580107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 --2- 172.21.15.82:0/930245647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb580104d20 0x7fb580107110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0098b0 tx=0x7fb56c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 -- 172.21.15.82:0/930245647 shutdown_connections 2024-09-17T01:39:54.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 --2- 172.21.15.82:0/930245647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb580104d20 0x7fb580107110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 --2- 172.21.15.82:0/930245647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5801023f0 0x7fb5801047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 -- 172.21.15.82:0/930245647 >> 172.21.15.82:0/930245647 conn(0x7fb5800fc010 msgr2=0x7fb5800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:54.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 -- 172.21.15.82:0/930245647 shutdown_connections 2024-09-17T01:39:54.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.649+0000 7fb586efe640 1 -- 172.21.15.82:0/930245647 wait complete. 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 Processor -- start 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 -- start start 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 0x7fb580195330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 0x7fb580195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb58010a790 con 0x7fb5801023f0 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb586efe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb58010a610 con 0x7fb580104d20 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb57ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 0x7fb580195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb57ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 0x7fb580195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48234/0 (socket says 172.21.15.82:48234) 2024-09-17T01:39:54.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb57ffff640 1 -- 172.21.15.82:0/2446442553 learned_addr learned my addr 172.21.15.82:0/2446442553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.650+0000 7fb584c9a640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 0x7fb580195330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb584c9a640 1 -- 172.21.15.82:0/2446442553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 msgr2=0x7fb580195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb584c9a640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 0x7fb580195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb584c9a640 1 -- 172.21.15.82:0/2446442553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb580195ef0 con 0x7fb5801023f0 2024-09-17T01:39:54.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb584c9a640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 0x7fb580195330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb57400e970 tx=0x7fb57400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb57400cac0 con 0x7fb5801023f0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb57400cc60 con 0x7fb5801023f0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.651+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58019a930 con 0x7fb5801023f0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.652+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb574018720 con 0x7fb5801023f0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.652+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58019aec0 con 0x7fb5801023f0 2024-09-17T01:39:54.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.653+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5801027d0 con 0x7fb5801023f0 2024-09-17T01:39:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.655+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb574010430 con 0x7fb5801023f0 2024-09-17T01:39:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.656+0000 7fb57dffb640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 0x7fb5700707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.656+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fb57408edc0 con 0x7fb5801023f0 2024-09-17T01:39:54.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.656+0000 7fb57ffff640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 0x7fb5700707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:54.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.657+0000 7fb57ffff640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 0x7fb5700707d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5801967e0 tx=0x7fb56c0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:54.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.659+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb574026070 con 0x7fb5801023f0 2024-09-17T01:39:54.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.946+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb5800fd570 con 0x7fb5801023f0 2024-09-17T01:39:54.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:54 smithi082 ceph-mon[28077]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:54.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:54 smithi082 ceph-mon[28077]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:54.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.947+0000 7fb57dffb640 1 -- 172.21.15.82:0/2446442553 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fb57405c840 con 0x7fb5801023f0 2024-09-17T01:39:54.945 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:39:54.946 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 msgr2=0x7fb5700707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 0x7fb5700707d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5801967e0 tx=0x7fb56c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 msgr2=0x7fb580195330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:54.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 0x7fb580195330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb57400e970 tx=0x7fb57400ee30 comp rx=0 tx=0).stop 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 shutdown_connections 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fb57006e310 0x7fb5700707d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb580104d20 0x7fb580195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 --2- 172.21.15.82:0/2446442553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5801023f0 0x7fb580195330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 >> 172.21.15.82:0/2446442553 conn(0x7fb5800fc010 msgr2=0x7fb580101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 shutdown_connections 2024-09-17T01:39:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:54.950+0000 7fb586efe640 1 -- 172.21.15.82:0/2446442553 wait complete. 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 -- 172.21.15.82:0/1734272926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 msgr2=0x7fa2e01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/1734272926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01047e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0098b0 tx=0x7fa2dc02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 -- 172.21.15.82:0/1734272926 shutdown_connections 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/1734272926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/1734272926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01047e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 -- 172.21.15.82:0/1734272926 >> 172.21.15.82:0/1734272926 conn(0x7fa2e00fc010 msgr2=0x7fa2e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 -- 172.21.15.82:0/1734272926 shutdown_connections 2024-09-17T01:39:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.039+0000 7fa2e80b4640 1 -- 172.21.15.82:0/1734272926 wait complete. 2024-09-17T01:39:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 Processor -- start 2024-09-17T01:39:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 -- start start 2024-09-17T01:39:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e010a7c0 con 0x7fa2e01023f0 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e80b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e010a640 con 0x7fa2e0104d20 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e5e50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e5e50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53626/0 (socket says 172.21.15.82:53626) 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e5e50640 1 -- 172.21.15.82:0/3726132732 learned_addr learned my addr 172.21.15.82:0/3726132732 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.040+0000 7fa2e564f640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2e564f640 1 -- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 msgr2=0x7fa2e01974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2e564f640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2e564f640 1 -- 172.21.15.82:0/3726132732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e01980a0 con 0x7fa2e0104d20 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2e564f640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0197a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005fd0 tx=0x7fa2d0009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2d0004030 con 0x7fa2e0104d20 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e0100240 con 0x7fa2e0104d20 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.041+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2d0007d30 con 0x7fa2e0104d20 2024-09-17T01:39:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.042+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e0100770 con 0x7fa2e0104d20 2024-09-17T01:39:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.043+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2d0003d00 con 0x7fa2e0104d20 2024-09-17T01:39:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.043+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e01027d0 con 0x7fa2e0104d20 2024-09-17T01:39:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.044+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa2d0007870 con 0x7fa2e0104d20 2024-09-17T01:39:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.044+0000 7fa2d6ffd640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 0x7fa2cc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.045+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fa2d0015030 con 0x7fa2e0104d20 2024-09-17T01:39:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.045+0000 7fa2e5e50640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 0x7fa2cc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.045+0000 7fa2e5e50640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 0x7fa2cc0707d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0096c0 tx=0x7fa2dc005db0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.050+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2d0063120 con 0x7fa2e0104d20 2024-09-17T01:39:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:54 smithi167 ceph-mon[35643]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:55.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:54 smithi167 ceph-mon[35643]: from='client.24363 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:55.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.297+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa2e0101140 con 0x7fa2e0104d20 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.298+0000 7fa2d6ffd640 1 -- 172.21.15.82:0/3726132732 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7fa2d0067950 con 0x7fa2e0104d20 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:39:55.296 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:39:55.297 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:39:55.298 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:55.299 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 msgr2=0x7fa2cc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 0x7fa2cc0707d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0096c0 tx=0x7fa2dc005db0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 msgr2=0x7fa2e0197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0197a20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0005fd0 tx=0x7fa2d0009f60 comp rx=0 tx=0).stop 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 shutdown_connections 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa2cc06e310 0x7fa2cc0707d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2e0104d20 0x7fa2e0197a20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 --2- 172.21.15.82:0/3726132732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2e01023f0 0x7fa2e01974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 >> 172.21.15.82:0/3726132732 conn(0x7fa2e00fc010 msgr2=0x7fa2e00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 shutdown_connections 2024-09-17T01:39:55.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.300+0000 7fa2e80b4640 1 -- 172.21.15.82:0/3726132732 wait complete. 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 -- 172.21.15.82:0/4247759041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 msgr2=0x7fc1a0104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 --2- 172.21.15.82:0/4247759041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0104800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc1900098b0 tx=0x7fc19002a4f0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 -- 172.21.15.82:0/4247759041 shutdown_connections 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 --2- 172.21.15.82:0/4247759041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a0107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 --2- 172.21.15.82:0/4247759041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0104800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 -- 172.21.15.82:0/4247759041 >> 172.21.15.82:0/4247759041 conn(0x7fc1a00fc030 msgr2=0x7fc1a00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 -- 172.21.15.82:0/4247759041 shutdown_connections 2024-09-17T01:39:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.391+0000 7fc1a592f640 1 -- 172.21.15.82:0/4247759041 wait complete. 2024-09-17T01:39:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 Processor -- start 2024-09-17T01:39:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 -- start start 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a010a7e0 con 0x7fc1a0102410 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc1a592f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a010a660 con 0x7fc1a0104d40 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc19e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc19e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48286/0 (socket says 172.21.15.82:48286) 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.392+0000 7fc19e7fc640 1 -- 172.21.15.82:0/1534176256 learned_addr learned my addr 172.21.15.82:0/1534176256 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19effd640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19e7fc640 1 -- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 msgr2=0x7fc1a0101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19e7fc640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19e7fc640 1 -- 172.21.15.82:0/1534176256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a0100900 con 0x7fc1a0104d40 2024-09-17T01:39:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19effd640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc19e7fc640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e940 tx=0x7fc19400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc19400cac0 con 0x7fc1a0104d40 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a0100bf0 con 0x7fc1a0104d40 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1940054e0 con 0x7fc1a0104d40 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc194004e40 con 0x7fc1a0104d40 2024-09-17T01:39:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.393+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a0101180 con 0x7fc1a0104d40 2024-09-17T01:39:55.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.395+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a01027f0 con 0x7fc1a0104d40 2024-09-17T01:39:55.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.395+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc194010570 con 0x7fc1a0104d40 2024-09-17T01:39:55.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.396+0000 7fc1a492d640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 0x7fc188070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.396+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fc19408e7c0 con 0x7fc1a0104d40 2024-09-17T01:39:55.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.396+0000 7fc19effd640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 0x7fc188070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.397+0000 7fc19effd640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 0x7fc188070770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc190033040 tx=0x7fc190005fd0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.402+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc19405c120 con 0x7fc1a0104d40 2024-09-17T01:39:55.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.597+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc1a019f5c0 con 0x7fc18806e2b0 2024-09-17T01:39:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.599+0000 7fc1a492d640 1 -- 172.21.15.82:0/1534176256 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7fc1a019f5c0 con 0x7fc18806e2b0 2024-09-17T01:39:55.597 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:39:55.597 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:39:55.597 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:39:55.597 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:39:55.598 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:39:55.598 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:39:55.598 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f image on host smithi167", 2024-09-17T01:39:55.598 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:39:55.598 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 msgr2=0x7fc188070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 0x7fc188070770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc190033040 tx=0x7fc190005fd0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 msgr2=0x7fc1a01003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc19400e940 tx=0x7fc19400ee00 comp rx=0 tx=0).stop 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 shutdown_connections 2024-09-17T01:39:55.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fc18806e2b0 0x7fc188070770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1a0104d40 0x7fc1a01003c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 --2- 172.21.15.82:0/1534176256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a0102410 0x7fc1a0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 >> 172.21.15.82:0/1534176256 conn(0x7fc1a00fc030 msgr2=0x7fc1a00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 shutdown_connections 2024-09-17T01:39:55.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.602+0000 7fc1a592f640 1 -- 172.21.15.82:0/1534176256 wait complete. 2024-09-17T01:39:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 -- 172.21.15.82:0/44572725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808101a60 msgr2=0x7f8808101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 --2- 172.21.15.82:0/44572725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808101a60 0x7f8808101ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009880 tx=0x7f87fc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 -- 172.21.15.82:0/44572725 shutdown_connections 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 --2- 172.21.15.82:0/44572725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808101a60 0x7f8808101ee0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 --2- 172.21.15.82:0/44572725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808100860 0x7f8808100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 -- 172.21.15.82:0/44572725 >> 172.21.15.82:0/44572725 conn(0x7f88080fc010 msgr2=0x7f88080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 -- 172.21.15.82:0/44572725 shutdown_connections 2024-09-17T01:39:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.689+0000 7f880cc8e640 1 -- 172.21.15.82:0/44572725 wait complete. 2024-09-17T01:39:55.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.690+0000 7f880cc8e640 1 Processor -- start 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.690+0000 7f880cc8e640 1 -- start start 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880cc8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880cc8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 0x7f8808196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880cc8e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88081096a0 con 0x7f8808100860 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880cc8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8808109520 con 0x7f8808101a60 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f8805d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 0x7f8808196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53664/0 (socket says 172.21.15.82:53664) 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880659c640 1 -- 172.21.15.82:0/1086703513 learned_addr learned my addr 172.21.15.82:0/1086703513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f8805d9b640 1 -- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 msgr2=0x7f8808196200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f8805d9b640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f8805d9b640 1 -- 172.21.15.82:0/1086703513 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808196dc0 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.691+0000 7f880659c640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f8805d9b640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 0x7f8808196740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc032c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87fc046070 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f880cc8e640 1 -- 172.21.15.82:0/1086703513 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8808069ca0 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87fc0046c0 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87fc035050 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.692+0000 7f880cc8e640 1 -- 172.21.15.82:0/1086703513 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880806a230 con 0x7f8808101a60 2024-09-17T01:39:55.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.693+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8808109e80 con 0x7f8808101a60 2024-09-17T01:39:55.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.694+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f87fc049070 con 0x7f8808101a60 2024-09-17T01:39:55.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.695+0000 7f87f77fe640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 0x7f87f00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:39:55.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.695+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f87fc03e070 con 0x7f8808101a60 2024-09-17T01:39:55.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.695+0000 7f880659c640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 0x7f87f00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:39:55.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.695+0000 7f880659c640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 0x7f87f00707d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87f80058c0 tx=0x7f87f8005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:39:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.704+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87fc081600 con 0x7f8808101a60 2024-09-17T01:39:55.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.951+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f880819d560 con 0x7f8808101a60 2024-09-17T01:39:55.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:55 smithi082 ceph-mon[28077]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:55.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:55 smithi082 ceph-mon[28077]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:55.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:55 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2446442553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:39:55.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:55 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3726132732' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:39:55.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.951+0000 7f87f77fe640 1 -- 172.21.15.82:0/1086703513 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f87fc085e30 con 0x7f8808101a60 2024-09-17T01:39:55.950 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:39:55.950 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:39:55.950 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 msgr2=0x7f87f00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 0x7f87f00707d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87f80058c0 tx=0x7f87f8005f90 comp rx=0 tx=0).stop 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 msgr2=0x7f8808196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 0x7f8808196740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc032c80 comp rx=0 tx=0).stop 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 shutdown_connections 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f87f006e310 0x7f87f00707d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8808101a60 0x7f8808196740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 --2- 172.21.15.82:0/1086703513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8808100860 0x7f8808196200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:39:55.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 >> 172.21.15.82:0/1086703513 conn(0x7f88080fc010 msgr2=0x7f8808104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:39:55.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 shutdown_connections 2024-09-17T01:39:55.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:39:55.954+0000 7f87f57fa640 1 -- 172.21.15.82:0/1086703513 wait complete. 2024-09-17T01:39:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:55 smithi167 ceph-mon[35643]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:56.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:55 smithi167 ceph-mon[35643]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:56.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:55 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2446442553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:39:56.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:55 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3726132732' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:39:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:56 smithi082 ceph-mon[28077]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:56 smithi082 ceph-mon[28077]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:56 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1086703513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:39:57.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:56 smithi167 ceph-mon[35643]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:39:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:56 smithi167 ceph-mon[35643]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:39:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:56 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1086703513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:39:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:58.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:39:59.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:39:58 smithi082 ceph-mon[28077]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:39:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:39:58 smithi167 ceph-mon[35643]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:00.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:00 smithi082 ceph-mon[28077]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:00.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:00 smithi082 ceph-mon[28077]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:00.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:00 smithi082 ceph-mon[28077]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:40:00.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:00 smithi167 ceph-mon[35643]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:00.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:00 smithi167 ceph-mon[35643]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:00.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:00 smithi167 ceph-mon[35643]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:40:01.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:01 smithi082 ceph-mon[28077]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:01.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:01 smithi167 ceph-mon[35643]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:03.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:03 smithi167 ceph-mon[35643]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:03.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:03 smithi082 ceph-mon[28077]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:05.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:05 smithi082 ceph-mon[28077]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:05.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:05 smithi167 ceph-mon[35643]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:07.393 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:07 smithi082 ceph-mon[28077]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:07.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:07 smithi167 ceph-mon[35643]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:09 smithi082 ceph-mon[28077]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:09.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:09 smithi167 ceph-mon[35643]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:11 smithi167 ceph-mon[35643]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:11.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:11 smithi082 ceph-mon[28077]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:13.032 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:13 smithi167 ceph-mon[35643]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:13.032 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:13 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:13.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:13 smithi082 ceph-mon[28077]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:13.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:13 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:15.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:15 smithi082 ceph-mon[28077]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:15.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:15 smithi167 ceph-mon[35643]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:16.862 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.863 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-09-17T01:40:16.864 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.864 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:40:16.864 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-09-17T01:40:16.864 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:40:16.869 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T01:40:16.898 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:40:16.900 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:40:16.900 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:40:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:17 smithi082 ceph-mon[28077]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:17.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:17 smithi167 ceph-mon[35643]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:40:17.585 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:40:17.654 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:40:17.694 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T01:40:17.695 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:40:17.696 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:40:17.736 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T01:40:17.739 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:40:17.739 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T01:40:17.797 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-17T01:40:17.799 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:40:17.799 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-17T01:40:17.867 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir -p fsstress 2024-09-17T01:40:17.870 INFO:tasks.workunit.client.0.smithi082.stderr:+ pushd fsstress 2024-09-17T01:40:17.871 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:40:17.872 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:40:18.378 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:40:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:18 smithi082 ceph-mon[28077]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:18.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:18 smithi167 ceph-mon[35643]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:19.551 INFO:tasks.workunit.client.1.smithi167.stderr:Updating files: 90% (11455/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr:Note: switching to 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'. 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.329 INFO:tasks.workunit.client.1.smithi167.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: git switch -c 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr:Or undo this operation with: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: git switch - 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr: 2024-09-17T01:40:20.330 INFO:tasks.workunit.client.1.smithi167.stderr:HEAD is now at ce1b342bf8c Merge PR #55006 into wip-pdonnell-testing-20240916.200549-debug 2024-09-17T01:40:20.335 DEBUG:teuthology.orchestra.run.smithi167:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-17T01:40:20.398 INFO:tasks.workunit.client.1.smithi167.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T01:40:20.401 INFO:tasks.workunit.client.1.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:40:20.401 INFO:tasks.workunit.client.1.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T01:40:21.121 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:20 smithi167 ceph-mon[35643]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:21.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:20 smithi082 ceph-mon[28077]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:40:21.266 INFO:tasks.workunit.client.1.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T01:40:21.335 INFO:tasks.workunit.client.1.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T01:40:21.375 INFO:tasks.workunit.client.1.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-17T01:40:21.376 INFO:tasks.workunit.client.1.smithi167.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:40:21.376 INFO:tasks.workunit.client.1.smithi167.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T01:40:21.417 INFO:tasks.workunit.client.1.smithi167.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-17T01:40:21.421 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-17T01:40:21.421 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-17T01:40:21.478 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-17T01:40:21.480 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-17T01:40:21.480 DEBUG:teuthology.orchestra.run.smithi167:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ce1b342bf8c6349a8c90cd607f83bff2443f21cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-17T01:40:21.546 INFO:tasks.workunit.client.1.smithi167.stderr:+ mkdir -p fsstress 2024-09-17T01:40:21.548 INFO:tasks.workunit.client.1.smithi167.stderr:+ pushd fsstress 2024-09-17T01:40:21.549 INFO:tasks.workunit.client.1.smithi167.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:40:21.549 INFO:tasks.workunit.client.1.smithi167.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-17T01:40:22.395 INFO:tasks.workunit.client.1.smithi167.stderr:+ tar xzf ltp-full.tgz 2024-09-17T01:40:23.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:22 smithi082 ceph-mon[28077]: pgmap v225: 65 pgs: 65 active+clean; 8.7 MiB data, 193 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 697 KiB/s wr, 17 op/s 2024-09-17T01:40:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:22 smithi167 ceph-mon[35643]: pgmap v225: 65 pgs: 65 active+clean; 8.7 MiB data, 193 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 697 KiB/s wr, 17 op/s 2024-09-17T01:40:25.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:24 smithi082 ceph-mon[28077]: pgmap v226: 65 pgs: 65 active+clean; 14 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-09-17T01:40:25.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:24 smithi167 ceph-mon[35643]: pgmap v226: 65 pgs: 65 active+clean; 14 MiB data, 221 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-09-17T01:40:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 -- 172.21.15.82:0/1931442582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 msgr2=0x7f72b8107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/1931442582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8107190 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f72ac009880 tx=0x7f72ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 -- 172.21.15.82:0/1931442582 shutdown_connections 2024-09-17T01:40:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/1931442582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8107190 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/1931442582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b8104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 -- 172.21.15.82:0/1931442582 >> 172.21.15.82:0/1931442582 conn(0x7f72b80fc010 msgr2=0x7f72b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 -- 172.21.15.82:0/1931442582 shutdown_connections 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.046+0000 7f72bd5eb640 1 -- 172.21.15.82:0/1931442582 wait complete. 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 Processor -- start 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 -- start start 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b81974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72b810a780 con 0x7f72b8104da0 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72bd5eb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72b810a600 con 0x7f72b8102470 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72b67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72b67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54912/0 (socket says 172.21.15.82:54912) 2024-09-17T01:40:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72b67fc640 1 -- 172.21.15.82:0/4069143026 learned_addr learned my addr 172.21.15.82:0/4069143026 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.047+0000 7f72b6ffd640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b81974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72b6ffd640 1 -- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 msgr2=0x7f72b8197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72b6ffd640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72b6ffd640 1 -- 172.21.15.82:0/4069143026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b81980a0 con 0x7f72b8102470 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72b6ffd640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b81974e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72a800d6d0 tx=0x7f72a800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72a8017070 con 0x7f72b8102470 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b819cae0 con 0x7f72b8102470 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72a80054e0 con 0x7f72b8102470 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72a8009a60 con 0x7f72b8102470 2024-09-17T01:40:26.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.048+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b819d070 con 0x7f72b8102470 2024-09-17T01:40:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.050+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8102850 con 0x7f72b8102470 2024-09-17T01:40:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.050+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f72a8005000 con 0x7f72b8102470 2024-09-17T01:40:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.050+0000 7f729ffff640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 0x7f72a00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.051+0000 7f72b67fc640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 0x7f72a00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.051+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f72a808de30 con 0x7f72b8102470 2024-09-17T01:40:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.051+0000 7f72b67fc640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 0x7f72a00707d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72b8198990 tx=0x7f72ac0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.056+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72a805f420 con 0x7f72b8102470 2024-09-17T01:40:26.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.321+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f72b8105780 con 0x7f72a006e310 2024-09-17T01:40:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.322+0000 7f729ffff640 1 -- 172.21.15.82:0/4069143026 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f72b8105780 con 0x7f72a006e310 2024-09-17T01:40:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.324+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 msgr2=0x7f72a00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.324+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 0x7f72a00707d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f72b8198990 tx=0x7f72ac0058d0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.324+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 msgr2=0x7f72b81974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.324+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b81974e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72a800d6d0 tx=0x7f72a800db90 comp rx=0 tx=0).stop 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 shutdown_connections 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72b8104da0 0x7f72b8197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f72a006e310 0x7f72a00707d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 --2- 172.21.15.82:0/4069143026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72b8102470 0x7f72b81974e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 >> 172.21.15.82:0/4069143026 conn(0x7f72b80fc010 msgr2=0x7f72b80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 shutdown_connections 2024-09-17T01:40:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.325+0000 7f72bd5eb640 1 -- 172.21.15.82:0/4069143026 wait complete. 2024-09-17T01:40:26.332 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:40:26.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.431+0000 7f3031697640 1 -- 172.21.15.82:0/218623784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c0ffc30 msgr2=0x7f302c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.431+0000 7f3031697640 1 --2- 172.21.15.82:0/218623784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c0ffc30 0x7f302c100030 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f301c009880 tx=0x7f301c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 -- 172.21.15.82:0/218623784 shutdown_connections 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 --2- 172.21.15.82:0/218623784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c102cb0 0x7f302c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 --2- 172.21.15.82:0/218623784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c0ffc30 0x7f302c100030 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 -- 172.21.15.82:0/218623784 >> 172.21.15.82:0/218623784 conn(0x7f302c0fb760 msgr2=0x7f302c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 -- 172.21.15.82:0/218623784 shutdown_connections 2024-09-17T01:40:26.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 -- 172.21.15.82:0/218623784 wait complete. 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.432+0000 7f3031697640 1 Processor -- start 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3031697640 1 -- start start 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3031697640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c0ffc30 0x7f302c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3031697640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3031697640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f302c10a770 con 0x7f302c102cb0 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3031697640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f302c10a5f0 con 0x7f302c0ffc30 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54918/0 (socket says 172.21.15.82:54918) 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 -- 172.21.15.82:0/462107170 learned_addr learned my addr 172.21.15.82:0/462107170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:26.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f302affd640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c0ffc30 0x7f302c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 -- 172.21.15.82:0/462107170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c0ffc30 msgr2=0x7f302c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c0ffc30 0x7f302c1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.433+0000 7f3023fff640 1 -- 172.21.15.82:0/462107170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302c198060 con 0x7f302c102cb0 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3023fff640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f301400d8d0 tx=0x7f301400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3014017070 con 0x7f302c102cb0 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302c100b60 con 0x7f302c102cb0 2024-09-17T01:40:26.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3014010460 con 0x7f302c102cb0 2024-09-17T01:40:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f301400f5f0 con 0x7f302c102cb0 2024-09-17T01:40:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.434+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302c1010f0 con 0x7f302c102cb0 2024-09-17T01:40:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.435+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302c100030 con 0x7f302c102cb0 2024-09-17T01:40:26.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.436+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f3014009a30 con 0x7f302c102cb0 2024-09-17T01:40:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.436+0000 7f3028ff9640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 0x7f3018070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.437+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f301408dfc0 con 0x7f302c102cb0 2024-09-17T01:40:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.437+0000 7f302affd640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 0x7f3018070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.437+0000 7f302affd640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 0x7f3018070770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f301c009230 tx=0x7f301c0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.444+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f301405f5d0 con 0x7f302c102cb0 2024-09-17T01:40:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.691+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f302c107280 con 0x7f301806e2b0 2024-09-17T01:40:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.692+0000 7f3028ff9640 1 -- 172.21.15.82:0/462107170 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f302c107280 con 0x7f301806e2b0 2024-09-17T01:40:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.694+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 msgr2=0x7f3018070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 0x7f3018070770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f301c009230 tx=0x7f301c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 msgr2=0x7f302c1979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f301400d8d0 tx=0x7f301400dd90 comp rx=0 tx=0).stop 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 shutdown_connections 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f302c102cb0 0x7f302c1979e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f301806e2b0 0x7f3018070770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 --2- 172.21.15.82:0/462107170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f302c0ffc30 0x7f302c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 >> 172.21.15.82:0/462107170 conn(0x7f302c0fb760 msgr2=0x7f302c0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 shutdown_connections 2024-09-17T01:40:26.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.695+0000 7f3031697640 1 -- 172.21.15.82:0/462107170 wait complete. 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 -- 172.21.15.82:0/2123369643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 msgr2=0x7f536010c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 --2- 172.21.15.82:0/2123369643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f536010c9a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5350009880 tx=0x7f535002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 -- 172.21.15.82:0/2123369643 shutdown_connections 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 --2- 172.21.15.82:0/2123369643 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f536010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 --2- 172.21.15.82:0/2123369643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f536010c9a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 -- 172.21.15.82:0/2123369643 >> 172.21.15.82:0/2123369643 conn(0x7f536006bdd0 msgr2=0x7f536006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:26.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 -- 172.21.15.82:0/2123369643 shutdown_connections 2024-09-17T01:40:26.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.797+0000 7f5365c62640 1 -- 172.21.15.82:0/2123369643 wait complete. 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 Processor -- start 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 -- start start 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f53601a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5360115190 con 0x7f536010c5a0 2024-09-17T01:40:26.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5365c62640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5360115010 con 0x7f536010d510 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f535f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54930/0 (socket says 172.21.15.82:54930) 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f535f7fe640 1 -- 172.21.15.82:0/1416680299 learned_addr learned my addr 172.21.15.82:0/1416680299 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.798+0000 7f5357fff640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f53601a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535f7fe640 1 -- 172.21.15.82:0/1416680299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 msgr2=0x7f53601a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535f7fe640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f53601a2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535f7fe640 1 -- 172.21.15.82:0/1416680299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53601a2af0 con 0x7f536010c5a0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f5357fff640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f53601a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535f7fe640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5350009230 tx=0x7f53500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f535003f070 con 0x7f536010c5a0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53500044d0 con 0x7f536010c5a0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53601a74d0 con 0x7f536010c5a0 2024-09-17T01:40:26.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5350035030 con 0x7f536010c5a0 2024-09-17T01:40:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.799+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53601a7ae0 con 0x7f536010c5a0 2024-09-17T01:40:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.800+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536010c9a0 con 0x7f536010c5a0 2024-09-17T01:40:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.801+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f5350042070 con 0x7f536010c5a0 2024-09-17T01:40:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.801+0000 7f535d7fa640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 0x7f534c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:26.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.801+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f53500aeea0 con 0x7f536010c5a0 2024-09-17T01:40:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.801+0000 7f5357fff640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 0x7f534c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:26.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.802+0000 7f5357fff640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 0x7f534c070770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53601a33e0 tx=0x7f5348008040 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:26.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:26.806+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f535007c800 con 0x7f536010c5a0 2024-09-17T01:40:26.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:26 smithi082 ceph-mon[28077]: pgmap v227: 65 pgs: 65 active+clean; 23 MiB data, 246 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.9 MiB/s wr, 74 op/s 2024-09-17T01:40:27.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.039+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5360062630 con 0x7f534c06e2b0 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.049+0000 7f535d7fa640 1 -- 172.21.15.82:0/1416680299 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5360062630 con 0x7f534c06e2b0 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (5m) 78s ago 6m 25.9M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (7m) 78s ago 7m 8304k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (6m) 81s ago 6m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 78s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (6m) 81s ago 6m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (5m) 78s ago 6m 79.0M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:40:27.048 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (100s) 78s ago 99s 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (94s) 78s ago 93s 15.3M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (97s) 81s ago 96s 17.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (91s) 81s ago 91s 15.7M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (8m) 78s ago 8m 499M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (6m) 81s ago 6m 442M - 19.1.1-330-gc2ddf972 ebb0615149de 79d443bb49e2 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 78s ago 8m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (6m) 81s ago 6m 34.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 78s ago 7m 13.6M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (6m) 81s ago 6m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 78s ago 4m 55.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 78s ago 4m 55.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 78s ago 3m 46.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (3m) 81s ago 3m 53.7M 4970M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:40:27.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (3m) 81s ago 3m 41.5M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:40:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (2m) 81s ago 2m 42.3M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:40:27.050 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 78s ago 6m 55.1M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:40:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 msgr2=0x7f534c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 0x7f534c070770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f53601a33e0 tx=0x7f5348008040 comp rx=0 tx=0).stop 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 msgr2=0x7f53601a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5350009230 tx=0x7f53500048f0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 shutdown_connections 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f534c06e2b0 0x7f534c070770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536010d510 0x7f53601a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 --2- 172.21.15.82:0/1416680299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f536010c5a0 0x7f53601a1f30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.051+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 >> 172.21.15.82:0/1416680299 conn(0x7f536006bdd0 msgr2=0x7f5360110ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.052+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 shutdown_connections 2024-09-17T01:40:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.052+0000 7f5365c62640 1 -- 172.21.15.82:0/1416680299 wait complete. 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 -- 172.21.15.82:0/150795934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 msgr2=0x7f2094107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 --2- 172.21.15.82:0/150795934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094107110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20880098b0 tx=0x7f208802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 -- 172.21.15.82:0/150795934 shutdown_connections 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 --2- 172.21.15.82:0/150795934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094107110 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 --2- 172.21.15.82:0/150795934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 0x7f20941047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.147+0000 7f209a0ee640 1 -- 172.21.15.82:0/150795934 >> 172.21.15.82:0/150795934 conn(0x7f20940fc010 msgr2=0x7f20940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.148+0000 7f209a0ee640 1 -- 172.21.15.82:0/150795934 shutdown_connections 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.148+0000 7f209a0ee640 1 -- 172.21.15.82:0/150795934 wait complete. 2024-09-17T01:40:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.148+0000 7f209a0ee640 1 Processor -- start 2024-09-17T01:40:27.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.148+0000 7f209a0ee640 1 -- start start 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f209a0ee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 0x7f2094199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f209a0ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f209a0ee640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f209410a7b0 con 0x7f2094104d20 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f209a0ee640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f209410a630 con 0x7f20941023f0 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f20937fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 0x7f2094199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54948/0 (socket says 172.21.15.82:54948) 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 -- 172.21.15.82:0/3736015416 learned_addr learned my addr 172.21.15.82:0/3736015416 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 -- 172.21.15.82:0/3736015416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 msgr2=0x7f2094199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 0x7f2094199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 -- 172.21.15.82:0/3736015416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209419a2f0 con 0x7f2094104d20 2024-09-17T01:40:27.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.149+0000 7f2092ffd640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2088009230 tx=0x7f20880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.150+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f208803f070 con 0x7f2094104d20 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.150+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209419ecd0 con 0x7f2094104d20 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.150+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209419f200 con 0x7f2094104d20 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.150+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20880049d0 con 0x7f2094104d20 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.150+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2088035030 con 0x7f2094104d20 2024-09-17T01:40:27.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.151+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20800052c0 con 0x7f2094104d20 2024-09-17T01:40:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.151+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2088042070 con 0x7f2094104d20 2024-09-17T01:40:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.152+0000 7f2090ff9640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 0x7f207c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.152+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f20880ae9b0 con 0x7f2094104d20 2024-09-17T01:40:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.152+0000 7f20937fe640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 0x7f207c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.153+0000 7f20937fe640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 0x7f207c0707d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2084009bd0 tx=0x7f2084005f90 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.157+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2088080040 con 0x7f2094104d20 2024-09-17T01:40:27.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:26 smithi167 ceph-mon[35643]: pgmap v227: 65 pgs: 65 active+clean; 23 MiB data, 246 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.9 MiB/s wr, 74 op/s 2024-09-17T01:40:27.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.511+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2080005dc0 con 0x7f2094104d20 2024-09-17T01:40:27.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.511+0000 7f2090ff9640 1 -- 172.21.15.82:0/3736015416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f2088084870 con 0x7f2094104d20 2024-09-17T01:40:27.510 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:40:27.510 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:40:27.510 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 14 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:40:27.511 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:40:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.514+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 msgr2=0x7f207c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.514+0000 7f209a0ee640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 0x7f207c0707d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2084009bd0 tx=0x7f2084005f90 comp rx=0 tx=0).stop 2024-09-17T01:40:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.514+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 msgr2=0x7f2094199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.514+0000 7f209a0ee640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2088009230 tx=0x7f20880045e0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 shutdown_connections 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2094104d20 0x7f2094199c70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f207c06e310 0x7f207c0707d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 --2- 172.21.15.82:0/3736015416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20941023f0 0x7f2094199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 >> 172.21.15.82:0/3736015416 conn(0x7f20940fc010 msgr2=0x7f2094101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 shutdown_connections 2024-09-17T01:40:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.515+0000 7f209a0ee640 1 -- 172.21.15.82:0/3736015416 wait complete. 2024-09-17T01:40:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 -- 172.21.15.82:0/4127923699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8101a60 msgr2=0x7fa3f8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 --2- 172.21.15.82:0/4127923699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8101a60 0x7fa3f8101ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0097e0 tx=0x7fa3ec02a3f0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 -- 172.21.15.82:0/4127923699 shutdown_connections 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 --2- 172.21.15.82:0/4127923699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8101a60 0x7fa3f8101ee0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec0097e0 tx=0x7fa3ec02a3f0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 --2- 172.21.15.82:0/4127923699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f8100860 0x7fa3f8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 -- 172.21.15.82:0/4127923699 >> 172.21.15.82:0/4127923699 conn(0x7fa3f80fc010 msgr2=0x7fa3f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 -- 172.21.15.82:0/4127923699 shutdown_connections 2024-09-17T01:40:27.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.636+0000 7fa3fd379640 1 -- 172.21.15.82:0/4127923699 wait complete. 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.637+0000 7fa3fd379640 1 Processor -- start 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.637+0000 7fa3fd379640 1 -- start start 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3fd379640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3fd379640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f81031b0 0x7fa3f8103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3fd379640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8109680 con 0x7fa3f81031b0 2024-09-17T01:40:27.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3fd379640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8109500 con 0x7fa3f8100860 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:60468/0 (socket says 172.21.15.82:60468) 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 -- 172.21.15.82:0/1196120634 learned_addr learned my addr 172.21.15.82:0/1196120634 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f67fc640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f81031b0 0x7fa3f8103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 -- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f81031b0 msgr2=0x7fa3f8103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f81031b0 0x7fa3f8103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.638+0000 7fa3f6ffd640 1 -- 172.21.15.82:0/1196120634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f819b310 con 0x7fa3f8100860 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.639+0000 7fa3f6ffd640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e970 tx=0x7fa3e800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.639+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3e800cac0 con 0x7fa3f8100860 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.639+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3e800cc60 con 0x7fa3f8100860 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.639+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3e8003d10 con 0x7fa3f8100860 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.639+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f8103b70 con 0x7fa3f8100860 2024-09-17T01:40:27.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.640+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a3f10 con 0x7fa3f8100860 2024-09-17T01:40:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.641+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f8109e60 con 0x7fa3f8100860 2024-09-17T01:40:27.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.642+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa3e8004000 con 0x7fa3f8100860 2024-09-17T01:40:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.642+0000 7fa3dffff640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 0x7fa3e0070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.643+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fa3e808e7e0 con 0x7fa3f8100860 2024-09-17T01:40:27.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.643+0000 7fa3f67fc640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 0x7fa3e0070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:27.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.644+0000 7fa3f67fc640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 0x7fa3e0070820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8104870 tx=0x7fa3ec030890 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:27.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.648+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3e8016330 con 0x7fa3f8100860 2024-09-17T01:40:27.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.952+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa3f802d9f0 con 0x7fa3f8100860 2024-09-17T01:40:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.952+0000 7fa3dffff640 1 -- 172.21.15.82:0/1196120634 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7fa3e805c090 con 0x7fa3f8100860 2024-09-17T01:40:27.951 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:40:27.951 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:40:27.952 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:40:27.953 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:40:27.954 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:40:27.955 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:40:27.955 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:40:27.955 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:40:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:40:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.954+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 msgr2=0x7fa3e0070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.954+0000 7fa3fd379640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 0x7fa3e0070820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8104870 tx=0x7fa3ec030890 comp rx=0 tx=0).stop 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 msgr2=0x7fa3f8104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800e970 tx=0x7fa3e800ee30 comp rx=0 tx=0).stop 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 shutdown_connections 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3f81031b0 0x7fa3f8103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7fa3e006e360 0x7fa3e0070820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 --2- 172.21.15.82:0/1196120634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3f8100860 0x7fa3f8104af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 >> 172.21.15.82:0/1196120634 conn(0x7fa3f80fc010 msgr2=0x7fa3f80fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 shutdown_connections 2024-09-17T01:40:27.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:27.955+0000 7fa3fd379640 1 -- 172.21.15.82:0/1196120634 wait complete. 2024-09-17T01:40:28.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/2408429650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04100860 msgr2=0x7f4f04100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/2408429650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04100860 0x7f4f04100c60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009880 tx=0x7f4ef402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/2408429650 shutdown_connections 2024-09-17T01:40:28.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/2408429650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04101a60 0x7f4f04101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/2408429650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04100860 0x7f4f04100c60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/2408429650 >> 172.21.15.82:0/2408429650 conn(0x7f4f040fc010 msgr2=0x7f4f040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/2408429650 shutdown_connections 2024-09-17T01:40:28.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.062+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/2408429650 wait complete. 2024-09-17T01:40:28.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 Processor -- start 2024-09-17T01:40:28.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 -- start start 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04100860 0x7f4f041996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04109680 con 0x7f4f04101a60 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f0b0c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04109500 con 0x7f4f04100860 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51670/0 (socket says 172.21.15.82:51670) 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.063+0000 7f4f03fff640 1 -- 172.21.15.82:0/3018299308 learned_addr learned my addr 172.21.15.82:0/3018299308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.064+0000 7f4f08e5e640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04100860 0x7f4f041996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.064+0000 7f4f03fff640 1 -- 172.21.15.82:0/3018299308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04100860 msgr2=0x7f4f041996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.064+0000 7f4f03fff640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04100860 0x7f4f041996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.064+0000 7f4f03fff640 1 -- 172.21.15.82:0/3018299308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0419a290 con 0x7f4f04101a60 2024-09-17T01:40:28.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:27 smithi082 ceph-mon[28077]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:28.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:27 smithi082 ceph-mon[28077]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:28.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:27 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3736015416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:40:28.066 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:27 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.064+0000 7f4f03fff640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800d8d0 tx=0x7f4ef800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.065+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ef8017030 con 0x7f4f04101a60 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.065+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ef8004020 con 0x7f4f04101a60 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.065+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0419ecd0 con 0x7f4f04101a60 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.065+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4ef80047a0 con 0x7f4f04101a60 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.065+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0419f200 con 0x7f4f04101a60 2024-09-17T01:40:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.066+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f04100c60 con 0x7f4f04101a60 2024-09-17T01:40:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.067+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f4ef80041d0 con 0x7f4f04101a60 2024-09-17T01:40:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.067+0000 7f4f01ffb640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 0x7f4eec0707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.067+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f4ef8018070 con 0x7f4f04101a60 2024-09-17T01:40:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.067+0000 7f4f08e5e640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 0x7f4eec0707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.068+0000 7f4f08e5e640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 0x7f4eec0707c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef4005a20 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.076+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ef805b8b0 con 0x7f4f04101a60 2024-09-17T01:40:28.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:27 smithi167 ceph-mon[35643]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:28.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:27 smithi167 ceph-mon[35643]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:28.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:27 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3736015416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:40:28.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:27 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:28.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.366+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 --> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4f0406a400 con 0x7f4eec06e300 2024-09-17T01:40:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.368+0000 7f4f01ffb640 1 -- 172.21.15.82:0/3018299308 <== mgr.14221 v2:172.21.15.82:6800/2005389412 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+447 (secure 0 0 0) 0x7f4f0406a400 con 0x7f4eec06e300 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "0/23 daemons upgraded", 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f image on host smithi167", 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:40:28.367 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 msgr2=0x7f4eec0707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 0x7f4eec0707c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef4005a20 comp rx=0 tx=0).stop 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 msgr2=0x7f4f04199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800d8d0 tx=0x7f4ef800dd90 comp rx=0 tx=0).stop 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 shutdown_connections 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f04101a60 0x7f4f04199c10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f4eec06e300 0x7f4eec0707c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 --2- 172.21.15.82:0/3018299308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f04100860 0x7f4f041996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 >> 172.21.15.82:0/3018299308 conn(0x7f4f040fc010 msgr2=0x7f4f04069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 shutdown_connections 2024-09-17T01:40:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.370+0000 7f4f0b0c2640 1 -- 172.21.15.82:0/3018299308 wait complete. 2024-09-17T01:40:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 -- 172.21.15.82:0/373426819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 msgr2=0x7f77c0102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 --2- 172.21.15.82:0/373426819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0102260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009880 tx=0x7f77bc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 -- 172.21.15.82:0/373426819 shutdown_connections 2024-09-17T01:40:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 --2- 172.21.15.82:0/373426819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 0x7f77c0100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 --2- 172.21.15.82:0/373426819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0102260 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.475+0000 7f77c7761640 1 -- 172.21.15.82:0/373426819 >> 172.21.15.82:0/373426819 conn(0x7f77c00fb760 msgr2=0x7f77c00fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 -- 172.21.15.82:0/373426819 shutdown_connections 2024-09-17T01:40:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 -- 172.21.15.82:0/373426819 wait complete. 2024-09-17T01:40:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 Processor -- start 2024-09-17T01:40:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 -- start start 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 0x7f77c0108810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010a7b0 con 0x7f77c0101e60 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.476+0000 7f77c7761640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010a630 con 0x7f77c0100ac0 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51688/0 (socket says 172.21.15.82:51688) 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 -- 172.21.15.82:0/2429139090 learned_addr learned my addr 172.21.15.82:0/2429139090 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c54fd640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 0x7f77c0108810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 -- 172.21.15.82:0/2429139090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 msgr2=0x7f77c0108810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 0x7f77c0108810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 -- 172.21.15.82:0/2429139090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c019b100 con 0x7f77c0101e60 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77c4cfc640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77b000d8d0 tx=0x7f77b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.477+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77b0017070 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.478+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77b000be10 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.478+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c0107410 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.478+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77b000f3c0 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.478+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01078e0 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.479+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f77b001a070 con 0x7f77c0101e60 2024-09-17T01:40:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.480+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c010af90 con 0x7f77c0101e60 2024-09-17T01:40:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.480+0000 7f77b67fc640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 0x7f77ac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.480+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f77b008dc20 con 0x7f77c0101e60 2024-09-17T01:40:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.481+0000 7f77c54fd640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 0x7f77ac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.482+0000 7f77c54fd640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 0x7f77ac0707d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009230 tx=0x7f77bc0058d0 comp rx=0 tx=0).ready entity=mgr.14221 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:28.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.486+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77b005f2b0 con 0x7f77c0101e60 2024-09-17T01:40:28.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.862+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f77c0100f40 con 0x7f77c0101e60 2024-09-17T01:40:28.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.862+0000 7f77b67fc640 1 -- 172.21.15.82:0/2429139090 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f77b0063ae0 con 0x7f77c0101e60 2024-09-17T01:40:28.861 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:28.861 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:40:28.861 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:40:28.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.864+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 msgr2=0x7f77ac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.864+0000 7f77c7761640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 0x7f77ac0707d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009230 tx=0x7f77bc0058d0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.864+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 msgr2=0x7f77c0106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.864+0000 7f77c7761640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77b000d8d0 tx=0x7f77b000dd90 comp rx=0 tx=0).stop 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 shutdown_connections 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c0101e60 0x7f77c0106ed0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.82:6800/2005389412,v1:172.21.15.82:6801/2005389412] conn(0x7f77ac06e310 0x7f77ac0707d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 --2- 172.21.15.82:0/2429139090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0100ac0 0x7f77c0108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 >> 172.21.15.82:0/2429139090 conn(0x7f77c00fb760 msgr2=0x7f77c00fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 shutdown_connections 2024-09-17T01:40:28.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:28.865+0000 7f77c7761640 1 -- 172.21.15.82:0/2429139090 wait complete. 2024-09-17T01:40:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:28 smithi082 ceph-mon[28077]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:28 smithi082 ceph-mon[28077]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 288 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 112 op/s 2024-09-17T01:40:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:28 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1196120634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:40:29.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:28 smithi167 ceph-mon[35643]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:28 smithi167 ceph-mon[35643]: pgmap v228: 65 pgs: 65 active+clean; 36 MiB data, 288 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 112 op/s 2024-09-17T01:40:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:28 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1196120634' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:40:30.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:29 smithi082 ceph-mon[28077]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:30.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:29 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2429139090' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:40:30.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:29 smithi167 ceph-mon[35643]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:40:30.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:29 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2429139090' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:40:31.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:30 smithi082 ceph-mon[28077]: pgmap v229: 65 pgs: 65 active+clean; 36 MiB data, 301 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 118 op/s 2024-09-17T01:40:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:30 smithi167 ceph-mon[35643]: pgmap v229: 65 pgs: 65 active+clean; 36 MiB data, 301 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 118 op/s 2024-09-17T01:40:33.135 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:32 smithi082 ceph-mon[28077]: pgmap v230: 65 pgs: 65 active+clean; 42 MiB data, 328 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-09-17T01:40:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:32 smithi167 ceph-mon[35643]: pgmap v230: 65 pgs: 65 active+clean; 42 MiB data, 328 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-09-17T01:40:35.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:34 smithi082 ceph-mon[28077]: pgmap v231: 65 pgs: 65 active+clean; 51 MiB data, 355 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 164 op/s 2024-09-17T01:40:35.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:34 smithi167 ceph-mon[35643]: pgmap v231: 65 pgs: 65 active+clean; 51 MiB data, 355 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 164 op/s 2024-09-17T01:40:37.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:36 smithi082 ceph-mon[28077]: pgmap v232: 65 pgs: 65 active+clean; 65 MiB data, 393 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2024-09-17T01:40:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:36 smithi167 ceph-mon[35643]: pgmap v232: 65 pgs: 65 active+clean; 65 MiB data, 393 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 MiB/s wr, 184 op/s 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: Upgrade: Updating mgr.smithi167.ysmbcy 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:40:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:38 smithi082 ceph-mon[28077]: pgmap v233: 65 pgs: 65 active+clean; 75 MiB data, 427 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-09-17T01:40:38.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: Upgrade: Updating mgr.smithi167.ysmbcy 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:40:38.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:38 smithi167 ceph-mon[35643]: pgmap v233: 65 pgs: 65 active+clean; 75 MiB data, 427 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 184 op/s 2024-09-17T01:40:41.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:40 smithi082 ceph-mon[28077]: pgmap v234: 65 pgs: 65 active+clean; 76 MiB data, 433 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-09-17T01:40:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:40 smithi167 ceph-mon[35643]: pgmap v234: 65 pgs: 65 active+clean; 76 MiB data, 433 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 150 op/s 2024-09-17T01:40:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:42 smithi082 ceph-mon[28077]: pgmap v235: 65 pgs: 65 active+clean; 92 MiB data, 470 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 196 op/s 2024-09-17T01:40:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:42 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:42 smithi167 ceph-mon[35643]: pgmap v235: 65 pgs: 65 active+clean; 92 MiB data, 470 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 196 op/s 2024-09-17T01:40:43.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:42 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:44 smithi082 ceph-mon[28077]: pgmap v236: 65 pgs: 65 active+clean; 98 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 208 op/s 2024-09-17T01:40:45.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:44 smithi167 ceph-mon[35643]: pgmap v236: 65 pgs: 65 active+clean; 98 MiB data, 519 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 208 op/s 2024-09-17T01:40:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:46 smithi082 ceph-mon[28077]: pgmap v237: 65 pgs: 65 active+clean; 107 MiB data, 530 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 196 op/s 2024-09-17T01:40:47.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:46 smithi167 ceph-mon[35643]: pgmap v237: 65 pgs: 65 active+clean; 107 MiB data, 530 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 196 op/s 2024-09-17T01:40:48.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:48 smithi082 ceph-mon[28077]: pgmap v238: 65 pgs: 65 active+clean; 112 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 186 op/s 2024-09-17T01:40:49.205 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:48 smithi167 ceph-mon[35643]: pgmap v238: 65 pgs: 65 active+clean; 112 MiB data, 553 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.1 MiB/s wr, 186 op/s 2024-09-17T01:40:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:50 smithi082 ceph-mon[28077]: pgmap v239: 65 pgs: 65 active+clean; 113 MiB data, 563 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 155 op/s 2024-09-17T01:40:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:50 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:40:51.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:50 smithi167 ceph-mon[35643]: pgmap v239: 65 pgs: 65 active+clean; 113 MiB data, 563 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 155 op/s 2024-09-17T01:40:51.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:51.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:51.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:50 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:40:53.057 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:52 smithi167 ceph-mon[35643]: pgmap v240: 65 pgs: 65 active+clean; 121 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 196 op/s 2024-09-17T01:40:53.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:52 smithi082 ceph-mon[28077]: pgmap v240: 65 pgs: 65 active+clean; 121 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 196 op/s 2024-09-17T01:40:55.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:54 smithi167 ceph-mon[35643]: pgmap v241: 65 pgs: 65 active+clean; 127 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 185 op/s 2024-09-17T01:40:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:54 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:54 smithi082 ceph-mon[28077]: pgmap v241: 65 pgs: 65 active+clean; 127 MiB data, 628 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 185 op/s 2024-09-17T01:40:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:54 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: pgmap v242: 65 pgs: 65 active+clean; 139 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 197 op/s 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy restarted 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:40:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:56 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:40:57.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: pgmap v242: 65 pgs: 65 active+clean; 139 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 197 op/s 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy restarted 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:40:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:56 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:40:58.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:57 smithi167 ceph-mon[35643]: mgrmap e20: smithi082.oppacm(active, since 6m), standbys: smithi167.ysmbcy 2024-09-17T01:40:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:57 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:58.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:57 smithi082 ceph-mon[28077]: mgrmap e20: smithi082.oppacm(active, since 6m), standbys: smithi167.ysmbcy 2024-09-17T01:40:58.204 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:57 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:40:58.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: pgmap v243: 65 pgs: 65 active+clean; 149 MiB data, 651 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 233 op/s 2024-09-17T01:40:58.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:58.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:58.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:40:58.951 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr fail", "who": "smithi082.oppacm"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: Activating manager daemon smithi167.ysmbcy 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "mgr fail", "who": "smithi082.oppacm"}]': finished 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: mgrmap e21: smithi167.ysmbcy(active, starting, since 0.0105471s) 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:40:58.952 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:40:58.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:58 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 -- 172.21.15.82:0/3552672328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 msgr2=0x7f3ab8076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 --2- 172.21.15.82:0/3552672328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab8076fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009880 tx=0x7f3aac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 -- 172.21.15.82:0/3552672328 shutdown_connections 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 --2- 172.21.15.82:0/3552672328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 --2- 172.21.15.82:0/3552672328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab8076fa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 -- 172.21.15.82:0/3552672328 >> 172.21.15.82:0/3552672328 conn(0x7f3ab80ff330 msgr2=0x7f3ab8101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 -- 172.21.15.82:0/3552672328 shutdown_connections 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.993+0000 7f3abe724640 1 -- 172.21.15.82:0/3552672328 wait complete. 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.994+0000 7f3abe724640 1 Processor -- start 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3abe724640 1 -- start start 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3abe724640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3abe724640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3abe724640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab8110d70 con 0x7f3ab8076ba0 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3abe724640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab8110bf0 con 0x7f3ab8077df0 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:40850/0 (socket says 172.21.15.82:40850) 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3ab77fe640 1 -- 172.21.15.82:0/4261799200 learned_addr learned my addr 172.21.15.82:0/4261799200 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:58.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.995+0000 7f3ab7fff640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:58.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab77fe640 1 -- 172.21.15.82:0/4261799200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 msgr2=0x7f3ab819da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:58.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab77fe640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab819da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab77fe640 1 -- 172.21.15.82:0/4261799200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab819e630 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab77fe640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800e970 tx=0x7f3aa800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa800cac0 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3aa800cc60 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3aa8018720 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.996+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab81a3070 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.997+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab81a3600 con 0x7f3ab8077df0 2024-09-17T01:40:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.998+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 21) ==== 51651+0+0 (secure 0 0 0) 0x7f3aa8018940 con 0x7f3ab8077df0 2024-09-17T01:40:58.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.998+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab8076fa0 con 0x7f3ab8077df0 2024-09-17T01:40:58.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:58.998+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f3aa80104c0 con 0x7f3ab8077df0 2024-09-17T01:40:59.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.004+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3aa8020360 con 0x7f3ab8077df0 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: pgmap v243: 65 pgs: 65 active+clean; 149 MiB data, 651 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 233 op/s 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' 2024-09-17T01:40:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr fail", "who": "smithi082.oppacm"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: Activating manager daemon smithi167.ysmbcy 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.14221 172.21.15.82:0/274603641' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "mgr fail", "who": "smithi082.oppacm"}]': finished 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: osdmap e46: 6 total, 6 up, 6 in 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: mgrmap e21: smithi167.ysmbcy(active, starting, since 0.0105471s) 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:40:59.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:40:59.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:58 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:40:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.838+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7f3aa8022980 con 0x7f3ab8077df0 2024-09-17T01:40:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.838+0000 7f3ab57fa640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 0x7f3aa0046b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:59.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.838+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3aa800be50 con 0x7f3aa0044740 2024-09-17T01:40:59.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.841+0000 7f3ab7fff640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 0x7f3aa0046b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:59.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.847+0000 7f3ab7fff640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 0x7f3aa0046b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3aac006010 tx=0x7f3aac02a9a0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:59.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.853+0000 7f3ab57fa640 1 -- 172.21.15.82:0/4261799200 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f3aa800be50 con 0x7f3aa0044740 2024-09-17T01:40:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 msgr2=0x7f3aa0046b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 0x7f3aa0046b30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3aac006010 tx=0x7f3aac02a9a0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 msgr2=0x7f3ab819dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800e970 tx=0x7f3aa800ee30 comp rx=0 tx=0).stop 2024-09-17T01:40:59.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 shutdown_connections 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ab8077df0 0x7f3ab819dfb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3aa0044740 0x7f3aa0046b30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 --2- 172.21.15.82:0/4261799200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ab8076ba0 0x7f3ab819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 >> 172.21.15.82:0/4261799200 conn(0x7f3ab80ff330 msgr2=0x7f3ab810e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 shutdown_connections 2024-09-17T01:40:59.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.856+0000 7f3abe724640 1 -- 172.21.15.82:0/4261799200 wait complete. 2024-09-17T01:40:59.865 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:40:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:59 smithi082 ceph-mon[28077]: Manager daemon smithi167.ysmbcy is now available 2024-09-17T01:40:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:59 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:40:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:59 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:40:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:59 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:40:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:40:59 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:40:59.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.975+0000 7fc4e9874640 1 -- 172.21.15.82:0/1376735765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4100860 msgr2=0x7fc4e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:59.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.975+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1376735765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4100860 0x7fc4e4100c60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009880 tx=0x7fc4d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 -- 172.21.15.82:0/1376735765 shutdown_connections 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1376735765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4101a60 0x7fc4e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1376735765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4100860 0x7fc4e4100c60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 -- 172.21.15.82:0/1376735765 >> 172.21.15.82:0/1376735765 conn(0x7fc4e40fc010 msgr2=0x7fc4e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 -- 172.21.15.82:0/1376735765 shutdown_connections 2024-09-17T01:40:59.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 -- 172.21.15.82:0/1376735765 wait complete. 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.976+0000 7fc4e9874640 1 Processor -- start 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e9874640 1 -- start start 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e9874640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 0x7fc4e419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e9874640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 0x7fc4e419e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e9874640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41096a0 con 0x7fc4e4101a60 2024-09-17T01:40:59.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e9874640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4109520 con 0x7fc4e4100860 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 0x7fc4e419e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 0x7fc4e419e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40370/0 (socket says 172.21.15.82:40370) 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e27fc640 1 -- 172.21.15.82:0/1799391668 learned_addr learned my addr 172.21.15.82:0/1799391668 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.977+0000 7fc4e2ffd640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 0x7fc4e419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e2ffd640 1 -- 172.21.15.82:0/1799391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 msgr2=0x7fc4e419e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e2ffd640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 0x7fc4e419e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:40:59.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e2ffd640 1 -- 172.21.15.82:0/1799391668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e419e710 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e2ffd640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 0x7fc4e419db50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006010 tx=0x7fc4d40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4d403f070 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41a3080 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.978+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4d40049d0 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.979+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41a3610 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.979+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc4d4035030 con 0x7fc4e4100860 2024-09-17T01:40:59.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.980+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d00052c0 con 0x7fc4e4100860 2024-09-17T01:40:59.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.980+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7fc4d4042070 con 0x7fc4e4100860 2024-09-17T01:40:59.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.980+0000 7fc4e8872640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 0x7fc4cc041c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:40:59.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.980+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fc4d4075de0 con 0x7fc4e4100860 2024-09-17T01:40:59.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.980+0000 7fc4e27fc640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 0x7fc4cc041c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:40:59.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.981+0000 7fc4e27fc640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 0x7fc4cc041c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4e419ef90 tx=0x7fc4d8005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:40:59.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:40:59.985+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fc4d4004b80 con 0x7fc4e4100860 2024-09-17T01:41:00.081 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:59 smithi167 ceph-mon[35643]: Manager daemon smithi167.ysmbcy is now available 2024-09-17T01:41:00.081 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:59 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:00.081 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:59 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:00.081 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:59 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:00.081 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:40:59 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:41:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.372+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc4d0000bf0 con 0x7fc4cc03f790 2024-09-17T01:41:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.373+0000 7fc4e8872640 1 -- 172.21.15.82:0/1799391668 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7fc4d0000bf0 con 0x7fc4cc03f790 2024-09-17T01:41:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 msgr2=0x7fc4cc041c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 0x7fc4cc041c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4e419ef90 tx=0x7fc4d8005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 msgr2=0x7fc4e419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 0x7fc4e419db50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006010 tx=0x7fc4d40045e0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 shutdown_connections 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fc4cc03f790 0x7fc4cc041c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e4101a60 0x7fc4e419e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 --2- 172.21.15.82:0/1799391668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e4100860 0x7fc4e419db50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 >> 172.21.15.82:0/1799391668 conn(0x7fc4e40fc010 msgr2=0x7fc4e40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 shutdown_connections 2024-09-17T01:41:00.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.377+0000 7fc4e9874640 1 -- 172.21.15.82:0/1799391668 wait complete. 2024-09-17T01:41:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 -- 172.21.15.82:0/1285646258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6870104de0 msgr2=0x7f68701071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 --2- 172.21.15.82:0/1285646258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6870104de0 0x7f68701071d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6864009880 tx=0x7f686402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 -- 172.21.15.82:0/1285646258 shutdown_connections 2024-09-17T01:41:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 --2- 172.21.15.82:0/1285646258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6870104de0 0x7f68701071d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 --2- 172.21.15.82:0/1285646258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68701024b0 0x7f68701048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 -- 172.21.15.82:0/1285646258 >> 172.21.15.82:0/1285646258 conn(0x7f68700fc010 msgr2=0x7f68700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 -- 172.21.15.82:0/1285646258 shutdown_connections 2024-09-17T01:41:00.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.500+0000 7f6875377640 1 -- 172.21.15.82:0/1285646258 wait complete. 2024-09-17T01:41:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 Processor -- start 2024-09-17T01:41:00.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 -- start start 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 0x7f6870100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f687010a7a0 con 0x7f68701024b0 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.501+0000 7f6875377640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f687010a620 con 0x7f6870104de0 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 0x7f6870100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40378/0 (socket says 172.21.15.82:40378) 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 0x7f6870100460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:40886/0 (socket says 172.21.15.82:40886) 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 -- 172.21.15.82:0/963953005 learned_addr learned my addr 172.21.15.82:0/963953005 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 -- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 msgr2=0x7f6870100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 0x7f6870100460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 -- 172.21.15.82:0/963953005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68701009a0 con 0x7f68701024b0 2024-09-17T01:41:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.502+0000 7f686effd640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f686000e970 tx=0x7f686000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.503+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f686000cac0 con 0x7f68701024b0 2024-09-17T01:41:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.503+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6870100c90 con 0x7f68701024b0 2024-09-17T01:41:00.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.503+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701011f0 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.503+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f686000cc60 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.503+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6860018720 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.504+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f685c0052c0 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.504+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 51778+0+0 (secure 0 0 0) 0x7f68600189a0 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.504+0000 7f6857fff640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 0x7f6858041ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.504+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f68600556e0 con 0x7f68701024b0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.505+0000 7f686e7fc640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 0x7f6858041ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.505+0000 7f686e7fc640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 0x7f6858041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6864009230 tx=0x7f68640058d0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:00.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.513+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f68600071c0 con 0x7f68701024b0 2024-09-17T01:41:00.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.783+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f685c000bf0 con 0x7f685803f7e0 2024-09-17T01:41:00.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.797+0000 7f6857fff640 1 -- 172.21.15.82:0/963953005 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f685c000bf0 con 0x7f685803f7e0 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (5m) 112s ago 7m 25.9M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (7m) 112s ago 7m 8304k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (6m) 7s ago 6m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 112s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (6m) 7s ago 6m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (5m) 112s ago 7m 79.0M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (2m) 112s ago 2m 17.4M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:41:00.796 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (2m) 112s ago 2m 15.3M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (2m) 7s ago 2m 22.4M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (2m) 7s ago 2m 20.9M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (8m) 112s ago 8m 499M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (13s) 7s ago 6m 147M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 930ab8ac2a03 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 112s ago 9m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (6m) 7s ago 6m 36.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (7m) 112s ago 7m 13.6M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (6m) 7s ago 6m 16.5M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 112s ago 5m 55.0M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 112s ago 4m 55.5M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (4m) 112s ago 4m 46.9M 3946M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (4m) 7s ago 4m 89.4M 4970M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:41:00.797 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (3m) 7s ago 3m 74.8M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (3m) 7s ago 3m 75.9M 4970M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 112s ago 7m 55.1M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 msgr2=0x7f6858041ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 0x7f6858041ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6864009230 tx=0x7f68640058d0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 msgr2=0x7f6870101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f686000e970 tx=0x7f686000ee30 comp rx=0 tx=0).stop 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 shutdown_connections 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6870104de0 0x7f6870100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f685803f7e0 0x7f6858041ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 --2- 172.21.15.82:0/963953005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68701024b0 0x7f6870101da0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 >> 172.21.15.82:0/963953005 conn(0x7f68700fc010 msgr2=0x7f68700fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 shutdown_connections 2024-09-17T01:41:00.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.800+0000 7f6875377640 1 -- 172.21.15.82:0/963953005 wait complete. 2024-09-17T01:41:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/617617000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 msgr2=0x7fbb68100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/617617000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb68100fa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009880 tx=0x7fbb5402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/617617000 shutdown_connections 2024-09-17T01:41:00.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/617617000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb68100fa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/617617000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb681021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/617617000 >> 172.21.15.82:0/617617000 conn(0x7fbb680fb760 msgr2=0x7fbb680fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/617617000 shutdown_connections 2024-09-17T01:41:00.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.907+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/617617000 wait complete. 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 Processor -- start 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 -- start start 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb681996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb68199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68108590 con 0x7fbb68100b20 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.908+0000 7fbb6f0a8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68108410 con 0x7fbb68101de0 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb68199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb6ce44640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb681996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb67fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb68199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:40902/0 (socket says 172.21.15.82:40902) 2024-09-17T01:41:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb67fff640 1 -- 172.21.15.82:0/3746280723 learned_addr learned my addr 172.21.15.82:0/3746280723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb6ce44640 1 -- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 msgr2=0x7fbb68199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb6ce44640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb68199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:00.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.909+0000 7fbb6ce44640 1 -- 172.21.15.82:0/3746280723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6819a260 con 0x7fbb68100b20 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.910+0000 7fbb6ce44640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb681996a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbb68069a20 tx=0x7fbb5c00db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.910+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb5c017070 con 0x7fbb68100b20 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.910+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb5c009c80 con 0x7fbb68100b20 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.910+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb5c010e30 con 0x7fbb68100b20 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.910+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6819eca0 con 0x7fbb68100b20 2024-09-17T01:41:00.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.911+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6819f180 con 0x7fbb68100b20 2024-09-17T01:41:00.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.911+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 51972+0+0 (secure 0 0 0) 0x7fbb5c01a070 con 0x7fbb68100b20 2024-09-17T01:41:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.912+0000 7fbb65ffb640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 0x7fbb58041f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.912+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fbb5c0550b0 con 0x7fbb68100b20 2024-09-17T01:41:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.912+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb68100fa0 con 0x7fbb68100b20 2024-09-17T01:41:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.912+0000 7fbb67fff640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 0x7fbb58041f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:00.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.913+0000 7fbb67fff640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 0x7fbb58041f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb540096c0 tx=0x7fbb5402a9a0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:00.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:00.918+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbb5c0097c0 con 0x7fbb68100b20 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: mgrmap e22: smithi167.ysmbcy(active, since 1.19575s) 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: pgmap v3: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:41:01.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:41:01.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/trash_purge_schedule"}]: dispatch 2024-09-17T01:41:01.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:00 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/trash_purge_schedule"}]: dispatch 2024-09-17T01:41:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: mgrmap e22: smithi167.ysmbcy(active, since 1.19575s) 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: pgmap v3: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:41:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/trash_purge_schedule"}]: dispatch 2024-09-17T01:41:01.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:00 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi167.ysmbcy/trash_purge_schedule"}]: dispatch 2024-09-17T01:41:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.296+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbb6819faf0 con 0x7fbb68100b20 2024-09-17T01:41:01.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.296+0000 7fbb65ffb640 1 -- 172.21.15.82:0/3746280723 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fbb5c010640 con 0x7fbb68100b20 2024-09-17T01:41:01.294 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:41:01.294 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:41:01.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T01:41:01.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:41:01.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:41:01.296 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:41:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 msgr2=0x7fbb58041f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 0x7fbb58041f50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbb540096c0 tx=0x7fbb5402a9a0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 msgr2=0x7fbb681996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb681996a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbb68069a20 tx=0x7fbb5c00db30 comp rx=0 tx=0).stop 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 shutdown_connections 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb68101de0 0x7fbb68199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbb5803fa90 0x7fbb58041f50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 --2- 172.21.15.82:0/3746280723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb68100b20 0x7fbb681996a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 >> 172.21.15.82:0/3746280723 conn(0x7fbb680fb760 msgr2=0x7fbb680fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 shutdown_connections 2024-09-17T01:41:01.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.300+0000 7fbb6f0a8640 1 -- 172.21.15.82:0/3746280723 wait complete. 2024-09-17T01:41:01.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 -- 172.21.15.82:0/991930040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 msgr2=0x7f4f20100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 --2- 172.21.15.82:0/991930040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f20100c60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009880 tx=0x7f4f1c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 -- 172.21.15.82:0/991930040 shutdown_connections 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 --2- 172.21.15.82:0/991930040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 --2- 172.21.15.82:0/991930040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f20100c60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 -- 172.21.15.82:0/991930040 >> 172.21.15.82:0/991930040 conn(0x7f4f200fc010 msgr2=0x7f4f200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.416+0000 7f4f27a31640 1 -- 172.21.15.82:0/991930040 shutdown_connections 2024-09-17T01:41:01.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.417+0000 7f4f27a31640 1 -- 172.21.15.82:0/991930040 wait complete. 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.417+0000 7f4f27a31640 1 Processor -- start 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.417+0000 7f4f27a31640 1 -- start start 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f27a31640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f201952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f27a31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f27a31640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20109680 con 0x7f4f20100860 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f257cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f201952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f257cd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f201952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40408/0 (socket says 172.21.15.82:40408) 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f257cd640 1 -- 172.21.15.82:0/386321455 learned_addr learned my addr 172.21.15.82:0/386321455 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:01.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f20109500 con 0x7f4f20101a60 2024-09-17T01:41:01.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f24fcc640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f24fcc640 1 -- 172.21.15.82:0/386321455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 msgr2=0x7f4f201952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f24fcc640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f201952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.418+0000 7f4f24fcc640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f20195e80 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f24fcc640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20195800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005fd0 tx=0x7f4f1000dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f1000be30 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2019a8c0 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f10004030 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f10003cd0 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.419+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2019ae50 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.420+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 23) ==== 51972+0+0 (secure 0 0 0) 0x7f4f10010460 con 0x7f4f20101a60 2024-09-17T01:41:01.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.420+0000 7f4f167fc640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 0x7f4f0c041f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.420+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f4f10054e90 con 0x7f4f20101a60 2024-09-17T01:41:01.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.420+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f20100c60 con 0x7f4f20101a60 2024-09-17T01:41:01.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.421+0000 7f4f257cd640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 0x7f4f0c041f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.421+0000 7f4f257cd640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 0x7f4f0c041f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000c00 tx=0x7f4f1c005a20 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:01.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.426+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4f10017020 con 0x7f4f20101a60 2024-09-17T01:41:01.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.741+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4f2019b7a0 con 0x7f4f20101a60 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.742+0000 7f4f167fc640 1 -- 172.21.15.82:0/386321455 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f4f100222f0 con 0x7f4f20101a60 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:41:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:41:01.741 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:41:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 msgr2=0x7f4f0c041f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 0x7f4f0c041f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c000c00 tx=0x7f4f1c005a20 comp rx=0 tx=0).stop 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 msgr2=0x7f4f20195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20195800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4f10005fd0 tx=0x7f4f1000dd60 comp rx=0 tx=0).stop 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 shutdown_connections 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f20101a60 0x7f4f20195800 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4f0c03fa40 0x7f4f0c041f00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 --2- 172.21.15.82:0/386321455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f20100860 0x7f4f201952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 >> 172.21.15.82:0/386321455 conn(0x7f4f200fc010 msgr2=0x7f4f20069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 shutdown_connections 2024-09-17T01:41:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.745+0000 7f4f27a31640 1 -- 172.21.15.82:0/386321455 wait complete. 2024-09-17T01:41:01.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 -- 172.21.15.82:0/1009419947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4100880 msgr2=0x7f7bf4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/1009419947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4100880 0x7f7bf4100c80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009880 tx=0x7f7be402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 -- 172.21.15.82:0/1009419947 shutdown_connections 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/1009419947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4101a80 0x7f7bf4101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/1009419947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4100880 0x7f7bf4100c80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 -- 172.21.15.82:0/1009419947 >> 172.21.15.82:0/1009419947 conn(0x7f7bf40fc010 msgr2=0x7f7bf40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 -- 172.21.15.82:0/1009419947 shutdown_connections 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.860+0000 7f7bf9e78640 1 -- 172.21.15.82:0/1009419947 wait complete. 2024-09-17T01:41:01.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 Processor -- start 2024-09-17T01:41:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 -- start start 2024-09-17T01:41:01.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4101a80 0x7f7bf4196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf41096a0 con 0x7f7bf4101a80 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.861+0000 7f7bf9e78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf4109520 con 0x7f7bf4100880 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:40952/0 (socket says 172.21.15.82:40952) 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 -- 172.21.15.82:0/3231966668 learned_addr learned my addr 172.21.15.82:0/3231966668 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf2ffd640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4101a80 0x7f7bf4196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 -- 172.21.15.82:0/3231966668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4101a80 msgr2=0x7f7bf4196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4101a80 0x7f7bf4196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 -- 172.21.15.82:0/3231966668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf4196ff0 con 0x7f7bf4100880 2024-09-17T01:41:01.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.862+0000 7f7bf37fe640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006010 tx=0x7f7be40045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:01.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.863+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7be403f070 con 0x7f7bf4100880 2024-09-17T01:41:01.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.863+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7be40035f0 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.863+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf406a520 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.863+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf406aab0 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.863+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7be4035030 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.864+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 23) ==== 51972+0+0 (secure 0 0 0) 0x7f7be4042070 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.864+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be00052c0 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.864+0000 7f7bf0ff9640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 0x7f7bdc041ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.865+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f7be4075ff0 con 0x7f7bf4100880 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.865+0000 7f7bf2ffd640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 0x7f7bdc041ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:01.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.865+0000 7f7bf2ffd640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 0x7f7bdc041ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7be80095f0 tx=0x7f7be8005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:01.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:01.869+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7be402f300 con 0x7f7bf4100880 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: Deploying cephadm binary to smithi167 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: Deploying cephadm binary to smithi082 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: pgmap v4: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:01.910 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: mgrmap e23: smithi167.ysmbcy(active, since 2s) 2024-09-17T01:41:01.911 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3746280723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:41:01.911 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:01 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/386321455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: Deploying cephadm binary to smithi167 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: Deploying cephadm binary to smithi082 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: pgmap v4: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: mgrmap e23: smithi167.ysmbcy(active, since 2s) 2024-09-17T01:41:02.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3746280723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:41:02.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:01 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/386321455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:41:02.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.298+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7be0000bf0 con 0x7f7bdc03fa30 2024-09-17T01:41:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.300+0000 7f7bf0ff9640 1 -- 172.21.15.82:0/3231966668 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f7be0000bf0 con 0x7f7bdc03fa30 2024-09-17T01:41:02.297 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:41:02.298 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:41:02.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 msgr2=0x7f7bdc041ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 0x7f7bdc041ef0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7be80095f0 tx=0x7f7be8005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:02.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 msgr2=0x7f7bf4196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006010 tx=0x7f7be40045e0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 shutdown_connections 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7bdc03fa30 0x7f7bdc041ef0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bf4101a80 0x7f7bf4196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 --2- 172.21.15.82:0/3231966668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bf4100880 0x7f7bf4196430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.303+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 >> 172.21.15.82:0/3231966668 conn(0x7f7bf40fc010 msgr2=0x7f7bf4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.304+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 shutdown_connections 2024-09-17T01:41:02.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.304+0000 7f7bf9e78640 1 -- 172.21.15.82:0/3231966668 wait complete. 2024-09-17T01:41:02.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 -- 172.21.15.82:0/1772900873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c076ba0 msgr2=0x7f105c076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 --2- 172.21.15.82:0/1772900873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c076ba0 0x7f105c076fa0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1054009c20 tx=0x7f105402a9a0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 -- 172.21.15.82:0/1772900873 shutdown_connections 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 --2- 172.21.15.82:0/1772900873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c077df0 0x7f105c078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 --2- 172.21.15.82:0/1772900873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c076ba0 0x7f105c076fa0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 -- 172.21.15.82:0/1772900873 >> 172.21.15.82:0/1772900873 conn(0x7f105c0ff320 msgr2=0x7f105c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 -- 172.21.15.82:0/1772900873 shutdown_connections 2024-09-17T01:41:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.425+0000 7f1060941640 1 -- 172.21.15.82:0/1772900873 wait complete. 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 Processor -- start 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 -- start start 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 0x7f105c19da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 0x7f105c19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f105c110d80 con 0x7f105c077df0 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.426+0000 7f1060941640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f105c110c00 con 0x7f105c076ba0 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f1059d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 0x7f105c19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f1059d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 0x7f105c19dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40452/0 (socket says 172.21.15.82:40452) 2024-09-17T01:41:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f1059d9b640 1 -- 172.21.15.82:0/3976731787 learned_addr learned my addr 172.21.15.82:0/3976731787 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f105a59c640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 0x7f105c19da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f105a59c640 1 -- 172.21.15.82:0/3976731787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 msgr2=0x7f105c19dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f105a59c640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 0x7f105c19dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.427+0000 7f105a59c640 1 -- 172.21.15.82:0/3976731787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105c19e630 con 0x7f105c076ba0 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f105a59c640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 0x7f105c19da70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1054036810 tx=0x7f105402f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1054047070 con 0x7f105c076ba0 2024-09-17T01:41:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105c1a3010 con 0x7f105c076ba0 2024-09-17T01:41:02.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1054003e30 con 0x7f105c076ba0 2024-09-17T01:41:02.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1054033050 con 0x7f105c076ba0 2024-09-17T01:41:02.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.428+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105c1a35a0 con 0x7f105c076ba0 2024-09-17T01:41:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.430+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 23) ==== 51972+0+0 (secure 0 0 0) 0x7f105404a070 con 0x7f105c076ba0 2024-09-17T01:41:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.430+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105c076fa0 con 0x7f105c076ba0 2024-09-17T01:41:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.430+0000 7f104b7fe640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 0x7f1044041f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.430+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f105403e030 con 0x7f105c076ba0 2024-09-17T01:41:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.430+0000 7f1059d9b640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 0x7f1044041f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:02.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.431+0000 7f1059d9b640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 0x7f1044041f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f105c19ef20 tx=0x7f1050005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:02.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.436+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f1054048260 con 0x7f105c076ba0 2024-09-17T01:41:02.838 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:41:02.838 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:41:02.838 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:41:02.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.839+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f105c197b90 con 0x7f105c076ba0 2024-09-17T01:41:02.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.840+0000 7f104b7fe640 1 -- 172.21.15.82:0/3976731787 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f1054004040 con 0x7f105c076ba0 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 msgr2=0x7f1044041f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 0x7f1044041f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f105c19ef20 tx=0x7f1050005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 msgr2=0x7f105c19da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 0x7f105c19da70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1054036810 tx=0x7f105402f830 comp rx=0 tx=0).stop 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 shutdown_connections 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f104403fa40 0x7f1044041f00 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f105c19ef20 tx=0x7f1050005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f105c077df0 0x7f105c19dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 --2- 172.21.15.82:0/3976731787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f105c076ba0 0x7f105c19da70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.844+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 >> 172.21.15.82:0/3976731787 conn(0x7f105c0ff320 msgr2=0x7f105c10e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.845+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 shutdown_connections 2024-09-17T01:41:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:02.845+0000 7f1060941640 1 -- 172.21.15.82:0/3976731787 wait complete. 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: [17/Sep/2024:01:41:01] ENGINE Bus STARTING 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: [17/Sep/2024:01:41:01] ENGINE Serving on http://172.21.15.167:8765 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: [17/Sep/2024:01:41:01] ENGINE Serving on https://172.21.15.167:7150 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: [17/Sep/2024:01:41:01] ENGINE Bus STARTED 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: [17/Sep/2024:01:41:01] ENGINE Error in HTTPServer.serve 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Traceback (most recent call last): 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:41:02.981 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._run(expiration_interval) 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s = self.context.wrap_socket( 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: return self.sslsocket_class._create( 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self.do_handshake() 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._sslobj.do_handshake() 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:41:02.982 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:02 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3976731787' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:41:03.162 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: [17/Sep/2024:01:41:01] ENGINE Bus STARTING 2024-09-17T01:41:03.162 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: [17/Sep/2024:01:41:01] ENGINE Serving on http://172.21.15.167:8765 2024-09-17T01:41:03.162 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: [17/Sep/2024:01:41:01] ENGINE Serving on https://172.21.15.167:7150 2024-09-17T01:41:03.162 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: [17/Sep/2024:01:41:01] ENGINE Bus STARTED 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: [17/Sep/2024:01:41:01] ENGINE Error in HTTPServer.serve 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Traceback (most recent call last): 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._run(expiration_interval) 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s = self.context.wrap_socket( 2024-09-17T01:41:03.163 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: return self.sslsocket_class._create( 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self.do_handshake() 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._sslobj.do_handshake() 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:41:03.164 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:02 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3976731787' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:41:03.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:03 smithi082 ceph-mon[28077]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:03.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:03 smithi082 ceph-mon[28077]: pgmap v5: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:03.975 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:03 smithi082 ceph-mon[28077]: mgrmap e24: smithi167.ysmbcy(active, since 4s) 2024-09-17T01:41:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:03 smithi167 ceph-mon[35643]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:03 smithi167 ceph-mon[35643]: pgmap v5: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:03 smithi167 ceph-mon[35643]: mgrmap e24: smithi167.ysmbcy(active, since 4s) 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: pgmap v6: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: Standby manager daemon smithi082.oppacm started 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/crt"}]: dispatch 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/key"}]: dispatch 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:05 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:06.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: pgmap v6: 65 pgs: 65 active+clean; 167 MiB data, 731 MiB used, 536 GiB / 536 GiB avail 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: Standby manager daemon smithi082.oppacm started 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/crt"}]: dispatch 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/key"}]: dispatch 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/347312727' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:05 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:07.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:06 smithi167 ceph-mon[35643]: mgrmap e25: smithi167.ysmbcy(active, since 7s), standbys: smithi082.oppacm 2024-09-17T01:41:07.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:06 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:41:07.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:06 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:07.180 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:06 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:06 smithi082 ceph-mon[28077]: mgrmap e25: smithi167.ysmbcy(active, since 7s), standbys: smithi082.oppacm 2024-09-17T01:41:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:06 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:41:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:06 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:06 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: pgmap v7: 65 pgs: 65 active+clean; 182 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 289 op/s 2024-09-17T01:41:08.248 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.249 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:08 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: pgmap v7: 65 pgs: 65 active+clean; 182 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 289 op/s 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:08.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:08 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:09 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi082 to 1216M 2024-09-17T01:41:09.418 INFO:tasks.workunit.client.0.smithi082.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:41:09.422 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:41:09.422 INFO:tasks.workunit.client.0.smithi082.stderr:+ make 2024-09-17T01:41:09.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:09 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi082 to 1216M 2024-09-17T01:41:09.994 INFO:tasks.workunit.client.0.smithi082.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:41:10.174 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:10 smithi167 ceph-mon[35643]: pgmap v8: 65 pgs: 65 active+clean; 182 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-09-17T01:41:10.371 INFO:tasks.workunit.client.0.smithi082.stderr:++ readlink -f fsstress 2024-09-17T01:41:10.373 INFO:tasks.workunit.client.0.smithi082.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:41:10.373 INFO:tasks.workunit.client.0.smithi082.stderr:+ popd 2024-09-17T01:41:10.374 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:41:10.374 INFO:tasks.workunit.client.0.smithi082.stderr:+ popd 2024-09-17T01:41:10.375 INFO:tasks.workunit.client.0.smithi082.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-17T01:41:10.375 INFO:tasks.workunit.client.0.smithi082.stderr:++ mktemp -d -p . 2024-09-17T01:41:10.378 INFO:tasks.workunit.client.0.smithi082.stderr:+ T=./tmp.H4QZ1BCB3F 2024-09-17T01:41:10.378 INFO:tasks.workunit.client.0.smithi082.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.H4QZ1BCB3F -l 1 -n 1000 -p 10 -v 2024-09-17T01:41:10.383 INFO:tasks.workunit.client.0.smithi082.stdout:seed = 1726822898 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/0: write - no filename 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/1: truncate - no filename 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/2: unlink - no file 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/3: chown . 4 1 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/4: chown . 2144 1 2024-09-17T01:41:10.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/5: write - no filename 2024-09-17T01:41:10.393 INFO:tasks.workunit.client.0.smithi082.stdout:0/6: creat f0 x:0 0 0 2024-09-17T01:41:10.393 INFO:tasks.workunit.client.0.smithi082.stdout:1/0: creat f0 x:0 0 0 2024-09-17T01:41:10.393 INFO:tasks.workunit.client.0.smithi082.stdout:0/7: dread - f0 zero size 2024-09-17T01:41:10.394 INFO:tasks.workunit.client.0.smithi082.stdout:1/1: read - f0 zero size 2024-09-17T01:41:10.395 INFO:tasks.workunit.client.0.smithi082.stdout:3/0: dread - no filename 2024-09-17T01:41:10.395 INFO:tasks.workunit.client.0.smithi082.stdout:3/1: fsync - no filename 2024-09-17T01:41:10.397 INFO:tasks.workunit.client.0.smithi082.stdout:0/8: creat f1 x:0 0 0 2024-09-17T01:41:10.397 INFO:tasks.workunit.client.0.smithi082.stdout:0/9: dread - f1 zero size 2024-09-17T01:41:10.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/2: mknod c1 0 2024-09-17T01:41:10.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/10: chown f0 12 1 2024-09-17T01:41:10.399 INFO:tasks.workunit.client.0.smithi082.stdout:2/0: mknod c0 0 2024-09-17T01:41:10.399 INFO:tasks.workunit.client.0.smithi082.stdout:1/3: write f0 [535711,76175] 0 2024-09-17T01:41:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/0: unlink - no file 2024-09-17T01:41:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/1: dread - no filename 2024-09-17T01:41:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/2: chown . 322440 1 2024-09-17T01:41:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/3: dread - no filename 2024-09-17T01:41:10.401 INFO:tasks.workunit.client.0.smithi082.stdout:1/4: write f0 [102701,50465] 0 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/1: mkdir d1 0 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/2: write - no filename 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/3: dread - no filename 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:0/11: creat f2 x:0 0 0 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/4: chown d1 322181 1 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/5: write - no filename 2024-09-17T01:41:10.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/6: fdatasync - no filename 2024-09-17T01:41:10.406 INFO:tasks.workunit.client.0.smithi082.stdout:2/7: write - no filename 2024-09-17T01:41:10.406 INFO:tasks.workunit.client.0.smithi082.stdout:0/12: truncate f1 369207 0 2024-09-17T01:41:10.406 INFO:tasks.workunit.client.0.smithi082.stdout:0/13: read - f0 zero size 2024-09-17T01:41:10.407 INFO:tasks.workunit.client.0.smithi082.stdout:0/14: write f1 [1226513,82355] 0 2024-09-17T01:41:10.407 INFO:tasks.workunit.client.0.smithi082.stdout:1/5: dread f0 [0,4194304] 0 2024-09-17T01:41:10.408 INFO:tasks.workunit.client.0.smithi082.stdout:4/4: symlink l0 0 2024-09-17T01:41:10.408 INFO:tasks.workunit.client.0.smithi082.stdout:4/5: stat l0 0 2024-09-17T01:41:10.409 INFO:tasks.workunit.client.0.smithi082.stdout:4/6: chown l0 186644511 1 2024-09-17T01:41:10.410 INFO:tasks.workunit.client.0.smithi082.stdout:2/8: rename c0 to d1/c2 0 2024-09-17T01:41:10.413 INFO:tasks.workunit.client.0.smithi082.stdout:8/0: dread - no filename 2024-09-17T01:41:10.413 INFO:tasks.workunit.client.0.smithi082.stdout:8/1: dread - no filename 2024-09-17T01:41:10.419 INFO:tasks.workunit.client.0.smithi082.stdout:1/6: mkdir d2 0 2024-09-17T01:41:10.420 INFO:tasks.workunit.client.0.smithi082.stdout:5/0: mknod c0 0 2024-09-17T01:41:10.420 INFO:tasks.workunit.client.0.smithi082.stdout:5/1: dread - no filename 2024-09-17T01:41:10.420 INFO:tasks.workunit.client.0.smithi082.stdout:5/2: dwrite - no filename 2024-09-17T01:41:10.420 INFO:tasks.workunit.client.0.smithi082.stdout:5/3: truncate - no filename 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:4/7: mknod c1 0 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:4/8: dread - no filename 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:2/9: mknod d1/c3 0 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:2/10: write - no filename 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:9/0: truncate - no filename 2024-09-17T01:41:10.421 INFO:tasks.workunit.client.0.smithi082.stdout:6/0: creat f0 x:0 0 0 2024-09-17T01:41:10.422 INFO:tasks.workunit.client.0.smithi082.stdout:2/11: chown d1/c3 47458100 1 2024-09-17T01:41:10.422 INFO:tasks.workunit.client.0.smithi082.stdout:2/12: truncate - no filename 2024-09-17T01:41:10.422 INFO:tasks.workunit.client.0.smithi082.stdout:6/1: dread - f0 zero size 2024-09-17T01:41:10.423 INFO:tasks.workunit.client.0.smithi082.stdout:1/7: write f0 [1364,17235] 0 2024-09-17T01:41:10.424 INFO:tasks.workunit.client.0.smithi082.stdout:8/2: creat f0 x:0 0 0 2024-09-17T01:41:10.425 INFO:tasks.workunit.client.0.smithi082.stdout:4/9: rename c1 to c2 0 2024-09-17T01:41:10.425 INFO:tasks.workunit.client.0.smithi082.stdout:4/10: write - no filename 2024-09-17T01:41:10.425 INFO:tasks.workunit.client.0.smithi082.stdout:4/11: fdatasync - no filename 2024-09-17T01:41:10.425 INFO:tasks.workunit.client.0.smithi082.stdout:4/12: write - no filename 2024-09-17T01:41:10.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/0: chown . 1391105437 1 2024-09-17T01:41:10.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/1: link - no file 2024-09-17T01:41:10.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/2: write - no filename 2024-09-17T01:41:10.431 INFO:tasks.workunit.client.0.smithi082.stdout:2/13: creat d1/f4 x:0 0 0 2024-09-17T01:41:10.431 INFO:tasks.workunit.client.0.smithi082.stdout:2/14: stat d1/c3 0 2024-09-17T01:41:10.435 INFO:tasks.workunit.client.0.smithi082.stdout:9/1: symlink l0 0 2024-09-17T01:41:10.435 INFO:tasks.workunit.client.0.smithi082.stdout:9/2: rmdir - no directory 2024-09-17T01:41:10.435 INFO:tasks.workunit.client.0.smithi082.stdout:9/3: fsync - no filename 2024-09-17T01:41:10.441 INFO:tasks.workunit.client.0.smithi082.stdout:1/8: creat d2/f3 x:0 0 0 2024-09-17T01:41:10.445 INFO:tasks.workunit.client.0.smithi082.stdout:9/4: mkdir d1 0 2024-09-17T01:41:10.445 INFO:tasks.workunit.client.0.smithi082.stdout:9/5: stat l0 0 2024-09-17T01:41:10.446 INFO:tasks.workunit.client.0.smithi082.stdout:9/6: fdatasync - no filename 2024-09-17T01:41:10.446 INFO:tasks.workunit.client.0.smithi082.stdout:9/7: fdatasync - no filename 2024-09-17T01:41:10.447 INFO:tasks.workunit.client.0.smithi082.stdout:9/8: rename d1 to d1/d2 22 2024-09-17T01:41:10.447 INFO:tasks.workunit.client.0.smithi082.stdout:9/9: dwrite - no filename 2024-09-17T01:41:10.447 INFO:tasks.workunit.client.0.smithi082.stdout:7/3: mkdir d0 0 2024-09-17T01:41:10.449 INFO:tasks.workunit.client.0.smithi082.stdout:2/15: link d1/f4 d1/f5 0 2024-09-17T01:41:10.452 INFO:tasks.workunit.client.0.smithi082.stdout:1/9: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:41:10.453 INFO:tasks.workunit.client.0.smithi082.stdout:1/10: chown f0 8319 1 2024-09-17T01:41:10.455 INFO:tasks.workunit.client.0.smithi082.stdout:1/11: write f0 [143799,82439] 0 2024-09-17T01:41:10.456 INFO:tasks.workunit.client.0.smithi082.stdout:1/12: write d2/f3 [2845345,78365] 0 2024-09-17T01:41:10.457 INFO:tasks.workunit.client.0.smithi082.stdout:2/16: write d1/f5 [663130,19948] 0 2024-09-17T01:41:10.459 INFO:tasks.workunit.client.0.smithi082.stdout:2/17: truncate d1/f4 1117851 0 2024-09-17T01:41:10.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/4: symlink d0/l1 0 2024-09-17T01:41:10.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/5: dwrite - no filename 2024-09-17T01:41:10.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/6: chown d0/l1 821413 1 2024-09-17T01:41:10.461 INFO:tasks.workunit.client.0.smithi082.stdout:7/7: chown d0/l1 156 1 2024-09-17T01:41:10.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:10 smithi082 ceph-mon[28077]: pgmap v8: 65 pgs: 65 active+clean; 182 MiB data, 777 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-09-17T01:41:10.467 INFO:tasks.workunit.client.0.smithi082.stdout:9/10: rmdir d1 0 2024-09-17T01:41:10.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/8: mknod d0/c2 0 2024-09-17T01:41:10.470 INFO:tasks.workunit.client.0.smithi082.stdout:2/18: read d1/f5 [431113,69139] 0 2024-09-17T01:41:10.471 INFO:tasks.workunit.client.0.smithi082.stdout:9/11: rename l0 to l3 0 2024-09-17T01:41:10.474 INFO:tasks.workunit.client.0.smithi082.stdout:2/19: rmdir d1 39 2024-09-17T01:41:11.160 INFO:tasks.workunit.client.0.smithi082.stdout:0/15: fsync f2 0 2024-09-17T01:41:11.160 INFO:tasks.workunit.client.0.smithi082.stdout:0/16: dread - f2 zero size 2024-09-17T01:41:11.163 INFO:tasks.workunit.client.0.smithi082.stdout:0/17: unlink f2 0 2024-09-17T01:41:11.166 INFO:tasks.workunit.client.0.smithi082.stdout:0/18: creat f3 x:0 0 0 2024-09-17T01:41:11.170 INFO:tasks.workunit.client.0.smithi082.stdout:0/19: rename f1 to f4 0 2024-09-17T01:41:11.174 INFO:tasks.workunit.client.0.smithi082.stdout:2/20: chown d1/c2 3386 1 2024-09-17T01:41:11.181 INFO:tasks.workunit.client.0.smithi082.stdout:6/2: fsync f0 0 2024-09-17T01:41:11.182 INFO:tasks.workunit.client.0.smithi082.stdout:8/3: getdents . 0 2024-09-17T01:41:11.184 INFO:tasks.workunit.client.0.smithi082.stdout:4/13: chown c2 7372 1 2024-09-17T01:41:11.185 INFO:tasks.workunit.client.0.smithi082.stdout:2/21: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:41:11.188 INFO:tasks.workunit.client.0.smithi082.stdout:4/14: mknod c3 0 2024-09-17T01:41:11.192 INFO:tasks.workunit.client.0.smithi082.stdout:1/13: fsync d2/f3 0 2024-09-17T01:41:11.193 INFO:tasks.workunit.client.0.smithi082.stdout:8/4: getdents . 0 2024-09-17T01:41:11.195 INFO:tasks.workunit.client.0.smithi082.stdout:2/22: dwrite d1/f5 [0,4194304] 0 2024-09-17T01:41:11.196 INFO:tasks.workunit.client.0.smithi082.stdout:4/15: symlink l4 0 2024-09-17T01:41:11.198 INFO:tasks.workunit.client.0.smithi082.stdout:6/3: getdents . 0 2024-09-17T01:41:11.200 INFO:tasks.workunit.client.0.smithi082.stdout:6/4: chown f0 0 1 2024-09-17T01:41:11.200 INFO:tasks.workunit.client.0.smithi082.stdout:1/14: creat d2/f4 x:0 0 0 2024-09-17T01:41:11.205 INFO:tasks.workunit.client.0.smithi082.stdout:4/16: mknod c5 0 2024-09-17T01:41:11.205 INFO:tasks.workunit.client.0.smithi082.stdout:4/17: truncate - no filename 2024-09-17T01:41:11.205 INFO:tasks.workunit.client.0.smithi082.stdout:8/5: dwrite f0 [0,4194304] 0 2024-09-17T01:41:11.206 INFO:tasks.workunit.client.0.smithi082.stdout:6/5: mkdir d1 0 2024-09-17T01:41:11.209 INFO:tasks.workunit.client.0.smithi082.stdout:1/15: rmdir d2 39 2024-09-17T01:41:11.210 INFO:tasks.workunit.client.0.smithi082.stdout:4/18: mknod c6 0 2024-09-17T01:41:11.211 INFO:tasks.workunit.client.0.smithi082.stdout:4/19: write - no filename 2024-09-17T01:41:11.212 INFO:tasks.workunit.client.0.smithi082.stdout:2/23: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:41:11.216 INFO:tasks.workunit.client.0.smithi082.stdout:1/16: chown d2 395523 1 2024-09-17T01:41:11.217 INFO:tasks.workunit.client.0.smithi082.stdout:2/24: dread d1/f5 [0,4194304] 0 2024-09-17T01:41:11.218 INFO:tasks.workunit.client.0.smithi082.stdout:8/6: link f0 f1 0 2024-09-17T01:41:11.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/9: getdents d0 0 2024-09-17T01:41:11.221 INFO:tasks.workunit.client.0.smithi082.stdout:7/10: chown d0/l1 47665 1 2024-09-17T01:41:11.221 INFO:tasks.workunit.client.0.smithi082.stdout:7/11: fsync - no filename 2024-09-17T01:41:11.222 INFO:tasks.workunit.client.0.smithi082.stdout:7/12: write - no filename 2024-09-17T01:41:11.223 INFO:tasks.workunit.client.0.smithi082.stdout:4/20: creat f7 x:0 0 0 2024-09-17T01:41:11.225 INFO:tasks.workunit.client.0.smithi082.stdout:1/17: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:41:11.225 INFO:tasks.workunit.client.0.smithi082.stdout:2/25: dread d1/f5 [0,4194304] 0 2024-09-17T01:41:11.226 INFO:tasks.workunit.client.0.smithi082.stdout:6/6: symlink d1/l2 0 2024-09-17T01:41:11.227 INFO:tasks.workunit.client.0.smithi082.stdout:6/7: chown d1/l2 210 1 2024-09-17T01:41:11.229 INFO:tasks.workunit.client.0.smithi082.stdout:8/7: unlink f0 0 2024-09-17T01:41:11.231 INFO:tasks.workunit.client.0.smithi082.stdout:7/13: mkdir d0/d3 0 2024-09-17T01:41:11.231 INFO:tasks.workunit.client.0.smithi082.stdout:7/14: dwrite - no filename 2024-09-17T01:41:11.231 INFO:tasks.workunit.client.0.smithi082.stdout:7/15: chown d0/d3 12 1 2024-09-17T01:41:11.231 INFO:tasks.workunit.client.0.smithi082.stdout:7/16: readlink d0/l1 0 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/17: dwrite - no filename 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/18: write - no filename 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/19: fsync - no filename 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/20: read - no filename 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/21: dwrite - no filename 2024-09-17T01:41:11.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/22: dread - no filename 2024-09-17T01:41:11.233 INFO:tasks.workunit.client.0.smithi082.stdout:4/21: creat f8 x:0 0 0 2024-09-17T01:41:11.236 INFO:tasks.workunit.client.0.smithi082.stdout:2/26: mknod d1/c6 0 2024-09-17T01:41:11.237 INFO:tasks.workunit.client.0.smithi082.stdout:6/8: mkdir d1/d3 0 2024-09-17T01:41:11.243 INFO:tasks.workunit.client.0.smithi082.stdout:4/22: mkdir d9 0 2024-09-17T01:41:11.243 INFO:tasks.workunit.client.0.smithi082.stdout:4/23: write f7 [86910,121239] 0 2024-09-17T01:41:11.243 INFO:tasks.workunit.client.0.smithi082.stdout:2/27: write d1/f4 [3404364,30197] 0 2024-09-17T01:41:11.244 INFO:tasks.workunit.client.0.smithi082.stdout:1/18: fsync d2/f3 0 2024-09-17T01:41:11.244 INFO:tasks.workunit.client.0.smithi082.stdout:2/28: stat d1/c6 0 2024-09-17T01:41:11.245 INFO:tasks.workunit.client.0.smithi082.stdout:1/19: chown d2/f3 513 1 2024-09-17T01:41:11.245 INFO:tasks.workunit.client.0.smithi082.stdout:6/9: mknod d1/c4 0 2024-09-17T01:41:11.247 INFO:tasks.workunit.client.0.smithi082.stdout:1/20: dread f0 [0,4194304] 0 2024-09-17T01:41:11.248 INFO:tasks.workunit.client.0.smithi082.stdout:8/8: rename f1 to f2 0 2024-09-17T01:41:11.250 INFO:tasks.workunit.client.0.smithi082.stdout:7/23: creat d0/d3/f4 x:0 0 0 2024-09-17T01:41:11.250 INFO:tasks.workunit.client.0.smithi082.stdout:1/21: dread d2/f3 [0,4194304] 0 2024-09-17T01:41:11.257 INFO:tasks.workunit.client.0.smithi082.stdout:7/24: unlink d0/c2 0 2024-09-17T01:41:11.258 INFO:tasks.workunit.client.0.smithi082.stdout:1/22: symlink d2/l5 0 2024-09-17T01:41:11.260 INFO:tasks.workunit.client.0.smithi082.stdout:4/24: creat d9/fa x:0 0 0 2024-09-17T01:41:11.264 INFO:tasks.workunit.client.0.smithi082.stdout:6/10: symlink d1/d3/l5 0 2024-09-17T01:41:11.266 INFO:tasks.workunit.client.0.smithi082.stdout:7/25: symlink d0/d3/l5 0 2024-09-17T01:41:11.267 INFO:tasks.workunit.client.0.smithi082.stdout:1/23: fdatasync f0 0 2024-09-17T01:41:11.267 INFO:tasks.workunit.client.0.smithi082.stdout:1/24: fdatasync f0 0 2024-09-17T01:41:11.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/11: mknod d1/d3/c6 0 2024-09-17T01:41:11.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/12: truncate f0 113057 0 2024-09-17T01:41:11.272 INFO:tasks.workunit.client.0.smithi082.stdout:6/13: truncate f0 308201 0 2024-09-17T01:41:11.272 INFO:tasks.workunit.client.0.smithi082.stdout:6/14: fdatasync f0 0 2024-09-17T01:41:11.272 INFO:tasks.workunit.client.0.smithi082.stdout:6/15: chown f0 12 1 2024-09-17T01:41:11.273 INFO:tasks.workunit.client.0.smithi082.stdout:1/25: creat d2/f6 x:0 0 0 2024-09-17T01:41:11.277 INFO:tasks.workunit.client.0.smithi082.stdout:6/16: mkdir d1/d7 0 2024-09-17T01:41:11.278 INFO:tasks.workunit.client.0.smithi082.stdout:1/26: mkdir d2/d7 0 2024-09-17T01:41:11.279 INFO:tasks.workunit.client.0.smithi082.stdout:6/17: rmdir d1 39 2024-09-17T01:41:11.280 INFO:tasks.workunit.client.0.smithi082.stdout:6/18: dread f0 [0,4194304] 0 2024-09-17T01:41:11.281 INFO:tasks.workunit.client.0.smithi082.stdout:1/27: mknod d2/c8 0 2024-09-17T01:41:11.284 INFO:tasks.workunit.client.0.smithi082.stdout:1/28: mknod d2/c9 0 2024-09-17T01:41:11.287 INFO:tasks.workunit.client.0.smithi082.stdout:1/29: rename d2/d7 to d2/da 0 2024-09-17T01:41:11.288 INFO:tasks.workunit.client.0.smithi082.stdout:1/30: write d2/f4 [273950,112903] 0 2024-09-17T01:41:11.289 INFO:tasks.workunit.client.0.smithi082.stdout:1/31: fdatasync f0 0 2024-09-17T01:41:11.289 INFO:tasks.workunit.client.0.smithi082.stdout:1/32: chown d2/f6 3257222 1 2024-09-17T01:41:11.290 INFO:tasks.workunit.client.0.smithi082.stdout:1/33: rename d2 to d2/da/db 22 2024-09-17T01:41:11.292 INFO:tasks.workunit.client.0.smithi082.stdout:1/34: mknod d2/cc 0 2024-09-17T01:41:11.294 INFO:tasks.workunit.client.0.smithi082.stdout:1/35: mkdir d2/dd 0 2024-09-17T01:41:11.300 INFO:tasks.workunit.client.0.smithi082.stdout:1/36: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:41:11.303 INFO:tasks.workunit.client.0.smithi082.stdout:1/37: getdents d2/da 0 2024-09-17T01:41:11.306 INFO:tasks.workunit.client.0.smithi082.stdout:1/38: getdents d2/da 0 2024-09-17T01:41:11.307 INFO:tasks.workunit.client.0.smithi082.stdout:1/39: write d2/f3 [2986960,128401] 0 2024-09-17T01:41:11.317 INFO:tasks.workunit.client.0.smithi082.stdout:1/40: fsync d2/f3 0 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: Adjusting osd_memory_target on smithi167 to 2240M 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.494 INFO:tasks.workunit.client.0.smithi082.stdout:0/20: getdents . 0 2024-09-17T01:41:11.497 INFO:tasks.workunit.client.0.smithi082.stdout:0/21: symlink l5 0 2024-09-17T01:41:11.500 INFO:tasks.workunit.client.0.smithi082.stdout:0/22: creat f6 x:0 0 0 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-17T01:41:11.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: Adjusting osd_memory_target on smithi167 to 2240M 2024-09-17T01:41:11.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:41:11.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:41:11.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:41:11.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:41:11.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:11.508 INFO:tasks.workunit.client.0.smithi082.stdout:0/23: dwrite f0 [0,4194304] 0 2024-09-17T01:41:11.512 INFO:tasks.workunit.client.0.smithi082.stdout:0/24: rename f3 to f7 0 2024-09-17T01:41:11.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/19: mkdir d1/d7/d8 0 2024-09-17T01:41:11.538 INFO:tasks.workunit.client.0.smithi082.stdout:6/20: stat d1/d7 0 2024-09-17T01:41:11.546 INFO:tasks.workunit.client.0.smithi082.stdout:7/26: fsync d0/d3/f4 0 2024-09-17T01:41:11.547 INFO:tasks.workunit.client.0.smithi082.stdout:6/21: dwrite f0 [0,4194304] 0 2024-09-17T01:41:11.547 INFO:tasks.workunit.client.0.smithi082.stdout:7/27: read - d0/d3/f4 zero size 2024-09-17T01:41:11.557 INFO:tasks.workunit.client.0.smithi082.stdout:6/22: dwrite f0 [0,4194304] 0 2024-09-17T01:41:11.558 INFO:tasks.workunit.client.0.smithi082.stdout:4/25: getdents d9 0 2024-09-17T01:41:11.560 INFO:tasks.workunit.client.0.smithi082.stdout:2/29: truncate d1/f5 1507656 0 2024-09-17T01:41:11.561 INFO:tasks.workunit.client.0.smithi082.stdout:2/30: chown d1/c6 12 1 2024-09-17T01:41:11.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/26: dwrite f7 [0,4194304] 0 2024-09-17T01:41:11.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/27: stat c5 0 2024-09-17T01:41:11.699 INFO:tasks.workunit.client.0.smithi082.stdout:8/9: truncate f2 154645 0 2024-09-17T01:41:11.706 INFO:tasks.workunit.client.0.smithi082.stdout:1/41: fsync d2/f6 0 2024-09-17T01:41:11.710 INFO:tasks.workunit.client.0.smithi082.stdout:6/23: fsync f0 0 2024-09-17T01:41:11.794 INFO:tasks.workunit.client.0.smithi082.stdout:0/25: dwrite f4 [0,4194304] 0 2024-09-17T01:41:11.932 INFO:tasks.workunit.client.0.smithi082.stdout:7/28: rename d0/d3/l5 to d0/l6 0 2024-09-17T01:41:11.935 INFO:tasks.workunit.client.0.smithi082.stdout:2/31: mknod d1/c7 0 2024-09-17T01:41:11.940 INFO:tasks.workunit.client.0.smithi082.stdout:6/24: symlink d1/d7/l9 0 2024-09-17T01:41:11.940 INFO:tasks.workunit.client.0.smithi082.stdout:6/25: write f0 [1039354,59229] 0 2024-09-17T01:41:11.944 INFO:tasks.workunit.client.0.smithi082.stdout:0/26: fdatasync f7 0 2024-09-17T01:41:11.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/26: dread f0 [0,4194304] 0 2024-09-17T01:41:11.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/27: write f0 [4009279,116195] 0 2024-09-17T01:41:11.949 INFO:tasks.workunit.client.0.smithi082.stdout:0/27: dread f0 [0,4194304] 0 2024-09-17T01:41:11.952 INFO:tasks.workunit.client.0.smithi082.stdout:6/28: dwrite f0 [0,4194304] 0 2024-09-17T01:41:11.954 INFO:tasks.workunit.client.0.smithi082.stdout:6/29: chown d1/d3/l5 245653784 1 2024-09-17T01:41:11.957 INFO:tasks.workunit.client.0.smithi082.stdout:0/28: dwrite f4 [0,4194304] 0 2024-09-17T01:41:11.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/29: read - f6 zero size 2024-09-17T01:41:11.959 INFO:tasks.workunit.client.0.smithi082.stdout:0/30: truncate f6 502511 0 2024-09-17T01:41:11.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/31: write f4 [2476357,112347] 0 2024-09-17T01:41:11.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/32: stat l5 0 2024-09-17T01:41:11.961 INFO:tasks.workunit.client.0.smithi082.stdout:0/33: chown f4 839303 1 2024-09-17T01:41:11.965 INFO:tasks.workunit.client.0.smithi082.stdout:4/28: link c6 d9/cb 0 2024-09-17T01:41:11.965 INFO:tasks.workunit.client.0.smithi082.stdout:2/32: dread d1/f5 [0,4194304] 0 2024-09-17T01:41:11.965 INFO:tasks.workunit.client.0.smithi082.stdout:4/29: chown d9/fa 2894 1 2024-09-17T01:41:11.976 INFO:tasks.workunit.client.0.smithi082.stdout:0/34: creat f8 x:0 0 0 2024-09-17T01:41:11.979 INFO:tasks.workunit.client.0.smithi082.stdout:2/33: mknod d1/c8 0 2024-09-17T01:41:11.982 INFO:tasks.workunit.client.0.smithi082.stdout:4/30: unlink c3 0 2024-09-17T01:41:11.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/35: dwrite f8 [0,4194304] 0 2024-09-17T01:41:11.983 INFO:tasks.workunit.client.0.smithi082.stdout:4/31: write f8 [287031,111493] 0 2024-09-17T01:41:11.983 INFO:tasks.workunit.client.0.smithi082.stdout:4/32: readlink l4 0 2024-09-17T01:41:11.984 INFO:tasks.workunit.client.0.smithi082.stdout:4/33: write d9/fa [551296,98533] 0 2024-09-17T01:41:11.986 INFO:tasks.workunit.client.0.smithi082.stdout:4/34: write d9/fa [971499,108707] 0 2024-09-17T01:41:11.987 INFO:tasks.workunit.client.0.smithi082.stdout:1/42: getdents d2 0 2024-09-17T01:41:11.988 INFO:tasks.workunit.client.0.smithi082.stdout:4/35: truncate f8 1014470 0 2024-09-17T01:41:11.988 INFO:tasks.workunit.client.0.smithi082.stdout:1/43: chown d2/da 4 1 2024-09-17T01:41:11.993 INFO:tasks.workunit.client.0.smithi082.stdout:0/36: creat f9 x:0 0 0 2024-09-17T01:41:11.996 INFO:tasks.workunit.client.0.smithi082.stdout:4/36: creat d9/fc x:0 0 0 2024-09-17T01:41:11.999 INFO:tasks.workunit.client.0.smithi082.stdout:1/44: creat d2/da/fe x:0 0 0 2024-09-17T01:41:11.999 INFO:tasks.workunit.client.0.smithi082.stdout:4/37: dread f7 [0,4194304] 0 2024-09-17T01:41:12.004 INFO:tasks.workunit.client.0.smithi082.stdout:1/45: mkdir d2/df 0 2024-09-17T01:41:12.007 INFO:tasks.workunit.client.0.smithi082.stdout:4/38: creat d9/fd x:0 0 0 2024-09-17T01:41:12.012 INFO:tasks.workunit.client.0.smithi082.stdout:1/46: rename d2/f6 to d2/f10 0 2024-09-17T01:41:12.012 INFO:tasks.workunit.client.0.smithi082.stdout:1/47: stat f0 0 2024-09-17T01:41:12.016 INFO:tasks.workunit.client.0.smithi082.stdout:4/39: dread f7 [0,4194304] 0 2024-09-17T01:41:12.016 INFO:tasks.workunit.client.0.smithi082.stdout:1/48: creat d2/f11 x:0 0 0 2024-09-17T01:41:12.019 INFO:tasks.workunit.client.0.smithi082.stdout:4/40: rmdir d9 39 2024-09-17T01:41:12.023 INFO:tasks.workunit.client.0.smithi082.stdout:1/49: dwrite f0 [0,4194304] 0 2024-09-17T01:41:12.024 INFO:tasks.workunit.client.0.smithi082.stdout:1/50: chown d2/f11 2600 1 2024-09-17T01:41:12.026 INFO:tasks.workunit.client.0.smithi082.stdout:4/41: mknod d9/ce 0 2024-09-17T01:41:12.026 INFO:tasks.workunit.client.0.smithi082.stdout:4/42: fsync d9/fa 0 2024-09-17T01:41:12.030 INFO:tasks.workunit.client.0.smithi082.stdout:4/43: rmdir d9 39 2024-09-17T01:41:12.034 INFO:tasks.workunit.client.0.smithi082.stdout:4/44: symlink d9/lf 0 2024-09-17T01:41:12.036 INFO:tasks.workunit.client.0.smithi082.stdout:4/45: symlink d9/l10 0 2024-09-17T01:41:12.127 INFO:tasks.workunit.client.0.smithi082.stdout:7/29: chown d0/l6 724 1 2024-09-17T01:41:12.130 INFO:tasks.workunit.client.0.smithi082.stdout:7/30: mknod d0/d3/c7 0 2024-09-17T01:41:12.131 INFO:tasks.workunit.client.0.smithi082.stdout:7/31: symlink d0/l8 0 2024-09-17T01:41:12.133 INFO:tasks.workunit.client.0.smithi082.stdout:7/32: unlink d0/l6 0 2024-09-17T01:41:12.134 INFO:tasks.workunit.client.0.smithi082.stdout:7/33: chown d0/l1 465932 1 2024-09-17T01:41:12.146 INFO:tasks.workunit.client.0.smithi082.stdout:2/34: dwrite d1/f4 [0,4194304] 0 2024-09-17T01:41:12.151 INFO:tasks.workunit.client.0.smithi082.stdout:2/35: dread d1/f5 [0,4194304] 0 2024-09-17T01:41:12.155 INFO:tasks.workunit.client.0.smithi082.stdout:8/10: mkdir d3 0 2024-09-17T01:41:12.159 INFO:tasks.workunit.client.0.smithi082.stdout:2/36: write d1/f5 [842421,96458] 0 2024-09-17T01:41:12.168 INFO:tasks.workunit.client.0.smithi082.stdout:0/37: truncate f8 324562 0 2024-09-17T01:41:12.168 INFO:tasks.workunit.client.0.smithi082.stdout:0/38: fsync f4 0 2024-09-17T01:41:12.171 INFO:tasks.workunit.client.0.smithi082.stdout:0/39: mkdir da 0 2024-09-17T01:41:12.173 INFO:tasks.workunit.client.0.smithi082.stdout:0/40: rename f9 to da/fb 0 2024-09-17T01:41:12.175 INFO:tasks.workunit.client.0.smithi082.stdout:0/41: read f0 [3119535,123631] 0 2024-09-17T01:41:12.177 INFO:tasks.workunit.client.0.smithi082.stdout:0/42: creat da/fc x:0 0 0 2024-09-17T01:41:12.183 INFO:tasks.workunit.client.0.smithi082.stdout:0/43: dwrite f6 [0,4194304] 0 2024-09-17T01:41:12.189 INFO:tasks.workunit.client.0.smithi082.stdout:4/46: getdents d9 0 2024-09-17T01:41:12.191 INFO:tasks.workunit.client.0.smithi082.stdout:4/47: mknod d9/c11 0 2024-09-17T01:41:12.192 INFO:tasks.workunit.client.0.smithi082.stdout:4/48: rmdir d9 39 2024-09-17T01:41:12.196 INFO:tasks.workunit.client.0.smithi082.stdout:4/49: dread f8 [0,4194304] 0 2024-09-17T01:41:12.199 INFO:tasks.workunit.client.0.smithi082.stdout:4/50: mknod d9/c12 0 2024-09-17T01:41:12.201 INFO:tasks.workunit.client.0.smithi082.stdout:4/51: symlink d9/l13 0 2024-09-17T01:41:12.218 INFO:tasks.workunit.client.0.smithi082.stdout:7/34: getdents d0/d3 0 2024-09-17T01:41:12.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/35: chown d0/d3 14025 1 2024-09-17T01:41:12.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/36: dread - d0/d3/f4 zero size 2024-09-17T01:41:12.220 INFO:tasks.workunit.client.0.smithi082.stdout:7/37: stat d0/d3/c7 0 2024-09-17T01:41:12.224 INFO:tasks.workunit.client.0.smithi082.stdout:8/11: write f2 [375373,23875] 0 2024-09-17T01:41:12.229 INFO:tasks.workunit.client.0.smithi082.stdout:7/38: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:12.231 INFO:tasks.workunit.client.0.smithi082.stdout:2/37: dwrite d1/f5 [4194304,4194304] 0 2024-09-17T01:41:12.232 INFO:tasks.workunit.client.0.smithi082.stdout:8/12: creat d3/f4 x:0 0 0 2024-09-17T01:41:12.233 INFO:tasks.workunit.client.0.smithi082.stdout:8/13: write f2 [102619,7814] 0 2024-09-17T01:41:12.236 INFO:tasks.workunit.client.0.smithi082.stdout:8/14: chown d3 236 1 2024-09-17T01:41:12.239 INFO:tasks.workunit.client.0.smithi082.stdout:8/15: write f2 [1051945,97185] 0 2024-09-17T01:41:12.242 INFO:tasks.workunit.client.0.smithi082.stdout:0/44: getdents da 0 2024-09-17T01:41:12.246 INFO:tasks.workunit.client.0.smithi082.stdout:8/16: creat d3/f5 x:0 0 0 2024-09-17T01:41:12.247 INFO:tasks.workunit.client.0.smithi082.stdout:0/45: rmdir da 39 2024-09-17T01:41:12.247 INFO:tasks.workunit.client.0.smithi082.stdout:7/39: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:12.248 INFO:tasks.workunit.client.0.smithi082.stdout:2/38: dwrite d1/f4 [4194304,4194304] 0 2024-09-17T01:41:12.248 INFO:tasks.workunit.client.0.smithi082.stdout:8/17: rename d3 to d3/d6 22 2024-09-17T01:41:12.249 INFO:tasks.workunit.client.0.smithi082.stdout:7/40: write d0/d3/f4 [3301371,48570] 0 2024-09-17T01:41:12.258 INFO:tasks.workunit.client.0.smithi082.stdout:0/46: creat da/fd x:0 0 0 2024-09-17T01:41:12.259 INFO:tasks.workunit.client.0.smithi082.stdout:8/18: dwrite d3/f4 [0,4194304] 0 2024-09-17T01:41:12.260 INFO:tasks.workunit.client.0.smithi082.stdout:8/19: write f2 [2039209,40407] 0 2024-09-17T01:41:12.265 INFO:tasks.workunit.client.0.smithi082.stdout:8/20: dread d3/f4 [0,4194304] 0 2024-09-17T01:41:12.271 INFO:tasks.workunit.client.0.smithi082.stdout:8/21: creat d3/f7 x:0 0 0 2024-09-17T01:41:12.272 INFO:tasks.workunit.client.0.smithi082.stdout:8/22: stat d3/f5 0 2024-09-17T01:41:12.275 INFO:tasks.workunit.client.0.smithi082.stdout:4/52: dwrite f7 [0,4194304] 0 2024-09-17T01:41:12.277 INFO:tasks.workunit.client.0.smithi082.stdout:7/41: fsync d0/d3/f4 0 2024-09-17T01:41:12.279 INFO:tasks.workunit.client.0.smithi082.stdout:4/53: creat d9/f14 x:0 0 0 2024-09-17T01:41:12.280 INFO:tasks.workunit.client.0.smithi082.stdout:7/42: chown d0/d3/c7 1 1 2024-09-17T01:41:12.281 INFO:tasks.workunit.client.0.smithi082.stdout:8/23: dwrite f2 [0,4194304] 0 2024-09-17T01:41:12.282 INFO:tasks.workunit.client.0.smithi082.stdout:7/43: chown d0/l8 358572 1 2024-09-17T01:41:12.283 INFO:tasks.workunit.client.0.smithi082.stdout:7/44: chown d0/d3/f4 2 1 2024-09-17T01:41:12.283 INFO:tasks.workunit.client.0.smithi082.stdout:4/54: unlink f8 0 2024-09-17T01:41:12.283 INFO:tasks.workunit.client.0.smithi082.stdout:7/45: chown d0/l1 1 1 2024-09-17T01:41:12.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/55: write f7 [278976,69869] 0 2024-09-17T01:41:12.285 INFO:tasks.workunit.client.0.smithi082.stdout:4/56: write f7 [4739483,72038] 0 2024-09-17T01:41:12.286 INFO:tasks.workunit.client.0.smithi082.stdout:4/57: write d9/fa [1772396,46967] 0 2024-09-17T01:41:12.287 INFO:tasks.workunit.client.0.smithi082.stdout:4/58: chown d9/l10 2148601 1 2024-09-17T01:41:12.287 INFO:tasks.workunit.client.0.smithi082.stdout:4/59: chown c2 745 1 2024-09-17T01:41:12.288 INFO:tasks.workunit.client.0.smithi082.stdout:4/60: chown d9/fc 228 1 2024-09-17T01:41:12.288 INFO:tasks.workunit.client.0.smithi082.stdout:7/46: symlink d0/l9 0 2024-09-17T01:41:12.291 INFO:tasks.workunit.client.0.smithi082.stdout:8/24: fsync d3/f4 0 2024-09-17T01:41:12.293 INFO:tasks.workunit.client.0.smithi082.stdout:4/61: mkdir d9/d15 0 2024-09-17T01:41:12.298 INFO:tasks.workunit.client.0.smithi082.stdout:7/47: creat d0/fa x:0 0 0 2024-09-17T01:41:12.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/25: mknod d3/c8 0 2024-09-17T01:41:12.300 INFO:tasks.workunit.client.0.smithi082.stdout:4/62: dwrite f7 [0,4194304] 0 2024-09-17T01:41:12.300 INFO:tasks.workunit.client.0.smithi082.stdout:8/26: read d3/f4 [322990,83038] 0 2024-09-17T01:41:12.303 INFO:tasks.workunit.client.0.smithi082.stdout:4/63: truncate d9/fc 750452 0 2024-09-17T01:41:12.305 INFO:tasks.workunit.client.0.smithi082.stdout:4/64: write d9/fc [529073,66412] 0 2024-09-17T01:41:12.308 INFO:tasks.workunit.client.0.smithi082.stdout:8/27: link d3/f7 d3/f9 0 2024-09-17T01:41:12.309 INFO:tasks.workunit.client.0.smithi082.stdout:8/28: fsync f2 0 2024-09-17T01:41:12.310 INFO:tasks.workunit.client.0.smithi082.stdout:7/48: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-17T01:41:12.310 INFO:tasks.workunit.client.0.smithi082.stdout:7/49: stat d0/fa 0 2024-09-17T01:41:12.311 INFO:tasks.workunit.client.0.smithi082.stdout:7/50: dread - d0/fa zero size 2024-09-17T01:41:12.311 INFO:tasks.workunit.client.0.smithi082.stdout:8/29: truncate d3/f9 207173 0 2024-09-17T01:41:12.313 INFO:tasks.workunit.client.0.smithi082.stdout:4/65: dread d9/fc [0,4194304] 0 2024-09-17T01:41:12.315 INFO:tasks.workunit.client.0.smithi082.stdout:4/66: truncate d9/fc 1433593 0 2024-09-17T01:41:12.317 INFO:tasks.workunit.client.0.smithi082.stdout:8/30: rename d3/f4 to d3/fa 0 2024-09-17T01:41:12.318 INFO:tasks.workunit.client.0.smithi082.stdout:8/31: chown d3/f9 696 1 2024-09-17T01:41:12.319 INFO:tasks.workunit.client.0.smithi082.stdout:8/32: chown d3 19029832 1 2024-09-17T01:41:12.319 INFO:tasks.workunit.client.0.smithi082.stdout:8/33: stat d3/c8 0 2024-09-17T01:41:12.319 INFO:tasks.workunit.client.0.smithi082.stdout:8/34: chown f2 63519711 1 2024-09-17T01:41:12.326 INFO:tasks.workunit.client.0.smithi082.stdout:8/35: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:41:12.326 INFO:tasks.workunit.client.0.smithi082.stdout:0/47: stat f8 0 2024-09-17T01:41:12.329 INFO:tasks.workunit.client.0.smithi082.stdout:7/51: fsync d0/fa 0 2024-09-17T01:41:12.332 INFO:tasks.workunit.client.0.smithi082.stdout:7/52: getdents d0/d3 0 2024-09-17T01:41:12.334 INFO:tasks.workunit.client.0.smithi082.stdout:7/53: mkdir d0/d3/db 0 2024-09-17T01:41:12.342 INFO:tasks.workunit.client.0.smithi082.stdout:7/54: dwrite d0/fa [0,4194304] 0 2024-09-17T01:41:12.346 INFO:tasks.workunit.client.0.smithi082.stdout:7/55: dread d0/fa [0,4194304] 0 2024-09-17T01:41:12.347 INFO:tasks.workunit.client.0.smithi082.stdout:8/36: truncate d3/fa 2248295 0 2024-09-17T01:41:12.348 INFO:tasks.workunit.client.0.smithi082.stdout:8/37: stat d3/f9 0 2024-09-17T01:41:12.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/56: dread d0/d3/f4 [4194304,4194304] 0 2024-09-17T01:41:12.356 INFO:tasks.workunit.client.0.smithi082.stdout:7/57: mknod d0/d3/db/cc 0 2024-09-17T01:41:12.363 INFO:tasks.workunit.client.0.smithi082.stdout:7/58: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:12.364 INFO:tasks.workunit.client.0.smithi082.stdout:7/59: mkdir d0/dd 0 2024-09-17T01:41:12.365 INFO:tasks.workunit.client.0.smithi082.stdout:7/60: chown d0/l8 6462464 1 2024-09-17T01:41:12.366 INFO:tasks.workunit.client.0.smithi082.stdout:7/61: read d0/fa [4134483,101304] 0 2024-09-17T01:41:12.394 INFO:tasks.workunit.client.0.smithi082.stdout:7/62: creat d0/d3/db/fe x:0 0 0 2024-09-17T01:41:12.396 INFO:tasks.workunit.client.0.smithi082.stdout:8/38: write d3/fa [461507,75181] 0 2024-09-17T01:41:12.397 INFO:tasks.workunit.client.0.smithi082.stdout:8/39: truncate d3/f9 443446 0 2024-09-17T01:41:12.397 INFO:tasks.workunit.client.0.smithi082.stdout:7/63: dread d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:12.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/64: symlink d0/dd/lf 0 2024-09-17T01:41:12.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/65: write d0/fa [230941,115049] 0 2024-09-17T01:41:12.464 INFO:tasks.workunit.client.0.smithi082.stdout:7/66: mkdir d0/d3/db/d10 0 2024-09-17T01:41:12.466 INFO:tasks.workunit.client.0.smithi082.stdout:7/67: write d0/d3/f4 [4857011,76207] 0 2024-09-17T01:41:12.467 INFO:tasks.workunit.client.0.smithi082.stdout:8/40: write d3/f7 [553443,37642] 0 2024-09-17T01:41:12.467 INFO:tasks.workunit.client.0.smithi082.stdout:8/41: chown d3/f7 454 1 2024-09-17T01:41:12.468 INFO:tasks.workunit.client.0.smithi082.stdout:7/68: write d0/d3/db/fe [1017465,64195] 0 2024-09-17T01:41:12.468 INFO:tasks.workunit.client.0.smithi082.stdout:8/42: chown d3 836 1 2024-09-17T01:41:12.470 INFO:tasks.workunit.client.0.smithi082.stdout:7/69: read d0/d3/db/fe [750703,1131] 0 2024-09-17T01:41:12.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/70: rename d0/d3/c7 to d0/d3/db/d10/c11 0 2024-09-17T01:41:12.475 INFO:tasks.workunit.client.0.smithi082.stdout:8/43: dwrite d3/f5 [0,4194304] 0 2024-09-17T01:41:12.480 INFO:tasks.workunit.client.0.smithi082.stdout:8/44: rename d3/f5 to d3/fb 0 2024-09-17T01:41:12.483 INFO:tasks.workunit.client.0.smithi082.stdout:7/71: dwrite d0/d3/f4 [4194304,4194304] 0 2024-09-17T01:41:12.484 INFO:tasks.workunit.client.0.smithi082.stdout:8/45: symlink d3/lc 0 2024-09-17T01:41:12.485 INFO:tasks.workunit.client.0.smithi082.stdout:8/46: rmdir d3 39 2024-09-17T01:41:12.490 INFO:tasks.workunit.client.0.smithi082.stdout:8/47: mkdir d3/dd 0 2024-09-17T01:41:12.492 INFO:tasks.workunit.client.0.smithi082.stdout:8/48: mknod d3/dd/ce 0 2024-09-17T01:41:12.494 INFO:tasks.workunit.client.0.smithi082.stdout:8/49: read d3/f9 [494929,93784] 0 2024-09-17T01:41:12.495 INFO:tasks.workunit.client.0.smithi082.stdout:8/50: fdatasync d3/f7 0 2024-09-17T01:41:12.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:41:12.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: pgmap v9: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 348 op/s 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:41:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:12 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: pgmap v9: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.0 MiB/s wr, 348 op/s 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:12.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:41:12.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:41:12.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:12 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:41:13.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:13 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:41:13.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:13 smithi167 ceph-mon[35643]: Reconfiguring ceph-exporter.smithi082 (dependencies changed)... 2024-09-17T01:41:13.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:13 smithi167 ceph-mon[35643]: Deploying daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:41:13.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:13 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:41:13.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:13 smithi082 ceph-mon[28077]: Reconfiguring ceph-exporter.smithi082 (dependencies changed)... 2024-09-17T01:41:13.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:13 smithi082 ceph-mon[28077]: Deploying daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:41:13.982 INFO:tasks.workunit.client.1.smithi167.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-17T01:41:13.986 INFO:tasks.workunit.client.1.smithi167.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:41:13.986 INFO:tasks.workunit.client.1.smithi167.stderr:+ make 2024-09-17T01:41:14.123 INFO:tasks.workunit.client.1.smithi167.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-17T01:41:14.286 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:14 smithi082 ceph-mon[28077]: pgmap v10: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 314 op/s 2024-09-17T01:41:14.496 INFO:tasks.workunit.client.1.smithi167.stderr:++ readlink -f fsstress 2024-09-17T01:41:14.497 INFO:tasks.workunit.client.1.smithi167.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-17T01:41:14.498 INFO:tasks.workunit.client.1.smithi167.stderr:+ popd 2024-09-17T01:41:14.498 INFO:tasks.workunit.client.1.smithi167.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:41:14.499 INFO:tasks.workunit.client.1.smithi167.stderr:+ popd 2024-09-17T01:41:14.499 INFO:tasks.workunit.client.1.smithi167.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-17T01:41:14.499 INFO:tasks.workunit.client.1.smithi167.stderr:++ mktemp -d -p . 2024-09-17T01:41:14.502 INFO:tasks.workunit.client.1.smithi167.stderr:+ T=./tmp.kJFn5dBISa 2024-09-17T01:41:14.502 INFO:tasks.workunit.client.1.smithi167.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kJFn5dBISa -l 1 -n 1000 -p 10 -v 2024-09-17T01:41:14.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:14 smithi167 ceph-mon[35643]: pgmap v10: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 314 op/s 2024-09-17T01:41:14.505 INFO:tasks.workunit.client.1.smithi167.stdout:seed = 1726946767 2024-09-17T01:41:14.511 INFO:tasks.workunit.client.1.smithi167.stdout:1/0: dread - no filename 2024-09-17T01:41:14.511 INFO:tasks.workunit.client.1.smithi167.stdout:1/1: write - no filename 2024-09-17T01:41:14.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/0: mknod c0 0 2024-09-17T01:41:14.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/1: chown c0 70539656 1 2024-09-17T01:41:14.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/2: stat c0 0 2024-09-17T01:41:14.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/3: read - no filename 2024-09-17T01:41:14.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/0: truncate - no filename 2024-09-17T01:41:14.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/1: chown . 6722074 1 2024-09-17T01:41:14.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/2: readlink - no filename 2024-09-17T01:41:14.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/3: fdatasync - no filename 2024-09-17T01:41:14.514 INFO:tasks.workunit.client.1.smithi167.stdout:0/4: mknod c1 0 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/0: stat - no entries 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/1: stat - no entries 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/2: rmdir - no directory 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/3: read - no filename 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/4: dwrite - no filename 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/5: unlink - no file 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/6: dwrite - no filename 2024-09-17T01:41:14.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/7: dread - no filename 2024-09-17T01:41:14.516 INFO:tasks.workunit.client.1.smithi167.stdout:2/4: symlink l0 0 2024-09-17T01:41:14.517 INFO:tasks.workunit.client.1.smithi167.stdout:4/0: dread - no filename 2024-09-17T01:41:14.517 INFO:tasks.workunit.client.1.smithi167.stdout:4/1: rename - no filename 2024-09-17T01:41:14.518 INFO:tasks.workunit.client.1.smithi167.stdout:4/2: dread - no filename 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/0: chown . 523407964 1 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/1: rmdir - no directory 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/2: readlink - no filename 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/3: dwrite - no filename 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/4: dread - no filename 2024-09-17T01:41:14.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/5: unlink - no file 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:6/0: dwrite - no filename 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:6/1: readlink - no filename 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:6/2: fdatasync - no filename 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:6/3: chown . 7375 1 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:2/5: link l0 l1 0 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:2/6: fdatasync - no filename 2024-09-17T01:41:14.522 INFO:tasks.workunit.client.1.smithi167.stdout:2/7: write - no filename 2024-09-17T01:41:14.523 INFO:tasks.workunit.client.1.smithi167.stdout:4/3: mkdir d0 0 2024-09-17T01:41:14.523 INFO:tasks.workunit.client.1.smithi167.stdout:4/4: write - no filename 2024-09-17T01:41:14.524 INFO:tasks.workunit.client.1.smithi167.stdout:4/5: chown d0 26 1 2024-09-17T01:41:14.524 INFO:tasks.workunit.client.1.smithi167.stdout:5/6: mkdir d0 0 2024-09-17T01:41:14.524 INFO:tasks.workunit.client.1.smithi167.stdout:5/7: dwrite - no filename 2024-09-17T01:41:14.524 INFO:tasks.workunit.client.1.smithi167.stdout:5/8: dwrite - no filename 2024-09-17T01:41:14.524 INFO:tasks.workunit.client.1.smithi167.stdout:5/9: dwrite - no filename 2024-09-17T01:41:14.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/10: link - no file 2024-09-17T01:41:14.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/11: dread - no filename 2024-09-17T01:41:14.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/12: fdatasync - no filename 2024-09-17T01:41:14.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/13: read - no filename 2024-09-17T01:41:14.526 INFO:tasks.workunit.client.1.smithi167.stdout:7/0: fsync - no filename 2024-09-17T01:41:14.527 INFO:tasks.workunit.client.1.smithi167.stdout:2/8: symlink l2 0 2024-09-17T01:41:14.531 INFO:tasks.workunit.client.1.smithi167.stdout:8/0: truncate - no filename 2024-09-17T01:41:14.531 INFO:tasks.workunit.client.1.smithi167.stdout:8/1: dread - no filename 2024-09-17T01:41:14.531 INFO:tasks.workunit.client.1.smithi167.stdout:6/4: creat f0 x:0 0 0 2024-09-17T01:41:14.532 INFO:tasks.workunit.client.1.smithi167.stdout:6/5: dread - f0 zero size 2024-09-17T01:41:14.534 INFO:tasks.workunit.client.1.smithi167.stdout:2/9: mknod c3 0 2024-09-17T01:41:14.534 INFO:tasks.workunit.client.1.smithi167.stdout:0/5: getdents . 0 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/6: symlink d0/l1 0 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/7: fsync - no filename 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/8: fdatasync - no filename 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/9: truncate - no filename 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/10: write - no filename 2024-09-17T01:41:14.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/11: chown d0 113886 1 2024-09-17T01:41:14.536 INFO:tasks.workunit.client.1.smithi167.stdout:5/14: symlink d0/l1 0 2024-09-17T01:41:14.537 INFO:tasks.workunit.client.1.smithi167.stdout:9/0: link - no file 2024-09-17T01:41:14.539 INFO:tasks.workunit.client.1.smithi167.stdout:7/1: mkdir d0 0 2024-09-17T01:41:14.540 INFO:tasks.workunit.client.1.smithi167.stdout:6/6: symlink l1 0 2024-09-17T01:41:14.540 INFO:tasks.workunit.client.1.smithi167.stdout:6/7: write f0 [927200,33545] 0 2024-09-17T01:41:14.541 INFO:tasks.workunit.client.1.smithi167.stdout:6/8: stat f0 0 2024-09-17T01:41:14.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/10: symlink l4 0 2024-09-17T01:41:14.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/11: dread - no filename 2024-09-17T01:41:14.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/12: rmdir - no directory 2024-09-17T01:41:14.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/13: chown c3 28507 1 2024-09-17T01:41:14.542 INFO:tasks.workunit.client.1.smithi167.stdout:0/6: rename c0 to c2 0 2024-09-17T01:41:14.542 INFO:tasks.workunit.client.1.smithi167.stdout:0/7: fdatasync - no filename 2024-09-17T01:41:14.542 INFO:tasks.workunit.client.1.smithi167.stdout:0/8: dread - no filename 2024-09-17T01:41:14.543 INFO:tasks.workunit.client.1.smithi167.stdout:4/12: creat d0/f2 x:0 0 0 2024-09-17T01:41:14.545 INFO:tasks.workunit.client.1.smithi167.stdout:5/15: creat d0/f2 x:0 0 0 2024-09-17T01:41:14.545 INFO:tasks.workunit.client.1.smithi167.stdout:5/16: readlink d0/l1 0 2024-09-17T01:41:14.545 INFO:tasks.workunit.client.1.smithi167.stdout:5/17: fdatasync d0/f2 0 2024-09-17T01:41:14.546 INFO:tasks.workunit.client.1.smithi167.stdout:8/2: creat f0 x:0 0 0 2024-09-17T01:41:14.546 INFO:tasks.workunit.client.1.smithi167.stdout:5/18: dread - d0/f2 zero size 2024-09-17T01:41:14.546 INFO:tasks.workunit.client.1.smithi167.stdout:8/3: read - f0 zero size 2024-09-17T01:41:14.547 INFO:tasks.workunit.client.1.smithi167.stdout:5/19: truncate d0/f2 1014207 0 2024-09-17T01:41:14.547 INFO:tasks.workunit.client.1.smithi167.stdout:6/9: rename l1 to l2 0 2024-09-17T01:41:14.548 INFO:tasks.workunit.client.1.smithi167.stdout:0/9: mknod c3 0 2024-09-17T01:41:14.549 INFO:tasks.workunit.client.1.smithi167.stdout:4/13: creat d0/f3 x:0 0 0 2024-09-17T01:41:14.550 INFO:tasks.workunit.client.1.smithi167.stdout:9/1: mknod c0 0 2024-09-17T01:41:14.550 INFO:tasks.workunit.client.1.smithi167.stdout:9/2: write - no filename 2024-09-17T01:41:14.551 INFO:tasks.workunit.client.1.smithi167.stdout:7/2: getdents d0 0 2024-09-17T01:41:14.551 INFO:tasks.workunit.client.1.smithi167.stdout:7/3: unlink - no file 2024-09-17T01:41:14.551 INFO:tasks.workunit.client.1.smithi167.stdout:4/14: chown d0/l1 4066727 1 2024-09-17T01:41:14.552 INFO:tasks.workunit.client.1.smithi167.stdout:5/20: rename d0/f2 to d0/f3 0 2024-09-17T01:41:14.555 INFO:tasks.workunit.client.1.smithi167.stdout:0/10: rename c1 to c4 0 2024-09-17T01:41:14.555 INFO:tasks.workunit.client.1.smithi167.stdout:0/11: dwrite - no filename 2024-09-17T01:41:14.555 INFO:tasks.workunit.client.1.smithi167.stdout:0/12: dread - no filename 2024-09-17T01:41:14.555 INFO:tasks.workunit.client.1.smithi167.stdout:6/10: dwrite f0 [0,4194304] 0 2024-09-17T01:41:14.556 INFO:tasks.workunit.client.1.smithi167.stdout:9/3: unlink c0 0 2024-09-17T01:41:14.556 INFO:tasks.workunit.client.1.smithi167.stdout:9/4: rename - no filename 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/5: unlink - no file 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/6: chown . 1419069 1 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/7: truncate - no filename 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/8: dread - no filename 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/9: read - no filename 2024-09-17T01:41:14.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/10: chown . 1 1 2024-09-17T01:41:14.558 INFO:tasks.workunit.client.1.smithi167.stdout:8/4: link f0 f1 0 2024-09-17T01:41:14.559 INFO:tasks.workunit.client.1.smithi167.stdout:8/5: stat f1 0 2024-09-17T01:41:14.561 INFO:tasks.workunit.client.1.smithi167.stdout:4/15: rmdir d0 39 2024-09-17T01:41:14.572 INFO:tasks.workunit.client.1.smithi167.stdout:9/11: creat f1 x:0 0 0 2024-09-17T01:41:14.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/21: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:14.573 INFO:tasks.workunit.client.1.smithi167.stdout:9/12: write f1 [269616,108987] 0 2024-09-17T01:41:14.574 INFO:tasks.workunit.client.1.smithi167.stdout:9/13: write f1 [920515,85790] 0 2024-09-17T01:41:14.574 INFO:tasks.workunit.client.1.smithi167.stdout:7/4: creat d0/f1 x:0 0 0 2024-09-17T01:41:14.578 INFO:tasks.workunit.client.1.smithi167.stdout:2/14: getdents . 0 2024-09-17T01:41:14.583 INFO:tasks.workunit.client.1.smithi167.stdout:5/22: write d0/f3 [2122031,7200] 0 2024-09-17T01:41:14.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/14: dwrite f1 [0,4194304] 0 2024-09-17T01:41:14.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/15: rmdir - no directory 2024-09-17T01:41:14.584 INFO:tasks.workunit.client.1.smithi167.stdout:8/6: link f0 f2 0 2024-09-17T01:41:14.585 INFO:tasks.workunit.client.1.smithi167.stdout:5/23: readlink d0/l1 0 2024-09-17T01:41:14.585 INFO:tasks.workunit.client.1.smithi167.stdout:5/24: stat d0/f3 0 2024-09-17T01:41:14.589 INFO:tasks.workunit.client.1.smithi167.stdout:7/5: mkdir d0/d2 0 2024-09-17T01:41:14.589 INFO:tasks.workunit.client.1.smithi167.stdout:7/6: chown d0/f1 2356230 1 2024-09-17T01:41:14.589 INFO:tasks.workunit.client.1.smithi167.stdout:7/7: dread - d0/f1 zero size 2024-09-17T01:41:14.590 INFO:tasks.workunit.client.1.smithi167.stdout:4/16: mkdir d0/d4 0 2024-09-17T01:41:14.590 INFO:tasks.workunit.client.1.smithi167.stdout:7/8: write d0/f1 [75592,100485] 0 2024-09-17T01:41:14.591 INFO:tasks.workunit.client.1.smithi167.stdout:2/15: mkdir d5 0 2024-09-17T01:41:14.592 INFO:tasks.workunit.client.1.smithi167.stdout:0/13: chown c4 0 1 2024-09-17T01:41:14.592 INFO:tasks.workunit.client.1.smithi167.stdout:6/11: write f0 [5090852,4628] 0 2024-09-17T01:41:14.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/16: creat f2 x:0 0 0 2024-09-17T01:41:14.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/17: stat f1 0 2024-09-17T01:41:14.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/18: truncate f1 5000272 0 2024-09-17T01:41:14.595 INFO:tasks.workunit.client.1.smithi167.stdout:9/19: write f1 [3816397,120882] 0 2024-09-17T01:41:14.596 INFO:tasks.workunit.client.1.smithi167.stdout:8/7: fdatasync f1 0 2024-09-17T01:41:14.596 INFO:tasks.workunit.client.1.smithi167.stdout:9/20: chown f1 21 1 2024-09-17T01:41:14.597 INFO:tasks.workunit.client.1.smithi167.stdout:5/25: mknod d0/c4 0 2024-09-17T01:41:14.599 INFO:tasks.workunit.client.1.smithi167.stdout:4/17: mkdir d0/d5 0 2024-09-17T01:41:14.601 INFO:tasks.workunit.client.1.smithi167.stdout:5/26: dread d0/f3 [0,4194304] 0 2024-09-17T01:41:14.601 INFO:tasks.workunit.client.1.smithi167.stdout:4/18: truncate d0/f2 1021095 0 2024-09-17T01:41:14.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/14: mkdir d5 0 2024-09-17T01:41:14.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/15: dread - no filename 2024-09-17T01:41:14.604 INFO:tasks.workunit.client.1.smithi167.stdout:0/16: dwrite - no filename 2024-09-17T01:41:14.609 INFO:tasks.workunit.client.1.smithi167.stdout:8/8: rename f0 to f3 0 2024-09-17T01:41:14.610 INFO:tasks.workunit.client.1.smithi167.stdout:9/21: symlink l3 0 2024-09-17T01:41:14.611 INFO:tasks.workunit.client.1.smithi167.stdout:9/22: chown l3 110738 1 2024-09-17T01:41:14.611 INFO:tasks.workunit.client.1.smithi167.stdout:9/23: chown f2 1584126 1 2024-09-17T01:41:14.612 INFO:tasks.workunit.client.1.smithi167.stdout:7/9: mknod d0/d2/c3 0 2024-09-17T01:41:14.612 INFO:tasks.workunit.client.1.smithi167.stdout:9/24: write f2 [110884,106475] 0 2024-09-17T01:41:14.613 INFO:tasks.workunit.client.1.smithi167.stdout:7/10: truncate d0/f1 850662 0 2024-09-17T01:41:14.618 INFO:tasks.workunit.client.1.smithi167.stdout:9/25: dwrite f2 [0,4194304] 0 2024-09-17T01:41:14.619 INFO:tasks.workunit.client.1.smithi167.stdout:9/26: write f2 [2554808,50460] 0 2024-09-17T01:41:14.620 INFO:tasks.workunit.client.1.smithi167.stdout:9/27: readlink l3 0 2024-09-17T01:41:14.715 INFO:tasks.workunit.client.1.smithi167.stdout:2/16: symlink d5/l6 0 2024-09-17T01:41:14.715 INFO:tasks.workunit.client.1.smithi167.stdout:2/17: dread - no filename 2024-09-17T01:41:14.716 INFO:tasks.workunit.client.1.smithi167.stdout:8/9: mkdir d4 0 2024-09-17T01:41:14.719 INFO:tasks.workunit.client.1.smithi167.stdout:6/12: fsync f0 0 2024-09-17T01:41:14.720 INFO:tasks.workunit.client.1.smithi167.stdout:7/11: creat d0/d2/f4 x:0 0 0 2024-09-17T01:41:14.723 INFO:tasks.workunit.client.1.smithi167.stdout:7/12: dread d0/f1 [0,4194304] 0 2024-09-17T01:41:14.724 INFO:tasks.workunit.client.1.smithi167.stdout:7/13: write d0/f1 [425249,35555] 0 2024-09-17T01:41:14.725 INFO:tasks.workunit.client.1.smithi167.stdout:9/28: mkdir d4 0 2024-09-17T01:41:14.726 INFO:tasks.workunit.client.1.smithi167.stdout:7/14: truncate d0/f1 1550769 0 2024-09-17T01:41:14.726 INFO:tasks.workunit.client.1.smithi167.stdout:4/19: mkdir d0/d5/d6 0 2024-09-17T01:41:14.727 INFO:tasks.workunit.client.1.smithi167.stdout:7/15: write d0/f1 [2320948,85261] 0 2024-09-17T01:41:14.729 INFO:tasks.workunit.client.1.smithi167.stdout:2/18: unlink d5/l6 0 2024-09-17T01:41:14.730 INFO:tasks.workunit.client.1.smithi167.stdout:2/19: dread - no filename 2024-09-17T01:41:14.730 INFO:tasks.workunit.client.1.smithi167.stdout:2/20: write - no filename 2024-09-17T01:41:14.733 INFO:tasks.workunit.client.1.smithi167.stdout:6/13: symlink l3 0 2024-09-17T01:41:14.734 INFO:tasks.workunit.client.1.smithi167.stdout:4/20: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:14.738 INFO:tasks.workunit.client.1.smithi167.stdout:7/16: creat d0/f5 x:0 0 0 2024-09-17T01:41:14.738 INFO:tasks.workunit.client.1.smithi167.stdout:7/17: chown d0/f1 40685 1 2024-09-17T01:41:14.738 INFO:tasks.workunit.client.1.smithi167.stdout:7/18: dread - d0/d2/f4 zero size 2024-09-17T01:41:14.739 INFO:tasks.workunit.client.1.smithi167.stdout:2/21: creat d5/f7 x:0 0 0 2024-09-17T01:41:14.739 INFO:tasks.workunit.client.1.smithi167.stdout:2/22: truncate d5/f7 812270 0 2024-09-17T01:41:14.740 INFO:tasks.workunit.client.1.smithi167.stdout:2/23: chown c3 1811402 1 2024-09-17T01:41:14.740 INFO:tasks.workunit.client.1.smithi167.stdout:2/24: read d5/f7 [734152,104347] 0 2024-09-17T01:41:14.741 INFO:tasks.workunit.client.1.smithi167.stdout:2/25: fdatasync d5/f7 0 2024-09-17T01:41:14.742 INFO:tasks.workunit.client.1.smithi167.stdout:8/10: unlink f2 0 2024-09-17T01:41:14.742 INFO:tasks.workunit.client.1.smithi167.stdout:2/26: write d5/f7 [485404,62634] 0 2024-09-17T01:41:14.748 INFO:tasks.workunit.client.1.smithi167.stdout:9/29: symlink d4/l5 0 2024-09-17T01:41:14.750 INFO:tasks.workunit.client.1.smithi167.stdout:7/19: mknod d0/d2/c6 0 2024-09-17T01:41:14.751 INFO:tasks.workunit.client.1.smithi167.stdout:5/27: truncate d0/f3 2828536 0 2024-09-17T01:41:14.754 INFO:tasks.workunit.client.1.smithi167.stdout:2/27: mkdir d5/d8 0 2024-09-17T01:41:14.758 INFO:tasks.workunit.client.1.smithi167.stdout:7/20: read d0/f1 [1667403,62548] 0 2024-09-17T01:41:14.761 INFO:tasks.workunit.client.1.smithi167.stdout:8/11: truncate f3 136473 0 2024-09-17T01:41:14.769 INFO:tasks.workunit.client.1.smithi167.stdout:7/21: fsync d0/f1 0 2024-09-17T01:41:14.772 INFO:tasks.workunit.client.1.smithi167.stdout:2/28: creat d5/d8/f9 x:0 0 0 2024-09-17T01:41:14.773 INFO:tasks.workunit.client.1.smithi167.stdout:6/14: getdents . 0 2024-09-17T01:41:14.773 INFO:tasks.workunit.client.1.smithi167.stdout:6/15: fdatasync f0 0 2024-09-17T01:41:14.781 INFO:tasks.workunit.client.1.smithi167.stdout:6/16: creat f4 x:0 0 0 2024-09-17T01:41:14.785 INFO:tasks.workunit.client.1.smithi167.stdout:8/12: rmdir d4 0 2024-09-17T01:41:14.785 INFO:tasks.workunit.client.1.smithi167.stdout:5/28: dread d0/f3 [0,4194304] 0 2024-09-17T01:41:14.791 INFO:tasks.workunit.client.1.smithi167.stdout:7/22: link d0/d2/c6 d0/d2/c7 0 2024-09-17T01:41:14.792 INFO:tasks.workunit.client.1.smithi167.stdout:7/23: dread - d0/d2/f4 zero size 2024-09-17T01:41:14.794 INFO:tasks.workunit.client.1.smithi167.stdout:5/29: mknod d0/c5 0 2024-09-17T01:41:14.798 INFO:tasks.workunit.client.1.smithi167.stdout:9/30: truncate f2 1872920 0 2024-09-17T01:41:14.799 INFO:tasks.workunit.client.1.smithi167.stdout:6/17: truncate f0 1588061 0 2024-09-17T01:41:14.800 INFO:tasks.workunit.client.1.smithi167.stdout:6/18: chown f4 0 1 2024-09-17T01:41:14.802 INFO:tasks.workunit.client.1.smithi167.stdout:7/24: creat d0/d2/f8 x:0 0 0 2024-09-17T01:41:14.804 INFO:tasks.workunit.client.1.smithi167.stdout:5/30: write d0/f3 [1964092,46004] 0 2024-09-17T01:41:14.806 INFO:tasks.workunit.client.1.smithi167.stdout:5/31: fdatasync d0/f3 0 2024-09-17T01:41:14.807 INFO:tasks.workunit.client.1.smithi167.stdout:2/29: getdents d5 0 2024-09-17T01:41:14.808 INFO:tasks.workunit.client.1.smithi167.stdout:7/25: dwrite d0/f5 [0,4194304] 0 2024-09-17T01:41:14.810 INFO:tasks.workunit.client.1.smithi167.stdout:7/26: dread - d0/d2/f4 zero size 2024-09-17T01:41:14.815 INFO:tasks.workunit.client.1.smithi167.stdout:5/32: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:14.817 INFO:tasks.workunit.client.1.smithi167.stdout:2/30: mknod d5/d8/ca 0 2024-09-17T01:41:14.818 INFO:tasks.workunit.client.1.smithi167.stdout:5/33: truncate d0/f3 5020599 0 2024-09-17T01:41:14.819 INFO:tasks.workunit.client.1.smithi167.stdout:5/34: readlink d0/l1 0 2024-09-17T01:41:14.821 INFO:tasks.workunit.client.1.smithi167.stdout:7/27: dwrite d0/d2/f8 [0,4194304] 0 2024-09-17T01:41:14.821 INFO:tasks.workunit.client.1.smithi167.stdout:5/35: write d0/f3 [4409151,102806] 0 2024-09-17T01:41:14.826 INFO:tasks.workunit.client.1.smithi167.stdout:7/28: rmdir d0 39 2024-09-17T01:41:14.828 INFO:tasks.workunit.client.1.smithi167.stdout:9/31: write f2 [1953764,11555] 0 2024-09-17T01:41:14.831 INFO:tasks.workunit.client.1.smithi167.stdout:9/32: chown d4 870319040 1 2024-09-17T01:41:14.834 INFO:tasks.workunit.client.1.smithi167.stdout:8/13: dwrite f1 [0,4194304] 0 2024-09-17T01:41:14.834 INFO:tasks.workunit.client.1.smithi167.stdout:6/19: dread f0 [0,4194304] 0 2024-09-17T01:41:14.835 INFO:tasks.workunit.client.1.smithi167.stdout:6/20: dread - f4 zero size 2024-09-17T01:41:14.835 INFO:tasks.workunit.client.1.smithi167.stdout:6/21: rmdir - no directory 2024-09-17T01:41:14.836 INFO:tasks.workunit.client.1.smithi167.stdout:6/22: chown l3 30 1 2024-09-17T01:41:14.836 INFO:tasks.workunit.client.1.smithi167.stdout:6/23: dread - f4 zero size 2024-09-17T01:41:14.836 INFO:tasks.workunit.client.1.smithi167.stdout:6/24: chown l2 95514184 1 2024-09-17T01:41:14.837 INFO:tasks.workunit.client.1.smithi167.stdout:6/25: write f4 [277008,47761] 0 2024-09-17T01:41:14.837 INFO:tasks.workunit.client.1.smithi167.stdout:6/26: readlink l3 0 2024-09-17T01:41:14.855 INFO:tasks.workunit.client.1.smithi167.stdout:9/33: fdatasync f2 0 2024-09-17T01:41:14.855 INFO:tasks.workunit.client.1.smithi167.stdout:8/14: fdatasync f3 0 2024-09-17T01:41:14.856 INFO:tasks.workunit.client.1.smithi167.stdout:6/27: symlink l5 0 2024-09-17T01:41:14.856 INFO:tasks.workunit.client.1.smithi167.stdout:2/31: link l0 d5/lb 0 2024-09-17T01:41:14.856 INFO:tasks.workunit.client.1.smithi167.stdout:5/36: truncate d0/f3 5009817 0 2024-09-17T01:41:14.857 INFO:tasks.workunit.client.1.smithi167.stdout:2/32: chown l4 1403046 1 2024-09-17T01:41:14.859 INFO:tasks.workunit.client.1.smithi167.stdout:8/15: dread f3 [0,4194304] 0 2024-09-17T01:41:14.866 INFO:tasks.workunit.client.1.smithi167.stdout:8/16: dwrite f3 [4194304,4194304] 0 2024-09-17T01:41:14.867 INFO:tasks.workunit.client.1.smithi167.stdout:8/17: write f3 [6686129,20515] 0 2024-09-17T01:41:15.049 INFO:tasks.workunit.client.1.smithi167.stdout:7/29: truncate d0/f1 2237944 0 2024-09-17T01:41:15.049 INFO:tasks.workunit.client.1.smithi167.stdout:9/34: symlink d4/l6 0 2024-09-17T01:41:15.050 INFO:tasks.workunit.client.1.smithi167.stdout:9/35: chown l3 153 1 2024-09-17T01:41:15.050 INFO:tasks.workunit.client.1.smithi167.stdout:6/28: creat f6 x:0 0 0 2024-09-17T01:41:15.053 INFO:tasks.workunit.client.1.smithi167.stdout:8/18: rename f3 to f5 0 2024-09-17T01:41:15.054 INFO:tasks.workunit.client.1.smithi167.stdout:7/30: unlink d0/d2/f4 0 2024-09-17T01:41:15.055 INFO:tasks.workunit.client.1.smithi167.stdout:6/29: mkdir d7 0 2024-09-17T01:41:15.056 INFO:tasks.workunit.client.1.smithi167.stdout:2/33: rename l1 to d5/lc 0 2024-09-17T01:41:15.056 INFO:tasks.workunit.client.1.smithi167.stdout:6/30: write f4 [483812,9913] 0 2024-09-17T01:41:15.057 INFO:tasks.workunit.client.1.smithi167.stdout:6/31: chown f6 13759 1 2024-09-17T01:41:15.057 INFO:tasks.workunit.client.1.smithi167.stdout:2/34: chown d5/d8/ca 238963710 1 2024-09-17T01:41:15.058 INFO:tasks.workunit.client.1.smithi167.stdout:8/19: dread f1 [4194304,4194304] 0 2024-09-17T01:41:15.061 INFO:tasks.workunit.client.1.smithi167.stdout:2/35: rename l4 to d5/d8/ld 0 2024-09-17T01:41:15.062 INFO:tasks.workunit.client.1.smithi167.stdout:9/36: link d4/l6 d4/l7 0 2024-09-17T01:41:15.063 INFO:tasks.workunit.client.1.smithi167.stdout:6/32: creat d7/f8 x:0 0 0 2024-09-17T01:41:15.063 INFO:tasks.workunit.client.1.smithi167.stdout:8/20: dread f5 [0,4194304] 0 2024-09-17T01:41:15.064 INFO:tasks.workunit.client.1.smithi167.stdout:2/36: truncate d5/d8/f9 225530 0 2024-09-17T01:41:15.064 INFO:tasks.workunit.client.1.smithi167.stdout:8/21: stat f5 0 2024-09-17T01:41:15.064 INFO:tasks.workunit.client.1.smithi167.stdout:9/37: creat d4/f8 x:0 0 0 2024-09-17T01:41:15.064 INFO:tasks.workunit.client.1.smithi167.stdout:5/37: write d0/f3 [4277228,59116] 0 2024-09-17T01:41:15.065 INFO:tasks.workunit.client.1.smithi167.stdout:6/33: mkdir d7/d9 0 2024-09-17T01:41:15.066 INFO:tasks.workunit.client.1.smithi167.stdout:5/38: truncate d0/f3 5786083 0 2024-09-17T01:41:15.068 INFO:tasks.workunit.client.1.smithi167.stdout:5/39: write d0/f3 [4477535,42174] 0 2024-09-17T01:41:15.068 INFO:tasks.workunit.client.1.smithi167.stdout:9/38: dread f2 [0,4194304] 0 2024-09-17T01:41:15.069 INFO:tasks.workunit.client.1.smithi167.stdout:9/39: read f1 [1825534,61016] 0 2024-09-17T01:41:15.074 INFO:tasks.workunit.client.1.smithi167.stdout:5/40: dread d0/f3 [0,4194304] 0 2024-09-17T01:41:15.074 INFO:tasks.workunit.client.1.smithi167.stdout:9/40: truncate f2 615512 0 2024-09-17T01:41:15.077 INFO:tasks.workunit.client.1.smithi167.stdout:5/41: creat d0/f6 x:0 0 0 2024-09-17T01:41:15.077 INFO:tasks.workunit.client.1.smithi167.stdout:9/41: mkdir d4/d9 0 2024-09-17T01:41:15.078 INFO:tasks.workunit.client.1.smithi167.stdout:9/42: fdatasync f1 0 2024-09-17T01:41:15.078 INFO:tasks.workunit.client.1.smithi167.stdout:9/43: rename d4/d9 to d4/d9/da 22 2024-09-17T01:41:15.080 INFO:tasks.workunit.client.1.smithi167.stdout:5/42: link d0/c5 d0/c7 0 2024-09-17T01:41:15.080 INFO:tasks.workunit.client.1.smithi167.stdout:5/43: write d0/f6 [246296,27022] 0 2024-09-17T01:41:15.084 INFO:tasks.workunit.client.1.smithi167.stdout:5/44: write d0/f3 [431298,98692] 0 2024-09-17T01:41:15.088 INFO:tasks.workunit.client.1.smithi167.stdout:5/45: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:15.091 INFO:tasks.workunit.client.1.smithi167.stdout:5/46: dread d0/f3 [0,4194304] 0 2024-09-17T01:41:15.174 INFO:tasks.workunit.client.1.smithi167.stdout:2/37: getdents d5 0 2024-09-17T01:41:15.176 INFO:tasks.workunit.client.1.smithi167.stdout:2/38: creat d5/fe x:0 0 0 2024-09-17T01:41:15.177 INFO:tasks.workunit.client.1.smithi167.stdout:2/39: chown d5/lc 1 1 2024-09-17T01:41:15.178 INFO:tasks.workunit.client.1.smithi167.stdout:6/34: write f0 [1349149,49903] 0 2024-09-17T01:41:15.179 INFO:tasks.workunit.client.1.smithi167.stdout:6/35: chown d7/d9 3326 1 2024-09-17T01:41:15.179 INFO:tasks.workunit.client.1.smithi167.stdout:2/40: symlink d5/d8/lf 0 2024-09-17T01:41:15.179 INFO:tasks.workunit.client.1.smithi167.stdout:6/36: dread - f6 zero size 2024-09-17T01:41:15.179 INFO:tasks.workunit.client.1.smithi167.stdout:8/22: truncate f1 6804532 0 2024-09-17T01:41:15.180 INFO:tasks.workunit.client.1.smithi167.stdout:2/41: write d5/fe [198577,20834] 0 2024-09-17T01:41:15.180 INFO:tasks.workunit.client.1.smithi167.stdout:2/42: chown l2 1349718093 1 2024-09-17T01:41:15.183 INFO:tasks.workunit.client.1.smithi167.stdout:2/43: truncate d5/fe 612289 0 2024-09-17T01:41:15.184 INFO:tasks.workunit.client.1.smithi167.stdout:9/44: read f2 [310777,76356] 0 2024-09-17T01:41:15.186 INFO:tasks.workunit.client.1.smithi167.stdout:2/44: mkdir d5/d10 0 2024-09-17T01:41:15.187 INFO:tasks.workunit.client.1.smithi167.stdout:7/31: truncate d0/f1 761481 0 2024-09-17T01:41:15.189 INFO:tasks.workunit.client.1.smithi167.stdout:6/37: dwrite f4 [0,4194304] 0 2024-09-17T01:41:15.189 INFO:tasks.workunit.client.1.smithi167.stdout:7/32: rename d0 to d0/d2/d9 22 2024-09-17T01:41:15.191 INFO:tasks.workunit.client.1.smithi167.stdout:6/38: rename d7/f8 to d7/fa 0 2024-09-17T01:41:15.192 INFO:tasks.workunit.client.1.smithi167.stdout:7/33: mknod d0/ca 0 2024-09-17T01:41:15.193 INFO:tasks.workunit.client.1.smithi167.stdout:2/45: link c3 d5/d8/c11 0 2024-09-17T01:41:15.195 INFO:tasks.workunit.client.1.smithi167.stdout:8/23: dread f5 [0,4194304] 0 2024-09-17T01:41:15.197 INFO:tasks.workunit.client.1.smithi167.stdout:7/34: fdatasync d0/f1 0 2024-09-17T01:41:15.199 INFO:tasks.workunit.client.1.smithi167.stdout:8/24: rename f1 to f6 0 2024-09-17T01:41:15.200 INFO:tasks.workunit.client.1.smithi167.stdout:8/25: creat f7 x:0 0 0 2024-09-17T01:41:15.200 INFO:tasks.workunit.client.1.smithi167.stdout:8/26: stat f7 0 2024-09-17T01:41:15.201 INFO:tasks.workunit.client.1.smithi167.stdout:8/27: truncate f7 135265 0 2024-09-17T01:41:15.203 INFO:tasks.workunit.client.1.smithi167.stdout:8/28: link f6 f8 0 2024-09-17T01:41:15.204 INFO:tasks.workunit.client.1.smithi167.stdout:8/29: mknod c9 0 2024-09-17T01:41:15.210 INFO:tasks.workunit.client.1.smithi167.stdout:7/35: write d0/f1 [452941,105085] 0 2024-09-17T01:41:15.210 INFO:tasks.workunit.client.1.smithi167.stdout:7/36: readlink - no filename 2024-09-17T01:41:15.214 INFO:tasks.workunit.client.1.smithi167.stdout:7/37: mknod d0/cb 0 2024-09-17T01:41:15.214 INFO:tasks.workunit.client.1.smithi167.stdout:2/46: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:15.215 INFO:tasks.workunit.client.1.smithi167.stdout:8/30: dwrite f7 [0,4194304] 0 2024-09-17T01:41:15.217 INFO:tasks.workunit.client.1.smithi167.stdout:8/31: creat fa x:0 0 0 2024-09-17T01:41:15.218 INFO:tasks.workunit.client.1.smithi167.stdout:7/38: dread d0/f1 [0,4194304] 0 2024-09-17T01:41:15.218 INFO:tasks.workunit.client.1.smithi167.stdout:2/47: mknod d5/d10/c12 0 2024-09-17T01:41:15.219 INFO:tasks.workunit.client.1.smithi167.stdout:7/39: fdatasync d0/f5 0 2024-09-17T01:41:15.220 INFO:tasks.workunit.client.1.smithi167.stdout:8/32: creat fb x:0 0 0 2024-09-17T01:41:15.227 INFO:tasks.workunit.client.1.smithi167.stdout:7/40: link d0/ca d0/d2/cc 0 2024-09-17T01:41:15.227 INFO:tasks.workunit.client.1.smithi167.stdout:2/48: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:15.229 INFO:tasks.workunit.client.1.smithi167.stdout:8/33: getdents . 0 2024-09-17T01:41:15.230 INFO:tasks.workunit.client.1.smithi167.stdout:2/49: write d5/fe [1415522,63482] 0 2024-09-17T01:41:15.232 INFO:tasks.workunit.client.1.smithi167.stdout:7/41: creat d0/d2/fd x:0 0 0 2024-09-17T01:41:15.232 INFO:tasks.workunit.client.1.smithi167.stdout:7/42: read - d0/d2/fd zero size 2024-09-17T01:41:15.233 INFO:tasks.workunit.client.1.smithi167.stdout:8/34: mkdir dc 0 2024-09-17T01:41:15.233 INFO:tasks.workunit.client.1.smithi167.stdout:7/43: chown d0/f5 9667 1 2024-09-17T01:41:15.234 INFO:tasks.workunit.client.1.smithi167.stdout:2/50: dread d5/f7 [0,4194304] 0 2024-09-17T01:41:15.235 INFO:tasks.workunit.client.1.smithi167.stdout:8/35: creat dc/fd x:0 0 0 2024-09-17T01:41:15.236 INFO:tasks.workunit.client.1.smithi167.stdout:7/44: mkdir d0/d2/de 0 2024-09-17T01:41:15.239 INFO:tasks.workunit.client.1.smithi167.stdout:7/45: creat d0/d2/de/ff x:0 0 0 2024-09-17T01:41:15.241 INFO:tasks.workunit.client.1.smithi167.stdout:7/46: read - d0/d2/de/ff zero size 2024-09-17T01:41:15.242 INFO:tasks.workunit.client.1.smithi167.stdout:8/36: dwrite fa [0,4194304] 0 2024-09-17T01:41:15.243 INFO:tasks.workunit.client.1.smithi167.stdout:7/47: write d0/f1 [1055559,41049] 0 2024-09-17T01:41:15.247 INFO:tasks.workunit.client.1.smithi167.stdout:2/51: fdatasync d5/fe 0 2024-09-17T01:41:15.252 INFO:tasks.workunit.client.1.smithi167.stdout:7/48: getdents d0/d2/de 0 2024-09-17T01:41:15.252 INFO:tasks.workunit.client.1.smithi167.stdout:8/37: write f6 [4470516,12456] 0 2024-09-17T01:41:15.254 INFO:tasks.workunit.client.1.smithi167.stdout:2/52: dread d5/fe [0,4194304] 0 2024-09-17T01:41:15.254 INFO:tasks.workunit.client.1.smithi167.stdout:7/49: mknod d0/d2/de/c10 0 2024-09-17T01:41:15.256 INFO:tasks.workunit.client.1.smithi167.stdout:7/50: write d0/f1 [471108,8997] 0 2024-09-17T01:41:15.256 INFO:tasks.workunit.client.1.smithi167.stdout:2/53: mknod d5/c13 0 2024-09-17T01:41:15.258 INFO:tasks.workunit.client.1.smithi167.stdout:2/54: truncate d5/fe 2510718 0 2024-09-17T01:41:15.259 INFO:tasks.workunit.client.1.smithi167.stdout:7/51: symlink d0/d2/l11 0 2024-09-17T01:41:15.259 INFO:tasks.workunit.client.1.smithi167.stdout:8/38: dwrite f7 [0,4194304] 0 2024-09-17T01:41:15.260 INFO:tasks.workunit.client.1.smithi167.stdout:8/39: stat fa 0 2024-09-17T01:41:15.260 INFO:tasks.workunit.client.1.smithi167.stdout:7/52: write d0/d2/f8 [2248332,115939] 0 2024-09-17T01:41:15.264 INFO:tasks.workunit.client.1.smithi167.stdout:8/40: symlink dc/le 0 2024-09-17T01:41:15.266 INFO:tasks.workunit.client.1.smithi167.stdout:7/53: rename d0/d2/de/c10 to d0/c12 0 2024-09-17T01:41:15.270 INFO:tasks.workunit.client.1.smithi167.stdout:2/55: dwrite d5/fe [0,4194304] 0 2024-09-17T01:41:15.270 INFO:tasks.workunit.client.1.smithi167.stdout:7/54: truncate d0/d2/de/ff 348692 0 2024-09-17T01:41:15.272 INFO:tasks.workunit.client.1.smithi167.stdout:7/55: write d0/d2/f8 [2016316,78623] 0 2024-09-17T01:41:15.273 INFO:tasks.workunit.client.1.smithi167.stdout:8/41: dread f6 [0,4194304] 0 2024-09-17T01:41:15.273 INFO:tasks.workunit.client.1.smithi167.stdout:8/42: readlink dc/le 0 2024-09-17T01:41:15.274 INFO:tasks.workunit.client.1.smithi167.stdout:8/43: chown fa 12691 1 2024-09-17T01:41:15.274 INFO:tasks.workunit.client.1.smithi167.stdout:8/44: read f6 [2991271,53155] 0 2024-09-17T01:41:15.276 INFO:tasks.workunit.client.1.smithi167.stdout:7/56: dread d0/f5 [0,4194304] 0 2024-09-17T01:41:15.277 INFO:tasks.workunit.client.1.smithi167.stdout:8/45: creat dc/ff x:0 0 0 2024-09-17T01:41:15.278 INFO:tasks.workunit.client.1.smithi167.stdout:8/46: chown fb 90 1 2024-09-17T01:41:15.279 INFO:tasks.workunit.client.1.smithi167.stdout:8/47: chown f5 57882 1 2024-09-17T01:41:15.279 INFO:tasks.workunit.client.1.smithi167.stdout:2/56: truncate d5/fe 2829905 0 2024-09-17T01:41:15.279 INFO:tasks.workunit.client.1.smithi167.stdout:2/57: chown d5/d8/f9 7840448 1 2024-09-17T01:41:15.282 INFO:tasks.workunit.client.1.smithi167.stdout:2/58: write d5/f7 [2228849,62588] 0 2024-09-17T01:41:15.284 INFO:tasks.workunit.client.1.smithi167.stdout:2/59: unlink d5/lb 0 2024-09-17T01:41:15.286 INFO:tasks.workunit.client.1.smithi167.stdout:2/60: rename d5 to d5/d8/d14 22 2024-09-17T01:41:15.286 INFO:tasks.workunit.client.1.smithi167.stdout:8/48: dwrite f8 [0,4194304] 0 2024-09-17T01:41:15.287 INFO:tasks.workunit.client.1.smithi167.stdout:2/61: dread d5/d8/f9 [0,4194304] 0 2024-09-17T01:41:15.293 INFO:tasks.workunit.client.1.smithi167.stdout:7/57: truncate d0/f1 713853 0 2024-09-17T01:41:15.293 INFO:tasks.workunit.client.1.smithi167.stdout:8/49: dread f6 [0,4194304] 0 2024-09-17T01:41:15.293 INFO:tasks.workunit.client.1.smithi167.stdout:2/62: fsync d5/d8/f9 0 2024-09-17T01:41:15.293 INFO:tasks.workunit.client.1.smithi167.stdout:2/63: chown d5/fe 0 1 2024-09-17T01:41:15.293 INFO:tasks.workunit.client.1.smithi167.stdout:7/58: creat d0/f13 x:0 0 0 2024-09-17T01:41:15.294 INFO:tasks.workunit.client.1.smithi167.stdout:7/59: write d0/f13 [99229,117091] 0 2024-09-17T01:41:15.294 INFO:tasks.workunit.client.1.smithi167.stdout:7/60: fsync d0/f5 0 2024-09-17T01:41:15.294 INFO:tasks.workunit.client.1.smithi167.stdout:8/50: creat dc/f10 x:0 0 0 2024-09-17T01:41:15.295 INFO:tasks.workunit.client.1.smithi167.stdout:7/61: chown d0/cb 1099385 1 2024-09-17T01:41:15.295 INFO:tasks.workunit.client.1.smithi167.stdout:7/62: readlink d0/d2/l11 0 2024-09-17T01:41:15.296 INFO:tasks.workunit.client.1.smithi167.stdout:2/64: write d5/fe [1606980,64480] 0 2024-09-17T01:41:15.296 INFO:tasks.workunit.client.1.smithi167.stdout:8/51: mkdir dc/d11 0 2024-09-17T01:41:15.297 INFO:tasks.workunit.client.1.smithi167.stdout:2/65: truncate d5/d8/f9 378166 0 2024-09-17T01:41:15.297 INFO:tasks.workunit.client.1.smithi167.stdout:7/63: mkdir d0/d2/d14 0 2024-09-17T01:41:15.298 INFO:tasks.workunit.client.1.smithi167.stdout:2/66: write d5/fe [3052848,74271] 0 2024-09-17T01:41:15.299 INFO:tasks.workunit.client.1.smithi167.stdout:8/52: creat dc/f12 x:0 0 0 2024-09-17T01:41:15.300 INFO:tasks.workunit.client.1.smithi167.stdout:2/67: chown l2 23331 1 2024-09-17T01:41:15.301 INFO:tasks.workunit.client.1.smithi167.stdout:2/68: write d5/fe [3656777,52320] 0 2024-09-17T01:41:15.305 INFO:tasks.workunit.client.1.smithi167.stdout:8/53: rmdir dc/d11 0 2024-09-17T01:41:15.305 INFO:tasks.workunit.client.1.smithi167.stdout:2/69: fdatasync d5/fe 0 2024-09-17T01:41:15.305 INFO:tasks.workunit.client.1.smithi167.stdout:8/54: write dc/fd [567230,91392] 0 2024-09-17T01:41:15.307 INFO:tasks.workunit.client.1.smithi167.stdout:2/70: mknod d5/d10/c15 0 2024-09-17T01:41:15.308 INFO:tasks.workunit.client.1.smithi167.stdout:2/71: write d5/fe [2342584,50037] 0 2024-09-17T01:41:15.308 INFO:tasks.workunit.client.1.smithi167.stdout:8/55: creat dc/f13 x:0 0 0 2024-09-17T01:41:15.309 INFO:tasks.workunit.client.1.smithi167.stdout:7/64: truncate d0/d2/f8 2343804 0 2024-09-17T01:41:15.310 INFO:tasks.workunit.client.1.smithi167.stdout:2/72: chown d5/d8/c11 30454285 1 2024-09-17T01:41:15.311 INFO:tasks.workunit.client.1.smithi167.stdout:7/65: write d0/d2/fd [617895,34963] 0 2024-09-17T01:41:15.313 INFO:tasks.workunit.client.1.smithi167.stdout:2/73: mkdir d5/d10/d16 0 2024-09-17T01:41:15.316 INFO:tasks.workunit.client.1.smithi167.stdout:8/56: dwrite dc/f13 [0,4194304] 0 2024-09-17T01:41:15.318 INFO:tasks.workunit.client.1.smithi167.stdout:8/57: write fa [4258524,109006] 0 2024-09-17T01:41:15.319 INFO:tasks.workunit.client.1.smithi167.stdout:8/58: dread - dc/f10 zero size 2024-09-17T01:41:15.323 INFO:tasks.workunit.client.1.smithi167.stdout:7/66: write d0/d2/f8 [1221919,40737] 0 2024-09-17T01:41:15.325 INFO:tasks.workunit.client.1.smithi167.stdout:2/74: dwrite d5/d8/f9 [0,4194304] 0 2024-09-17T01:41:15.327 INFO:tasks.workunit.client.1.smithi167.stdout:2/75: readlink l0 0 2024-09-17T01:41:15.328 INFO:tasks.workunit.client.1.smithi167.stdout:7/67: dread d0/d2/f8 [0,4194304] 0 2024-09-17T01:41:15.328 INFO:tasks.workunit.client.1.smithi167.stdout:2/76: write d5/d8/f9 [1625189,31494] 0 2024-09-17T01:41:15.330 INFO:tasks.workunit.client.1.smithi167.stdout:2/77: creat d5/d8/f17 x:0 0 0 2024-09-17T01:41:15.332 INFO:tasks.workunit.client.1.smithi167.stdout:8/59: truncate f7 2315593 0 2024-09-17T01:41:15.333 INFO:tasks.workunit.client.1.smithi167.stdout:2/78: creat d5/d10/d16/f18 x:0 0 0 2024-09-17T01:41:15.334 INFO:tasks.workunit.client.1.smithi167.stdout:8/60: truncate dc/f10 77092 0 2024-09-17T01:41:15.336 INFO:tasks.workunit.client.1.smithi167.stdout:8/61: write fa [1909661,117504] 0 2024-09-17T01:41:15.336 INFO:tasks.workunit.client.1.smithi167.stdout:2/79: creat d5/d10/d16/f19 x:0 0 0 2024-09-17T01:41:15.337 INFO:tasks.workunit.client.1.smithi167.stdout:8/62: mknod dc/c14 0 2024-09-17T01:41:15.339 INFO:tasks.workunit.client.1.smithi167.stdout:2/80: mkdir d5/d10/d1a 0 2024-09-17T01:41:15.340 INFO:tasks.workunit.client.1.smithi167.stdout:2/81: write d5/d8/f9 [3096142,118957] 0 2024-09-17T01:41:15.340 INFO:tasks.workunit.client.1.smithi167.stdout:8/63: rename dc/f13 to dc/f15 0 2024-09-17T01:41:15.342 INFO:tasks.workunit.client.1.smithi167.stdout:8/64: write dc/f15 [4711726,6610] 0 2024-09-17T01:41:15.344 INFO:tasks.workunit.client.1.smithi167.stdout:8/65: write f8 [776495,33940] 0 2024-09-17T01:41:15.347 INFO:tasks.workunit.client.1.smithi167.stdout:2/82: dwrite d5/d10/d16/f19 [0,4194304] 0 2024-09-17T01:41:15.351 INFO:tasks.workunit.client.1.smithi167.stdout:2/83: creat d5/d10/d16/f1b x:0 0 0 2024-09-17T01:41:15.355 INFO:tasks.workunit.client.1.smithi167.stdout:8/66: dwrite dc/ff [0,4194304] 0 2024-09-17T01:41:15.356 INFO:tasks.workunit.client.1.smithi167.stdout:2/84: symlink d5/d8/l1c 0 2024-09-17T01:41:15.358 INFO:tasks.workunit.client.1.smithi167.stdout:2/85: rename d5/d8/l1c to d5/d8/l1d 0 2024-09-17T01:41:15.366 INFO:tasks.workunit.client.1.smithi167.stdout:2/86: dwrite d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:15.367 INFO:tasks.workunit.client.1.smithi167.stdout:2/87: truncate d5/d10/d16/f1b 441556 0 2024-09-17T01:41:15.369 INFO:tasks.workunit.client.1.smithi167.stdout:2/88: unlink d5/d8/ca 0 2024-09-17T01:41:15.376 INFO:tasks.workunit.client.1.smithi167.stdout:8/67: dread dc/fd [0,4194304] 0 2024-09-17T01:41:15.377 INFO:tasks.workunit.client.1.smithi167.stdout:8/68: dread - fb zero size 2024-09-17T01:41:15.377 INFO:tasks.workunit.client.1.smithi167.stdout:2/89: dwrite d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:15.379 INFO:tasks.workunit.client.1.smithi167.stdout:8/69: creat dc/f16 x:0 0 0 2024-09-17T01:41:15.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/70: rename fa to dc/f17 0 2024-09-17T01:41:15.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/71: stat f6 0 2024-09-17T01:41:15.381 INFO:tasks.workunit.client.1.smithi167.stdout:2/90: dread d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:15.383 INFO:tasks.workunit.client.1.smithi167.stdout:8/72: mkdir dc/d18 0 2024-09-17T01:41:15.383 INFO:tasks.workunit.client.1.smithi167.stdout:8/73: chown dc/c14 62 1 2024-09-17T01:41:15.384 INFO:tasks.workunit.client.1.smithi167.stdout:8/74: dread dc/f10 [0,4194304] 0 2024-09-17T01:41:15.385 INFO:tasks.workunit.client.1.smithi167.stdout:8/75: truncate fb 675566 0 2024-09-17T01:41:15.385 INFO:tasks.workunit.client.1.smithi167.stdout:8/76: chown dc/c14 181478 1 2024-09-17T01:41:15.388 INFO:tasks.workunit.client.1.smithi167.stdout:8/77: creat dc/f19 x:0 0 0 2024-09-17T01:41:15.388 INFO:tasks.workunit.client.1.smithi167.stdout:8/78: fdatasync f5 0 2024-09-17T01:41:15.390 INFO:tasks.workunit.client.1.smithi167.stdout:2/91: truncate d5/d10/d16/f1b 149582 0 2024-09-17T01:41:15.391 INFO:tasks.workunit.client.1.smithi167.stdout:2/92: chown d5/d8/f17 11 1 2024-09-17T01:41:15.394 INFO:tasks.workunit.client.1.smithi167.stdout:8/79: dwrite fb [0,4194304] 0 2024-09-17T01:41:15.399 INFO:tasks.workunit.client.1.smithi167.stdout:8/80: getdents dc 0 2024-09-17T01:41:15.400 INFO:tasks.workunit.client.1.smithi167.stdout:8/81: chown f7 423910909 1 2024-09-17T01:41:15.402 INFO:tasks.workunit.client.1.smithi167.stdout:8/82: mkdir dc/d1a 0 2024-09-17T01:41:15.404 INFO:tasks.workunit.client.1.smithi167.stdout:8/83: creat dc/f1b x:0 0 0 2024-09-17T01:41:15.404 INFO:tasks.workunit.client.1.smithi167.stdout:8/84: write f8 [5070827,71128] 0 2024-09-17T01:41:15.405 INFO:tasks.workunit.client.1.smithi167.stdout:8/85: chown dc/f12 0 1 2024-09-17T01:41:15.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/86: symlink dc/d1a/l1c 0 2024-09-17T01:41:15.411 INFO:tasks.workunit.client.1.smithi167.stdout:8/87: write f7 [2967094,87607] 0 2024-09-17T01:41:15.412 INFO:tasks.workunit.client.1.smithi167.stdout:8/88: write dc/f16 [391015,112391] 0 2024-09-17T01:41:15.415 INFO:tasks.workunit.client.1.smithi167.stdout:8/89: truncate dc/ff 4096619 0 2024-09-17T01:41:15.416 INFO:tasks.workunit.client.1.smithi167.stdout:8/90: chown dc/f19 2983 1 2024-09-17T01:41:15.419 INFO:tasks.workunit.client.1.smithi167.stdout:8/91: dread f6 [0,4194304] 0 2024-09-17T01:41:15.420 INFO:tasks.workunit.client.1.smithi167.stdout:8/92: symlink dc/l1d 0 2024-09-17T01:41:15.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/93: symlink dc/l1e 0 2024-09-17T01:41:15.422 INFO:tasks.workunit.client.1.smithi167.stdout:8/94: fdatasync dc/fd 0 2024-09-17T01:41:15.423 INFO:tasks.workunit.client.1.smithi167.stdout:8/95: write fb [2762227,17214] 0 2024-09-17T01:41:15.425 INFO:tasks.workunit.client.1.smithi167.stdout:8/96: unlink f5 0 2024-09-17T01:41:15.425 INFO:tasks.workunit.client.1.smithi167.stdout:8/97: readlink dc/d1a/l1c 0 2024-09-17T01:41:15.427 INFO:tasks.workunit.client.1.smithi167.stdout:8/98: mknod dc/d1a/c1f 0 2024-09-17T01:41:15.428 INFO:tasks.workunit.client.1.smithi167.stdout:8/99: write dc/f17 [2658404,73193] 0 2024-09-17T01:41:15.434 INFO:tasks.workunit.client.1.smithi167.stdout:8/100: dwrite dc/fd [0,4194304] 0 2024-09-17T01:41:15.437 INFO:tasks.workunit.client.1.smithi167.stdout:8/101: write f6 [7585401,130800] 0 2024-09-17T01:41:15.441 INFO:tasks.workunit.client.1.smithi167.stdout:8/102: link dc/l1e dc/d18/l20 0 2024-09-17T01:41:15.502 INFO:tasks.workunit.client.1.smithi167.stdout:8/103: truncate dc/f17 4130120 0 2024-09-17T01:41:15.502 INFO:tasks.workunit.client.1.smithi167.stdout:8/104: readlink dc/d1a/l1c 0 2024-09-17T01:41:15.505 INFO:tasks.workunit.client.1.smithi167.stdout:8/105: dread dc/fd [0,4194304] 0 2024-09-17T01:41:15.507 INFO:tasks.workunit.client.1.smithi167.stdout:8/106: write f8 [8525489,130768] 0 2024-09-17T01:41:15.509 INFO:tasks.workunit.client.1.smithi167.stdout:8/107: mkdir dc/d21 0 2024-09-17T01:41:15.511 INFO:tasks.workunit.client.1.smithi167.stdout:8/108: symlink dc/l22 0 2024-09-17T01:41:15.517 INFO:tasks.workunit.client.1.smithi167.stdout:8/109: write dc/f17 [3489815,89741] 0 2024-09-17T01:41:15.519 INFO:tasks.workunit.client.1.smithi167.stdout:8/110: rename dc/l22 to dc/d1a/l23 0 2024-09-17T01:41:15.519 INFO:tasks.workunit.client.1.smithi167.stdout:8/111: chown dc/f16 23174 1 2024-09-17T01:41:15.520 INFO:tasks.workunit.client.1.smithi167.stdout:8/112: truncate dc/f15 5255691 0 2024-09-17T01:41:15.522 INFO:tasks.workunit.client.1.smithi167.stdout:8/113: link dc/f10 dc/d21/f24 0 2024-09-17T01:41:15.523 INFO:tasks.workunit.client.1.smithi167.stdout:8/114: chown fb 8309 1 2024-09-17T01:41:15.524 INFO:tasks.workunit.client.1.smithi167.stdout:8/115: write f6 [616943,127086] 0 2024-09-17T01:41:15.526 INFO:tasks.workunit.client.1.smithi167.stdout:8/116: creat dc/d21/f25 x:0 0 0 2024-09-17T01:41:15.528 INFO:tasks.workunit.client.1.smithi167.stdout:8/117: symlink dc/d1a/l26 0 2024-09-17T01:41:15.533 INFO:tasks.workunit.client.1.smithi167.stdout:8/118: dwrite fb [0,4194304] 0 2024-09-17T01:41:15.534 INFO:tasks.workunit.client.1.smithi167.stdout:8/119: symlink dc/l27 0 2024-09-17T01:41:15.700 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:15 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:15.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:15 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:16.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:16 smithi082 ceph-mon[28077]: pgmap v11: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 314 op/s 2024-09-17T01:41:16.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:16 smithi167 ceph-mon[35643]: pgmap v11: 65 pgs: 65 active+clean; 209 MiB data, 841 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 314 op/s 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:4/21: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:3/8: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:3/9: dread - no filename 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:3/10: write - no filename 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:2/93: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:5/47: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:7/68: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:9/45: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:0/17: sync 2024-09-17T01:41:16.922 INFO:tasks.workunit.client.1.smithi167.stdout:0/18: dwrite - no filename 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:0/19: truncate - no filename 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:0/20: truncate - no filename 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/2: sync 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/3: stat - no entries 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/4: dwrite - no filename 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/5: stat - no entries 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/6: dread - no filename 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/7: stat - no entries 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:8/120: sync 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:6/39: sync 2024-09-17T01:41:16.923 INFO:tasks.workunit.client.1.smithi167.stdout:0/21: chown c3 68023378 1 2024-09-17T01:41:16.924 INFO:tasks.workunit.client.1.smithi167.stdout:0/22: write - no filename 2024-09-17T01:41:16.924 INFO:tasks.workunit.client.1.smithi167.stdout:9/46: write d4/f8 [744390,14842] 0 2024-09-17T01:41:16.937 INFO:tasks.workunit.client.1.smithi167.stdout:6/40: rmdir d7 39 2024-09-17T01:41:16.939 INFO:tasks.workunit.client.1.smithi167.stdout:4/22: rename d0/d5 to d0/d4/d7 0 2024-09-17T01:41:16.941 INFO:tasks.workunit.client.1.smithi167.stdout:1/8: mkdir d0 0 2024-09-17T01:41:16.943 INFO:tasks.workunit.client.1.smithi167.stdout:0/23: creat d5/f6 x:0 0 0 2024-09-17T01:41:16.943 INFO:tasks.workunit.client.1.smithi167.stdout:1/9: rename d0 to d0/d1 22 2024-09-17T01:41:16.945 INFO:tasks.workunit.client.1.smithi167.stdout:9/47: mknod d4/d9/cb 0 2024-09-17T01:41:16.946 INFO:tasks.workunit.client.1.smithi167.stdout:4/23: mknod d0/d4/c8 0 2024-09-17T01:41:16.949 INFO:tasks.workunit.client.1.smithi167.stdout:0/24: creat d5/f7 x:0 0 0 2024-09-17T01:41:16.949 INFO:tasks.workunit.client.1.smithi167.stdout:0/25: readlink - no filename 2024-09-17T01:41:16.952 INFO:tasks.workunit.client.1.smithi167.stdout:5/48: getdents d0 0 2024-09-17T01:41:16.953 INFO:tasks.workunit.client.1.smithi167.stdout:2/94: link d5/d8/l1d d5/d10/l1e 0 2024-09-17T01:41:16.953 INFO:tasks.workunit.client.1.smithi167.stdout:8/121: dwrite f7 [0,4194304] 0 2024-09-17T01:41:16.953 INFO:tasks.workunit.client.1.smithi167.stdout:0/26: dread - d5/f7 zero size 2024-09-17T01:41:16.954 INFO:tasks.workunit.client.1.smithi167.stdout:1/10: getdents d0 0 2024-09-17T01:41:16.955 INFO:tasks.workunit.client.1.smithi167.stdout:6/41: dwrite f6 [0,4194304] 0 2024-09-17T01:41:16.955 INFO:tasks.workunit.client.1.smithi167.stdout:0/27: chown d5 11177019 1 2024-09-17T01:41:16.956 INFO:tasks.workunit.client.1.smithi167.stdout:8/122: readlink dc/l27 0 2024-09-17T01:41:16.957 INFO:tasks.workunit.client.1.smithi167.stdout:0/28: fdatasync d5/f7 0 2024-09-17T01:41:16.957 INFO:tasks.workunit.client.1.smithi167.stdout:8/123: dread - dc/f12 zero size 2024-09-17T01:41:16.958 INFO:tasks.workunit.client.1.smithi167.stdout:4/24: getdents d0/d4/d7/d6 0 2024-09-17T01:41:16.962 INFO:tasks.workunit.client.1.smithi167.stdout:9/48: dread f1 [0,4194304] 0 2024-09-17T01:41:16.963 INFO:tasks.workunit.client.1.smithi167.stdout:0/29: mkdir d5/d8 0 2024-09-17T01:41:16.963 INFO:tasks.workunit.client.1.smithi167.stdout:5/49: getdents d0 0 2024-09-17T01:41:16.966 INFO:tasks.workunit.client.1.smithi167.stdout:1/11: creat d0/f2 x:0 0 0 2024-09-17T01:41:16.967 INFO:tasks.workunit.client.1.smithi167.stdout:2/95: unlink d5/d8/ld 0 2024-09-17T01:41:16.968 INFO:tasks.workunit.client.1.smithi167.stdout:5/50: write d0/f6 [1123846,96555] 0 2024-09-17T01:41:16.968 INFO:tasks.workunit.client.1.smithi167.stdout:9/49: dread f2 [0,4194304] 0 2024-09-17T01:41:16.970 INFO:tasks.workunit.client.1.smithi167.stdout:6/42: rename f4 to d7/d9/fb 0 2024-09-17T01:41:16.971 INFO:tasks.workunit.client.1.smithi167.stdout:4/25: rename d0/d4 to d0/d4/d9 22 2024-09-17T01:41:16.972 INFO:tasks.workunit.client.1.smithi167.stdout:6/43: read f6 [2251204,116397] 0 2024-09-17T01:41:16.973 INFO:tasks.workunit.client.1.smithi167.stdout:8/124: dwrite fb [0,4194304] 0 2024-09-17T01:41:16.976 INFO:tasks.workunit.client.1.smithi167.stdout:1/12: rename d0/f2 to d0/f3 0 2024-09-17T01:41:16.977 INFO:tasks.workunit.client.1.smithi167.stdout:0/30: mkdir d5/d8/d9 0 2024-09-17T01:41:16.977 INFO:tasks.workunit.client.1.smithi167.stdout:6/44: write f6 [3044962,113380] 0 2024-09-17T01:41:16.977 INFO:tasks.workunit.client.1.smithi167.stdout:1/13: rename d0 to d0/d4 22 2024-09-17T01:41:16.978 INFO:tasks.workunit.client.1.smithi167.stdout:9/50: rmdir d4 39 2024-09-17T01:41:16.979 INFO:tasks.workunit.client.1.smithi167.stdout:2/96: dread d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:16.980 INFO:tasks.workunit.client.1.smithi167.stdout:5/51: fsync d0/f6 0 2024-09-17T01:41:16.980 INFO:tasks.workunit.client.1.smithi167.stdout:0/31: fdatasync d5/f6 0 2024-09-17T01:41:16.981 INFO:tasks.workunit.client.1.smithi167.stdout:9/51: read f2 [557887,69868] 0 2024-09-17T01:41:16.982 INFO:tasks.workunit.client.1.smithi167.stdout:8/125: creat dc/d1a/f28 x:0 0 0 2024-09-17T01:41:16.983 INFO:tasks.workunit.client.1.smithi167.stdout:1/14: truncate d0/f3 572401 0 2024-09-17T01:41:16.984 INFO:tasks.workunit.client.1.smithi167.stdout:2/97: read d5/fe [642600,31041] 0 2024-09-17T01:41:16.987 INFO:tasks.workunit.client.1.smithi167.stdout:6/45: dread f0 [0,4194304] 0 2024-09-17T01:41:16.987 INFO:tasks.workunit.client.1.smithi167.stdout:9/52: fsync d4/f8 0 2024-09-17T01:41:16.990 INFO:tasks.workunit.client.1.smithi167.stdout:4/26: dwrite d0/f2 [0,4194304] 0 2024-09-17T01:41:16.991 INFO:tasks.workunit.client.1.smithi167.stdout:2/98: mkdir d5/d1f 0 2024-09-17T01:41:16.992 INFO:tasks.workunit.client.1.smithi167.stdout:6/46: chown l5 79935841 1 2024-09-17T01:41:16.992 INFO:tasks.workunit.client.1.smithi167.stdout:8/126: dread dc/f10 [0,4194304] 0 2024-09-17T01:41:16.993 INFO:tasks.workunit.client.1.smithi167.stdout:5/52: link d0/f6 d0/f8 0 2024-09-17T01:41:16.995 INFO:tasks.workunit.client.1.smithi167.stdout:4/27: read d0/f3 [669637,129244] 0 2024-09-17T01:41:16.998 INFO:tasks.workunit.client.1.smithi167.stdout:8/127: creat dc/f29 x:0 0 0 2024-09-17T01:41:16.998 INFO:tasks.workunit.client.1.smithi167.stdout:9/53: dread d4/f8 [0,4194304] 0 2024-09-17T01:41:17.076 INFO:tasks.workunit.client.1.smithi167.stdout:0/32: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:17.076 INFO:tasks.workunit.client.1.smithi167.stdout:6/47: rename l5 to d7/d9/lc 0 2024-09-17T01:41:17.082 INFO:tasks.workunit.client.1.smithi167.stdout:0/33: dread d5/f7 [0,4194304] 0 2024-09-17T01:41:17.087 INFO:tasks.workunit.client.1.smithi167.stdout:7/69: truncate d0/d2/fd 494397 0 2024-09-17T01:41:17.088 INFO:tasks.workunit.client.1.smithi167.stdout:1/15: unlink d0/f3 0 2024-09-17T01:41:17.088 INFO:tasks.workunit.client.1.smithi167.stdout:4/28: write d0/f2 [4702819,92970] 0 2024-09-17T01:41:17.090 INFO:tasks.workunit.client.1.smithi167.stdout:6/48: readlink d7/d9/lc 0 2024-09-17T01:41:17.090 INFO:tasks.workunit.client.1.smithi167.stdout:1/16: mkdir d0/d5 0 2024-09-17T01:41:17.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/17: fsync - no filename 2024-09-17T01:41:17.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/18: dwrite - no filename 2024-09-17T01:41:17.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/19: fdatasync - no filename 2024-09-17T01:41:17.091 INFO:tasks.workunit.client.1.smithi167.stdout:4/29: mkdir d0/d4/d7/da 0 2024-09-17T01:41:17.093 INFO:tasks.workunit.client.1.smithi167.stdout:8/128: rename c9 to dc/c2a 0 2024-09-17T01:41:17.093 INFO:tasks.workunit.client.1.smithi167.stdout:5/53: getdents d0 0 2024-09-17T01:41:17.094 INFO:tasks.workunit.client.1.smithi167.stdout:6/49: write d7/fa [879432,121389] 0 2024-09-17T01:41:17.094 INFO:tasks.workunit.client.1.smithi167.stdout:4/30: mknod d0/d4/cb 0 2024-09-17T01:41:17.096 INFO:tasks.workunit.client.1.smithi167.stdout:9/54: rename l3 to d4/lc 0 2024-09-17T01:41:17.097 INFO:tasks.workunit.client.1.smithi167.stdout:1/20: rename d0 to d0/d5/d6 22 2024-09-17T01:41:17.097 INFO:tasks.workunit.client.1.smithi167.stdout:8/129: fsync dc/f10 0 2024-09-17T01:41:17.099 INFO:tasks.workunit.client.1.smithi167.stdout:0/34: link c2 d5/ca 0 2024-09-17T01:41:17.100 INFO:tasks.workunit.client.1.smithi167.stdout:5/54: dread d0/f8 [0,4194304] 0 2024-09-17T01:41:17.100 INFO:tasks.workunit.client.1.smithi167.stdout:1/21: creat d0/f7 x:0 0 0 2024-09-17T01:41:17.101 INFO:tasks.workunit.client.1.smithi167.stdout:6/50: dread d7/fa [0,4194304] 0 2024-09-17T01:41:17.101 INFO:tasks.workunit.client.1.smithi167.stdout:1/22: rename d0 to d0/d8 22 2024-09-17T01:41:17.102 INFO:tasks.workunit.client.1.smithi167.stdout:1/23: chown d0/f7 78278044 1 2024-09-17T01:41:17.102 INFO:tasks.workunit.client.1.smithi167.stdout:1/24: chown d0/d5 57631 1 2024-09-17T01:41:17.106 INFO:tasks.workunit.client.1.smithi167.stdout:6/51: rename l2 to d7/ld 0 2024-09-17T01:41:17.107 INFO:tasks.workunit.client.1.smithi167.stdout:8/130: write dc/d21/f24 [108903,14977] 0 2024-09-17T01:41:17.108 INFO:tasks.workunit.client.1.smithi167.stdout:0/35: mknod d5/d8/d9/cb 0 2024-09-17T01:41:17.109 INFO:tasks.workunit.client.1.smithi167.stdout:5/55: getdents d0 0 2024-09-17T01:41:17.110 INFO:tasks.workunit.client.1.smithi167.stdout:0/36: fdatasync d5/f6 0 2024-09-17T01:41:17.111 INFO:tasks.workunit.client.1.smithi167.stdout:4/31: truncate d0/f2 1813442 0 2024-09-17T01:41:17.111 INFO:tasks.workunit.client.1.smithi167.stdout:0/37: chown d5/d8 88 1 2024-09-17T01:41:17.111 INFO:tasks.workunit.client.1.smithi167.stdout:1/25: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:41:17.112 INFO:tasks.workunit.client.1.smithi167.stdout:6/52: dread f0 [0,4194304] 0 2024-09-17T01:41:17.113 INFO:tasks.workunit.client.1.smithi167.stdout:6/53: truncate f0 2596376 0 2024-09-17T01:41:17.114 INFO:tasks.workunit.client.1.smithi167.stdout:8/131: rename dc/l1d to dc/d1a/l2b 0 2024-09-17T01:41:17.116 INFO:tasks.workunit.client.1.smithi167.stdout:0/38: mkdir d5/dc 0 2024-09-17T01:41:17.117 INFO:tasks.workunit.client.1.smithi167.stdout:0/39: chown c3 1504452 1 2024-09-17T01:41:17.119 INFO:tasks.workunit.client.1.smithi167.stdout:0/40: chown c3 4075784 1 2024-09-17T01:41:17.119 INFO:tasks.workunit.client.1.smithi167.stdout:6/54: creat d7/fe x:0 0 0 2024-09-17T01:41:17.122 INFO:tasks.workunit.client.1.smithi167.stdout:8/132: dread f7 [0,4194304] 0 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/11: sync 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/12: dread - no filename 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/13: rename - no filename 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/14: truncate - no filename 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/15: write - no filename 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/16: dread - no filename 2024-09-17T01:41:17.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/17: truncate - no filename 2024-09-17T01:41:17.124 INFO:tasks.workunit.client.1.smithi167.stdout:0/41: creat d5/fd x:0 0 0 2024-09-17T01:41:17.125 INFO:tasks.workunit.client.1.smithi167.stdout:6/55: rename d7/d9/fb to d7/d9/ff 0 2024-09-17T01:41:17.125 INFO:tasks.workunit.client.1.smithi167.stdout:4/32: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:17.127 INFO:tasks.workunit.client.1.smithi167.stdout:0/42: rmdir d5/d8 39 2024-09-17T01:41:17.128 INFO:tasks.workunit.client.1.smithi167.stdout:0/43: dread - d5/f6 zero size 2024-09-17T01:41:17.128 INFO:tasks.workunit.client.1.smithi167.stdout:3/18: symlink l0 0 2024-09-17T01:41:17.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/19: truncate - no filename 2024-09-17T01:41:17.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/20: dread - no filename 2024-09-17T01:41:17.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/21: read - no filename 2024-09-17T01:41:17.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/22: dread - no filename 2024-09-17T01:41:17.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/23: readlink l0 0 2024-09-17T01:41:17.132 INFO:tasks.workunit.client.1.smithi167.stdout:6/56: link f0 d7/d9/f10 0 2024-09-17T01:41:17.133 INFO:tasks.workunit.client.1.smithi167.stdout:3/24: creat f1 x:0 0 0 2024-09-17T01:41:17.133 INFO:tasks.workunit.client.1.smithi167.stdout:8/133: link dc/l1e dc/l2c 0 2024-09-17T01:41:17.134 INFO:tasks.workunit.client.1.smithi167.stdout:0/44: rmdir d5/d8 39 2024-09-17T01:41:17.135 INFO:tasks.workunit.client.1.smithi167.stdout:3/25: dread - f1 zero size 2024-09-17T01:41:17.135 INFO:tasks.workunit.client.1.smithi167.stdout:8/134: read - dc/f12 zero size 2024-09-17T01:41:17.137 INFO:tasks.workunit.client.1.smithi167.stdout:1/26: fsync d0/f7 0 2024-09-17T01:41:17.138 INFO:tasks.workunit.client.1.smithi167.stdout:0/45: chown d5/d8/d9/cb 3673 1 2024-09-17T01:41:17.138 INFO:tasks.workunit.client.1.smithi167.stdout:0/46: readlink - no filename 2024-09-17T01:41:17.138 INFO:tasks.workunit.client.1.smithi167.stdout:8/135: rmdir dc 39 2024-09-17T01:41:17.139 INFO:tasks.workunit.client.1.smithi167.stdout:1/27: read d0/f7 [1851066,80176] 0 2024-09-17T01:41:17.141 INFO:tasks.workunit.client.1.smithi167.stdout:1/28: write d0/f7 [2178821,66356] 0 2024-09-17T01:41:17.142 INFO:tasks.workunit.client.1.smithi167.stdout:6/57: dwrite d7/fe [0,4194304] 0 2024-09-17T01:41:17.143 INFO:tasks.workunit.client.1.smithi167.stdout:4/33: read d0/f2 [1534533,116000] 0 2024-09-17T01:41:17.144 INFO:tasks.workunit.client.1.smithi167.stdout:3/26: link l0 l2 0 2024-09-17T01:41:17.145 INFO:tasks.workunit.client.1.smithi167.stdout:3/27: chown f1 133934 1 2024-09-17T01:41:17.146 INFO:tasks.workunit.client.1.smithi167.stdout:3/28: dread - f1 zero size 2024-09-17T01:41:17.146 INFO:tasks.workunit.client.1.smithi167.stdout:8/136: chown dc/c2a 75280764 1 2024-09-17T01:41:17.149 INFO:tasks.workunit.client.1.smithi167.stdout:1/29: mkdir d0/d9 0 2024-09-17T01:41:17.150 INFO:tasks.workunit.client.1.smithi167.stdout:4/34: symlink d0/d4/lc 0 2024-09-17T01:41:17.150 INFO:tasks.workunit.client.1.smithi167.stdout:6/58: write f0 [2185556,19967] 0 2024-09-17T01:41:17.151 INFO:tasks.workunit.client.1.smithi167.stdout:8/137: fdatasync f7 0 2024-09-17T01:41:17.152 INFO:tasks.workunit.client.1.smithi167.stdout:3/29: creat f3 x:0 0 0 2024-09-17T01:41:17.152 INFO:tasks.workunit.client.1.smithi167.stdout:6/59: dread d7/fa [0,4194304] 0 2024-09-17T01:41:17.153 INFO:tasks.workunit.client.1.smithi167.stdout:1/30: dread d0/f7 [0,4194304] 0 2024-09-17T01:41:17.153 INFO:tasks.workunit.client.1.smithi167.stdout:0/47: rmdir d5/dc 0 2024-09-17T01:41:17.154 INFO:tasks.workunit.client.1.smithi167.stdout:0/48: dread - d5/f6 zero size 2024-09-17T01:41:17.154 INFO:tasks.workunit.client.1.smithi167.stdout:0/49: dread - d5/fd zero size 2024-09-17T01:41:17.155 INFO:tasks.workunit.client.1.smithi167.stdout:4/35: creat d0/fd x:0 0 0 2024-09-17T01:41:17.156 INFO:tasks.workunit.client.1.smithi167.stdout:3/30: mknod c4 0 2024-09-17T01:41:17.156 INFO:tasks.workunit.client.1.smithi167.stdout:6/60: rmdir d7/d9 39 2024-09-17T01:41:17.157 INFO:tasks.workunit.client.1.smithi167.stdout:3/31: fdatasync f3 0 2024-09-17T01:41:17.157 INFO:tasks.workunit.client.1.smithi167.stdout:1/31: creat d0/fa x:0 0 0 2024-09-17T01:41:17.158 INFO:tasks.workunit.client.1.smithi167.stdout:8/138: creat dc/d18/f2d x:0 0 0 2024-09-17T01:41:17.159 INFO:tasks.workunit.client.1.smithi167.stdout:1/32: read d0/f7 [154578,8955] 0 2024-09-17T01:41:17.159 INFO:tasks.workunit.client.1.smithi167.stdout:6/61: stat d7/ld 0 2024-09-17T01:41:17.160 INFO:tasks.workunit.client.1.smithi167.stdout:4/36: creat d0/d4/d7/da/fe x:0 0 0 2024-09-17T01:41:17.161 INFO:tasks.workunit.client.1.smithi167.stdout:8/139: dread - dc/d1a/f28 zero size 2024-09-17T01:41:17.164 INFO:tasks.workunit.client.1.smithi167.stdout:0/50: dwrite d5/f6 [0,4194304] 0 2024-09-17T01:41:17.164 INFO:tasks.workunit.client.1.smithi167.stdout:0/51: readlink - no filename 2024-09-17T01:41:17.164 INFO:tasks.workunit.client.1.smithi167.stdout:4/37: creat d0/d4/d7/ff x:0 0 0 2024-09-17T01:41:17.166 INFO:tasks.workunit.client.1.smithi167.stdout:8/140: write dc/fd [4159279,97322] 0 2024-09-17T01:41:17.167 INFO:tasks.workunit.client.1.smithi167.stdout:6/62: rename d7/d9 to d7/d11 0 2024-09-17T01:41:17.167 INFO:tasks.workunit.client.1.smithi167.stdout:4/38: read - d0/d4/d7/da/fe zero size 2024-09-17T01:41:17.169 INFO:tasks.workunit.client.1.smithi167.stdout:6/63: stat d7/ld 0 2024-09-17T01:41:17.171 INFO:tasks.workunit.client.1.smithi167.stdout:4/39: dread - d0/d4/d7/ff zero size 2024-09-17T01:41:17.171 INFO:tasks.workunit.client.1.smithi167.stdout:1/33: dwrite d0/f7 [0,4194304] 0 2024-09-17T01:41:17.171 INFO:tasks.workunit.client.1.smithi167.stdout:1/34: chown d0/d5 192 1 2024-09-17T01:41:17.172 INFO:tasks.workunit.client.1.smithi167.stdout:0/52: rename d5/d8/d9/cb to d5/ce 0 2024-09-17T01:41:17.174 INFO:tasks.workunit.client.1.smithi167.stdout:6/64: mkdir d7/d12 0 2024-09-17T01:41:17.174 INFO:tasks.workunit.client.1.smithi167.stdout:4/40: mkdir d0/d4/d7/d10 0 2024-09-17T01:41:17.176 INFO:tasks.workunit.client.1.smithi167.stdout:8/141: getdents dc 0 2024-09-17T01:41:17.177 INFO:tasks.workunit.client.1.smithi167.stdout:1/35: rename d0/f7 to d0/d9/fb 0 2024-09-17T01:41:17.179 INFO:tasks.workunit.client.1.smithi167.stdout:0/53: unlink c4 0 2024-09-17T01:41:17.179 INFO:tasks.workunit.client.1.smithi167.stdout:6/65: mkdir d7/d11/d13 0 2024-09-17T01:41:17.180 INFO:tasks.workunit.client.1.smithi167.stdout:0/54: dread - d5/fd zero size 2024-09-17T01:41:17.181 INFO:tasks.workunit.client.1.smithi167.stdout:4/41: unlink d0/d4/d7/da/fe 0 2024-09-17T01:41:17.182 INFO:tasks.workunit.client.1.smithi167.stdout:4/42: stat d0/d4 0 2024-09-17T01:41:17.183 INFO:tasks.workunit.client.1.smithi167.stdout:1/36: mknod d0/d5/cc 0 2024-09-17T01:41:17.184 INFO:tasks.workunit.client.1.smithi167.stdout:0/55: mkdir d5/d8/df 0 2024-09-17T01:41:17.185 INFO:tasks.workunit.client.1.smithi167.stdout:6/66: mknod d7/c14 0 2024-09-17T01:41:17.186 INFO:tasks.workunit.client.1.smithi167.stdout:4/43: mknod d0/c11 0 2024-09-17T01:41:17.186 INFO:tasks.workunit.client.1.smithi167.stdout:8/142: dwrite dc/f12 [0,4194304] 0 2024-09-17T01:41:17.187 INFO:tasks.workunit.client.1.smithi167.stdout:1/37: rmdir d0 39 2024-09-17T01:41:17.188 INFO:tasks.workunit.client.1.smithi167.stdout:0/56: write d5/fd [439400,11067] 0 2024-09-17T01:41:17.190 INFO:tasks.workunit.client.1.smithi167.stdout:1/38: read d0/d9/fb [231691,117902] 0 2024-09-17T01:41:17.190 INFO:tasks.workunit.client.1.smithi167.stdout:4/44: creat d0/d4/f12 x:0 0 0 2024-09-17T01:41:17.190 INFO:tasks.workunit.client.1.smithi167.stdout:4/45: chown d0/l1 218 1 2024-09-17T01:41:17.191 INFO:tasks.workunit.client.1.smithi167.stdout:8/143: creat dc/d18/f2e x:0 0 0 2024-09-17T01:41:17.192 INFO:tasks.workunit.client.1.smithi167.stdout:4/46: write d0/d4/f12 [763865,7453] 0 2024-09-17T01:41:17.193 INFO:tasks.workunit.client.1.smithi167.stdout:4/47: chown d0/d4/d7 49697848 1 2024-09-17T01:41:17.193 INFO:tasks.workunit.client.1.smithi167.stdout:0/57: creat d5/d8/f10 x:0 0 0 2024-09-17T01:41:17.195 INFO:tasks.workunit.client.1.smithi167.stdout:1/39: creat d0/d5/fd x:0 0 0 2024-09-17T01:41:17.196 INFO:tasks.workunit.client.1.smithi167.stdout:1/40: chown d0/d5 753361 1 2024-09-17T01:41:17.197 INFO:tasks.workunit.client.1.smithi167.stdout:6/67: rename l3 to d7/l15 0 2024-09-17T01:41:17.198 INFO:tasks.workunit.client.1.smithi167.stdout:4/48: creat d0/f13 x:0 0 0 2024-09-17T01:41:17.199 INFO:tasks.workunit.client.1.smithi167.stdout:0/58: creat d5/d8/d9/f11 x:0 0 0 2024-09-17T01:41:17.199 INFO:tasks.workunit.client.1.smithi167.stdout:1/41: truncate d0/d9/fb 4237044 0 2024-09-17T01:41:17.201 INFO:tasks.workunit.client.1.smithi167.stdout:6/68: mknod d7/d11/d13/c16 0 2024-09-17T01:41:17.201 INFO:tasks.workunit.client.1.smithi167.stdout:8/144: dwrite dc/d21/f24 [0,4194304] 0 2024-09-17T01:41:17.201 INFO:tasks.workunit.client.1.smithi167.stdout:4/49: mknod d0/c14 0 2024-09-17T01:41:17.202 INFO:tasks.workunit.client.1.smithi167.stdout:0/59: write d5/d8/f10 [424382,89470] 0 2024-09-17T01:41:17.202 INFO:tasks.workunit.client.1.smithi167.stdout:1/42: mknod d0/ce 0 2024-09-17T01:41:17.205 INFO:tasks.workunit.client.1.smithi167.stdout:6/69: creat d7/d11/d13/f17 x:0 0 0 2024-09-17T01:41:17.205 INFO:tasks.workunit.client.1.smithi167.stdout:4/50: fdatasync d0/f2 0 2024-09-17T01:41:17.207 INFO:tasks.workunit.client.1.smithi167.stdout:6/70: write d7/fe [1034378,91472] 0 2024-09-17T01:41:17.208 INFO:tasks.workunit.client.1.smithi167.stdout:0/60: symlink d5/d8/df/l12 0 2024-09-17T01:41:17.211 INFO:tasks.workunit.client.1.smithi167.stdout:4/51: symlink d0/l15 0 2024-09-17T01:41:17.212 INFO:tasks.workunit.client.1.smithi167.stdout:0/61: readlink d5/d8/df/l12 0 2024-09-17T01:41:17.213 INFO:tasks.workunit.client.1.smithi167.stdout:6/71: mknod d7/d11/d13/c18 0 2024-09-17T01:41:17.214 INFO:tasks.workunit.client.1.smithi167.stdout:8/145: dread dc/f10 [0,4194304] 0 2024-09-17T01:41:17.215 INFO:tasks.workunit.client.1.smithi167.stdout:4/52: rename d0/c11 to d0/d4/c16 0 2024-09-17T01:41:17.215 INFO:tasks.workunit.client.1.smithi167.stdout:1/43: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:17.215 INFO:tasks.workunit.client.1.smithi167.stdout:6/72: chown d7/d11/d13/c18 5968208 1 2024-09-17T01:41:17.216 INFO:tasks.workunit.client.1.smithi167.stdout:4/53: fdatasync d0/fd 0 2024-09-17T01:41:17.217 INFO:tasks.workunit.client.1.smithi167.stdout:8/146: creat dc/f2f x:0 0 0 2024-09-17T01:41:17.218 INFO:tasks.workunit.client.1.smithi167.stdout:8/147: fdatasync fb 0 2024-09-17T01:41:17.218 INFO:tasks.workunit.client.1.smithi167.stdout:6/73: readlink d7/d11/lc 0 2024-09-17T01:41:17.218 INFO:tasks.workunit.client.1.smithi167.stdout:4/54: stat d0/f13 0 2024-09-17T01:41:17.219 INFO:tasks.workunit.client.1.smithi167.stdout:1/44: rmdir d0/d9 39 2024-09-17T01:41:17.221 INFO:tasks.workunit.client.1.smithi167.stdout:8/148: creat dc/d1a/f30 x:0 0 0 2024-09-17T01:41:17.221 INFO:tasks.workunit.client.1.smithi167.stdout:4/55: truncate d0/f3 5142764 0 2024-09-17T01:41:17.222 INFO:tasks.workunit.client.1.smithi167.stdout:6/74: mknod d7/d11/d13/c19 0 2024-09-17T01:41:17.223 INFO:tasks.workunit.client.1.smithi167.stdout:0/62: dwrite d5/fd [0,4194304] 0 2024-09-17T01:41:17.224 INFO:tasks.workunit.client.1.smithi167.stdout:1/45: rename d0/d5/cc to d0/d5/cf 0 2024-09-17T01:41:17.225 INFO:tasks.workunit.client.1.smithi167.stdout:8/149: creat dc/d21/f31 x:0 0 0 2024-09-17T01:41:17.225 INFO:tasks.workunit.client.1.smithi167.stdout:0/63: fdatasync d5/d8/f10 0 2024-09-17T01:41:17.225 INFO:tasks.workunit.client.1.smithi167.stdout:6/75: symlink d7/d11/d13/l1a 0 2024-09-17T01:41:17.226 INFO:tasks.workunit.client.1.smithi167.stdout:4/56: dread d0/f2 [0,4194304] 0 2024-09-17T01:41:17.228 INFO:tasks.workunit.client.1.smithi167.stdout:1/46: write d0/d9/fb [2343377,85813] 0 2024-09-17T01:41:17.228 INFO:tasks.workunit.client.1.smithi167.stdout:0/64: write d5/f6 [812557,108086] 0 2024-09-17T01:41:17.228 INFO:tasks.workunit.client.1.smithi167.stdout:8/150: unlink dc/d1a/f28 0 2024-09-17T01:41:17.232 INFO:tasks.workunit.client.1.smithi167.stdout:4/57: creat d0/d4/d7/f17 x:0 0 0 2024-09-17T01:41:17.232 INFO:tasks.workunit.client.1.smithi167.stdout:1/47: dread - d0/d5/fd zero size 2024-09-17T01:41:17.235 INFO:tasks.workunit.client.1.smithi167.stdout:0/65: symlink d5/d8/df/l13 0 2024-09-17T01:41:17.237 INFO:tasks.workunit.client.1.smithi167.stdout:1/48: mknod d0/d5/c10 0 2024-09-17T01:41:17.237 INFO:tasks.workunit.client.1.smithi167.stdout:6/76: dwrite d7/fe [0,4194304] 0 2024-09-17T01:41:17.239 INFO:tasks.workunit.client.1.smithi167.stdout:4/58: mknod d0/d4/d7/d6/c18 0 2024-09-17T01:41:17.244 INFO:tasks.workunit.client.1.smithi167.stdout:4/59: write d0/fd [438997,69469] 0 2024-09-17T01:41:17.247 INFO:tasks.workunit.client.1.smithi167.stdout:0/66: getdents d5/d8 0 2024-09-17T01:41:17.252 INFO:tasks.workunit.client.1.smithi167.stdout:0/67: symlink d5/d8/l14 0 2024-09-17T01:41:17.253 INFO:tasks.workunit.client.1.smithi167.stdout:8/151: dwrite dc/d21/f31 [0,4194304] 0 2024-09-17T01:41:17.253 INFO:tasks.workunit.client.1.smithi167.stdout:4/60: chown d0/d4/d7/f17 5327672 1 2024-09-17T01:41:17.257 INFO:tasks.workunit.client.1.smithi167.stdout:8/152: creat dc/f32 x:0 0 0 2024-09-17T01:41:17.259 INFO:tasks.workunit.client.1.smithi167.stdout:0/68: write d5/d8/d9/f11 [247174,126508] 0 2024-09-17T01:41:17.260 INFO:tasks.workunit.client.1.smithi167.stdout:1/49: dwrite d0/d5/fd [0,4194304] 0 2024-09-17T01:41:17.261 INFO:tasks.workunit.client.1.smithi167.stdout:8/153: dread - dc/f1b zero size 2024-09-17T01:41:17.262 INFO:tasks.workunit.client.1.smithi167.stdout:6/77: dwrite d7/d11/d13/f17 [0,4194304] 0 2024-09-17T01:41:17.263 INFO:tasks.workunit.client.1.smithi167.stdout:4/61: write d0/f2 [1018886,21660] 0 2024-09-17T01:41:17.265 INFO:tasks.workunit.client.1.smithi167.stdout:0/69: mknod d5/d8/d9/c15 0 2024-09-17T01:41:17.267 INFO:tasks.workunit.client.1.smithi167.stdout:4/62: mkdir d0/d4/d7/d10/d19 0 2024-09-17T01:41:17.269 INFO:tasks.workunit.client.1.smithi167.stdout:2/99: sync 2024-09-17T01:41:17.270 INFO:tasks.workunit.client.1.smithi167.stdout:4/63: dread - d0/d4/d7/ff zero size 2024-09-17T01:41:17.272 INFO:tasks.workunit.client.1.smithi167.stdout:0/70: getdents d5 0 2024-09-17T01:41:17.272 INFO:tasks.workunit.client.1.smithi167.stdout:2/100: dread - d5/d8/f17 zero size 2024-09-17T01:41:17.273 INFO:tasks.workunit.client.1.smithi167.stdout:4/64: read d0/f3 [3890031,74604] 0 2024-09-17T01:41:17.274 INFO:tasks.workunit.client.1.smithi167.stdout:8/154: dwrite dc/f29 [0,4194304] 0 2024-09-17T01:41:17.277 INFO:tasks.workunit.client.1.smithi167.stdout:4/65: symlink d0/l1a 0 2024-09-17T01:41:17.277 INFO:tasks.workunit.client.1.smithi167.stdout:4/66: readlink d0/l1 0 2024-09-17T01:41:17.277 INFO:tasks.workunit.client.1.smithi167.stdout:8/155: creat dc/d18/f33 x:0 0 0 2024-09-17T01:41:17.279 INFO:tasks.workunit.client.1.smithi167.stdout:2/101: creat d5/d1f/f20 x:0 0 0 2024-09-17T01:41:17.279 INFO:tasks.workunit.client.1.smithi167.stdout:0/71: getdents d5 0 2024-09-17T01:41:17.280 INFO:tasks.workunit.client.1.smithi167.stdout:4/67: creat d0/d4/d7/f1b x:0 0 0 2024-09-17T01:41:17.281 INFO:tasks.workunit.client.1.smithi167.stdout:2/102: write d5/d10/d16/f18 [4000627,35128] 0 2024-09-17T01:41:17.283 INFO:tasks.workunit.client.1.smithi167.stdout:8/156: link dc/d21/f31 dc/d21/f34 0 2024-09-17T01:41:17.283 INFO:tasks.workunit.client.1.smithi167.stdout:4/68: truncate d0/d4/d7/f17 441751 0 2024-09-17T01:41:17.285 INFO:tasks.workunit.client.1.smithi167.stdout:2/103: stat d5/d8/l1d 0 2024-09-17T01:41:17.286 INFO:tasks.workunit.client.1.smithi167.stdout:4/69: dread - d0/d4/d7/f1b zero size 2024-09-17T01:41:17.286 INFO:tasks.workunit.client.1.smithi167.stdout:8/157: write dc/d1a/f30 [894455,24155] 0 2024-09-17T01:41:17.288 INFO:tasks.workunit.client.1.smithi167.stdout:2/104: chown d5/f7 86460657 1 2024-09-17T01:41:17.288 INFO:tasks.workunit.client.1.smithi167.stdout:1/50: fdatasync d0/d5/fd 0 2024-09-17T01:41:17.289 INFO:tasks.workunit.client.1.smithi167.stdout:8/158: readlink dc/l27 0 2024-09-17T01:41:17.290 INFO:tasks.workunit.client.1.smithi167.stdout:1/51: stat d0/fa 0 2024-09-17T01:41:17.290 INFO:tasks.workunit.client.1.smithi167.stdout:0/72: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T01:41:17.291 INFO:tasks.workunit.client.1.smithi167.stdout:4/70: chown d0/d4/d7/f1b 1 1 2024-09-17T01:41:17.291 INFO:tasks.workunit.client.1.smithi167.stdout:2/105: creat d5/d1f/f21 x:0 0 0 2024-09-17T01:41:17.293 INFO:tasks.workunit.client.1.smithi167.stdout:8/159: creat dc/d21/f35 x:0 0 0 2024-09-17T01:41:17.293 INFO:tasks.workunit.client.1.smithi167.stdout:4/71: truncate d0/d4/d7/f17 460802 0 2024-09-17T01:41:17.350 INFO:tasks.workunit.client.1.smithi167.stdout:1/52: mkdir d0/d9/d11 0 2024-09-17T01:41:17.351 INFO:tasks.workunit.client.1.smithi167.stdout:8/160: dread - dc/d18/f2d zero size 2024-09-17T01:41:17.352 INFO:tasks.workunit.client.1.smithi167.stdout:4/72: chown d0/d4/d7/d10/d19 222 1 2024-09-17T01:41:17.353 INFO:tasks.workunit.client.1.smithi167.stdout:8/161: chown dc/f19 24042 1 2024-09-17T01:41:17.353 INFO:tasks.workunit.client.1.smithi167.stdout:1/53: truncate d0/fa 35409 0 2024-09-17T01:41:17.355 INFO:tasks.workunit.client.1.smithi167.stdout:0/73: dread d5/d8/f10 [0,4194304] 0 2024-09-17T01:41:17.355 INFO:tasks.workunit.client.1.smithi167.stdout:0/74: stat d5/f6 0 2024-09-17T01:41:17.356 INFO:tasks.workunit.client.1.smithi167.stdout:4/73: truncate d0/d4/d7/f17 1002406 0 2024-09-17T01:41:17.357 INFO:tasks.workunit.client.1.smithi167.stdout:2/106: dwrite d5/d10/d16/f19 [0,4194304] 0 2024-09-17T01:41:17.357 INFO:tasks.workunit.client.1.smithi167.stdout:1/54: truncate d0/d5/fd 5081971 0 2024-09-17T01:41:17.359 INFO:tasks.workunit.client.1.smithi167.stdout:1/55: stat d0/d9 0 2024-09-17T01:41:17.361 INFO:tasks.workunit.client.1.smithi167.stdout:2/107: chown d5/d8/lf 712980 1 2024-09-17T01:41:17.362 INFO:tasks.workunit.client.1.smithi167.stdout:4/74: mknod d0/d4/d7/d10/c1c 0 2024-09-17T01:41:17.364 INFO:tasks.workunit.client.1.smithi167.stdout:4/75: dread - d0/d4/d7/ff zero size 2024-09-17T01:41:17.366 INFO:tasks.workunit.client.1.smithi167.stdout:8/162: dwrite dc/f17 [0,4194304] 0 2024-09-17T01:41:17.368 INFO:tasks.workunit.client.1.smithi167.stdout:0/75: dread d5/fd [0,4194304] 0 2024-09-17T01:41:17.369 INFO:tasks.workunit.client.1.smithi167.stdout:4/76: creat d0/d4/d7/d6/f1d x:0 0 0 2024-09-17T01:41:17.370 INFO:tasks.workunit.client.1.smithi167.stdout:8/163: rename dc/f32 to dc/f36 0 2024-09-17T01:41:17.370 INFO:tasks.workunit.client.1.smithi167.stdout:0/76: chown d5/ce 1017 1 2024-09-17T01:41:17.371 INFO:tasks.workunit.client.1.smithi167.stdout:1/56: dwrite d0/d5/fd [0,4194304] 0 2024-09-17T01:41:17.372 INFO:tasks.workunit.client.1.smithi167.stdout:8/164: symlink dc/d21/l37 0 2024-09-17T01:41:17.373 INFO:tasks.workunit.client.1.smithi167.stdout:0/77: write d5/f7 [3499746,54526] 0 2024-09-17T01:41:17.373 INFO:tasks.workunit.client.1.smithi167.stdout:2/108: fdatasync d5/d10/d16/f19 0 2024-09-17T01:41:17.376 INFO:tasks.workunit.client.1.smithi167.stdout:8/165: mknod dc/d18/c38 0 2024-09-17T01:41:17.377 INFO:tasks.workunit.client.1.smithi167.stdout:4/77: link d0/d4/cb d0/d4/d7/d10/c1e 0 2024-09-17T01:41:17.380 INFO:tasks.workunit.client.1.smithi167.stdout:8/166: write dc/f15 [3975757,74524] 0 2024-09-17T01:41:17.380 INFO:tasks.workunit.client.1.smithi167.stdout:4/78: chown d0/fd 30420857 1 2024-09-17T01:41:17.383 INFO:tasks.workunit.client.1.smithi167.stdout:1/57: dwrite d0/d5/fd [0,4194304] 0 2024-09-17T01:41:17.384 INFO:tasks.workunit.client.1.smithi167.stdout:8/167: symlink dc/l39 0 2024-09-17T01:41:17.386 INFO:tasks.workunit.client.1.smithi167.stdout:4/79: write d0/d4/f12 [1550942,124609] 0 2024-09-17T01:41:17.388 INFO:tasks.workunit.client.1.smithi167.stdout:0/78: dwrite d5/d8/d9/f11 [0,4194304] 0 2024-09-17T01:41:17.389 INFO:tasks.workunit.client.1.smithi167.stdout:1/58: creat d0/d5/f12 x:0 0 0 2024-09-17T01:41:17.391 INFO:tasks.workunit.client.1.smithi167.stdout:4/80: chown d0/d4/d7/d6/f1d 4746998 1 2024-09-17T01:41:17.391 INFO:tasks.workunit.client.1.smithi167.stdout:0/79: rmdir d5 39 2024-09-17T01:41:17.391 INFO:tasks.workunit.client.1.smithi167.stdout:2/109: dread d5/fe [0,4194304] 0 2024-09-17T01:41:17.391 INFO:tasks.workunit.client.1.smithi167.stdout:1/59: chown d0/ce 30315 1 2024-09-17T01:41:17.394 INFO:tasks.workunit.client.1.smithi167.stdout:4/81: fsync d0/f3 0 2024-09-17T01:41:17.394 INFO:tasks.workunit.client.1.smithi167.stdout:0/80: readlink d5/d8/l14 0 2024-09-17T01:41:17.394 INFO:tasks.workunit.client.1.smithi167.stdout:7/70: sync 2024-09-17T01:41:17.396 INFO:tasks.workunit.client.1.smithi167.stdout:2/110: creat d5/d10/f22 x:0 0 0 2024-09-17T01:41:17.399 INFO:tasks.workunit.client.1.smithi167.stdout:1/60: mknod d0/d9/d11/c13 0 2024-09-17T01:41:17.400 INFO:tasks.workunit.client.1.smithi167.stdout:7/71: rename d0/d2 to d0/d2/d14/d15 22 2024-09-17T01:41:17.401 INFO:tasks.workunit.client.1.smithi167.stdout:4/82: mknod d0/d4/d7/d6/c1f 0 2024-09-17T01:41:17.403 INFO:tasks.workunit.client.1.smithi167.stdout:1/61: write d0/d9/fb [4201115,6721] 0 2024-09-17T01:41:17.404 INFO:tasks.workunit.client.1.smithi167.stdout:0/81: link d5/ce d5/d8/c16 0 2024-09-17T01:41:17.404 INFO:tasks.workunit.client.1.smithi167.stdout:4/83: chown d0/l1 691 1 2024-09-17T01:41:17.404 INFO:tasks.workunit.client.1.smithi167.stdout:8/168: dwrite dc/d21/f35 [0,4194304] 0 2024-09-17T01:41:17.407 INFO:tasks.workunit.client.1.smithi167.stdout:7/72: creat d0/d2/d14/f16 x:0 0 0 2024-09-17T01:41:17.407 INFO:tasks.workunit.client.1.smithi167.stdout:4/84: readlink d0/d4/lc 0 2024-09-17T01:41:17.407 INFO:tasks.workunit.client.1.smithi167.stdout:0/82: write d5/f6 [3519717,54883] 0 2024-09-17T01:41:17.409 INFO:tasks.workunit.client.1.smithi167.stdout:1/62: write d0/d9/fb [2163636,20887] 0 2024-09-17T01:41:17.411 INFO:tasks.workunit.client.1.smithi167.stdout:4/85: symlink d0/d4/d7/d10/l20 0 2024-09-17T01:41:17.413 INFO:tasks.workunit.client.1.smithi167.stdout:1/63: unlink d0/fa 0 2024-09-17T01:41:17.413 INFO:tasks.workunit.client.1.smithi167.stdout:8/169: dread f7 [0,4194304] 0 2024-09-17T01:41:17.414 INFO:tasks.workunit.client.1.smithi167.stdout:7/73: creat d0/d2/f17 x:0 0 0 2024-09-17T01:41:17.415 INFO:tasks.workunit.client.1.smithi167.stdout:7/74: chown d0 0 1 2024-09-17T01:41:17.416 INFO:tasks.workunit.client.1.smithi167.stdout:1/64: write d0/d5/fd [2061537,21699] 0 2024-09-17T01:41:17.417 INFO:tasks.workunit.client.1.smithi167.stdout:4/86: mknod d0/d4/d7/d10/c21 0 2024-09-17T01:41:17.417 INFO:tasks.workunit.client.1.smithi167.stdout:7/75: dread - d0/d2/f17 zero size 2024-09-17T01:41:17.418 INFO:tasks.workunit.client.1.smithi167.stdout:0/83: dread d5/fd [0,4194304] 0 2024-09-17T01:41:17.419 INFO:tasks.workunit.client.1.smithi167.stdout:1/65: creat d0/d9/d11/f14 x:0 0 0 2024-09-17T01:41:17.419 INFO:tasks.workunit.client.1.smithi167.stdout:0/84: stat d5/d8/d9/c15 0 2024-09-17T01:41:17.420 INFO:tasks.workunit.client.1.smithi167.stdout:7/76: creat d0/d2/d14/f18 x:0 0 0 2024-09-17T01:41:17.420 INFO:tasks.workunit.client.1.smithi167.stdout:1/66: dread - d0/d5/f12 zero size 2024-09-17T01:41:17.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/170: dread dc/fd [0,4194304] 0 2024-09-17T01:41:17.421 INFO:tasks.workunit.client.1.smithi167.stdout:4/87: rename d0/d4/d7/d10/c21 to d0/d4/c22 0 2024-09-17T01:41:17.422 INFO:tasks.workunit.client.1.smithi167.stdout:0/85: mknod d5/d8/d9/c17 0 2024-09-17T01:41:17.422 INFO:tasks.workunit.client.1.smithi167.stdout:7/77: mkdir d0/d2/d14/d19 0 2024-09-17T01:41:17.424 INFO:tasks.workunit.client.1.smithi167.stdout:1/67: fdatasync d0/d9/fb 0 2024-09-17T01:41:17.424 INFO:tasks.workunit.client.1.smithi167.stdout:4/88: rmdir d0/d4/d7/d6 39 2024-09-17T01:41:17.424 INFO:tasks.workunit.client.1.smithi167.stdout:1/68: chown d0 23675977 1 2024-09-17T01:41:17.424 INFO:tasks.workunit.client.1.smithi167.stdout:8/171: rename dc/f16 to dc/d21/f3a 0 2024-09-17T01:41:17.425 INFO:tasks.workunit.client.1.smithi167.stdout:1/69: chown d0 32 1 2024-09-17T01:41:17.425 INFO:tasks.workunit.client.1.smithi167.stdout:0/86: rmdir d5/d8/df 39 2024-09-17T01:41:17.427 INFO:tasks.workunit.client.1.smithi167.stdout:7/78: mknod d0/d2/d14/c1a 0 2024-09-17T01:41:17.428 INFO:tasks.workunit.client.1.smithi167.stdout:2/111: truncate d5/f7 2136017 0 2024-09-17T01:41:17.429 INFO:tasks.workunit.client.1.smithi167.stdout:1/70: chown d0/d5/cf 266 1 2024-09-17T01:41:17.429 INFO:tasks.workunit.client.1.smithi167.stdout:0/87: dread d5/f6 [0,4194304] 0 2024-09-17T01:41:17.431 INFO:tasks.workunit.client.1.smithi167.stdout:1/71: write d0/d9/d11/f14 [623682,45797] 0 2024-09-17T01:41:17.431 INFO:tasks.workunit.client.1.smithi167.stdout:7/79: creat d0/d2/d14/f1b x:0 0 0 2024-09-17T01:41:17.435 INFO:tasks.workunit.client.1.smithi167.stdout:0/88: unlink d5/d8/d9/f11 0 2024-09-17T01:41:17.436 INFO:tasks.workunit.client.1.smithi167.stdout:1/72: symlink d0/d9/l15 0 2024-09-17T01:41:17.436 INFO:tasks.workunit.client.1.smithi167.stdout:2/112: dwrite d5/d8/f9 [4194304,4194304] 0 2024-09-17T01:41:17.438 INFO:tasks.workunit.client.1.smithi167.stdout:7/80: fsync d0/d2/d14/f18 0 2024-09-17T01:41:17.438 INFO:tasks.workunit.client.1.smithi167.stdout:0/89: write d5/fd [4917393,1435] 0 2024-09-17T01:41:17.438 INFO:tasks.workunit.client.1.smithi167.stdout:1/73: mkdir d0/d9/d16 0 2024-09-17T01:41:17.439 INFO:tasks.workunit.client.1.smithi167.stdout:2/113: truncate d5/fe 1956973 0 2024-09-17T01:41:17.442 INFO:tasks.workunit.client.1.smithi167.stdout:8/172: getdents dc 0 2024-09-17T01:41:17.443 INFO:tasks.workunit.client.1.smithi167.stdout:2/114: mknod d5/c23 0 2024-09-17T01:41:17.446 INFO:tasks.workunit.client.1.smithi167.stdout:2/115: chown d5/d8/c11 898287 1 2024-09-17T01:41:17.448 INFO:tasks.workunit.client.1.smithi167.stdout:1/74: truncate d0/d9/fb 4171974 0 2024-09-17T01:41:17.448 INFO:tasks.workunit.client.1.smithi167.stdout:0/90: dread d5/d8/f10 [0,4194304] 0 2024-09-17T01:41:17.449 INFO:tasks.workunit.client.1.smithi167.stdout:7/81: dwrite d0/d2/f17 [0,4194304] 0 2024-09-17T01:41:17.450 INFO:tasks.workunit.client.1.smithi167.stdout:4/89: truncate d0/d4/d7/f17 494324 0 2024-09-17T01:41:17.450 INFO:tasks.workunit.client.1.smithi167.stdout:8/173: creat dc/d18/f3b x:0 0 0 2024-09-17T01:41:17.453 INFO:tasks.workunit.client.1.smithi167.stdout:2/116: creat d5/d10/d16/f24 x:0 0 0 2024-09-17T01:41:17.453 INFO:tasks.workunit.client.1.smithi167.stdout:7/82: fsync d0/d2/d14/f1b 0 2024-09-17T01:41:17.455 INFO:tasks.workunit.client.1.smithi167.stdout:0/91: chown d5/d8/df 18476 1 2024-09-17T01:41:17.455 INFO:tasks.workunit.client.1.smithi167.stdout:1/75: creat d0/f17 x:0 0 0 2024-09-17T01:41:17.457 INFO:tasks.workunit.client.1.smithi167.stdout:8/174: rename dc/d21/f35 to dc/f3c 0 2024-09-17T01:41:17.459 INFO:tasks.workunit.client.1.smithi167.stdout:7/83: dread d0/d2/de/ff [0,4194304] 0 2024-09-17T01:41:17.461 INFO:tasks.workunit.client.1.smithi167.stdout:1/76: write d0/d9/d11/f14 [1308010,32473] 0 2024-09-17T01:41:17.461 INFO:tasks.workunit.client.1.smithi167.stdout:8/175: fdatasync dc/d21/f25 0 2024-09-17T01:41:17.465 INFO:tasks.workunit.client.1.smithi167.stdout:7/84: readlink d0/d2/l11 0 2024-09-17T01:41:17.467 INFO:tasks.workunit.client.1.smithi167.stdout:4/90: dwrite d0/d4/d7/ff [0,4194304] 0 2024-09-17T01:41:17.472 INFO:tasks.workunit.client.1.smithi167.stdout:0/92: dwrite d5/d8/f10 [0,4194304] 0 2024-09-17T01:41:17.473 INFO:tasks.workunit.client.1.smithi167.stdout:0/93: readlink d5/d8/l14 0 2024-09-17T01:41:17.480 INFO:tasks.workunit.client.1.smithi167.stdout:9/55: sync 2024-09-17T01:41:17.486 INFO:tasks.workunit.client.1.smithi167.stdout:2/117: link d5/c23 d5/d10/d16/c25 0 2024-09-17T01:41:17.491 INFO:tasks.workunit.client.1.smithi167.stdout:0/94: mknod d5/c18 0 2024-09-17T01:41:17.493 INFO:tasks.workunit.client.1.smithi167.stdout:8/176: write dc/ff [1484967,28033] 0 2024-09-17T01:41:17.493 INFO:tasks.workunit.client.1.smithi167.stdout:1/77: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:17.495 INFO:tasks.workunit.client.1.smithi167.stdout:9/56: write f2 [546594,62763] 0 2024-09-17T01:41:17.496 INFO:tasks.workunit.client.1.smithi167.stdout:9/57: write f2 [525912,125398] 0 2024-09-17T01:41:17.496 INFO:tasks.workunit.client.1.smithi167.stdout:4/91: creat d0/d4/d7/f23 x:0 0 0 2024-09-17T01:41:17.497 INFO:tasks.workunit.client.1.smithi167.stdout:1/78: rmdir d0 39 2024-09-17T01:41:17.497 INFO:tasks.workunit.client.1.smithi167.stdout:8/177: symlink dc/d1a/l3d 0 2024-09-17T01:41:17.498 INFO:tasks.workunit.client.1.smithi167.stdout:4/92: fdatasync d0/d4/f12 0 2024-09-17T01:41:17.498 INFO:tasks.workunit.client.1.smithi167.stdout:7/85: getdents d0/d2/d14 0 2024-09-17T01:41:17.500 INFO:tasks.workunit.client.1.smithi167.stdout:8/178: mknod dc/c3e 0 2024-09-17T01:41:17.500 INFO:tasks.workunit.client.1.smithi167.stdout:2/118: getdents d5 0 2024-09-17T01:41:17.501 INFO:tasks.workunit.client.1.smithi167.stdout:1/79: mknod d0/d9/c18 0 2024-09-17T01:41:17.502 INFO:tasks.workunit.client.1.smithi167.stdout:0/95: dread d5/f6 [0,4194304] 0 2024-09-17T01:41:17.503 INFO:tasks.workunit.client.1.smithi167.stdout:8/179: mknod dc/c3f 0 2024-09-17T01:41:17.503 INFO:tasks.workunit.client.1.smithi167.stdout:4/93: creat d0/d4/d7/d10/d19/f24 x:0 0 0 2024-09-17T01:41:17.504 INFO:tasks.workunit.client.1.smithi167.stdout:2/119: creat d5/d1f/f26 x:0 0 0 2024-09-17T01:41:17.504 INFO:tasks.workunit.client.1.smithi167.stdout:8/180: write dc/f12 [2805358,49211] 0 2024-09-17T01:41:17.505 INFO:tasks.workunit.client.1.smithi167.stdout:7/86: rename d0/d2/fd to d0/d2/de/f1c 0 2024-09-17T01:41:17.506 INFO:tasks.workunit.client.1.smithi167.stdout:9/58: dwrite f1 [0,4194304] 0 2024-09-17T01:41:17.523 INFO:tasks.workunit.client.1.smithi167.stdout:8/181: symlink dc/d1a/l40 0 2024-09-17T01:41:17.523 INFO:tasks.workunit.client.1.smithi167.stdout:4/94: write d0/d4/d7/d10/d19/f24 [1046830,54720] 0 2024-09-17T01:41:17.523 INFO:tasks.workunit.client.1.smithi167.stdout:9/59: truncate f2 920365 0 2024-09-17T01:41:17.526 INFO:tasks.workunit.client.1.smithi167.stdout:0/96: rename d5/d8/df to d5/d8/d9/d19 0 2024-09-17T01:41:17.527 INFO:tasks.workunit.client.1.smithi167.stdout:9/60: symlink d4/d9/ld 0 2024-09-17T01:41:17.527 INFO:tasks.workunit.client.1.smithi167.stdout:7/87: mknod d0/d2/d14/d19/c1d 0 2024-09-17T01:41:17.531 INFO:tasks.workunit.client.1.smithi167.stdout:4/95: link d0/l15 d0/d4/d7/da/l25 0 2024-09-17T01:41:17.532 INFO:tasks.workunit.client.1.smithi167.stdout:9/61: symlink d4/d9/le 0 2024-09-17T01:41:17.533 INFO:tasks.workunit.client.1.smithi167.stdout:7/88: unlink d0/cb 0 2024-09-17T01:41:17.536 INFO:tasks.workunit.client.1.smithi167.stdout:9/62: fsync f1 0 2024-09-17T01:41:17.536 INFO:tasks.workunit.client.1.smithi167.stdout:8/182: dwrite dc/f12 [4194304,4194304] 0 2024-09-17T01:41:17.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/120: dwrite d5/fe [0,4194304] 0 2024-09-17T01:41:17.541 INFO:tasks.workunit.client.1.smithi167.stdout:7/89: write d0/d2/d14/f18 [80489,107322] 0 2024-09-17T01:41:17.543 INFO:tasks.workunit.client.1.smithi167.stdout:4/96: rename d0/d4/f12 to d0/d4/d7/f26 0 2024-09-17T01:41:17.544 INFO:tasks.workunit.client.1.smithi167.stdout:8/183: symlink dc/d21/l41 0 2024-09-17T01:41:17.545 INFO:tasks.workunit.client.1.smithi167.stdout:2/121: dread d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:17.546 INFO:tasks.workunit.client.1.smithi167.stdout:8/184: fsync f8 0 2024-09-17T01:41:17.547 INFO:tasks.workunit.client.1.smithi167.stdout:2/122: chown d5/d1f 28772 1 2024-09-17T01:41:17.547 INFO:tasks.workunit.client.1.smithi167.stdout:7/90: creat d0/d2/d14/d19/f1e x:0 0 0 2024-09-17T01:41:17.548 INFO:tasks.workunit.client.1.smithi167.stdout:0/97: dwrite d5/f6 [0,4194304] 0 2024-09-17T01:41:17.550 INFO:tasks.workunit.client.1.smithi167.stdout:9/63: getdents d4/d9 0 2024-09-17T01:41:17.551 INFO:tasks.workunit.client.1.smithi167.stdout:2/123: mknod d5/d10/c27 0 2024-09-17T01:41:17.552 INFO:tasks.workunit.client.1.smithi167.stdout:2/124: stat d5/d10/c12 0 2024-09-17T01:41:17.552 INFO:tasks.workunit.client.1.smithi167.stdout:8/185: mknod dc/d18/c42 0 2024-09-17T01:41:17.552 INFO:tasks.workunit.client.1.smithi167.stdout:2/125: chown d5/d10/d16/f1b 24779 1 2024-09-17T01:41:17.553 INFO:tasks.workunit.client.1.smithi167.stdout:7/91: rename d0/d2/de to d0/d2/d14/d1f 0 2024-09-17T01:41:17.554 INFO:tasks.workunit.client.1.smithi167.stdout:0/98: creat d5/d8/d9/f1a x:0 0 0 2024-09-17T01:41:17.555 INFO:tasks.workunit.client.1.smithi167.stdout:9/64: creat d4/ff x:0 0 0 2024-09-17T01:41:17.557 INFO:tasks.workunit.client.1.smithi167.stdout:9/65: fsync f2 0 2024-09-17T01:41:17.557 INFO:tasks.workunit.client.1.smithi167.stdout:7/92: symlink d0/d2/d14/d19/l20 0 2024-09-17T01:41:17.559 INFO:tasks.workunit.client.1.smithi167.stdout:0/99: rename d5/d8/d9 to d5/d8/d9/d19/d1b 22 2024-09-17T01:41:17.561 INFO:tasks.workunit.client.1.smithi167.stdout:7/93: creat d0/d2/f21 x:0 0 0 2024-09-17T01:41:17.562 INFO:tasks.workunit.client.1.smithi167.stdout:9/66: unlink d4/l7 0 2024-09-17T01:41:17.563 INFO:tasks.workunit.client.1.smithi167.stdout:5/56: sync 2024-09-17T01:41:17.563 INFO:tasks.workunit.client.1.smithi167.stdout:3/32: sync 2024-09-17T01:41:17.563 INFO:tasks.workunit.client.1.smithi167.stdout:6/78: sync 2024-09-17T01:41:17.563 INFO:tasks.workunit.client.1.smithi167.stdout:8/186: dwrite dc/d18/f2d [0,4194304] 0 2024-09-17T01:41:17.565 INFO:tasks.workunit.client.1.smithi167.stdout:0/100: rename d5/c18 to d5/d8/d9/d19/c1c 0 2024-09-17T01:41:17.565 INFO:tasks.workunit.client.1.smithi167.stdout:5/57: read d0/f8 [594228,44371] 0 2024-09-17T01:41:17.565 INFO:tasks.workunit.client.1.smithi167.stdout:3/33: write f1 [867645,102079] 0 2024-09-17T01:41:17.566 INFO:tasks.workunit.client.1.smithi167.stdout:6/79: read d7/d11/ff [409778,31822] 0 2024-09-17T01:41:17.566 INFO:tasks.workunit.client.1.smithi167.stdout:9/67: write d4/f8 [131389,116248] 0 2024-09-17T01:41:17.567 INFO:tasks.workunit.client.1.smithi167.stdout:7/94: mkdir d0/d2/d14/d19/d22 0 2024-09-17T01:41:17.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/34: symlink l5 0 2024-09-17T01:41:17.570 INFO:tasks.workunit.client.1.smithi167.stdout:8/187: write dc/d21/f3a [956679,56281] 0 2024-09-17T01:41:17.570 INFO:tasks.workunit.client.1.smithi167.stdout:7/95: chown d0/d2/d14/d1f/ff 347201 1 2024-09-17T01:41:17.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/58: mkdir d0/d9 0 2024-09-17T01:41:17.573 INFO:tasks.workunit.client.1.smithi167.stdout:9/68: dread f2 [0,4194304] 0 2024-09-17T01:41:17.576 INFO:tasks.workunit.client.1.smithi167.stdout:0/101: unlink d5/d8/f10 0 2024-09-17T01:41:17.576 INFO:tasks.workunit.client.1.smithi167.stdout:2/126: write d5/d10/d16/f1b [564158,51098] 0 2024-09-17T01:41:17.577 INFO:tasks.workunit.client.1.smithi167.stdout:4/97: dwrite d0/d4/d7/f17 [0,4194304] 0 2024-09-17T01:41:17.579 INFO:tasks.workunit.client.1.smithi167.stdout:3/35: creat f6 x:0 0 0 2024-09-17T01:41:17.580 INFO:tasks.workunit.client.1.smithi167.stdout:9/69: dread d4/f8 [0,4194304] 0 2024-09-17T01:41:17.581 INFO:tasks.workunit.client.1.smithi167.stdout:7/96: mkdir d0/d2/d14/d23 0 2024-09-17T01:41:17.583 INFO:tasks.workunit.client.1.smithi167.stdout:2/127: fsync d5/d10/d16/f1b 0 2024-09-17T01:41:17.583 INFO:tasks.workunit.client.1.smithi167.stdout:5/59: creat d0/fa x:0 0 0 2024-09-17T01:41:17.588 INFO:tasks.workunit.client.1.smithi167.stdout:0/102: rename d5/f6 to d5/f1d 0 2024-09-17T01:41:17.589 INFO:tasks.workunit.client.1.smithi167.stdout:7/97: chown d0/d2/f8 170494 1 2024-09-17T01:41:17.590 INFO:tasks.workunit.client.1.smithi167.stdout:3/36: mkdir d7 0 2024-09-17T01:41:17.594 INFO:tasks.workunit.client.1.smithi167.stdout:3/37: chown f6 150633 1 2024-09-17T01:41:17.595 INFO:tasks.workunit.client.1.smithi167.stdout:2/128: truncate d5/d1f/f26 786068 0 2024-09-17T01:41:17.596 INFO:tasks.workunit.client.1.smithi167.stdout:5/60: dread d0/f8 [0,4194304] 0 2024-09-17T01:41:17.598 INFO:tasks.workunit.client.1.smithi167.stdout:1/80: sync 2024-09-17T01:41:17.599 INFO:tasks.workunit.client.1.smithi167.stdout:9/70: rename d4/d9/cb to d4/d9/c10 0 2024-09-17T01:41:17.599 INFO:tasks.workunit.client.1.smithi167.stdout:6/80: dwrite d7/fa [0,4194304] 0 2024-09-17T01:41:17.600 INFO:tasks.workunit.client.1.smithi167.stdout:2/129: chown d5/d1f 10521 1 2024-09-17T01:41:17.602 INFO:tasks.workunit.client.1.smithi167.stdout:4/98: dwrite d0/d4/d7/f1b [0,4194304] 0 2024-09-17T01:41:17.603 INFO:tasks.workunit.client.1.smithi167.stdout:7/98: symlink d0/l24 0 2024-09-17T01:41:17.605 INFO:tasks.workunit.client.1.smithi167.stdout:8/188: dwrite dc/f10 [4194304,4194304] 0 2024-09-17T01:41:17.606 INFO:tasks.workunit.client.1.smithi167.stdout:0/103: symlink d5/d8/l1e 0 2024-09-17T01:41:17.606 INFO:tasks.workunit.client.1.smithi167.stdout:3/38: mkdir d7/d8 0 2024-09-17T01:41:17.607 INFO:tasks.workunit.client.1.smithi167.stdout:4/99: chown d0/f13 16457 1 2024-09-17T01:41:17.608 INFO:tasks.workunit.client.1.smithi167.stdout:8/189: chown dc/f36 907003558 1 2024-09-17T01:41:17.608 INFO:tasks.workunit.client.1.smithi167.stdout:2/130: write d5/d1f/f26 [1181625,62203] 0 2024-09-17T01:41:17.609 INFO:tasks.workunit.client.1.smithi167.stdout:5/61: creat d0/d9/fb x:0 0 0 2024-09-17T01:41:17.609 INFO:tasks.workunit.client.1.smithi167.stdout:1/81: symlink d0/d9/d16/l19 0 2024-09-17T01:41:17.610 INFO:tasks.workunit.client.1.smithi167.stdout:4/100: dread - d0/f13 zero size 2024-09-17T01:41:17.610 INFO:tasks.workunit.client.1.smithi167.stdout:6/81: rename d7/fe to d7/d11/f1b 0 2024-09-17T01:41:17.610 INFO:tasks.workunit.client.1.smithi167.stdout:8/190: read dc/f29 [1701412,1213] 0 2024-09-17T01:41:17.611 INFO:tasks.workunit.client.1.smithi167.stdout:0/104: chown d5/ce 3 1 2024-09-17T01:41:17.613 INFO:tasks.workunit.client.1.smithi167.stdout:4/101: fsync d0/fd 0 2024-09-17T01:41:17.614 INFO:tasks.workunit.client.1.smithi167.stdout:1/82: truncate d0/d5/f12 750373 0 2024-09-17T01:41:17.614 INFO:tasks.workunit.client.1.smithi167.stdout:7/99: link d0/f13 d0/d2/d14/d19/d22/f25 0 2024-09-17T01:41:17.615 INFO:tasks.workunit.client.1.smithi167.stdout:2/131: mknod d5/d8/c28 0 2024-09-17T01:41:17.619 INFO:tasks.workunit.client.1.smithi167.stdout:9/71: getdents d4 0 2024-09-17T01:41:17.619 INFO:tasks.workunit.client.1.smithi167.stdout:8/191: symlink dc/d21/l43 0 2024-09-17T01:41:17.619 INFO:tasks.workunit.client.1.smithi167.stdout:1/83: readlink d0/d9/d16/l19 0 2024-09-17T01:41:17.621 INFO:tasks.workunit.client.1.smithi167.stdout:9/72: rename d4/d9 to d4/d9/d11 22 2024-09-17T01:41:17.621 INFO:tasks.workunit.client.1.smithi167.stdout:4/102: read d0/d4/d7/f1b [2461212,80988] 0 2024-09-17T01:41:17.623 INFO:tasks.workunit.client.1.smithi167.stdout:6/82: creat d7/d12/f1c x:0 0 0 2024-09-17T01:41:17.624 INFO:tasks.workunit.client.1.smithi167.stdout:8/192: write dc/d21/f25 [999207,56546] 0 2024-09-17T01:41:17.626 INFO:tasks.workunit.client.1.smithi167.stdout:4/103: chown d0/d4/d7 1 1 2024-09-17T01:41:17.626 INFO:tasks.workunit.client.1.smithi167.stdout:9/73: truncate f2 1758970 0 2024-09-17T01:41:17.630 INFO:tasks.workunit.client.1.smithi167.stdout:5/62: dwrite d0/fa [0,4194304] 0 2024-09-17T01:41:17.631 INFO:tasks.workunit.client.1.smithi167.stdout:3/39: getdents d7 0 2024-09-17T01:41:17.633 INFO:tasks.workunit.client.1.smithi167.stdout:6/83: creat d7/d12/f1d x:0 0 0 2024-09-17T01:41:17.639 INFO:tasks.workunit.client.1.smithi167.stdout:7/100: getdents d0/d2/d14 0 2024-09-17T01:41:17.643 INFO:tasks.workunit.client.1.smithi167.stdout:9/74: symlink d4/d9/l12 0 2024-09-17T01:41:17.643 INFO:tasks.workunit.client.1.smithi167.stdout:0/105: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:41:17.647 INFO:tasks.workunit.client.1.smithi167.stdout:2/132: dwrite d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:17.650 INFO:tasks.workunit.client.1.smithi167.stdout:4/104: dwrite d0/fd [0,4194304] 0 2024-09-17T01:41:17.653 INFO:tasks.workunit.client.1.smithi167.stdout:5/63: chown d0/c7 1 1 2024-09-17T01:41:17.653 INFO:tasks.workunit.client.1.smithi167.stdout:8/193: dwrite dc/d18/f2d [0,4194304] 0 2024-09-17T01:41:17.654 INFO:tasks.workunit.client.1.smithi167.stdout:1/84: rename d0/d5/cf to d0/c1a 0 2024-09-17T01:41:17.658 INFO:tasks.workunit.client.1.smithi167.stdout:9/75: rename d4/d9/le to d4/d9/l13 0 2024-09-17T01:41:17.659 INFO:tasks.workunit.client.1.smithi167.stdout:2/133: creat d5/d10/d16/f29 x:0 0 0 2024-09-17T01:41:17.659 INFO:tasks.workunit.client.1.smithi167.stdout:3/40: symlink d7/d8/l9 0 2024-09-17T01:41:17.659 INFO:tasks.workunit.client.1.smithi167.stdout:6/84: mkdir d7/d1e 0 2024-09-17T01:41:17.660 INFO:tasks.workunit.client.1.smithi167.stdout:4/105: mknod d0/d4/d7/d10/d19/c27 0 2024-09-17T01:41:17.662 INFO:tasks.workunit.client.1.smithi167.stdout:3/41: read f1 [400996,35485] 0 2024-09-17T01:41:17.664 INFO:tasks.workunit.client.1.smithi167.stdout:2/134: chown d5/d10/d16/f29 669120784 1 2024-09-17T01:41:17.664 INFO:tasks.workunit.client.1.smithi167.stdout:5/64: truncate d0/f6 846975 0 2024-09-17T01:41:17.664 INFO:tasks.workunit.client.1.smithi167.stdout:1/85: rename d0/ce to d0/d9/c1b 0 2024-09-17T01:41:17.664 INFO:tasks.workunit.client.1.smithi167.stdout:6/85: write d7/d12/f1c [797724,125042] 0 2024-09-17T01:41:17.666 INFO:tasks.workunit.client.1.smithi167.stdout:9/76: mkdir d4/d9/d14 0 2024-09-17T01:41:17.667 INFO:tasks.workunit.client.1.smithi167.stdout:4/106: creat d0/d4/f28 x:0 0 0 2024-09-17T01:41:17.668 INFO:tasks.workunit.client.1.smithi167.stdout:8/194: dread dc/d21/f31 [0,4194304] 0 2024-09-17T01:41:17.671 INFO:tasks.workunit.client.1.smithi167.stdout:1/86: mknod d0/d9/d11/c1c 0 2024-09-17T01:41:17.672 INFO:tasks.workunit.client.1.smithi167.stdout:3/42: dread f1 [0,4194304] 0 2024-09-17T01:41:17.672 INFO:tasks.workunit.client.1.smithi167.stdout:2/135: rename d5/d10/d16/f24 to d5/f2a 0 2024-09-17T01:41:17.672 INFO:tasks.workunit.client.1.smithi167.stdout:8/195: write dc/d18/f3b [16317,49961] 0 2024-09-17T01:41:17.673 INFO:tasks.workunit.client.1.smithi167.stdout:3/43: write f3 [371500,94965] 0 2024-09-17T01:41:17.674 INFO:tasks.workunit.client.1.smithi167.stdout:3/44: read - f6 zero size 2024-09-17T01:41:17.674 INFO:tasks.workunit.client.1.smithi167.stdout:6/86: mknod d7/d1e/c1f 0 2024-09-17T01:41:17.675 INFO:tasks.workunit.client.1.smithi167.stdout:6/87: write f0 [3030434,101596] 0 2024-09-17T01:41:17.680 INFO:tasks.workunit.client.1.smithi167.stdout:8/196: creat dc/d21/f44 x:0 0 0 2024-09-17T01:41:17.681 INFO:tasks.workunit.client.1.smithi167.stdout:8/197: dread - dc/f36 zero size 2024-09-17T01:41:17.681 INFO:tasks.workunit.client.1.smithi167.stdout:3/45: mkdir d7/da 0 2024-09-17T01:41:17.683 INFO:tasks.workunit.client.1.smithi167.stdout:4/107: creat d0/d4/d7/d6/f29 x:0 0 0 2024-09-17T01:41:17.683 INFO:tasks.workunit.client.1.smithi167.stdout:7/101: dwrite d0/d2/d14/d1f/f1c [0,4194304] 0 2024-09-17T01:41:17.684 INFO:tasks.workunit.client.1.smithi167.stdout:1/87: rename d0/d9/c1b to d0/d9/c1d 0 2024-09-17T01:41:17.688 INFO:tasks.workunit.client.1.smithi167.stdout:8/198: mkdir dc/d1a/d45 0 2024-09-17T01:41:17.688 INFO:tasks.workunit.client.1.smithi167.stdout:3/46: write f1 [323909,71828] 0 2024-09-17T01:41:17.689 INFO:tasks.workunit.client.1.smithi167.stdout:1/88: truncate d0/f17 104270 0 2024-09-17T01:41:17.693 INFO:tasks.workunit.client.1.smithi167.stdout:6/88: getdents d7 0 2024-09-17T01:41:17.694 INFO:tasks.workunit.client.1.smithi167.stdout:8/199: chown dc/d18/f2e 9818886 1 2024-09-17T01:41:17.695 INFO:tasks.workunit.client.1.smithi167.stdout:1/89: fdatasync d0/d9/d11/f14 0 2024-09-17T01:41:17.695 INFO:tasks.workunit.client.1.smithi167.stdout:7/102: rename d0/d2/d14/d1f to d0/d2/d14/d19/d26 0 2024-09-17T01:41:17.698 INFO:tasks.workunit.client.1.smithi167.stdout:5/65: dwrite d0/f3 [4194304,4194304] 0 2024-09-17T01:41:17.700 INFO:tasks.workunit.client.1.smithi167.stdout:6/89: symlink d7/l20 0 2024-09-17T01:41:17.702 INFO:tasks.workunit.client.1.smithi167.stdout:3/47: dread f3 [0,4194304] 0 2024-09-17T01:41:17.705 INFO:tasks.workunit.client.1.smithi167.stdout:1/90: write d0/d5/f12 [1666167,38960] 0 2024-09-17T01:41:17.706 INFO:tasks.workunit.client.1.smithi167.stdout:9/77: dwrite d4/f8 [0,4194304] 0 2024-09-17T01:41:17.708 INFO:tasks.workunit.client.1.smithi167.stdout:4/108: dwrite d0/d4/d7/d6/f29 [0,4194304] 0 2024-09-17T01:41:17.710 INFO:tasks.workunit.client.1.smithi167.stdout:5/66: stat d0/c7 0 2024-09-17T01:41:17.720 INFO:tasks.workunit.client.1.smithi167.stdout:7/103: unlink d0/d2/l11 0 2024-09-17T01:41:17.723 INFO:tasks.workunit.client.1.smithi167.stdout:8/200: dread dc/d18/f2d [0,4194304] 0 2024-09-17T01:41:17.724 INFO:tasks.workunit.client.1.smithi167.stdout:7/104: chown d0/d2/d14/d19/d26 59568 1 2024-09-17T01:41:17.724 INFO:tasks.workunit.client.1.smithi167.stdout:9/78: mknod d4/c15 0 2024-09-17T01:41:17.727 INFO:tasks.workunit.client.1.smithi167.stdout:3/48: dwrite f6 [0,4194304] 0 2024-09-17T01:41:17.727 INFO:tasks.workunit.client.1.smithi167.stdout:4/109: mknod d0/d4/d7/d10/d19/c2a 0 2024-09-17T01:41:17.729 INFO:tasks.workunit.client.1.smithi167.stdout:1/91: rename d0/d9/d11 to d0/d9/d1e 0 2024-09-17T01:41:17.730 INFO:tasks.workunit.client.1.smithi167.stdout:5/67: dwrite d0/fa [0,4194304] 0 2024-09-17T01:41:17.730 INFO:tasks.workunit.client.1.smithi167.stdout:8/201: rmdir dc/d1a 39 2024-09-17T01:41:17.731 INFO:tasks.workunit.client.1.smithi167.stdout:4/110: stat d0/f3 0 2024-09-17T01:41:17.732 INFO:tasks.workunit.client.1.smithi167.stdout:8/202: read - dc/f2f zero size 2024-09-17T01:41:17.736 INFO:tasks.workunit.client.1.smithi167.stdout:5/68: symlink d0/lc 0 2024-09-17T01:41:17.739 INFO:tasks.workunit.client.1.smithi167.stdout:7/105: rename d0/d2/c6 to d0/d2/d14/d19/c27 0 2024-09-17T01:41:17.741 INFO:tasks.workunit.client.1.smithi167.stdout:1/92: mkdir d0/d9/d16/d1f 0 2024-09-17T01:41:17.743 INFO:tasks.workunit.client.1.smithi167.stdout:1/93: stat d0/d9/d16 0 2024-09-17T01:41:17.743 INFO:tasks.workunit.client.1.smithi167.stdout:6/90: creat d7/f21 x:0 0 0 2024-09-17T01:41:17.744 INFO:tasks.workunit.client.1.smithi167.stdout:7/106: dread - d0/d2/d14/d19/f1e zero size 2024-09-17T01:41:17.744 INFO:tasks.workunit.client.1.smithi167.stdout:8/203: stat dc/d1a 0 2024-09-17T01:41:17.748 INFO:tasks.workunit.client.1.smithi167.stdout:4/111: mkdir d0/d4/d7/d6/d2b 0 2024-09-17T01:41:17.748 INFO:tasks.workunit.client.1.smithi167.stdout:9/79: rmdir d4/d9/d14 0 2024-09-17T01:41:17.749 INFO:tasks.workunit.client.1.smithi167.stdout:5/69: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:17.751 INFO:tasks.workunit.client.1.smithi167.stdout:1/94: mknod d0/d5/c20 0 2024-09-17T01:41:17.752 INFO:tasks.workunit.client.1.smithi167.stdout:7/107: mknod d0/d2/d14/d19/d26/c28 0 2024-09-17T01:41:17.753 INFO:tasks.workunit.client.1.smithi167.stdout:4/112: creat d0/d4/d7/da/f2c x:0 0 0 2024-09-17T01:41:17.754 INFO:tasks.workunit.client.1.smithi167.stdout:9/80: chown d4/d9/c10 0 1 2024-09-17T01:41:17.755 INFO:tasks.workunit.client.1.smithi167.stdout:4/113: fdatasync d0/f13 0 2024-09-17T01:41:17.755 INFO:tasks.workunit.client.1.smithi167.stdout:9/81: fsync f1 0 2024-09-17T01:41:17.755 INFO:tasks.workunit.client.1.smithi167.stdout:6/91: symlink d7/d12/l22 0 2024-09-17T01:41:17.758 INFO:tasks.workunit.client.1.smithi167.stdout:9/82: write d4/ff [51386,98586] 0 2024-09-17T01:41:17.759 INFO:tasks.workunit.client.1.smithi167.stdout:8/204: unlink dc/d1a/l23 0 2024-09-17T01:41:17.760 INFO:tasks.workunit.client.1.smithi167.stdout:7/108: fdatasync d0/f13 0 2024-09-17T01:41:17.761 INFO:tasks.workunit.client.1.smithi167.stdout:1/95: symlink d0/d9/d1e/l21 0 2024-09-17T01:41:17.763 INFO:tasks.workunit.client.1.smithi167.stdout:6/92: creat d7/d12/f23 x:0 0 0 2024-09-17T01:41:17.764 INFO:tasks.workunit.client.1.smithi167.stdout:8/205: truncate dc/d21/f25 1655463 0 2024-09-17T01:41:17.764 INFO:tasks.workunit.client.1.smithi167.stdout:9/83: rmdir d4 39 2024-09-17T01:41:17.764 INFO:tasks.workunit.client.1.smithi167.stdout:1/96: fsync d0/d5/f12 0 2024-09-17T01:41:17.765 INFO:tasks.workunit.client.1.smithi167.stdout:7/109: truncate d0/d2/f21 956667 0 2024-09-17T01:41:17.767 INFO:tasks.workunit.client.1.smithi167.stdout:9/84: write f1 [1634970,80604] 0 2024-09-17T01:41:17.767 INFO:tasks.workunit.client.1.smithi167.stdout:4/114: dread d0/d4/d7/f17 [0,4194304] 0 2024-09-17T01:41:17.768 INFO:tasks.workunit.client.1.smithi167.stdout:6/93: write d7/d12/f1d [772910,59939] 0 2024-09-17T01:41:17.768 INFO:tasks.workunit.client.1.smithi167.stdout:7/110: dread - d0/d2/d14/f1b zero size 2024-09-17T01:41:17.769 INFO:tasks.workunit.client.1.smithi167.stdout:8/206: read dc/f12 [1257813,37118] 0 2024-09-17T01:41:17.770 INFO:tasks.workunit.client.1.smithi167.stdout:8/207: fsync dc/f15 0 2024-09-17T01:41:17.772 INFO:tasks.workunit.client.1.smithi167.stdout:4/115: unlink d0/c14 0 2024-09-17T01:41:17.773 INFO:tasks.workunit.client.1.smithi167.stdout:0/106: sync 2024-09-17T01:41:17.773 INFO:tasks.workunit.client.1.smithi167.stdout:2/136: sync 2024-09-17T01:41:17.774 INFO:tasks.workunit.client.1.smithi167.stdout:8/208: stat dc/d18/f3b 0 2024-09-17T01:41:17.776 INFO:tasks.workunit.client.1.smithi167.stdout:1/97: dread d0/d5/f12 [0,4194304] 0 2024-09-17T01:41:17.776 INFO:tasks.workunit.client.1.smithi167.stdout:9/85: creat d4/f16 x:0 0 0 2024-09-17T01:41:17.779 INFO:tasks.workunit.client.1.smithi167.stdout:4/116: mkdir d0/d4/d7/d10/d19/d2d 0 2024-09-17T01:41:17.780 INFO:tasks.workunit.client.1.smithi167.stdout:0/107: mknod d5/d8/d9/c1f 0 2024-09-17T01:41:17.782 INFO:tasks.workunit.client.1.smithi167.stdout:1/98: write d0/f17 [546921,97779] 0 2024-09-17T01:41:17.784 INFO:tasks.workunit.client.1.smithi167.stdout:9/86: creat d4/f17 x:0 0 0 2024-09-17T01:41:17.788 INFO:tasks.workunit.client.1.smithi167.stdout:3/49: truncate f1 822806 0 2024-09-17T01:41:17.789 INFO:tasks.workunit.client.1.smithi167.stdout:1/99: write d0/d5/fd [5883423,829] 0 2024-09-17T01:41:17.790 INFO:tasks.workunit.client.1.smithi167.stdout:8/209: link f7 dc/d18/f46 0 2024-09-17T01:41:17.792 INFO:tasks.workunit.client.1.smithi167.stdout:2/137: dwrite d5/d1f/f21 [0,4194304] 0 2024-09-17T01:41:17.793 INFO:tasks.workunit.client.1.smithi167.stdout:4/117: truncate d0/d4/d7/d6/f29 4868994 0 2024-09-17T01:41:17.793 INFO:tasks.workunit.client.1.smithi167.stdout:6/94: dwrite d7/d12/f1d [0,4194304] 0 2024-09-17T01:41:17.794 INFO:tasks.workunit.client.1.smithi167.stdout:9/87: creat d4/f18 x:0 0 0 2024-09-17T01:41:17.796 INFO:tasks.workunit.client.1.smithi167.stdout:5/70: write d0/f6 [1424754,91017] 0 2024-09-17T01:41:17.797 INFO:tasks.workunit.client.1.smithi167.stdout:0/108: dread d5/f1d [0,4194304] 0 2024-09-17T01:41:17.798 INFO:tasks.workunit.client.1.smithi167.stdout:7/111: getdents d0/d2/d14 0 2024-09-17T01:41:17.799 INFO:tasks.workunit.client.1.smithi167.stdout:5/71: readlink d0/lc 0 2024-09-17T01:41:17.801 INFO:tasks.workunit.client.1.smithi167.stdout:5/72: chown d0/fa 3900880 1 2024-09-17T01:41:17.802 INFO:tasks.workunit.client.1.smithi167.stdout:3/50: symlink d7/da/lb 0 2024-09-17T01:41:17.802 INFO:tasks.workunit.client.1.smithi167.stdout:4/118: rmdir d0/d4/d7/d10/d19 39 2024-09-17T01:41:17.803 INFO:tasks.workunit.client.1.smithi167.stdout:9/88: rename f2 to d4/d9/f19 0 2024-09-17T01:41:17.806 INFO:tasks.workunit.client.1.smithi167.stdout:8/210: dread dc/fd [0,4194304] 0 2024-09-17T01:41:17.806 INFO:tasks.workunit.client.1.smithi167.stdout:6/95: mknod d7/d1e/c24 0 2024-09-17T01:41:17.806 INFO:tasks.workunit.client.1.smithi167.stdout:9/89: write f1 [3932974,67998] 0 2024-09-17T01:41:17.806 INFO:tasks.workunit.client.1.smithi167.stdout:8/211: stat dc/c14 0 2024-09-17T01:41:17.807 INFO:tasks.workunit.client.1.smithi167.stdout:9/90: write f1 [777642,58700] 0 2024-09-17T01:41:17.807 INFO:tasks.workunit.client.1.smithi167.stdout:3/51: symlink d7/d8/lc 0 2024-09-17T01:41:17.808 INFO:tasks.workunit.client.1.smithi167.stdout:3/52: dread f3 [0,4194304] 0 2024-09-17T01:41:17.811 INFO:tasks.workunit.client.1.smithi167.stdout:7/112: fsync d0/f1 0 2024-09-17T01:41:17.813 INFO:tasks.workunit.client.1.smithi167.stdout:6/96: stat d7/d11/lc 0 2024-09-17T01:41:17.814 INFO:tasks.workunit.client.1.smithi167.stdout:8/212: creat dc/d21/f47 x:0 0 0 2024-09-17T01:41:17.816 INFO:tasks.workunit.client.1.smithi167.stdout:9/91: dwrite f1 [0,4194304] 0 2024-09-17T01:41:17.816 INFO:tasks.workunit.client.1.smithi167.stdout:7/113: chown d0/d2/d14/f16 0 1 2024-09-17T01:41:17.817 INFO:tasks.workunit.client.1.smithi167.stdout:0/109: creat d5/d8/f20 x:0 0 0 2024-09-17T01:41:17.819 INFO:tasks.workunit.client.1.smithi167.stdout:3/53: mknod d7/cd 0 2024-09-17T01:41:17.822 INFO:tasks.workunit.client.1.smithi167.stdout:7/114: read - d0/d2/d14/f16 zero size 2024-09-17T01:41:17.822 INFO:tasks.workunit.client.1.smithi167.stdout:5/73: link d0/l1 d0/d9/ld 0 2024-09-17T01:41:17.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/92: mknod d4/c1a 0 2024-09-17T01:41:17.827 INFO:tasks.workunit.client.1.smithi167.stdout:3/54: dread f3 [0,4194304] 0 2024-09-17T01:41:17.828 INFO:tasks.workunit.client.1.smithi167.stdout:0/110: mknod d5/d8/d9/c21 0 2024-09-17T01:41:17.830 INFO:tasks.workunit.client.1.smithi167.stdout:4/119: dwrite d0/d4/d7/f17 [4194304,4194304] 0 2024-09-17T01:41:17.833 INFO:tasks.workunit.client.1.smithi167.stdout:5/74: readlink d0/l1 0 2024-09-17T01:41:17.834 INFO:tasks.workunit.client.1.smithi167.stdout:2/138: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:17.834 INFO:tasks.workunit.client.1.smithi167.stdout:0/111: unlink c3 0 2024-09-17T01:41:17.836 INFO:tasks.workunit.client.1.smithi167.stdout:1/100: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:17.836 INFO:tasks.workunit.client.1.smithi167.stdout:8/213: creat dc/f48 x:0 0 0 2024-09-17T01:41:17.836 INFO:tasks.workunit.client.1.smithi167.stdout:5/75: fsync d0/f8 0 2024-09-17T01:41:17.837 INFO:tasks.workunit.client.1.smithi167.stdout:3/55: symlink d7/da/le 0 2024-09-17T01:41:17.838 INFO:tasks.workunit.client.1.smithi167.stdout:6/97: dwrite f0 [0,4194304] 0 2024-09-17T01:41:17.839 INFO:tasks.workunit.client.1.smithi167.stdout:7/115: mknod d0/d2/d14/d19/d22/c29 0 2024-09-17T01:41:17.843 INFO:tasks.workunit.client.1.smithi167.stdout:0/112: write d5/d8/f20 [986345,32589] 0 2024-09-17T01:41:17.845 INFO:tasks.workunit.client.1.smithi167.stdout:6/98: chown d7/c14 10 1 2024-09-17T01:41:17.847 INFO:tasks.workunit.client.1.smithi167.stdout:5/76: rename d0/fa to d0/fe 0 2024-09-17T01:41:17.849 INFO:tasks.workunit.client.1.smithi167.stdout:3/56: symlink d7/da/lf 0 2024-09-17T01:41:17.849 INFO:tasks.workunit.client.1.smithi167.stdout:9/93: dread f1 [0,4194304] 0 2024-09-17T01:41:17.851 INFO:tasks.workunit.client.1.smithi167.stdout:2/139: rename d5/d8/lf to d5/d1f/l2b 0 2024-09-17T01:41:17.854 INFO:tasks.workunit.client.1.smithi167.stdout:9/94: chown d4/f8 20009180 1 2024-09-17T01:41:17.854 INFO:tasks.workunit.client.1.smithi167.stdout:1/101: mkdir d0/d9/d16/d22 0 2024-09-17T01:41:17.856 INFO:tasks.workunit.client.1.smithi167.stdout:7/116: unlink d0/d2/f8 0 2024-09-17T01:41:17.859 INFO:tasks.workunit.client.1.smithi167.stdout:8/214: dwrite dc/d21/f24 [4194304,4194304] 0 2024-09-17T01:41:17.860 INFO:tasks.workunit.client.1.smithi167.stdout:2/140: write d5/d1f/f21 [1516143,87480] 0 2024-09-17T01:41:17.862 INFO:tasks.workunit.client.1.smithi167.stdout:4/120: dwrite d0/d4/d7/d6/f29 [0,4194304] 0 2024-09-17T01:41:17.864 INFO:tasks.workunit.client.1.smithi167.stdout:9/95: symlink d4/l1b 0 2024-09-17T01:41:17.867 INFO:tasks.workunit.client.1.smithi167.stdout:4/121: fsync d0/d4/d7/f17 0 2024-09-17T01:41:17.869 INFO:tasks.workunit.client.1.smithi167.stdout:0/113: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:17.872 INFO:tasks.workunit.client.1.smithi167.stdout:4/122: chown d0/d4/f28 0 1 2024-09-17T01:41:17.872 INFO:tasks.workunit.client.1.smithi167.stdout:5/77: dwrite d0/f6 [0,4194304] 0 2024-09-17T01:41:17.873 INFO:tasks.workunit.client.1.smithi167.stdout:5/78: chown d0/d9 0 1 2024-09-17T01:41:17.875 INFO:tasks.workunit.client.1.smithi167.stdout:6/99: rename d7/d11/d13/l1a to d7/l25 0 2024-09-17T01:41:17.878 INFO:tasks.workunit.client.1.smithi167.stdout:8/215: link dc/f17 dc/d1a/f49 0 2024-09-17T01:41:17.880 INFO:tasks.workunit.client.1.smithi167.stdout:5/79: write d0/f8 [2624023,26022] 0 2024-09-17T01:41:17.893 INFO:tasks.workunit.client.1.smithi167.stdout:2/141: dread d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:17.895 INFO:tasks.workunit.client.1.smithi167.stdout:5/80: read d0/f8 [207825,93771] 0 2024-09-17T01:41:17.896 INFO:tasks.workunit.client.1.smithi167.stdout:6/100: creat d7/d1e/f26 x:0 0 0 2024-09-17T01:41:17.898 INFO:tasks.workunit.client.1.smithi167.stdout:0/114: dwrite d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:17.900 INFO:tasks.workunit.client.1.smithi167.stdout:6/101: chown d7/d11/d13/c16 129446 1 2024-09-17T01:41:17.902 INFO:tasks.workunit.client.1.smithi167.stdout:3/57: dwrite f1 [0,4194304] 0 2024-09-17T01:41:17.902 INFO:tasks.workunit.client.1.smithi167.stdout:7/117: dwrite d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:17.903 INFO:tasks.workunit.client.1.smithi167.stdout:7/118: write d0/d2/d14/d19/f1e [204855,40076] 0 2024-09-17T01:41:17.913 INFO:tasks.workunit.client.1.smithi167.stdout:7/119: dwrite d0/d2/d14/d19/f1e [0,4194304] 0 2024-09-17T01:41:17.968 INFO:tasks.workunit.client.1.smithi167.stdout:8/216: creat dc/d1a/f4a x:0 0 0 2024-09-17T01:41:17.969 INFO:tasks.workunit.client.1.smithi167.stdout:2/142: mknod d5/d1f/c2c 0 2024-09-17T01:41:17.970 INFO:tasks.workunit.client.1.smithi167.stdout:1/102: rename d0/c1a to d0/d9/d16/d22/c23 0 2024-09-17T01:41:17.973 INFO:tasks.workunit.client.1.smithi167.stdout:0/115: rmdir d5/d8/d9/d19 39 2024-09-17T01:41:17.975 INFO:tasks.workunit.client.1.smithi167.stdout:9/96: getdents d4/d9 0 2024-09-17T01:41:17.976 INFO:tasks.workunit.client.1.smithi167.stdout:4/123: mkdir d0/d4/d7/d10/d19/d2d/d2e 0 2024-09-17T01:41:17.976 INFO:tasks.workunit.client.1.smithi167.stdout:6/102: write d7/fa [599114,25342] 0 2024-09-17T01:41:17.977 INFO:tasks.workunit.client.1.smithi167.stdout:8/217: dwrite dc/d21/f47 [0,4194304] 0 2024-09-17T01:41:17.977 INFO:tasks.workunit.client.1.smithi167.stdout:5/81: rename d0/fe to d0/d9/ff 0 2024-09-17T01:41:17.978 INFO:tasks.workunit.client.1.smithi167.stdout:4/124: dread - d0/d4/f28 zero size 2024-09-17T01:41:17.983 INFO:tasks.workunit.client.1.smithi167.stdout:7/120: link d0/d2/d14/d19/f1e d0/d2/d14/d19/d22/f2a 0 2024-09-17T01:41:17.985 INFO:tasks.workunit.client.1.smithi167.stdout:2/143: rename d5/d1f/f21 to d5/d10/d16/f2d 0 2024-09-17T01:41:17.987 INFO:tasks.workunit.client.1.smithi167.stdout:7/121: chown d0/d2/d14/f1b 78 1 2024-09-17T01:41:17.989 INFO:tasks.workunit.client.1.smithi167.stdout:3/58: getdents d7 0 2024-09-17T01:41:17.990 INFO:tasks.workunit.client.1.smithi167.stdout:7/122: read d0/d2/d14/d19/d26/f1c [2401546,33526] 0 2024-09-17T01:41:17.990 INFO:tasks.workunit.client.1.smithi167.stdout:6/103: rename d7/d1e to d7/d12/d27 0 2024-09-17T01:41:17.991 INFO:tasks.workunit.client.1.smithi167.stdout:5/82: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:17.992 INFO:tasks.workunit.client.1.smithi167.stdout:9/97: dwrite d4/ff [0,4194304] 0 2024-09-17T01:41:17.995 INFO:tasks.workunit.client.1.smithi167.stdout:7/123: write d0/d2/d14/f16 [564668,42262] 0 2024-09-17T01:41:17.998 INFO:tasks.workunit.client.1.smithi167.stdout:8/218: getdents dc/d21 0 2024-09-17T01:41:17.998 INFO:tasks.workunit.client.1.smithi167.stdout:6/104: mkdir d7/d12/d27/d28 0 2024-09-17T01:41:17.999 INFO:tasks.workunit.client.1.smithi167.stdout:7/124: chown d0/d2/d14/d19/d22 20068 1 2024-09-17T01:41:17.999 INFO:tasks.workunit.client.1.smithi167.stdout:6/105: stat d7/f21 0 2024-09-17T01:41:18.000 INFO:tasks.workunit.client.1.smithi167.stdout:4/125: rename d0/d4/d7/da/l25 to d0/d4/d7/d6/l2f 0 2024-09-17T01:41:18.001 INFO:tasks.workunit.client.1.smithi167.stdout:5/83: creat d0/d9/f10 x:0 0 0 2024-09-17T01:41:18.002 INFO:tasks.workunit.client.1.smithi167.stdout:4/126: write d0/d4/d7/f23 [682360,111523] 0 2024-09-17T01:41:18.004 INFO:tasks.workunit.client.1.smithi167.stdout:7/125: rmdir d0/d2 39 2024-09-17T01:41:18.005 INFO:tasks.workunit.client.1.smithi167.stdout:4/127: fsync d0/d4/d7/d10/d19/f24 0 2024-09-17T01:41:18.006 INFO:tasks.workunit.client.1.smithi167.stdout:5/84: creat d0/f11 x:0 0 0 2024-09-17T01:41:18.007 INFO:tasks.workunit.client.1.smithi167.stdout:9/98: dwrite f1 [0,4194304] 0 2024-09-17T01:41:18.009 INFO:tasks.workunit.client.1.smithi167.stdout:6/106: creat d7/f29 x:0 0 0 2024-09-17T01:41:18.010 INFO:tasks.workunit.client.1.smithi167.stdout:7/126: mknod d0/c2b 0 2024-09-17T01:41:18.012 INFO:tasks.workunit.client.1.smithi167.stdout:6/107: rmdir d7/d11 39 2024-09-17T01:41:18.013 INFO:tasks.workunit.client.1.smithi167.stdout:8/219: dwrite dc/fd [4194304,4194304] 0 2024-09-17T01:41:18.014 INFO:tasks.workunit.client.1.smithi167.stdout:9/99: rename d4/d9/c10 to d4/d9/c1c 0 2024-09-17T01:41:18.015 INFO:tasks.workunit.client.1.smithi167.stdout:5/85: dread d0/d9/ff [0,4194304] 0 2024-09-17T01:41:18.019 INFO:tasks.workunit.client.1.smithi167.stdout:7/127: dread d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:18.020 INFO:tasks.workunit.client.1.smithi167.stdout:7/128: chown d0/d2/c3 3600363 1 2024-09-17T01:41:18.021 INFO:tasks.workunit.client.1.smithi167.stdout:4/128: link d0/d4/d7/da/f2c d0/d4/d7/da/f30 0 2024-09-17T01:41:18.022 INFO:tasks.workunit.client.1.smithi167.stdout:4/129: chown d0/d4/d7/d10/l20 15344 1 2024-09-17T01:41:18.024 INFO:tasks.workunit.client.1.smithi167.stdout:6/108: write d7/d11/ff [4585371,24446] 0 2024-09-17T01:41:18.025 INFO:tasks.workunit.client.1.smithi167.stdout:7/129: rmdir d0/d2 39 2024-09-17T01:41:18.029 INFO:tasks.workunit.client.1.smithi167.stdout:4/130: mkdir d0/d4/d7/d10/d19/d2d/d2e/d31 0 2024-09-17T01:41:18.030 INFO:tasks.workunit.client.1.smithi167.stdout:6/109: symlink d7/d12/d27/d28/l2a 0 2024-09-17T01:41:18.034 INFO:tasks.workunit.client.1.smithi167.stdout:4/131: dread d0/d4/d7/d10/d19/f24 [0,4194304] 0 2024-09-17T01:41:18.034 INFO:tasks.workunit.client.1.smithi167.stdout:6/110: dread d7/d12/f1c [0,4194304] 0 2024-09-17T01:41:18.038 INFO:tasks.workunit.client.1.smithi167.stdout:6/111: dread f0 [0,4194304] 0 2024-09-17T01:41:18.038 INFO:tasks.workunit.client.1.smithi167.stdout:4/132: dread d0/d4/d7/f17 [4194304,4194304] 0 2024-09-17T01:41:18.040 INFO:tasks.workunit.client.1.smithi167.stdout:6/112: creat d7/d12/f2b x:0 0 0 2024-09-17T01:41:18.042 INFO:tasks.workunit.client.1.smithi167.stdout:4/133: dread d0/d4/d7/ff [0,4194304] 0 2024-09-17T01:41:18.043 INFO:tasks.workunit.client.1.smithi167.stdout:4/134: fsync d0/d4/d7/d10/d19/f24 0 2024-09-17T01:41:18.049 INFO:tasks.workunit.client.1.smithi167.stdout:4/135: dwrite d0/d4/d7/ff [0,4194304] 0 2024-09-17T01:41:18.051 INFO:tasks.workunit.client.1.smithi167.stdout:4/136: rmdir d0 39 2024-09-17T01:41:18.056 INFO:tasks.workunit.client.1.smithi167.stdout:4/137: creat d0/d4/d7/d6/f32 x:0 0 0 2024-09-17T01:41:18.077 INFO:tasks.workunit.client.1.smithi167.stdout:4/138: dread d0/f3 [0,4194304] 0 2024-09-17T01:41:18.079 INFO:tasks.workunit.client.1.smithi167.stdout:3/59: write f1 [4742473,86006] 0 2024-09-17T01:41:18.082 INFO:tasks.workunit.client.1.smithi167.stdout:3/60: mkdir d7/d8/d10 0 2024-09-17T01:41:18.083 INFO:tasks.workunit.client.1.smithi167.stdout:4/139: dwrite d0/f2 [0,4194304] 0 2024-09-17T01:41:18.083 INFO:tasks.workunit.client.1.smithi167.stdout:3/61: chown d7/d8/lc 13377 1 2024-09-17T01:41:18.084 INFO:tasks.workunit.client.1.smithi167.stdout:3/62: truncate f3 1185755 0 2024-09-17T01:41:18.086 INFO:tasks.workunit.client.1.smithi167.stdout:1/103: truncate d0/d9/fb 2811706 0 2024-09-17T01:41:18.087 INFO:tasks.workunit.client.1.smithi167.stdout:0/116: truncate d5/f1d 3363761 0 2024-09-17T01:41:18.090 INFO:tasks.workunit.client.1.smithi167.stdout:4/140: rename d0/d4/d7/d10/l20 to d0/d4/d7/d10/d19/d2d/d2e/d31/l33 0 2024-09-17T01:41:18.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/104: symlink d0/d5/l24 0 2024-09-17T01:41:18.096 INFO:tasks.workunit.client.1.smithi167.stdout:2/144: truncate d5/d8/f9 3616354 0 2024-09-17T01:41:18.097 INFO:tasks.workunit.client.1.smithi167.stdout:4/141: creat d0/d4/d7/d10/d19/d2d/d2e/f34 x:0 0 0 2024-09-17T01:41:18.099 INFO:tasks.workunit.client.1.smithi167.stdout:1/105: creat d0/d9/f25 x:0 0 0 2024-09-17T01:41:18.100 INFO:tasks.workunit.client.1.smithi167.stdout:1/106: fdatasync d0/d5/f12 0 2024-09-17T01:41:18.101 INFO:tasks.workunit.client.1.smithi167.stdout:2/145: dwrite d5/d10/d16/f19 [0,4194304] 0 2024-09-17T01:41:18.102 INFO:tasks.workunit.client.1.smithi167.stdout:2/146: chown d5/d8/c11 2621276 1 2024-09-17T01:41:18.103 INFO:tasks.workunit.client.1.smithi167.stdout:0/117: link d5/d8/f20 d5/d8/d9/d19/f22 0 2024-09-17T01:41:18.103 INFO:tasks.workunit.client.1.smithi167.stdout:2/147: write d5/d1f/f26 [1552635,6466] 0 2024-09-17T01:41:18.104 INFO:tasks.workunit.client.1.smithi167.stdout:1/107: mkdir d0/d9/d1e/d26 0 2024-09-17T01:41:18.105 INFO:tasks.workunit.client.1.smithi167.stdout:0/118: chown d5/d8/d9/c21 243689 1 2024-09-17T01:41:18.107 INFO:tasks.workunit.client.1.smithi167.stdout:1/108: write d0/f17 [1120964,66591] 0 2024-09-17T01:41:18.107 INFO:tasks.workunit.client.1.smithi167.stdout:0/119: read - d5/d8/d9/f1a zero size 2024-09-17T01:41:18.112 INFO:tasks.workunit.client.1.smithi167.stdout:9/100: truncate d4/ff 1021448 0 2024-09-17T01:41:18.114 INFO:tasks.workunit.client.1.smithi167.stdout:9/101: dread - d4/f16 zero size 2024-09-17T01:41:18.115 INFO:tasks.workunit.client.1.smithi167.stdout:6/113: getdents d7/d12/d27/d28 0 2024-09-17T01:41:18.116 INFO:tasks.workunit.client.1.smithi167.stdout:0/120: link d5/d8/l14 d5/d8/l23 0 2024-09-17T01:41:18.118 INFO:tasks.workunit.client.1.smithi167.stdout:8/220: dwrite dc/d21/f31 [0,4194304] 0 2024-09-17T01:41:18.118 INFO:tasks.workunit.client.1.smithi167.stdout:1/109: dwrite d0/d5/fd [0,4194304] 0 2024-09-17T01:41:18.120 INFO:tasks.workunit.client.1.smithi167.stdout:9/102: creat d4/d9/f1d x:0 0 0 2024-09-17T01:41:18.122 INFO:tasks.workunit.client.1.smithi167.stdout:6/114: write d7/d12/f1d [2099470,42500] 0 2024-09-17T01:41:18.126 INFO:tasks.workunit.client.1.smithi167.stdout:9/103: rmdir d4 39 2024-09-17T01:41:18.126 INFO:tasks.workunit.client.1.smithi167.stdout:3/63: truncate f3 808222 0 2024-09-17T01:41:18.128 INFO:tasks.workunit.client.1.smithi167.stdout:7/130: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:18.131 INFO:tasks.workunit.client.1.smithi167.stdout:4/142: fsync d0/d4/d7/d10/d19/d2d/d2e/f34 0 2024-09-17T01:41:18.134 INFO:tasks.workunit.client.1.smithi167.stdout:0/121: symlink d5/d8/d9/l24 0 2024-09-17T01:41:18.138 INFO:tasks.workunit.client.1.smithi167.stdout:6/115: symlink d7/l2c 0 2024-09-17T01:41:18.139 INFO:tasks.workunit.client.1.smithi167.stdout:8/221: mkdir dc/d1a/d45/d4b 0 2024-09-17T01:41:18.140 INFO:tasks.workunit.client.1.smithi167.stdout:3/64: dwrite f1 [4194304,4194304] 0 2024-09-17T01:41:18.140 INFO:tasks.workunit.client.1.smithi167.stdout:4/143: fdatasync d0/d4/d7/f1b 0 2024-09-17T01:41:18.142 INFO:tasks.workunit.client.1.smithi167.stdout:0/122: unlink d5/fd 0 2024-09-17T01:41:18.142 INFO:tasks.workunit.client.1.smithi167.stdout:9/104: symlink d4/l1e 0 2024-09-17T01:41:18.142 INFO:tasks.workunit.client.1.smithi167.stdout:4/144: read - d0/d4/f28 zero size 2024-09-17T01:41:18.143 INFO:tasks.workunit.client.1.smithi167.stdout:9/105: dread - d4/f18 zero size 2024-09-17T01:41:18.143 INFO:tasks.workunit.client.1.smithi167.stdout:6/116: creat d7/d11/d13/f2d x:0 0 0 2024-09-17T01:41:18.144 INFO:tasks.workunit.client.1.smithi167.stdout:8/222: creat dc/d1a/f4c x:0 0 0 2024-09-17T01:41:18.145 INFO:tasks.workunit.client.1.smithi167.stdout:1/110: link d0/d9/d16/d22/c23 d0/d9/d1e/c27 0 2024-09-17T01:41:18.146 INFO:tasks.workunit.client.1.smithi167.stdout:1/111: write d0/d5/f12 [2440068,94693] 0 2024-09-17T01:41:18.147 INFO:tasks.workunit.client.1.smithi167.stdout:4/145: mkdir d0/d35 0 2024-09-17T01:41:18.153 INFO:tasks.workunit.client.1.smithi167.stdout:6/117: symlink d7/d11/l2e 0 2024-09-17T01:41:18.153 INFO:tasks.workunit.client.1.smithi167.stdout:8/223: rmdir dc/d1a/d45 39 2024-09-17T01:41:18.155 INFO:tasks.workunit.client.1.smithi167.stdout:6/118: chown d7/d12/f2b 12573 1 2024-09-17T01:41:18.159 INFO:tasks.workunit.client.1.smithi167.stdout:2/148: dwrite d5/d8/f9 [0,4194304] 0 2024-09-17T01:41:18.160 INFO:tasks.workunit.client.1.smithi167.stdout:8/224: symlink dc/d1a/d45/l4d 0 2024-09-17T01:41:18.160 INFO:tasks.workunit.client.1.smithi167.stdout:6/119: dread d7/d12/f1c [0,4194304] 0 2024-09-17T01:41:18.160 INFO:tasks.workunit.client.1.smithi167.stdout:6/120: fsync d7/d12/f2b 0 2024-09-17T01:41:18.160 INFO:tasks.workunit.client.1.smithi167.stdout:9/106: rename d4/ff to d4/f1f 0 2024-09-17T01:41:18.163 INFO:tasks.workunit.client.1.smithi167.stdout:9/107: chown d4/lc 296233 1 2024-09-17T01:41:18.164 INFO:tasks.workunit.client.1.smithi167.stdout:7/131: truncate d0/d2/d14/d19/d26/ff 492009 0 2024-09-17T01:41:18.168 INFO:tasks.workunit.client.1.smithi167.stdout:2/149: getdents d5/d8 0 2024-09-17T01:41:18.170 INFO:tasks.workunit.client.1.smithi167.stdout:7/132: getdents d0/d2/d14/d23 0 2024-09-17T01:41:18.171 INFO:tasks.workunit.client.1.smithi167.stdout:2/150: fdatasync d5/d8/f17 0 2024-09-17T01:41:18.172 INFO:tasks.workunit.client.1.smithi167.stdout:6/121: dwrite d7/d11/d13/f17 [0,4194304] 0 2024-09-17T01:41:18.174 INFO:tasks.workunit.client.1.smithi167.stdout:9/108: dread d4/f8 [0,4194304] 0 2024-09-17T01:41:18.176 INFO:tasks.workunit.client.1.smithi167.stdout:4/146: dwrite d0/d4/d7/da/f30 [0,4194304] 0 2024-09-17T01:41:18.177 INFO:tasks.workunit.client.1.smithi167.stdout:6/122: mkdir d7/d11/d13/d2f 0 2024-09-17T01:41:18.178 INFO:tasks.workunit.client.1.smithi167.stdout:2/151: mkdir d5/d10/d1a/d2e 0 2024-09-17T01:41:18.179 INFO:tasks.workunit.client.1.smithi167.stdout:4/147: write d0/d4/d7/f23 [222741,41041] 0 2024-09-17T01:41:18.180 INFO:tasks.workunit.client.1.smithi167.stdout:2/152: write d5/d1f/f20 [833811,25406] 0 2024-09-17T01:41:18.181 INFO:tasks.workunit.client.1.smithi167.stdout:2/153: stat d5/d8/c11 0 2024-09-17T01:41:18.181 INFO:tasks.workunit.client.1.smithi167.stdout:2/154: stat d5/f7 0 2024-09-17T01:41:18.181 INFO:tasks.workunit.client.1.smithi167.stdout:4/148: chown d0/d4/d7/d6/f29 115641940 1 2024-09-17T01:41:18.184 INFO:tasks.workunit.client.1.smithi167.stdout:6/123: mkdir d7/d11/d13/d2f/d30 0 2024-09-17T01:41:18.185 INFO:tasks.workunit.client.1.smithi167.stdout:7/133: write d0/d2/d14/d19/d26/f1c [3896675,28127] 0 2024-09-17T01:41:18.187 INFO:tasks.workunit.client.1.smithi167.stdout:4/149: truncate d0/d4/d7/d10/d19/f24 1946190 0 2024-09-17T01:41:18.188 INFO:tasks.workunit.client.1.smithi167.stdout:3/65: dread f3 [0,4194304] 0 2024-09-17T01:41:18.191 INFO:tasks.workunit.client.1.smithi167.stdout:7/134: creat d0/f2c x:0 0 0 2024-09-17T01:41:18.192 INFO:tasks.workunit.client.1.smithi167.stdout:2/155: dwrite d5/d1f/f26 [0,4194304] 0 2024-09-17T01:41:18.192 INFO:tasks.workunit.client.1.smithi167.stdout:6/124: getdents d7/d11 0 2024-09-17T01:41:18.192 INFO:tasks.workunit.client.1.smithi167.stdout:3/66: mknod d7/da/c11 0 2024-09-17T01:41:18.193 INFO:tasks.workunit.client.1.smithi167.stdout:4/150: rename d0/d4/d7/d6/c18 to d0/d4/d7/da/c36 0 2024-09-17T01:41:18.194 INFO:tasks.workunit.client.1.smithi167.stdout:8/225: dread dc/f3c [0,4194304] 0 2024-09-17T01:41:18.194 INFO:tasks.workunit.client.1.smithi167.stdout:7/135: mknod d0/d2/d14/c2d 0 2024-09-17T01:41:18.199 INFO:tasks.workunit.client.1.smithi167.stdout:6/125: creat d7/d12/d27/d28/f31 x:0 0 0 2024-09-17T01:41:18.201 INFO:tasks.workunit.client.1.smithi167.stdout:4/151: link d0/l1a d0/d4/d7/d6/l37 0 2024-09-17T01:41:18.203 INFO:tasks.workunit.client.1.smithi167.stdout:2/156: getdents d5/d1f 0 2024-09-17T01:41:18.204 INFO:tasks.workunit.client.1.smithi167.stdout:3/67: dwrite f6 [0,4194304] 0 2024-09-17T01:41:18.211 INFO:tasks.workunit.client.1.smithi167.stdout:6/126: dwrite d7/f21 [0,4194304] 0 2024-09-17T01:41:18.212 INFO:tasks.workunit.client.1.smithi167.stdout:4/152: dread d0/d4/d7/da/f2c [0,4194304] 0 2024-09-17T01:41:18.213 INFO:tasks.workunit.client.1.smithi167.stdout:3/68: dread f6 [0,4194304] 0 2024-09-17T01:41:18.214 INFO:tasks.workunit.client.1.smithi167.stdout:6/127: write d7/d11/f10 [4439397,106084] 0 2024-09-17T01:41:18.215 INFO:tasks.workunit.client.1.smithi167.stdout:3/69: readlink l0 0 2024-09-17T01:41:18.227 INFO:tasks.workunit.client.1.smithi167.stdout:4/153: dwrite d0/d4/d7/d10/d19/d2d/d2e/f34 [0,4194304] 0 2024-09-17T01:41:18.229 INFO:tasks.workunit.client.1.smithi167.stdout:3/70: dread f1 [0,4194304] 0 2024-09-17T01:41:18.229 INFO:tasks.workunit.client.1.smithi167.stdout:6/128: dwrite d7/f29 [0,4194304] 0 2024-09-17T01:41:18.233 INFO:tasks.workunit.client.1.smithi167.stdout:8/226: dread dc/d1a/f49 [0,4194304] 0 2024-09-17T01:41:18.233 INFO:tasks.workunit.client.1.smithi167.stdout:3/71: mknod d7/c12 0 2024-09-17T01:41:18.234 INFO:tasks.workunit.client.1.smithi167.stdout:4/154: write d0/d4/d7/f26 [2356649,99269] 0 2024-09-17T01:41:18.235 INFO:tasks.workunit.client.1.smithi167.stdout:4/155: fdatasync d0/d4/d7/d6/f29 0 2024-09-17T01:41:18.235 INFO:tasks.workunit.client.1.smithi167.stdout:6/129: mkdir d7/d11/d13/d2f/d30/d32 0 2024-09-17T01:41:18.236 INFO:tasks.workunit.client.1.smithi167.stdout:6/130: chown d7/d11/lc 30382251 1 2024-09-17T01:41:18.237 INFO:tasks.workunit.client.1.smithi167.stdout:8/227: mknod dc/d18/c4e 0 2024-09-17T01:41:18.237 INFO:tasks.workunit.client.1.smithi167.stdout:3/72: creat d7/d8/d10/f13 x:0 0 0 2024-09-17T01:41:18.238 INFO:tasks.workunit.client.1.smithi167.stdout:4/156: fsync d0/f3 0 2024-09-17T01:41:18.238 INFO:tasks.workunit.client.1.smithi167.stdout:6/131: symlink d7/d12/d27/l33 0 2024-09-17T01:41:18.240 INFO:tasks.workunit.client.1.smithi167.stdout:3/73: write f1 [562229,123730] 0 2024-09-17T01:41:18.241 INFO:tasks.workunit.client.1.smithi167.stdout:3/74: read f1 [470106,103023] 0 2024-09-17T01:41:18.242 INFO:tasks.workunit.client.1.smithi167.stdout:3/75: write f1 [5819942,29963] 0 2024-09-17T01:41:18.242 INFO:tasks.workunit.client.1.smithi167.stdout:4/157: fdatasync d0/f3 0 2024-09-17T01:41:18.244 INFO:tasks.workunit.client.1.smithi167.stdout:6/132: mkdir d7/d11/d34 0 2024-09-17T01:41:18.246 INFO:tasks.workunit.client.1.smithi167.stdout:3/76: rmdir d7/da 39 2024-09-17T01:41:18.248 INFO:tasks.workunit.client.1.smithi167.stdout:4/158: mknod d0/d4/d7/d10/d19/d2d/d2e/c38 0 2024-09-17T01:41:18.248 INFO:tasks.workunit.client.1.smithi167.stdout:4/159: fdatasync d0/d4/d7/d6/f29 0 2024-09-17T01:41:18.250 INFO:tasks.workunit.client.1.smithi167.stdout:4/160: symlink d0/d4/l39 0 2024-09-17T01:41:18.254 INFO:tasks.workunit.client.1.smithi167.stdout:3/77: dwrite f6 [0,4194304] 0 2024-09-17T01:41:18.255 INFO:tasks.workunit.client.1.smithi167.stdout:5/86: sync 2024-09-17T01:41:18.257 INFO:tasks.workunit.client.1.smithi167.stdout:3/78: mkdir d7/d8/d10/d14 0 2024-09-17T01:41:18.258 INFO:tasks.workunit.client.1.smithi167.stdout:4/161: dread d0/d4/d7/da/f30 [0,4194304] 0 2024-09-17T01:41:18.259 INFO:tasks.workunit.client.1.smithi167.stdout:3/79: dread - d7/d8/d10/f13 zero size 2024-09-17T01:41:18.259 INFO:tasks.workunit.client.1.smithi167.stdout:4/162: write d0/f13 [623838,104106] 0 2024-09-17T01:41:18.260 INFO:tasks.workunit.client.1.smithi167.stdout:5/87: rename d0/d9/f10 to d0/d9/f12 0 2024-09-17T01:41:18.262 INFO:tasks.workunit.client.1.smithi167.stdout:3/80: rename f1 to d7/d8/f15 0 2024-09-17T01:41:18.264 INFO:tasks.workunit.client.1.smithi167.stdout:4/163: creat d0/d4/d7/d10/d19/f3a x:0 0 0 2024-09-17T01:41:18.264 INFO:tasks.workunit.client.1.smithi167.stdout:6/133: dread d7/d11/f1b [0,4194304] 0 2024-09-17T01:41:18.265 INFO:tasks.workunit.client.1.smithi167.stdout:8/228: dread dc/ff [0,4194304] 0 2024-09-17T01:41:18.266 INFO:tasks.workunit.client.1.smithi167.stdout:3/81: truncate d7/d8/d10/f13 986072 0 2024-09-17T01:41:18.266 INFO:tasks.workunit.client.1.smithi167.stdout:8/229: fsync dc/f48 0 2024-09-17T01:41:18.267 INFO:tasks.workunit.client.1.smithi167.stdout:6/134: write d7/d12/f1c [1690530,7090] 0 2024-09-17T01:41:18.269 INFO:tasks.workunit.client.1.smithi167.stdout:3/82: mknod d7/d8/d10/c16 0 2024-09-17T01:41:18.269 INFO:tasks.workunit.client.1.smithi167.stdout:6/135: write d7/f29 [93331,3264] 0 2024-09-17T01:41:18.271 INFO:tasks.workunit.client.1.smithi167.stdout:8/230: link dc/d1a/f4c dc/d18/f4f 0 2024-09-17T01:41:18.274 INFO:tasks.workunit.client.1.smithi167.stdout:4/164: dwrite d0/d4/d7/ff [4194304,4194304] 0 2024-09-17T01:41:18.278 INFO:tasks.workunit.client.1.smithi167.stdout:4/165: chown d0/d4/d7/d6/l37 0 1 2024-09-17T01:41:18.278 INFO:tasks.workunit.client.1.smithi167.stdout:3/83: link d7/c12 d7/da/c17 0 2024-09-17T01:41:18.280 INFO:tasks.workunit.client.1.smithi167.stdout:8/231: rmdir dc/d1a/d45/d4b 0 2024-09-17T01:41:18.280 INFO:tasks.workunit.client.1.smithi167.stdout:6/136: dwrite d7/d12/d27/d28/f31 [0,4194304] 0 2024-09-17T01:41:18.282 INFO:tasks.workunit.client.1.smithi167.stdout:8/232: write dc/d21/f34 [5188612,14239] 0 2024-09-17T01:41:18.285 INFO:tasks.workunit.client.1.smithi167.stdout:3/84: creat d7/d8/d10/f18 x:0 0 0 2024-09-17T01:41:18.287 INFO:tasks.workunit.client.1.smithi167.stdout:6/137: mknod d7/d11/c35 0 2024-09-17T01:41:18.287 INFO:tasks.workunit.client.1.smithi167.stdout:8/233: unlink dc/f12 0 2024-09-17T01:41:18.289 INFO:tasks.workunit.client.1.smithi167.stdout:6/138: symlink d7/d12/d27/d28/l36 0 2024-09-17T01:41:18.289 INFO:tasks.workunit.client.1.smithi167.stdout:3/85: link d7/cd d7/d8/d10/c19 0 2024-09-17T01:41:18.291 INFO:tasks.workunit.client.1.smithi167.stdout:3/86: write d7/d8/f15 [3570563,9140] 0 2024-09-17T01:41:18.291 INFO:tasks.workunit.client.1.smithi167.stdout:6/139: mknod d7/d12/d27/c37 0 2024-09-17T01:41:18.292 INFO:tasks.workunit.client.1.smithi167.stdout:3/87: chown d7/d8/f15 51 1 2024-09-17T01:41:18.293 INFO:tasks.workunit.client.1.smithi167.stdout:6/140: mknod d7/d12/c38 0 2024-09-17T01:41:18.295 INFO:tasks.workunit.client.1.smithi167.stdout:3/88: rename d7/cd to d7/d8/c1a 0 2024-09-17T01:41:18.295 INFO:tasks.workunit.client.1.smithi167.stdout:3/89: readlink l0 0 2024-09-17T01:41:18.295 INFO:tasks.workunit.client.1.smithi167.stdout:6/141: creat d7/d11/d13/f39 x:0 0 0 2024-09-17T01:41:18.297 INFO:tasks.workunit.client.1.smithi167.stdout:6/142: mkdir d7/d12/d27/d3a 0 2024-09-17T01:41:18.298 INFO:tasks.workunit.client.1.smithi167.stdout:6/143: chown d7/d11/d13/d2f 1628410761 1 2024-09-17T01:41:18.300 INFO:tasks.workunit.client.1.smithi167.stdout:6/144: read d7/d12/d27/d28/f31 [800191,96256] 0 2024-09-17T01:41:18.300 INFO:tasks.workunit.client.1.smithi167.stdout:3/90: dwrite f6 [0,4194304] 0 2024-09-17T01:41:18.303 INFO:tasks.workunit.client.1.smithi167.stdout:4/166: fsync d0/d4/d7/ff 0 2024-09-17T01:41:18.304 INFO:tasks.workunit.client.1.smithi167.stdout:4/167: stat d0/f2 0 2024-09-17T01:41:18.304 INFO:tasks.workunit.client.1.smithi167.stdout:6/145: dread d7/d12/f1c [0,4194304] 0 2024-09-17T01:41:18.305 INFO:tasks.workunit.client.1.smithi167.stdout:3/91: rename d7/d8/lc to d7/da/l1b 0 2024-09-17T01:41:18.305 INFO:tasks.workunit.client.1.smithi167.stdout:6/146: fdatasync d7/d12/f1c 0 2024-09-17T01:41:18.306 INFO:tasks.workunit.client.1.smithi167.stdout:4/168: stat d0/d4/d7/d10/d19/d2d/d2e/d31/l33 0 2024-09-17T01:41:18.307 INFO:tasks.workunit.client.1.smithi167.stdout:3/92: dread f3 [0,4194304] 0 2024-09-17T01:41:18.308 INFO:tasks.workunit.client.1.smithi167.stdout:4/169: write d0/d4/d7/d6/f32 [809636,66795] 0 2024-09-17T01:41:18.308 INFO:tasks.workunit.client.1.smithi167.stdout:6/147: unlink d7/d11/ff 0 2024-09-17T01:41:18.310 INFO:tasks.workunit.client.1.smithi167.stdout:4/170: fsync d0/d4/d7/f1b 0 2024-09-17T01:41:18.310 INFO:tasks.workunit.client.1.smithi167.stdout:6/148: readlink d7/d12/d27/d28/l36 0 2024-09-17T01:41:18.314 INFO:tasks.workunit.client.1.smithi167.stdout:3/93: dwrite f6 [0,4194304] 0 2024-09-17T01:41:18.314 INFO:tasks.workunit.client.1.smithi167.stdout:4/171: truncate d0/d4/d7/d10/d19/f3a 394666 0 2024-09-17T01:41:18.316 INFO:tasks.workunit.client.1.smithi167.stdout:4/172: mknod d0/c3b 0 2024-09-17T01:41:18.318 INFO:tasks.workunit.client.1.smithi167.stdout:3/94: creat d7/da/f1c x:0 0 0 2024-09-17T01:41:18.323 INFO:tasks.workunit.client.1.smithi167.stdout:4/173: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:18.324 INFO:tasks.workunit.client.1.smithi167.stdout:4/174: fdatasync d0/d4/d7/da/f2c 0 2024-09-17T01:41:18.327 INFO:tasks.workunit.client.1.smithi167.stdout:4/175: truncate d0/d4/d7/da/f30 642980 0 2024-09-17T01:41:18.327 INFO:tasks.workunit.client.1.smithi167.stdout:4/176: readlink d0/d4/l39 0 2024-09-17T01:41:18.328 INFO:tasks.workunit.client.1.smithi167.stdout:4/177: fdatasync d0/d4/d7/f23 0 2024-09-17T01:41:18.343 INFO:tasks.workunit.client.1.smithi167.stdout:4/178: dread d0/d4/d7/f1b [0,4194304] 0 2024-09-17T01:41:18.346 INFO:tasks.workunit.client.1.smithi167.stdout:4/179: dread d0/d4/d7/f23 [0,4194304] 0 2024-09-17T01:41:18.360 INFO:tasks.workunit.client.1.smithi167.stdout:8/234: getdents dc/d1a/d45 0 2024-09-17T01:41:18.360 INFO:tasks.workunit.client.1.smithi167.stdout:8/235: chown dc/d1a/l3d 40848279 1 2024-09-17T01:41:18.363 INFO:tasks.workunit.client.1.smithi167.stdout:8/236: unlink dc/f19 0 2024-09-17T01:41:18.365 INFO:tasks.workunit.client.1.smithi167.stdout:8/237: symlink dc/d18/l50 0 2024-09-17T01:41:18.371 INFO:tasks.workunit.client.1.smithi167.stdout:8/238: dwrite dc/f36 [0,4194304] 0 2024-09-17T01:41:18.371 INFO:tasks.workunit.client.1.smithi167.stdout:6/149: truncate d7/f21 2484695 0 2024-09-17T01:41:18.372 INFO:tasks.workunit.client.1.smithi167.stdout:6/150: fdatasync d7/d12/f1c 0 2024-09-17T01:41:18.373 INFO:tasks.workunit.client.1.smithi167.stdout:6/151: fsync d7/fa 0 2024-09-17T01:41:18.373 INFO:tasks.workunit.client.1.smithi167.stdout:3/95: truncate d7/d8/f15 2556928 0 2024-09-17T01:41:18.374 INFO:tasks.workunit.client.1.smithi167.stdout:3/96: dread - d7/da/f1c zero size 2024-09-17T01:41:18.376 INFO:tasks.workunit.client.1.smithi167.stdout:8/239: mknod dc/c51 0 2024-09-17T01:41:18.380 INFO:tasks.workunit.client.1.smithi167.stdout:6/152: rename d7/d12/d27/d28/l2a to d7/d11/d13/l3b 0 2024-09-17T01:41:18.385 INFO:tasks.workunit.client.1.smithi167.stdout:8/240: creat dc/d1a/f52 x:0 0 0 2024-09-17T01:41:18.385 INFO:tasks.workunit.client.1.smithi167.stdout:6/153: symlink d7/d11/d34/l3c 0 2024-09-17T01:41:18.385 INFO:tasks.workunit.client.1.smithi167.stdout:8/241: chown dc/d21/f44 30396 1 2024-09-17T01:41:18.386 INFO:tasks.workunit.client.1.smithi167.stdout:4/180: truncate d0/d4/d7/da/f2c 983982 0 2024-09-17T01:41:18.389 INFO:tasks.workunit.client.1.smithi167.stdout:8/242: symlink dc/l53 0 2024-09-17T01:41:18.390 INFO:tasks.workunit.client.1.smithi167.stdout:3/97: write d7/d8/f15 [1989393,69917] 0 2024-09-17T01:41:18.392 INFO:tasks.workunit.client.1.smithi167.stdout:6/154: link d7/c14 d7/d12/d27/c3d 0 2024-09-17T01:41:18.392 INFO:tasks.workunit.client.1.smithi167.stdout:8/243: creat dc/d1a/d45/f54 x:0 0 0 2024-09-17T01:41:18.393 INFO:tasks.workunit.client.1.smithi167.stdout:6/155: read d7/d12/f1c [1545512,110335] 0 2024-09-17T01:41:18.394 INFO:tasks.workunit.client.1.smithi167.stdout:8/244: truncate dc/d18/f46 4677825 0 2024-09-17T01:41:18.395 INFO:tasks.workunit.client.1.smithi167.stdout:8/245: chown dc/d1a/l40 175549528 1 2024-09-17T01:41:18.397 INFO:tasks.workunit.client.1.smithi167.stdout:3/98: dwrite d7/d8/d10/f13 [0,4194304] 0 2024-09-17T01:41:18.398 INFO:tasks.workunit.client.1.smithi167.stdout:6/156: link d7/d11/lc d7/d12/d27/l3e 0 2024-09-17T01:41:18.398 INFO:tasks.workunit.client.1.smithi167.stdout:3/99: fsync d7/da/f1c 0 2024-09-17T01:41:18.400 INFO:tasks.workunit.client.1.smithi167.stdout:8/246: read f7 [1386478,97115] 0 2024-09-17T01:41:18.401 INFO:tasks.workunit.client.1.smithi167.stdout:6/157: unlink d7/d11/d13/f39 0 2024-09-17T01:41:18.401 INFO:tasks.workunit.client.1.smithi167.stdout:0/123: sync 2024-09-17T01:41:18.401 INFO:tasks.workunit.client.1.smithi167.stdout:0/124: dread - d5/d8/d9/f1a zero size 2024-09-17T01:41:18.402 INFO:tasks.workunit.client.1.smithi167.stdout:8/247: creat dc/d21/f55 x:0 0 0 2024-09-17T01:41:18.404 INFO:tasks.workunit.client.1.smithi167.stdout:6/158: dread d7/d11/d13/f17 [0,4194304] 0 2024-09-17T01:41:18.405 INFO:tasks.workunit.client.1.smithi167.stdout:6/159: dread - d7/d11/d13/f2d zero size 2024-09-17T01:41:18.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/248: mkdir dc/d56 0 2024-09-17T01:41:18.408 INFO:tasks.workunit.client.1.smithi167.stdout:6/160: creat d7/d11/d13/f3f x:0 0 0 2024-09-17T01:41:18.410 INFO:tasks.workunit.client.1.smithi167.stdout:8/249: truncate dc/f15 1701720 0 2024-09-17T01:41:18.411 INFO:tasks.workunit.client.1.smithi167.stdout:6/161: creat d7/d12/f40 x:0 0 0 2024-09-17T01:41:18.411 INFO:tasks.workunit.client.1.smithi167.stdout:0/125: write d5/d8/d9/d19/f22 [1939135,82044] 0 2024-09-17T01:41:18.412 INFO:tasks.workunit.client.1.smithi167.stdout:8/250: mkdir dc/d56/d57 0 2024-09-17T01:41:18.414 INFO:tasks.workunit.client.1.smithi167.stdout:6/162: creat d7/d11/d13/d2f/d30/d32/f41 x:0 0 0 2024-09-17T01:41:18.417 INFO:tasks.workunit.client.1.smithi167.stdout:8/251: mknod dc/d56/d57/c58 0 2024-09-17T01:41:18.417 INFO:tasks.workunit.client.1.smithi167.stdout:6/163: dread d7/d12/f1d [0,4194304] 0 2024-09-17T01:41:18.418 INFO:tasks.workunit.client.1.smithi167.stdout:0/126: rename d5/d8/d9/c17 to d5/d8/c25 0 2024-09-17T01:41:18.419 INFO:tasks.workunit.client.1.smithi167.stdout:0/127: write d5/d8/f20 [902367,48007] 0 2024-09-17T01:41:18.420 INFO:tasks.workunit.client.1.smithi167.stdout:8/252: mkdir dc/d56/d59 0 2024-09-17T01:41:18.420 INFO:tasks.workunit.client.1.smithi167.stdout:0/128: readlink d5/d8/d9/d19/l12 0 2024-09-17T01:41:18.420 INFO:tasks.workunit.client.1.smithi167.stdout:8/253: dread - dc/d1a/d45/f54 zero size 2024-09-17T01:41:18.421 INFO:tasks.workunit.client.1.smithi167.stdout:6/164: mkdir d7/d42 0 2024-09-17T01:41:18.423 INFO:tasks.workunit.client.1.smithi167.stdout:8/254: creat dc/d21/f5a x:0 0 0 2024-09-17T01:41:18.424 INFO:tasks.workunit.client.1.smithi167.stdout:8/255: chown dc/d21/f24 1337258421 1 2024-09-17T01:41:18.427 INFO:tasks.workunit.client.1.smithi167.stdout:6/165: rename d7/d11/c35 to d7/d12/c43 0 2024-09-17T01:41:18.427 INFO:tasks.workunit.client.1.smithi167.stdout:8/256: write dc/f3c [4407742,64606] 0 2024-09-17T01:41:18.427 INFO:tasks.workunit.client.1.smithi167.stdout:0/129: link d5/d8/c16 d5/c26 0 2024-09-17T01:41:18.428 INFO:tasks.workunit.client.1.smithi167.stdout:8/257: stat dc/d56/d57 0 2024-09-17T01:41:18.428 INFO:tasks.workunit.client.1.smithi167.stdout:6/166: write d7/d11/d13/f17 [1845757,109997] 0 2024-09-17T01:41:18.430 INFO:tasks.workunit.client.1.smithi167.stdout:8/258: creat dc/d56/d57/f5b x:0 0 0 2024-09-17T01:41:18.430 INFO:tasks.workunit.client.1.smithi167.stdout:6/167: read d7/d11/f10 [2943628,107798] 0 2024-09-17T01:41:18.430 INFO:tasks.workunit.client.1.smithi167.stdout:6/168: fdatasync d7/fa 0 2024-09-17T01:41:18.431 INFO:tasks.workunit.client.1.smithi167.stdout:8/259: write dc/d21/f5a [535278,77313] 0 2024-09-17T01:41:18.432 INFO:tasks.workunit.client.1.smithi167.stdout:0/130: dread d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:18.433 INFO:tasks.workunit.client.1.smithi167.stdout:6/169: symlink d7/d11/d13/d2f/d30/l44 0 2024-09-17T01:41:18.433 INFO:tasks.workunit.client.1.smithi167.stdout:8/260: mkdir dc/d56/d57/d5c 0 2024-09-17T01:41:18.434 INFO:tasks.workunit.client.1.smithi167.stdout:0/131: chown c2 12733355 1 2024-09-17T01:41:18.435 INFO:tasks.workunit.client.1.smithi167.stdout:6/170: unlink d7/d12/f1d 0 2024-09-17T01:41:18.436 INFO:tasks.workunit.client.1.smithi167.stdout:0/132: stat d5/d8/c16 0 2024-09-17T01:41:18.437 INFO:tasks.workunit.client.1.smithi167.stdout:6/171: mkdir d7/d11/d13/d2f/d30/d32/d45 0 2024-09-17T01:41:18.438 INFO:tasks.workunit.client.1.smithi167.stdout:0/133: symlink d5/d8/d9/l27 0 2024-09-17T01:41:18.440 INFO:tasks.workunit.client.1.smithi167.stdout:6/172: creat d7/d12/d27/d28/f46 x:0 0 0 2024-09-17T01:41:18.442 INFO:tasks.workunit.client.1.smithi167.stdout:0/134: symlink d5/d8/d9/d19/l28 0 2024-09-17T01:41:18.445 INFO:tasks.workunit.client.1.smithi167.stdout:6/173: dwrite d7/f29 [0,4194304] 0 2024-09-17T01:41:18.446 INFO:tasks.workunit.client.1.smithi167.stdout:6/174: chown d7/d11/d34 2784237 1 2024-09-17T01:41:18.450 INFO:tasks.workunit.client.1.smithi167.stdout:8/261: truncate dc/d1a/f30 460640 0 2024-09-17T01:41:18.452 INFO:tasks.workunit.client.1.smithi167.stdout:8/262: creat dc/d56/d57/d5c/f5d x:0 0 0 2024-09-17T01:41:18.454 INFO:tasks.workunit.client.1.smithi167.stdout:8/263: creat dc/d56/f5e x:0 0 0 2024-09-17T01:41:18.455 INFO:tasks.workunit.client.1.smithi167.stdout:8/264: mknod dc/d18/c5f 0 2024-09-17T01:41:18.486 INFO:tasks.workunit.client.1.smithi167.stdout:0/135: write d5/f1d [1266380,805] 0 2024-09-17T01:41:18.487 INFO:tasks.workunit.client.1.smithi167.stdout:6/175: write d7/d11/f10 [4497730,38653] 0 2024-09-17T01:41:18.488 INFO:tasks.workunit.client.1.smithi167.stdout:6/176: write d7/d11/d13/f3f [1023007,60289] 0 2024-09-17T01:41:18.490 INFO:tasks.workunit.client.1.smithi167.stdout:6/177: write d7/d12/f40 [97419,119752] 0 2024-09-17T01:41:18.490 INFO:tasks.workunit.client.1.smithi167.stdout:0/136: symlink d5/d8/d9/l29 0 2024-09-17T01:41:18.490 INFO:tasks.workunit.client.1.smithi167.stdout:6/178: chown d7/d12/d27/d28 6377 1 2024-09-17T01:41:18.493 INFO:tasks.workunit.client.1.smithi167.stdout:6/179: getdents d7/d11/d34 0 2024-09-17T01:41:18.495 INFO:tasks.workunit.client.1.smithi167.stdout:6/180: chown d7/d11/d13/c16 54 1 2024-09-17T01:41:18.495 INFO:tasks.workunit.client.1.smithi167.stdout:8/265: dwrite dc/f15 [0,4194304] 0 2024-09-17T01:41:18.498 INFO:tasks.workunit.client.1.smithi167.stdout:6/181: creat d7/d11/d13/d2f/d30/d32/f47 x:0 0 0 2024-09-17T01:41:18.499 INFO:tasks.workunit.client.1.smithi167.stdout:6/182: write d7/d11/d13/f17 [965991,12468] 0 2024-09-17T01:41:18.499 INFO:tasks.workunit.client.1.smithi167.stdout:6/183: rename d7 to d7/d42/d48 22 2024-09-17T01:41:18.499 INFO:tasks.workunit.client.1.smithi167.stdout:6/184: chown d7/fa 159 1 2024-09-17T01:41:18.500 INFO:tasks.workunit.client.1.smithi167.stdout:6/185: stat d7/d12/f23 0 2024-09-17T01:41:18.503 INFO:tasks.workunit.client.1.smithi167.stdout:6/186: creat d7/d11/d13/f49 x:0 0 0 2024-09-17T01:41:18.503 INFO:tasks.workunit.client.1.smithi167.stdout:6/187: read - d7/d11/d13/f2d zero size 2024-09-17T01:41:18.505 INFO:tasks.workunit.client.1.smithi167.stdout:6/188: getdents d7/d12/d27/d3a 0 2024-09-17T01:41:18.539 INFO:tasks.workunit.client.1.smithi167.stdout:1/112: sync 2024-09-17T01:41:18.542 INFO:tasks.workunit.client.1.smithi167.stdout:1/113: dread d0/d5/f12 [0,4194304] 0 2024-09-17T01:41:18.544 INFO:tasks.workunit.client.1.smithi167.stdout:1/114: symlink d0/d9/d1e/l28 0 2024-09-17T01:41:18.547 INFO:tasks.workunit.client.1.smithi167.stdout:1/115: dread d0/d5/f12 [0,4194304] 0 2024-09-17T01:41:18.548 INFO:tasks.workunit.client.1.smithi167.stdout:1/116: truncate d0/d5/f12 3485476 0 2024-09-17T01:41:18.548 INFO:tasks.workunit.client.1.smithi167.stdout:6/189: truncate f6 180186 0 2024-09-17T01:41:18.548 INFO:tasks.workunit.client.1.smithi167.stdout:1/117: fdatasync d0/d9/d1e/f14 0 2024-09-17T01:41:18.549 INFO:tasks.workunit.client.1.smithi167.stdout:6/190: fdatasync d7/d12/f40 0 2024-09-17T01:41:18.549 INFO:tasks.workunit.client.1.smithi167.stdout:1/118: chown d0/d9/d1e/c1c 258146 1 2024-09-17T01:41:18.550 INFO:tasks.workunit.client.1.smithi167.stdout:6/191: symlink d7/d12/l4a 0 2024-09-17T01:41:18.552 INFO:tasks.workunit.client.1.smithi167.stdout:6/192: mknod d7/d12/d27/d3a/c4b 0 2024-09-17T01:41:18.553 INFO:tasks.workunit.client.1.smithi167.stdout:6/193: rmdir d7/d12/d27/d28 39 2024-09-17T01:41:18.554 INFO:tasks.workunit.client.1.smithi167.stdout:1/119: dwrite d0/d9/d1e/f14 [0,4194304] 0 2024-09-17T01:41:18.556 INFO:tasks.workunit.client.1.smithi167.stdout:1/120: mknod d0/d9/c29 0 2024-09-17T01:41:18.636 INFO:tasks.workunit.client.1.smithi167.stdout:6/194: getdents d7/d11/d13/d2f/d30 0 2024-09-17T01:41:18.637 INFO:tasks.workunit.client.1.smithi167.stdout:1/121: dread d0/d5/f12 [0,4194304] 0 2024-09-17T01:41:18.674 INFO:tasks.workunit.client.1.smithi167.stdout:7/136: sync 2024-09-17T01:41:18.674 INFO:tasks.workunit.client.1.smithi167.stdout:9/109: sync 2024-09-17T01:41:18.675 INFO:tasks.workunit.client.1.smithi167.stdout:9/110: stat f1 0 2024-09-17T01:41:18.679 INFO:tasks.workunit.client.1.smithi167.stdout:7/137: write d0/d2/d14/f16 [824624,79679] 0 2024-09-17T01:41:18.679 INFO:tasks.workunit.client.1.smithi167.stdout:6/195: dwrite d7/d12/d27/f26 [0,4194304] 0 2024-09-17T01:41:18.681 INFO:tasks.workunit.client.1.smithi167.stdout:1/122: dwrite d0/d9/f25 [0,4194304] 0 2024-09-17T01:41:18.683 INFO:tasks.workunit.client.1.smithi167.stdout:7/138: write d0/f13 [3712384,90243] 0 2024-09-17T01:41:18.685 INFO:tasks.workunit.client.1.smithi167.stdout:1/123: read d0/d5/fd [334671,96783] 0 2024-09-17T01:41:18.690 INFO:tasks.workunit.client.1.smithi167.stdout:9/111: dwrite f1 [0,4194304] 0 2024-09-17T01:41:18.691 INFO:tasks.workunit.client.1.smithi167.stdout:9/112: truncate d4/f16 991529 0 2024-09-17T01:41:18.692 INFO:tasks.workunit.client.1.smithi167.stdout:6/196: dwrite d7/f29 [0,4194304] 0 2024-09-17T01:41:18.694 INFO:tasks.workunit.client.1.smithi167.stdout:6/197: write d7/d12/f1c [2075683,60029] 0 2024-09-17T01:41:18.696 INFO:tasks.workunit.client.1.smithi167.stdout:9/113: creat d4/d9/f20 x:0 0 0 2024-09-17T01:41:18.699 INFO:tasks.workunit.client.1.smithi167.stdout:1/124: dread d0/d5/fd [4194304,4194304] 0 2024-09-17T01:41:18.701 INFO:tasks.workunit.client.1.smithi167.stdout:9/114: mkdir d4/d9/d21 0 2024-09-17T01:41:18.701 INFO:tasks.workunit.client.1.smithi167.stdout:6/198: dread d7/d11/d13/f3f [0,4194304] 0 2024-09-17T01:41:18.702 INFO:tasks.workunit.client.1.smithi167.stdout:6/199: write d7/d12/f23 [263218,30241] 0 2024-09-17T01:41:18.705 INFO:tasks.workunit.client.1.smithi167.stdout:9/115: creat d4/d9/f22 x:0 0 0 2024-09-17T01:41:18.706 INFO:tasks.workunit.client.1.smithi167.stdout:1/125: link d0/d9/d1e/l28 d0/d9/l2a 0 2024-09-17T01:41:18.706 INFO:tasks.workunit.client.1.smithi167.stdout:9/116: chown d4/d9/f1d 12738723 1 2024-09-17T01:41:18.709 INFO:tasks.workunit.client.1.smithi167.stdout:1/126: rename d0/d9/f25 to d0/d9/d1e/d26/f2b 0 2024-09-17T01:41:18.710 INFO:tasks.workunit.client.1.smithi167.stdout:6/200: rmdir d7/d11/d13/d2f/d30/d32/d45 0 2024-09-17T01:41:18.711 INFO:tasks.workunit.client.1.smithi167.stdout:1/127: fsync d0/d5/fd 0 2024-09-17T01:41:18.712 INFO:tasks.workunit.client.1.smithi167.stdout:6/201: mknod d7/d11/d13/d2f/c4c 0 2024-09-17T01:41:18.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:18 smithi082 ceph-mon[28077]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 18 MiB/s wr, 392 op/s 2024-09-17T01:41:18.714 INFO:tasks.workunit.client.1.smithi167.stdout:6/202: creat d7/d11/d13/d2f/f4d x:0 0 0 2024-09-17T01:41:18.715 INFO:tasks.workunit.client.1.smithi167.stdout:6/203: read d7/d11/f1b [1463321,93583] 0 2024-09-17T01:41:18.717 INFO:tasks.workunit.client.1.smithi167.stdout:6/204: creat d7/d12/f4e x:0 0 0 2024-09-17T01:41:18.719 INFO:tasks.workunit.client.1.smithi167.stdout:6/205: rename d7/l20 to d7/d12/l4f 0 2024-09-17T01:41:18.723 INFO:tasks.workunit.client.1.smithi167.stdout:6/206: rename d7/d12/d27/l3e to d7/d11/d34/l50 0 2024-09-17T01:41:18.724 INFO:tasks.workunit.client.1.smithi167.stdout:6/207: write d7/d12/f23 [15779,84588] 0 2024-09-17T01:41:18.725 INFO:tasks.workunit.client.1.smithi167.stdout:1/128: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:18.727 INFO:tasks.workunit.client.1.smithi167.stdout:6/208: creat d7/d11/d34/f51 x:0 0 0 2024-09-17T01:41:18.729 INFO:tasks.workunit.client.1.smithi167.stdout:6/209: mkdir d7/d52 0 2024-09-17T01:41:18.730 INFO:tasks.workunit.client.1.smithi167.stdout:1/129: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:18.734 INFO:tasks.workunit.client.1.smithi167.stdout:6/210: write d7/d12/d27/d28/f31 [3990640,57325] 0 2024-09-17T01:41:18.737 INFO:tasks.workunit.client.1.smithi167.stdout:1/130: dwrite d0/f17 [0,4194304] 0 2024-09-17T01:41:18.737 INFO:tasks.workunit.client.1.smithi167.stdout:6/211: write d7/d11/d13/d2f/f4d [776499,23464] 0 2024-09-17T01:41:18.739 INFO:tasks.workunit.client.1.smithi167.stdout:6/212: write d7/d11/f10 [1150154,108252] 0 2024-09-17T01:41:18.741 INFO:tasks.workunit.client.1.smithi167.stdout:1/131: symlink d0/d9/d1e/d26/l2c 0 2024-09-17T01:41:18.746 INFO:tasks.workunit.client.1.smithi167.stdout:6/213: dwrite d7/d12/f40 [0,4194304] 0 2024-09-17T01:41:18.748 INFO:tasks.workunit.client.1.smithi167.stdout:6/214: write d7/d11/d13/f17 [3519012,81039] 0 2024-09-17T01:41:18.753 INFO:tasks.workunit.client.1.smithi167.stdout:6/215: link d7/d12/l22 d7/d12/d27/d3a/l53 0 2024-09-17T01:41:18.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:18 smithi167 ceph-mon[35643]: pgmap v12: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 18 MiB/s wr, 392 op/s 2024-09-17T01:41:18.754 INFO:tasks.workunit.client.1.smithi167.stdout:1/132: rename d0/d9/d1e/d26 to d0/d5/d2d 0 2024-09-17T01:41:18.755 INFO:tasks.workunit.client.1.smithi167.stdout:1/133: chown d0/d9/d1e 13735 1 2024-09-17T01:41:18.757 INFO:tasks.workunit.client.1.smithi167.stdout:1/134: creat d0/f2e x:0 0 0 2024-09-17T01:41:18.757 INFO:tasks.workunit.client.1.smithi167.stdout:6/216: dread d7/d11/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:18.757 INFO:tasks.workunit.client.1.smithi167.stdout:6/217: fdatasync d7/f29 0 2024-09-17T01:41:18.758 INFO:tasks.workunit.client.1.smithi167.stdout:1/135: readlink d0/d9/d1e/l28 0 2024-09-17T01:41:18.759 INFO:tasks.workunit.client.1.smithi167.stdout:1/136: write d0/f17 [780172,48329] 0 2024-09-17T01:41:18.759 INFO:tasks.workunit.client.1.smithi167.stdout:6/218: write d7/d12/d27/f26 [4880563,83972] 0 2024-09-17T01:41:18.761 INFO:tasks.workunit.client.1.smithi167.stdout:6/219: dread - d7/d11/d34/f51 zero size 2024-09-17T01:41:18.765 INFO:tasks.workunit.client.1.smithi167.stdout:1/137: dwrite d0/f2e [0,4194304] 0 2024-09-17T01:41:18.766 INFO:tasks.workunit.client.1.smithi167.stdout:1/138: rename d0/d9 to d0/d9/d2f 22 2024-09-17T01:41:18.772 INFO:tasks.workunit.client.1.smithi167.stdout:1/139: creat d0/d9/d1e/f30 x:0 0 0 2024-09-17T01:41:18.772 INFO:tasks.workunit.client.1.smithi167.stdout:6/220: mkdir d7/d54 0 2024-09-17T01:41:18.775 INFO:tasks.workunit.client.1.smithi167.stdout:6/221: creat d7/d11/d13/f55 x:0 0 0 2024-09-17T01:41:18.776 INFO:tasks.workunit.client.1.smithi167.stdout:1/140: rmdir d0/d9/d16/d1f 0 2024-09-17T01:41:18.777 INFO:tasks.workunit.client.1.smithi167.stdout:2/157: sync 2024-09-17T01:41:18.779 INFO:tasks.workunit.client.1.smithi167.stdout:2/158: creat d5/f2f x:0 0 0 2024-09-17T01:41:18.784 INFO:tasks.workunit.client.1.smithi167.stdout:6/222: dwrite d7/d11/d13/f55 [0,4194304] 0 2024-09-17T01:41:18.784 INFO:tasks.workunit.client.1.smithi167.stdout:2/159: getdents d5/d10/d1a 0 2024-09-17T01:41:18.785 INFO:tasks.workunit.client.1.smithi167.stdout:2/160: dread - d5/f2f zero size 2024-09-17T01:41:18.786 INFO:tasks.workunit.client.1.smithi167.stdout:6/223: mkdir d7/d12/d27/d3a/d56 0 2024-09-17T01:41:18.786 INFO:tasks.workunit.client.1.smithi167.stdout:1/141: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:18.787 INFO:tasks.workunit.client.1.smithi167.stdout:2/161: creat d5/d10/f30 x:0 0 0 2024-09-17T01:41:18.790 INFO:tasks.workunit.client.1.smithi167.stdout:2/162: read d5/d1f/f20 [769011,98776] 0 2024-09-17T01:41:18.791 INFO:tasks.workunit.client.1.smithi167.stdout:6/224: dwrite d7/d12/d27/d28/f31 [0,4194304] 0 2024-09-17T01:41:18.793 INFO:tasks.workunit.client.1.smithi167.stdout:2/163: creat d5/d10/d1a/f31 x:0 0 0 2024-09-17T01:41:18.831 INFO:tasks.workunit.client.1.smithi167.stdout:6/225: getdents d7/d11/d13/d2f/d30 0 2024-09-17T01:41:18.833 INFO:tasks.workunit.client.1.smithi167.stdout:6/226: creat d7/d11/d13/d2f/d30/d32/f57 x:0 0 0 2024-09-17T01:41:18.833 INFO:tasks.workunit.client.1.smithi167.stdout:6/227: readlink d7/d12/d27/l33 0 2024-09-17T01:41:18.835 INFO:tasks.workunit.client.1.smithi167.stdout:2/164: truncate d5/d10/d16/f18 2474563 0 2024-09-17T01:41:18.839 INFO:tasks.workunit.client.1.smithi167.stdout:6/228: dwrite d7/d11/f1b [0,4194304] 0 2024-09-17T01:41:18.841 INFO:tasks.workunit.client.1.smithi167.stdout:6/229: rmdir d7/d11/d13 39 2024-09-17T01:41:18.841 INFO:tasks.workunit.client.1.smithi167.stdout:2/165: dwrite d5/d10/d16/f19 [0,4194304] 0 2024-09-17T01:41:18.843 INFO:tasks.workunit.client.1.smithi167.stdout:6/230: read - d7/d11/d13/f2d zero size 2024-09-17T01:41:18.843 INFO:tasks.workunit.client.1.smithi167.stdout:2/166: mknod d5/c32 0 2024-09-17T01:41:18.845 INFO:tasks.workunit.client.1.smithi167.stdout:2/167: mkdir d5/d33 0 2024-09-17T01:41:18.848 INFO:tasks.workunit.client.1.smithi167.stdout:6/231: dread d7/d12/f40 [0,4194304] 0 2024-09-17T01:41:18.855 INFO:tasks.workunit.client.1.smithi167.stdout:6/232: creat d7/d11/d13/d2f/d30/d32/f58 x:0 0 0 2024-09-17T01:41:18.858 INFO:tasks.workunit.client.1.smithi167.stdout:6/233: dwrite d7/d12/f23 [0,4194304] 0 2024-09-17T01:41:18.862 INFO:tasks.workunit.client.1.smithi167.stdout:6/234: dread d7/d11/f1b [0,4194304] 0 2024-09-17T01:41:18.864 INFO:tasks.workunit.client.1.smithi167.stdout:6/235: unlink d7/d12/c38 0 2024-09-17T01:41:18.865 INFO:tasks.workunit.client.1.smithi167.stdout:0/137: sync 2024-09-17T01:41:18.865 INFO:tasks.workunit.client.1.smithi167.stdout:5/88: sync 2024-09-17T01:41:18.865 INFO:tasks.workunit.client.1.smithi167.stdout:4/181: sync 2024-09-17T01:41:18.865 INFO:tasks.workunit.client.1.smithi167.stdout:3/100: sync 2024-09-17T01:41:18.865 INFO:tasks.workunit.client.1.smithi167.stdout:8/266: sync 2024-09-17T01:41:18.866 INFO:tasks.workunit.client.1.smithi167.stdout:8/267: chown dc/d1a/l1c 56 1 2024-09-17T01:41:18.867 INFO:tasks.workunit.client.1.smithi167.stdout:6/236: creat d7/d11/d13/d2f/d30/f59 x:0 0 0 2024-09-17T01:41:18.869 INFO:tasks.workunit.client.1.smithi167.stdout:4/182: fdatasync d0/f3 0 2024-09-17T01:41:18.870 INFO:tasks.workunit.client.1.smithi167.stdout:2/168: truncate d5/d10/d16/f2d 3113310 0 2024-09-17T01:41:18.871 INFO:tasks.workunit.client.1.smithi167.stdout:5/89: link d0/d9/fb d0/f13 0 2024-09-17T01:41:18.873 INFO:tasks.workunit.client.1.smithi167.stdout:2/169: chown d5/d1f/l2b 30496395 1 2024-09-17T01:41:18.873 INFO:tasks.workunit.client.1.smithi167.stdout:6/237: rmdir d7/d11/d13/d2f/d30 39 2024-09-17T01:41:18.875 INFO:tasks.workunit.client.1.smithi167.stdout:5/90: creat d0/f14 x:0 0 0 2024-09-17T01:41:18.876 INFO:tasks.workunit.client.1.smithi167.stdout:3/101: getdents d7/d8/d10 0 2024-09-17T01:41:18.876 INFO:tasks.workunit.client.1.smithi167.stdout:8/268: dwrite dc/d21/f31 [4194304,4194304] 0 2024-09-17T01:41:18.877 INFO:tasks.workunit.client.1.smithi167.stdout:6/238: chown d7/d12/d27/d28/l36 62369 1 2024-09-17T01:41:18.877 INFO:tasks.workunit.client.1.smithi167.stdout:4/183: rename d0/d35 to d0/d4/d7/d10/d19/d2d/d2e/d31/d3c 0 2024-09-17T01:41:18.878 INFO:tasks.workunit.client.1.smithi167.stdout:4/184: chown d0/d4/d7/f23 205069 1 2024-09-17T01:41:18.881 INFO:tasks.workunit.client.1.smithi167.stdout:3/102: chown d7/da/l1b 71551232 1 2024-09-17T01:41:18.881 INFO:tasks.workunit.client.1.smithi167.stdout:5/91: rename d0/f6 to d0/d9/f15 0 2024-09-17T01:41:18.883 INFO:tasks.workunit.client.1.smithi167.stdout:3/103: write d7/d8/d10/f13 [4630684,70952] 0 2024-09-17T01:41:18.883 INFO:tasks.workunit.client.1.smithi167.stdout:2/170: symlink d5/d10/d1a/d2e/l34 0 2024-09-17T01:41:18.884 INFO:tasks.workunit.client.1.smithi167.stdout:3/104: stat l5 0 2024-09-17T01:41:18.884 INFO:tasks.workunit.client.1.smithi167.stdout:0/138: truncate d5/f1d 2443175 0 2024-09-17T01:41:18.886 INFO:tasks.workunit.client.1.smithi167.stdout:5/92: mkdir d0/d16 0 2024-09-17T01:41:18.887 INFO:tasks.workunit.client.1.smithi167.stdout:4/185: rename d0/d4/d7/f1b to d0/d4/d7/d10/d19/d2d/d2e/f3d 0 2024-09-17T01:41:18.890 INFO:tasks.workunit.client.1.smithi167.stdout:3/105: mknod d7/c1d 0 2024-09-17T01:41:18.890 INFO:tasks.workunit.client.1.smithi167.stdout:8/269: getdents dc/d1a 0 2024-09-17T01:41:18.890 INFO:tasks.workunit.client.1.smithi167.stdout:5/93: chown d0/l1 483 1 2024-09-17T01:41:18.901 INFO:tasks.workunit.client.1.smithi167.stdout:9/117: sync 2024-09-17T01:41:18.901 INFO:tasks.workunit.client.1.smithi167.stdout:7/139: sync 2024-09-17T01:41:18.903 INFO:tasks.workunit.client.1.smithi167.stdout:5/94: fdatasync d0/f3 0 2024-09-17T01:41:18.905 INFO:tasks.workunit.client.1.smithi167.stdout:0/139: getdents d5/d8/d9/d19 0 2024-09-17T01:41:18.905 INFO:tasks.workunit.client.1.smithi167.stdout:2/171: dwrite d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:18.906 INFO:tasks.workunit.client.1.smithi167.stdout:9/118: chown d4/c15 34850790 1 2024-09-17T01:41:18.910 INFO:tasks.workunit.client.1.smithi167.stdout:4/186: write d0/f3 [2241096,119809] 0 2024-09-17T01:41:18.910 INFO:tasks.workunit.client.1.smithi167.stdout:3/106: write f3 [1214270,128078] 0 2024-09-17T01:41:18.912 INFO:tasks.workunit.client.1.smithi167.stdout:4/187: write d0/f13 [3663627,99639] 0 2024-09-17T01:41:18.912 INFO:tasks.workunit.client.1.smithi167.stdout:3/107: fsync d7/d8/d10/f13 0 2024-09-17T01:41:18.914 INFO:tasks.workunit.client.1.smithi167.stdout:3/108: read f6 [2405050,65251] 0 2024-09-17T01:41:18.915 INFO:tasks.workunit.client.1.smithi167.stdout:6/239: dread d7/fa [0,4194304] 0 2024-09-17T01:41:18.915 INFO:tasks.workunit.client.1.smithi167.stdout:3/109: write d7/da/f1c [625697,75237] 0 2024-09-17T01:41:18.918 INFO:tasks.workunit.client.1.smithi167.stdout:3/110: dread d7/d8/f15 [0,4194304] 0 2024-09-17T01:41:18.923 INFO:tasks.workunit.client.1.smithi167.stdout:3/111: dwrite f3 [0,4194304] 0 2024-09-17T01:41:18.924 INFO:tasks.workunit.client.1.smithi167.stdout:3/112: truncate f6 4820153 0 2024-09-17T01:41:18.949 INFO:tasks.workunit.client.1.smithi167.stdout:1/142: sync 2024-09-17T01:41:19.157 INFO:tasks.workunit.client.1.smithi167.stdout:5/95: mknod d0/c17 0 2024-09-17T01:41:19.159 INFO:tasks.workunit.client.1.smithi167.stdout:8/270: truncate dc/d18/f46 4107674 0 2024-09-17T01:41:19.159 INFO:tasks.workunit.client.1.smithi167.stdout:9/119: mknod d4/c23 0 2024-09-17T01:41:19.160 INFO:tasks.workunit.client.1.smithi167.stdout:2/172: symlink d5/d10/d1a/l35 0 2024-09-17T01:41:19.163 INFO:tasks.workunit.client.1.smithi167.stdout:4/188: symlink d0/d4/d7/d6/l3e 0 2024-09-17T01:41:19.165 INFO:tasks.workunit.client.1.smithi167.stdout:6/240: read f6 [128098,23323] 0 2024-09-17T01:41:19.166 INFO:tasks.workunit.client.1.smithi167.stdout:6/241: chown d7/d11/d13/d2f 448 1 2024-09-17T01:41:19.167 INFO:tasks.workunit.client.1.smithi167.stdout:1/143: creat d0/d9/f31 x:0 0 0 2024-09-17T01:41:19.168 INFO:tasks.workunit.client.1.smithi167.stdout:0/140: mknod d5/d8/c2a 0 2024-09-17T01:41:19.168 INFO:tasks.workunit.client.1.smithi167.stdout:7/140: truncate d0/d2/d14/d19/d26/ff 817127 0 2024-09-17T01:41:19.169 INFO:tasks.workunit.client.1.smithi167.stdout:5/96: write d0/d9/ff [769962,33911] 0 2024-09-17T01:41:19.170 INFO:tasks.workunit.client.1.smithi167.stdout:0/141: fdatasync d5/d8/d9/f1a 0 2024-09-17T01:41:19.170 INFO:tasks.workunit.client.1.smithi167.stdout:2/173: creat d5/d10/d1a/d2e/f36 x:0 0 0 2024-09-17T01:41:19.172 INFO:tasks.workunit.client.1.smithi167.stdout:5/97: chown d0/c7 384583434 1 2024-09-17T01:41:19.173 INFO:tasks.workunit.client.1.smithi167.stdout:4/189: dwrite d0/d4/d7/ff [0,4194304] 0 2024-09-17T01:41:19.175 INFO:tasks.workunit.client.1.smithi167.stdout:8/271: creat dc/d56/d59/f60 x:0 0 0 2024-09-17T01:41:19.178 INFO:tasks.workunit.client.1.smithi167.stdout:6/242: write d7/d11/d13/d2f/f4d [782629,35506] 0 2024-09-17T01:41:19.178 INFO:tasks.workunit.client.1.smithi167.stdout:7/141: creat d0/d2/f2e x:0 0 0 2024-09-17T01:41:19.178 INFO:tasks.workunit.client.1.smithi167.stdout:5/98: rmdir d0 39 2024-09-17T01:41:19.178 INFO:tasks.workunit.client.1.smithi167.stdout:1/144: mknod d0/c32 0 2024-09-17T01:41:19.180 INFO:tasks.workunit.client.1.smithi167.stdout:6/243: readlink d7/l2c 0 2024-09-17T01:41:19.180 INFO:tasks.workunit.client.1.smithi167.stdout:8/272: mkdir dc/d21/d61 0 2024-09-17T01:41:19.182 INFO:tasks.workunit.client.1.smithi167.stdout:2/174: dwrite d5/f7 [4194304,4194304] 0 2024-09-17T01:41:19.183 INFO:tasks.workunit.client.1.smithi167.stdout:1/145: symlink d0/d5/d2d/l33 0 2024-09-17T01:41:19.184 INFO:tasks.workunit.client.1.smithi167.stdout:7/142: creat d0/d2/d14/d19/f2f x:0 0 0 2024-09-17T01:41:19.185 INFO:tasks.workunit.client.1.smithi167.stdout:8/273: chown dc/l1e 0 1 2024-09-17T01:41:19.186 INFO:tasks.workunit.client.1.smithi167.stdout:6/244: chown d7/d12/d27/d3a/l53 5410989 1 2024-09-17T01:41:19.189 INFO:tasks.workunit.client.1.smithi167.stdout:2/175: creat d5/d10/d1a/f37 x:0 0 0 2024-09-17T01:41:19.190 INFO:tasks.workunit.client.1.smithi167.stdout:2/176: chown d5/d10/c15 255 1 2024-09-17T01:41:19.191 INFO:tasks.workunit.client.1.smithi167.stdout:1/146: rename d0/d9/d1e to d0/d5/d34 0 2024-09-17T01:41:19.193 INFO:tasks.workunit.client.1.smithi167.stdout:7/143: creat d0/d2/d14/d19/f30 x:0 0 0 2024-09-17T01:41:19.193 INFO:tasks.workunit.client.1.smithi167.stdout:8/274: creat dc/d56/f62 x:0 0 0 2024-09-17T01:41:19.198 INFO:tasks.workunit.client.1.smithi167.stdout:8/275: mknod dc/d21/d61/c63 0 2024-09-17T01:41:19.201 INFO:tasks.workunit.client.1.smithi167.stdout:2/177: dwrite d5/d10/d1a/f31 [0,4194304] 0 2024-09-17T01:41:19.204 INFO:tasks.workunit.client.1.smithi167.stdout:7/144: dread d0/f1 [0,4194304] 0 2024-09-17T01:41:19.205 INFO:tasks.workunit.client.1.smithi167.stdout:1/147: dwrite d0/d5/d2d/f2b [0,4194304] 0 2024-09-17T01:41:19.207 INFO:tasks.workunit.client.1.smithi167.stdout:7/145: write d0/d2/d14/d19/d26/f1c [2659821,97543] 0 2024-09-17T01:41:19.207 INFO:tasks.workunit.client.1.smithi167.stdout:2/178: mknod d5/d10/d16/c38 0 2024-09-17T01:41:19.210 INFO:tasks.workunit.client.1.smithi167.stdout:1/148: mknod d0/d9/d16/d22/c35 0 2024-09-17T01:41:19.211 INFO:tasks.workunit.client.1.smithi167.stdout:5/99: dread d0/f8 [0,4194304] 0 2024-09-17T01:41:19.213 INFO:tasks.workunit.client.1.smithi167.stdout:2/179: unlink d5/d10/f30 0 2024-09-17T01:41:19.214 INFO:tasks.workunit.client.1.smithi167.stdout:1/149: dread d0/f2e [0,4194304] 0 2024-09-17T01:41:19.214 INFO:tasks.workunit.client.1.smithi167.stdout:7/146: mknod d0/d2/d14/d19/d22/c31 0 2024-09-17T01:41:19.215 INFO:tasks.workunit.client.1.smithi167.stdout:7/147: dread - d0/d2/d14/d19/f30 zero size 2024-09-17T01:41:19.217 INFO:tasks.workunit.client.1.smithi167.stdout:5/100: creat d0/f18 x:0 0 0 2024-09-17T01:41:19.218 INFO:tasks.workunit.client.1.smithi167.stdout:1/150: mkdir d0/d9/d16/d36 0 2024-09-17T01:41:19.219 INFO:tasks.workunit.client.1.smithi167.stdout:5/101: write d0/f18 [902080,35445] 0 2024-09-17T01:41:19.220 INFO:tasks.workunit.client.1.smithi167.stdout:7/148: fdatasync d0/d2/d14/d19/d22/f2a 0 2024-09-17T01:41:19.221 INFO:tasks.workunit.client.1.smithi167.stdout:1/151: write d0/d5/d34/f30 [236060,26591] 0 2024-09-17T01:41:19.222 INFO:tasks.workunit.client.1.smithi167.stdout:1/152: chown d0/d5/fd 120 1 2024-09-17T01:41:19.223 INFO:tasks.workunit.client.1.smithi167.stdout:7/149: mkdir d0/d2/d14/d19/d32 0 2024-09-17T01:41:19.226 INFO:tasks.workunit.client.1.smithi167.stdout:7/150: chown d0/d2/d14/d19/c27 599039 1 2024-09-17T01:41:19.226 INFO:tasks.workunit.client.1.smithi167.stdout:5/102: dwrite d0/f18 [0,4194304] 0 2024-09-17T01:41:19.227 INFO:tasks.workunit.client.1.smithi167.stdout:5/103: chown d0/f14 830919 1 2024-09-17T01:41:19.230 INFO:tasks.workunit.client.1.smithi167.stdout:7/151: mkdir d0/d33 0 2024-09-17T01:41:19.230 INFO:tasks.workunit.client.1.smithi167.stdout:1/153: fdatasync d0/d5/d2d/f2b 0 2024-09-17T01:41:19.233 INFO:tasks.workunit.client.1.smithi167.stdout:5/104: rmdir d0/d16 0 2024-09-17T01:41:19.233 INFO:tasks.workunit.client.1.smithi167.stdout:1/154: stat d0/d5/d34/c27 0 2024-09-17T01:41:19.234 INFO:tasks.workunit.client.1.smithi167.stdout:1/155: chown d0/d5/d34/l28 1246 1 2024-09-17T01:41:19.234 INFO:tasks.workunit.client.1.smithi167.stdout:5/105: rmdir d0/d9 39 2024-09-17T01:41:19.238 INFO:tasks.workunit.client.1.smithi167.stdout:3/113: truncate d7/d8/f15 747725 0 2024-09-17T01:41:19.241 INFO:tasks.workunit.client.1.smithi167.stdout:1/156: getdents d0 0 2024-09-17T01:41:19.242 INFO:tasks.workunit.client.1.smithi167.stdout:1/157: write d0/d9/f31 [1030102,38985] 0 2024-09-17T01:41:19.242 INFO:tasks.workunit.client.1.smithi167.stdout:3/114: getdents d7 0 2024-09-17T01:41:19.245 INFO:tasks.workunit.client.1.smithi167.stdout:3/115: chown d7/c12 2485503 1 2024-09-17T01:41:19.246 INFO:tasks.workunit.client.1.smithi167.stdout:3/116: mkdir d7/d1e 0 2024-09-17T01:41:19.247 INFO:tasks.workunit.client.1.smithi167.stdout:1/158: dread d0/d9/f31 [0,4194304] 0 2024-09-17T01:41:19.247 INFO:tasks.workunit.client.1.smithi167.stdout:6/245: truncate f0 785323 0 2024-09-17T01:41:19.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/117: mkdir d7/d8/d1f 0 2024-09-17T01:41:19.249 INFO:tasks.workunit.client.1.smithi167.stdout:1/159: write d0/d9/fb [2404428,65173] 0 2024-09-17T01:41:19.251 INFO:tasks.workunit.client.1.smithi167.stdout:3/118: mkdir d7/d1e/d20 0 2024-09-17T01:41:19.252 INFO:tasks.workunit.client.1.smithi167.stdout:1/160: creat d0/d9/f37 x:0 0 0 2024-09-17T01:41:19.257 INFO:tasks.workunit.client.1.smithi167.stdout:8/276: dwrite dc/d1a/f30 [0,4194304] 0 2024-09-17T01:41:19.257 INFO:tasks.workunit.client.1.smithi167.stdout:5/106: getdents d0 0 2024-09-17T01:41:19.257 INFO:tasks.workunit.client.1.smithi167.stdout:7/152: truncate d0/d2/f21 85414 0 2024-09-17T01:41:19.259 INFO:tasks.workunit.client.1.smithi167.stdout:5/107: chown d0/d9 0 1 2024-09-17T01:41:19.259 INFO:tasks.workunit.client.1.smithi167.stdout:8/277: chown dc/fd 6045465 1 2024-09-17T01:41:19.259 INFO:tasks.workunit.client.1.smithi167.stdout:6/246: dwrite d7/d12/f4e [0,4194304] 0 2024-09-17T01:41:19.263 INFO:tasks.workunit.client.1.smithi167.stdout:7/153: chown d0/d2/d14/d19/f2f 21870075 1 2024-09-17T01:41:19.263 INFO:tasks.workunit.client.1.smithi167.stdout:1/161: mknod d0/d9/d16/c38 0 2024-09-17T01:41:19.267 INFO:tasks.workunit.client.1.smithi167.stdout:5/108: creat d0/f19 x:0 0 0 2024-09-17T01:41:19.269 INFO:tasks.workunit.client.1.smithi167.stdout:3/119: getdents d7/d8/d10 0 2024-09-17T01:41:19.270 INFO:tasks.workunit.client.1.smithi167.stdout:1/162: rename d0/d9/c18 to d0/d9/c39 0 2024-09-17T01:41:19.270 INFO:tasks.workunit.client.1.smithi167.stdout:6/247: rmdir d7/d11/d13/d2f/d30 39 2024-09-17T01:41:19.272 INFO:tasks.workunit.client.1.smithi167.stdout:5/109: symlink d0/l1a 0 2024-09-17T01:41:19.273 INFO:tasks.workunit.client.1.smithi167.stdout:3/120: symlink d7/d8/l21 0 2024-09-17T01:41:19.273 INFO:tasks.workunit.client.1.smithi167.stdout:8/278: dwrite dc/d21/f25 [0,4194304] 0 2024-09-17T01:41:19.275 INFO:tasks.workunit.client.1.smithi167.stdout:6/248: truncate d7/d12/d27/d28/f46 51504 0 2024-09-17T01:41:19.276 INFO:tasks.workunit.client.1.smithi167.stdout:7/154: dwrite d0/d2/d14/d19/d26/f1c [0,4194304] 0 2024-09-17T01:41:19.279 INFO:tasks.workunit.client.1.smithi167.stdout:3/121: getdents d7/d8/d1f 0 2024-09-17T01:41:19.281 INFO:tasks.workunit.client.1.smithi167.stdout:5/110: truncate d0/d9/f15 4274675 0 2024-09-17T01:41:19.283 INFO:tasks.workunit.client.1.smithi167.stdout:8/279: getdents dc/d1a/d45 0 2024-09-17T01:41:19.284 INFO:tasks.workunit.client.1.smithi167.stdout:3/122: chown d7/d8/d10/c19 47 1 2024-09-17T01:41:19.285 INFO:tasks.workunit.client.1.smithi167.stdout:7/155: dread d0/d2/d14/d19/d26/f1c [0,4194304] 0 2024-09-17T01:41:19.285 INFO:tasks.workunit.client.1.smithi167.stdout:5/111: mknod d0/d9/c1b 0 2024-09-17T01:41:19.287 INFO:tasks.workunit.client.1.smithi167.stdout:8/280: creat dc/d56/d59/f64 x:0 0 0 2024-09-17T01:41:19.291 INFO:tasks.workunit.client.1.smithi167.stdout:3/123: creat d7/d1e/d20/f22 x:0 0 0 2024-09-17T01:41:19.291 INFO:tasks.workunit.client.1.smithi167.stdout:8/281: dread dc/f3c [4194304,4194304] 0 2024-09-17T01:41:19.293 INFO:tasks.workunit.client.1.smithi167.stdout:8/282: mkdir dc/d56/d59/d65 0 2024-09-17T01:41:19.295 INFO:tasks.workunit.client.1.smithi167.stdout:8/283: symlink dc/d56/l66 0 2024-09-17T01:41:19.299 INFO:tasks.workunit.client.1.smithi167.stdout:3/124: dwrite d7/d1e/d20/f22 [0,4194304] 0 2024-09-17T01:41:19.304 INFO:tasks.workunit.client.1.smithi167.stdout:7/156: dwrite d0/f1 [0,4194304] 0 2024-09-17T01:41:19.306 INFO:tasks.workunit.client.1.smithi167.stdout:8/284: dread dc/f15 [0,4194304] 0 2024-09-17T01:41:19.309 INFO:tasks.workunit.client.1.smithi167.stdout:8/285: rename dc/l53 to dc/d56/d57/l67 0 2024-09-17T01:41:19.310 INFO:tasks.workunit.client.1.smithi167.stdout:7/157: read d0/d2/d14/f18 [182542,71530] 0 2024-09-17T01:41:19.315 INFO:tasks.workunit.client.1.smithi167.stdout:7/158: dread d0/f1 [0,4194304] 0 2024-09-17T01:41:19.316 INFO:tasks.workunit.client.1.smithi167.stdout:7/159: fdatasync d0/f13 0 2024-09-17T01:41:19.316 INFO:tasks.workunit.client.1.smithi167.stdout:7/160: write d0/f5 [74443,63927] 0 2024-09-17T01:41:19.318 INFO:tasks.workunit.client.1.smithi167.stdout:7/161: mkdir d0/d2/d14/d19/d26/d34 0 2024-09-17T01:41:19.318 INFO:tasks.workunit.client.1.smithi167.stdout:7/162: chown d0/d2/c3 16014250 1 2024-09-17T01:41:19.320 INFO:tasks.workunit.client.1.smithi167.stdout:7/163: unlink d0/d2/d14/d19/d22/c31 0 2024-09-17T01:41:19.325 INFO:tasks.workunit.client.1.smithi167.stdout:3/125: fsync d7/d1e/d20/f22 0 2024-09-17T01:41:19.326 INFO:tasks.workunit.client.1.smithi167.stdout:3/126: write f3 [2196860,97427] 0 2024-09-17T01:41:19.327 INFO:tasks.workunit.client.1.smithi167.stdout:8/286: getdents dc 0 2024-09-17T01:41:19.328 INFO:tasks.workunit.client.1.smithi167.stdout:9/120: sync 2024-09-17T01:41:19.330 INFO:tasks.workunit.client.1.smithi167.stdout:8/287: creat dc/d56/d57/d5c/f68 x:0 0 0 2024-09-17T01:41:19.330 INFO:tasks.workunit.client.1.smithi167.stdout:8/288: chown dc/d18/f2e 1104 1 2024-09-17T01:41:19.330 INFO:tasks.workunit.client.1.smithi167.stdout:3/127: rename d7/d8/c1a to d7/d8/d1f/c23 0 2024-09-17T01:41:19.331 INFO:tasks.workunit.client.1.smithi167.stdout:8/289: dread - dc/d21/f44 zero size 2024-09-17T01:41:19.334 INFO:tasks.workunit.client.1.smithi167.stdout:8/290: rename dc/d21/f55 to dc/d56/d59/d65/f69 0 2024-09-17T01:41:19.335 INFO:tasks.workunit.client.1.smithi167.stdout:8/291: readlink dc/d1a/d45/l4d 0 2024-09-17T01:41:19.335 INFO:tasks.workunit.client.1.smithi167.stdout:3/128: mkdir d7/d8/d10/d14/d24 0 2024-09-17T01:41:19.337 INFO:tasks.workunit.client.1.smithi167.stdout:9/121: getdents d4 0 2024-09-17T01:41:19.337 INFO:tasks.workunit.client.1.smithi167.stdout:8/292: mknod dc/d18/c6a 0 2024-09-17T01:41:19.337 INFO:tasks.workunit.client.1.smithi167.stdout:9/122: chown d4 70 1 2024-09-17T01:41:19.338 INFO:tasks.workunit.client.1.smithi167.stdout:3/129: rename d7/da to d7/d8/d10/d14/d25 0 2024-09-17T01:41:19.338 INFO:tasks.workunit.client.1.smithi167.stdout:8/293: mkdir dc/d21/d6b 0 2024-09-17T01:41:19.339 INFO:tasks.workunit.client.1.smithi167.stdout:7/164: dread d0/f5 [0,4194304] 0 2024-09-17T01:41:19.339 INFO:tasks.workunit.client.1.smithi167.stdout:3/130: dread - d7/d8/d10/f18 zero size 2024-09-17T01:41:19.340 INFO:tasks.workunit.client.1.smithi167.stdout:3/131: write d7/d1e/d20/f22 [4856097,1307] 0 2024-09-17T01:41:19.342 INFO:tasks.workunit.client.1.smithi167.stdout:7/165: creat d0/d2/d14/d19/d26/f35 x:0 0 0 2024-09-17T01:41:19.342 INFO:tasks.workunit.client.1.smithi167.stdout:3/132: chown d7/c1d 1574 1 2024-09-17T01:41:19.345 INFO:tasks.workunit.client.1.smithi167.stdout:9/123: dread d4/d9/f19 [0,4194304] 0 2024-09-17T01:41:19.346 INFO:tasks.workunit.client.1.smithi167.stdout:8/294: dwrite f8 [4194304,4194304] 0 2024-09-17T01:41:19.346 INFO:tasks.workunit.client.1.smithi167.stdout:9/124: readlink d4/l1e 0 2024-09-17T01:41:19.347 INFO:tasks.workunit.client.1.smithi167.stdout:9/125: write d4/f17 [704141,7237] 0 2024-09-17T01:41:19.350 INFO:tasks.workunit.client.1.smithi167.stdout:7/166: dread d0/f1 [0,4194304] 0 2024-09-17T01:41:19.351 INFO:tasks.workunit.client.1.smithi167.stdout:9/126: rename d4/c23 to d4/d9/c24 0 2024-09-17T01:41:19.351 INFO:tasks.workunit.client.1.smithi167.stdout:3/133: getdents d7/d8/d1f 0 2024-09-17T01:41:19.353 INFO:tasks.workunit.client.1.smithi167.stdout:9/127: dread d4/f17 [0,4194304] 0 2024-09-17T01:41:19.354 INFO:tasks.workunit.client.1.smithi167.stdout:9/128: stat d4/f17 0 2024-09-17T01:41:19.356 INFO:tasks.workunit.client.1.smithi167.stdout:3/134: unlink d7/d8/l9 0 2024-09-17T01:41:19.358 INFO:tasks.workunit.client.1.smithi167.stdout:9/129: fsync d4/f1f 0 2024-09-17T01:41:19.359 INFO:tasks.workunit.client.1.smithi167.stdout:8/295: write f7 [5117549,10296] 0 2024-09-17T01:41:19.360 INFO:tasks.workunit.client.1.smithi167.stdout:3/135: unlink d7/d8/d10/f18 0 2024-09-17T01:41:19.361 INFO:tasks.workunit.client.1.smithi167.stdout:3/136: chown d7/c12 100780034 1 2024-09-17T01:41:19.361 INFO:tasks.workunit.client.1.smithi167.stdout:7/167: write d0/d2/d14/d19/f1e [1562028,104803] 0 2024-09-17T01:41:19.362 INFO:tasks.workunit.client.1.smithi167.stdout:3/137: chown d7/d8/d10/d14/d25 108 1 2024-09-17T01:41:19.362 INFO:tasks.workunit.client.1.smithi167.stdout:7/168: chown d0/l24 1411029656 1 2024-09-17T01:41:19.363 INFO:tasks.workunit.client.1.smithi167.stdout:9/130: dread f1 [0,4194304] 0 2024-09-17T01:41:19.364 INFO:tasks.workunit.client.1.smithi167.stdout:8/296: link dc/d21/f44 dc/d21/d6b/f6c 0 2024-09-17T01:41:19.366 INFO:tasks.workunit.client.1.smithi167.stdout:3/138: creat d7/d8/d10/d14/f26 x:0 0 0 2024-09-17T01:41:19.367 INFO:tasks.workunit.client.1.smithi167.stdout:9/131: creat d4/d9/f25 x:0 0 0 2024-09-17T01:41:19.368 INFO:tasks.workunit.client.1.smithi167.stdout:9/132: read f1 [4548370,58764] 0 2024-09-17T01:41:19.369 INFO:tasks.workunit.client.1.smithi167.stdout:7/169: mknod d0/d2/d14/d19/d26/c36 0 2024-09-17T01:41:19.369 INFO:tasks.workunit.client.1.smithi167.stdout:8/297: dread dc/d1a/f49 [0,4194304] 0 2024-09-17T01:41:19.369 INFO:tasks.workunit.client.1.smithi167.stdout:9/133: stat d4/d9/f20 0 2024-09-17T01:41:19.369 INFO:tasks.workunit.client.1.smithi167.stdout:7/170: read d0/f5 [1578712,54351] 0 2024-09-17T01:41:19.370 INFO:tasks.workunit.client.1.smithi167.stdout:3/139: rename d7/d8/d10/d14/d25/le to d7/d1e/d20/l27 0 2024-09-17T01:41:19.370 INFO:tasks.workunit.client.1.smithi167.stdout:7/171: chown d0/d2/d14/d19/d26/d34 6 1 2024-09-17T01:41:19.371 INFO:tasks.workunit.client.1.smithi167.stdout:9/134: truncate d4/d9/f25 918710 0 2024-09-17T01:41:19.371 INFO:tasks.workunit.client.1.smithi167.stdout:7/172: fsync d0/d2/f17 0 2024-09-17T01:41:19.372 INFO:tasks.workunit.client.1.smithi167.stdout:9/135: fsync d4/d9/f22 0 2024-09-17T01:41:19.372 INFO:tasks.workunit.client.1.smithi167.stdout:3/140: mknod d7/d8/d1f/c28 0 2024-09-17T01:41:19.373 INFO:tasks.workunit.client.1.smithi167.stdout:8/298: dread f8 [4194304,4194304] 0 2024-09-17T01:41:19.374 INFO:tasks.workunit.client.1.smithi167.stdout:9/136: rmdir d4 39 2024-09-17T01:41:19.374 INFO:tasks.workunit.client.1.smithi167.stdout:8/299: dread - dc/f2f zero size 2024-09-17T01:41:19.375 INFO:tasks.workunit.client.1.smithi167.stdout:7/173: rename d0/d33 to d0/d2/d14/d23/d37 0 2024-09-17T01:41:19.376 INFO:tasks.workunit.client.1.smithi167.stdout:3/141: mkdir d7/d8/d10/d29 0 2024-09-17T01:41:19.377 INFO:tasks.workunit.client.1.smithi167.stdout:3/142: chown d7/d8/d1f 638294078 1 2024-09-17T01:41:19.379 INFO:tasks.workunit.client.1.smithi167.stdout:8/300: dwrite f7 [0,4194304] 0 2024-09-17T01:41:19.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/301: truncate f6 9599230 0 2024-09-17T01:41:19.382 INFO:tasks.workunit.client.1.smithi167.stdout:3/143: read d7/d8/f15 [704813,53863] 0 2024-09-17T01:41:19.388 INFO:tasks.workunit.client.1.smithi167.stdout:3/144: rename d7/d1e/d20 to d7/d8/d2a 0 2024-09-17T01:41:19.389 INFO:tasks.workunit.client.1.smithi167.stdout:7/174: dwrite d0/f5 [0,4194304] 0 2024-09-17T01:41:19.391 INFO:tasks.workunit.client.1.smithi167.stdout:3/145: mknod d7/d8/d1f/c2b 0 2024-09-17T01:41:19.391 INFO:tasks.workunit.client.1.smithi167.stdout:7/175: write d0/d2/d14/d19/f1e [2625810,120285] 0 2024-09-17T01:41:19.393 INFO:tasks.workunit.client.1.smithi167.stdout:9/137: dwrite d4/f8 [0,4194304] 0 2024-09-17T01:41:19.394 INFO:tasks.workunit.client.1.smithi167.stdout:3/146: mkdir d7/d8/d10/d14/d2c 0 2024-09-17T01:41:19.397 INFO:tasks.workunit.client.1.smithi167.stdout:8/302: truncate dc/d21/f25 4058750 0 2024-09-17T01:41:19.399 INFO:tasks.workunit.client.1.smithi167.stdout:9/138: rename d4/f8 to d4/d9/d21/f26 0 2024-09-17T01:41:19.400 INFO:tasks.workunit.client.1.smithi167.stdout:3/147: fsync d7/d8/f15 0 2024-09-17T01:41:19.402 INFO:tasks.workunit.client.1.smithi167.stdout:8/303: rename dc/d56/d57/c58 to dc/d18/c6d 0 2024-09-17T01:41:19.404 INFO:tasks.workunit.client.1.smithi167.stdout:9/139: unlink d4/d9/f22 0 2024-09-17T01:41:19.405 INFO:tasks.workunit.client.1.smithi167.stdout:7/176: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:19.405 INFO:tasks.workunit.client.1.smithi167.stdout:8/304: creat dc/d56/d57/d5c/f6e x:0 0 0 2024-09-17T01:41:19.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/305: chown dc/c14 4711 1 2024-09-17T01:41:19.409 INFO:tasks.workunit.client.1.smithi167.stdout:9/140: creat d4/d9/d21/f27 x:0 0 0 2024-09-17T01:41:19.409 INFO:tasks.workunit.client.1.smithi167.stdout:8/306: dread dc/f3c [0,4194304] 0 2024-09-17T01:41:19.410 INFO:tasks.workunit.client.1.smithi167.stdout:8/307: dread - dc/d1a/f4a zero size 2024-09-17T01:41:19.411 INFO:tasks.workunit.client.1.smithi167.stdout:9/141: creat d4/d9/f28 x:0 0 0 2024-09-17T01:41:19.412 INFO:tasks.workunit.client.1.smithi167.stdout:9/142: dread - d4/d9/f28 zero size 2024-09-17T01:41:19.413 INFO:tasks.workunit.client.1.smithi167.stdout:8/308: creat dc/d21/d61/f6f x:0 0 0 2024-09-17T01:41:19.414 INFO:tasks.workunit.client.1.smithi167.stdout:9/143: truncate d4/d9/d21/f27 1031706 0 2024-09-17T01:41:19.416 INFO:tasks.workunit.client.1.smithi167.stdout:8/309: unlink dc/d1a/f4c 0 2024-09-17T01:41:19.418 INFO:tasks.workunit.client.1.smithi167.stdout:8/310: creat dc/d56/f70 x:0 0 0 2024-09-17T01:41:19.420 INFO:tasks.workunit.client.1.smithi167.stdout:3/148: truncate d7/d8/d2a/f22 4399453 0 2024-09-17T01:41:19.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/311: symlink dc/d56/d59/d65/l71 0 2024-09-17T01:41:19.421 INFO:tasks.workunit.client.1.smithi167.stdout:9/144: getdents d4/d9/d21 0 2024-09-17T01:41:19.422 INFO:tasks.workunit.client.1.smithi167.stdout:9/145: chown d4/f18 14220972 1 2024-09-17T01:41:19.495 INFO:tasks.workunit.client.1.smithi167.stdout:0/142: sync 2024-09-17T01:41:19.495 INFO:tasks.workunit.client.1.smithi167.stdout:4/190: sync 2024-09-17T01:41:19.512 INFO:tasks.workunit.client.1.smithi167.stdout:9/146: symlink d4/d9/d21/l29 0 2024-09-17T01:41:19.512 INFO:tasks.workunit.client.1.smithi167.stdout:3/149: getdents d7/d8/d10 0 2024-09-17T01:41:19.516 INFO:tasks.workunit.client.1.smithi167.stdout:0/143: creat d5/d8/d9/d19/f2b x:0 0 0 2024-09-17T01:41:19.518 INFO:tasks.workunit.client.1.smithi167.stdout:3/150: write d7/d8/d10/d14/f26 [806105,70453] 0 2024-09-17T01:41:19.518 INFO:tasks.workunit.client.1.smithi167.stdout:8/312: dwrite dc/d56/d57/d5c/f5d [0,4194304] 0 2024-09-17T01:41:19.519 INFO:tasks.workunit.client.1.smithi167.stdout:9/147: dread d4/d9/f19 [0,4194304] 0 2024-09-17T01:41:19.526 INFO:tasks.workunit.client.1.smithi167.stdout:8/313: creat dc/d1a/f72 x:0 0 0 2024-09-17T01:41:19.526 INFO:tasks.workunit.client.1.smithi167.stdout:9/148: stat d4/l6 0 2024-09-17T01:41:19.526 INFO:tasks.workunit.client.1.smithi167.stdout:3/151: creat d7/d8/d10/d14/d2c/f2d x:0 0 0 2024-09-17T01:41:19.526 INFO:tasks.workunit.client.1.smithi167.stdout:9/149: dread f1 [4194304,4194304] 0 2024-09-17T01:41:19.526 INFO:tasks.workunit.client.1.smithi167.stdout:0/144: write d5/f1d [1265273,111804] 0 2024-09-17T01:41:19.527 INFO:tasks.workunit.client.1.smithi167.stdout:8/314: creat dc/d1a/f73 x:0 0 0 2024-09-17T01:41:19.527 INFO:tasks.workunit.client.1.smithi167.stdout:9/150: dread - d4/d9/f1d zero size 2024-09-17T01:41:19.528 INFO:tasks.workunit.client.1.smithi167.stdout:3/152: creat d7/d8/d2a/f2e x:0 0 0 2024-09-17T01:41:19.530 INFO:tasks.workunit.client.1.smithi167.stdout:9/151: creat d4/d9/f2a x:0 0 0 2024-09-17T01:41:19.531 INFO:tasks.workunit.client.1.smithi167.stdout:3/153: dread d7/d8/f15 [0,4194304] 0 2024-09-17T01:41:19.532 INFO:tasks.workunit.client.1.smithi167.stdout:0/145: dread d5/d8/d9/d19/f22 [0,4194304] 0 2024-09-17T01:41:19.533 INFO:tasks.workunit.client.1.smithi167.stdout:4/191: dread d0/fd [0,4194304] 0 2024-09-17T01:41:19.533 INFO:tasks.workunit.client.1.smithi167.stdout:9/152: unlink d4/f1f 0 2024-09-17T01:41:19.536 INFO:tasks.workunit.client.1.smithi167.stdout:3/154: dread d7/d8/d10/d14/d25/f1c [0,4194304] 0 2024-09-17T01:41:19.538 INFO:tasks.workunit.client.1.smithi167.stdout:8/315: write dc/d21/f25 [4720488,27558] 0 2024-09-17T01:41:19.540 INFO:tasks.workunit.client.1.smithi167.stdout:3/155: chown d7/d8/d2a/f2e 5 1 2024-09-17T01:41:19.542 INFO:tasks.workunit.client.1.smithi167.stdout:4/192: truncate d0/d4/d7/da/f30 372153 0 2024-09-17T01:41:19.542 INFO:tasks.workunit.client.1.smithi167.stdout:8/316: dread - dc/d1a/f73 zero size 2024-09-17T01:41:19.543 INFO:tasks.workunit.client.1.smithi167.stdout:0/146: dwrite d5/d8/d9/f1a [0,4194304] 0 2024-09-17T01:41:19.546 INFO:tasks.workunit.client.1.smithi167.stdout:9/153: dwrite d4/d9/f19 [0,4194304] 0 2024-09-17T01:41:19.547 INFO:tasks.workunit.client.1.smithi167.stdout:9/154: readlink d4/l5 0 2024-09-17T01:41:19.550 INFO:tasks.workunit.client.1.smithi167.stdout:8/317: mkdir dc/d21/d6b/d74 0 2024-09-17T01:41:19.551 INFO:tasks.workunit.client.1.smithi167.stdout:9/155: mkdir d4/d9/d2b 0 2024-09-17T01:41:19.552 INFO:tasks.workunit.client.1.smithi167.stdout:3/156: dread f6 [0,4194304] 0 2024-09-17T01:41:19.552 INFO:tasks.workunit.client.1.smithi167.stdout:4/193: getdents d0/d4/d7/d6/d2b 0 2024-09-17T01:41:19.555 INFO:tasks.workunit.client.1.smithi167.stdout:9/156: write d4/d9/f1d [337650,86979] 0 2024-09-17T01:41:19.555 INFO:tasks.workunit.client.1.smithi167.stdout:3/157: chown d7/d8/d1f/c2b 132248667 1 2024-09-17T01:41:19.559 INFO:tasks.workunit.client.1.smithi167.stdout:4/194: dread d0/d4/d7/f23 [0,4194304] 0 2024-09-17T01:41:19.561 INFO:tasks.workunit.client.1.smithi167.stdout:9/157: chown d4/d9/c24 0 1 2024-09-17T01:41:19.562 INFO:tasks.workunit.client.1.smithi167.stdout:4/195: chown d0/c3b 21 1 2024-09-17T01:41:19.563 INFO:tasks.workunit.client.1.smithi167.stdout:8/318: dwrite dc/d21/f5a [0,4194304] 0 2024-09-17T01:41:19.563 INFO:tasks.workunit.client.1.smithi167.stdout:0/147: truncate d5/d8/d9/d19/f22 3318814 0 2024-09-17T01:41:19.565 INFO:tasks.workunit.client.1.smithi167.stdout:8/319: rmdir dc 39 2024-09-17T01:41:19.565 INFO:tasks.workunit.client.1.smithi167.stdout:0/148: fsync d5/f1d 0 2024-09-17T01:41:19.569 INFO:tasks.workunit.client.1.smithi167.stdout:1/163: sync 2024-09-17T01:41:19.569 INFO:tasks.workunit.client.1.smithi167.stdout:2/180: sync 2024-09-17T01:41:19.570 INFO:tasks.workunit.client.1.smithi167.stdout:0/149: write d5/d8/d9/f1a [1273583,72708] 0 2024-09-17T01:41:19.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/158: dwrite d7/d8/d10/f13 [0,4194304] 0 2024-09-17T01:41:19.570 INFO:tasks.workunit.client.1.smithi167.stdout:8/320: readlink dc/d56/l66 0 2024-09-17T01:41:19.570 INFO:tasks.workunit.client.1.smithi167.stdout:2/181: chown d5/d8 1345 1 2024-09-17T01:41:19.571 INFO:tasks.workunit.client.1.smithi167.stdout:3/159: readlink l2 0 2024-09-17T01:41:19.575 INFO:tasks.workunit.client.1.smithi167.stdout:9/158: dread d4/d9/f19 [0,4194304] 0 2024-09-17T01:41:19.577 INFO:tasks.workunit.client.1.smithi167.stdout:0/150: read d5/f7 [1484984,9133] 0 2024-09-17T01:41:19.578 INFO:tasks.workunit.client.1.smithi167.stdout:8/321: symlink dc/d21/l75 0 2024-09-17T01:41:19.579 INFO:tasks.workunit.client.1.smithi167.stdout:1/164: rename d0/d5/d34/l28 to d0/l3a 0 2024-09-17T01:41:19.580 INFO:tasks.workunit.client.1.smithi167.stdout:3/160: creat d7/d8/d10/d14/d2c/f2f x:0 0 0 2024-09-17T01:41:19.582 INFO:tasks.workunit.client.1.smithi167.stdout:8/322: rmdir dc/d21 39 2024-09-17T01:41:19.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/159: dwrite d4/d9/f28 [0,4194304] 0 2024-09-17T01:41:19.585 INFO:tasks.workunit.client.1.smithi167.stdout:1/165: chown d0/d5/d34/l21 1237530 1 2024-09-17T01:41:19.586 INFO:tasks.workunit.client.1.smithi167.stdout:8/323: dread - dc/d1a/f73 zero size 2024-09-17T01:41:19.589 INFO:tasks.workunit.client.1.smithi167.stdout:4/196: truncate d0/d4/d7/d10/d19/d2d/d2e/f3d 4044358 0 2024-09-17T01:41:19.592 INFO:tasks.workunit.client.1.smithi167.stdout:3/161: dwrite d7/d8/d10/d14/d25/f1c [0,4194304] 0 2024-09-17T01:41:19.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/160: mknod d4/d9/d2b/c2c 0 2024-09-17T01:41:19.595 INFO:tasks.workunit.client.1.smithi167.stdout:1/166: mknod d0/d9/d16/d36/c3b 0 2024-09-17T01:41:19.595 INFO:tasks.workunit.client.1.smithi167.stdout:8/324: mknod dc/d56/d57/c76 0 2024-09-17T01:41:19.598 INFO:tasks.workunit.client.1.smithi167.stdout:4/197: creat d0/d4/d7/d10/f3f x:0 0 0 2024-09-17T01:41:19.601 INFO:tasks.workunit.client.1.smithi167.stdout:8/325: fdatasync dc/f2f 0 2024-09-17T01:41:19.601 INFO:tasks.workunit.client.1.smithi167.stdout:3/162: getdents d7/d8 0 2024-09-17T01:41:19.601 INFO:tasks.workunit.client.1.smithi167.stdout:4/198: rmdir d0/d4/d7 39 2024-09-17T01:41:19.605 INFO:tasks.workunit.client.1.smithi167.stdout:3/163: write d7/d8/d10/d14/f26 [1086692,69092] 0 2024-09-17T01:41:19.605 INFO:tasks.workunit.client.1.smithi167.stdout:1/167: dread d0/d5/d34/f14 [0,4194304] 0 2024-09-17T01:41:19.607 INFO:tasks.workunit.client.1.smithi167.stdout:2/182: dread d5/d10/d16/f2d [0,4194304] 0 2024-09-17T01:41:19.609 INFO:tasks.workunit.client.1.smithi167.stdout:4/199: mkdir d0/d4/d7/d10/d19/d2d/d2e/d31/d3c/d40 0 2024-09-17T01:41:19.611 INFO:tasks.workunit.client.1.smithi167.stdout:9/161: dwrite d4/d9/d21/f26 [4194304,4194304] 0 2024-09-17T01:41:19.612 INFO:tasks.workunit.client.1.smithi167.stdout:2/183: mkdir d5/d10/d1a/d39 0 2024-09-17T01:41:19.612 INFO:tasks.workunit.client.1.smithi167.stdout:4/200: chown d0/fd 31 1 2024-09-17T01:41:19.613 INFO:tasks.workunit.client.1.smithi167.stdout:1/168: rename d0/d5/d2d to d0/d5/d34/d3c 0 2024-09-17T01:41:19.617 INFO:tasks.workunit.client.1.smithi167.stdout:8/326: dwrite dc/d1a/f49 [4194304,4194304] 0 2024-09-17T01:41:19.618 INFO:tasks.workunit.client.1.smithi167.stdout:9/162: mkdir d4/d9/d21/d2d 0 2024-09-17T01:41:19.618 INFO:tasks.workunit.client.1.smithi167.stdout:4/201: rename d0 to d0/d4/d7/d10/d19/d2d/d41 22 2024-09-17T01:41:19.618 INFO:tasks.workunit.client.1.smithi167.stdout:1/169: read d0/d9/f31 [858711,79813] 0 2024-09-17T01:41:19.623 INFO:tasks.workunit.client.1.smithi167.stdout:1/170: fsync d0/f17 0 2024-09-17T01:41:19.623 INFO:tasks.workunit.client.1.smithi167.stdout:2/184: rename d5/d10/d1a/d2e/l34 to d5/d10/l3a 0 2024-09-17T01:41:19.627 INFO:tasks.workunit.client.1.smithi167.stdout:4/202: mknod d0/d4/d7/d10/d19/d2d/d2e/d31/d3c/c42 0 2024-09-17T01:41:19.628 INFO:tasks.workunit.client.1.smithi167.stdout:9/163: dwrite d4/d9/f1d [0,4194304] 0 2024-09-17T01:41:19.633 INFO:tasks.workunit.client.1.smithi167.stdout:9/164: rmdir d4 39 2024-09-17T01:41:19.634 INFO:tasks.workunit.client.1.smithi167.stdout:4/203: creat d0/d4/d7/d6/f43 x:0 0 0 2024-09-17T01:41:19.636 INFO:tasks.workunit.client.1.smithi167.stdout:3/164: truncate d7/d8/d10/f13 2894717 0 2024-09-17T01:41:19.636 INFO:tasks.workunit.client.1.smithi167.stdout:1/171: dwrite d0/d5/d34/f30 [0,4194304] 0 2024-09-17T01:41:19.636 INFO:tasks.workunit.client.1.smithi167.stdout:2/185: link d5/f2a d5/d10/d1a/d2e/f3b 0 2024-09-17T01:41:19.637 INFO:tasks.workunit.client.1.smithi167.stdout:8/327: getdents dc/d18 0 2024-09-17T01:41:19.639 INFO:tasks.workunit.client.1.smithi167.stdout:4/204: write d0/d4/d7/f23 [1661531,66649] 0 2024-09-17T01:41:19.640 INFO:tasks.workunit.client.1.smithi167.stdout:2/186: mkdir d5/d3c 0 2024-09-17T01:41:19.641 INFO:tasks.workunit.client.1.smithi167.stdout:9/165: dread - d4/d9/f2a zero size 2024-09-17T01:41:19.641 INFO:tasks.workunit.client.1.smithi167.stdout:1/172: fsync d0/d5/f12 0 2024-09-17T01:41:19.642 INFO:tasks.workunit.client.1.smithi167.stdout:2/187: fsync d5/d10/d1a/f37 0 2024-09-17T01:41:19.643 INFO:tasks.workunit.client.1.smithi167.stdout:4/205: creat d0/f44 x:0 0 0 2024-09-17T01:41:19.645 INFO:tasks.workunit.client.1.smithi167.stdout:8/328: rename dc/d56/d57/d5c/f6e to dc/d56/d59/f77 0 2024-09-17T01:41:19.646 INFO:tasks.workunit.client.1.smithi167.stdout:8/329: chown dc/d1a/d45/l4d 465 1 2024-09-17T01:41:19.646 INFO:tasks.workunit.client.1.smithi167.stdout:2/188: mknod d5/d10/d16/c3d 0 2024-09-17T01:41:19.646 INFO:tasks.workunit.client.1.smithi167.stdout:1/173: dread d0/d5/d34/f14 [0,4194304] 0 2024-09-17T01:41:19.647 INFO:tasks.workunit.client.1.smithi167.stdout:4/206: rmdir d0/d4/d7/d10 39 2024-09-17T01:41:19.648 INFO:tasks.workunit.client.1.smithi167.stdout:9/166: mkdir d4/d9/d21/d2d/d2e 0 2024-09-17T01:41:19.650 INFO:tasks.workunit.client.1.smithi167.stdout:2/189: mknod d5/d3c/c3e 0 2024-09-17T01:41:19.652 INFO:tasks.workunit.client.1.smithi167.stdout:8/330: write dc/f36 [1357877,38079] 0 2024-09-17T01:41:19.654 INFO:tasks.workunit.client.1.smithi167.stdout:2/190: write d5/f7 [7691357,40876] 0 2024-09-17T01:41:19.654 INFO:tasks.workunit.client.1.smithi167.stdout:4/207: write d0/d4/d7/d10/f3f [206784,85778] 0 2024-09-17T01:41:19.654 INFO:tasks.workunit.client.1.smithi167.stdout:9/167: creat d4/d9/d21/f2f x:0 0 0 2024-09-17T01:41:19.657 INFO:tasks.workunit.client.1.smithi167.stdout:2/191: write d5/f2f [904358,79415] 0 2024-09-17T01:41:19.657 INFO:tasks.workunit.client.1.smithi167.stdout:8/331: read - dc/d21/d61/f6f zero size 2024-09-17T01:41:19.660 INFO:tasks.workunit.client.1.smithi167.stdout:1/174: dwrite d0/d5/f12 [4194304,4194304] 0 2024-09-17T01:41:19.662 INFO:tasks.workunit.client.1.smithi167.stdout:2/192: mkdir d5/d8/d3f 0 2024-09-17T01:41:19.662 INFO:tasks.workunit.client.1.smithi167.stdout:3/165: write f6 [2082133,8036] 0 2024-09-17T01:41:19.663 INFO:tasks.workunit.client.1.smithi167.stdout:1/175: fdatasync d0/d5/d34/f30 0 2024-09-17T01:41:19.665 INFO:tasks.workunit.client.1.smithi167.stdout:6/249: sync 2024-09-17T01:41:19.665 INFO:tasks.workunit.client.1.smithi167.stdout:7/177: sync 2024-09-17T01:41:19.665 INFO:tasks.workunit.client.1.smithi167.stdout:5/112: sync 2024-09-17T01:41:19.666 INFO:tasks.workunit.client.1.smithi167.stdout:8/332: truncate dc/d21/d61/f6f 162613 0 2024-09-17T01:41:19.667 INFO:tasks.workunit.client.1.smithi167.stdout:4/208: truncate d0/d4/d7/d6/f43 994984 0 2024-09-17T01:41:19.669 INFO:tasks.workunit.client.1.smithi167.stdout:9/168: truncate f1 1128208 0 2024-09-17T01:41:19.670 INFO:tasks.workunit.client.1.smithi167.stdout:5/113: write d0/f11 [520130,76861] 0 2024-09-17T01:41:19.670 INFO:tasks.workunit.client.1.smithi167.stdout:7/178: creat d0/d2/d14/d23/f38 x:0 0 0 2024-09-17T01:41:19.712 INFO:tasks.workunit.client.1.smithi167.stdout:1/176: unlink d0/c32 0 2024-09-17T01:41:19.712 INFO:tasks.workunit.client.1.smithi167.stdout:5/114: fsync d0/f11 0 2024-09-17T01:41:19.712 INFO:tasks.workunit.client.1.smithi167.stdout:3/166: dread f6 [0,4194304] 0 2024-09-17T01:41:19.712 INFO:tasks.workunit.client.1.smithi167.stdout:5/115: chown d0 2162026 1 2024-09-17T01:41:19.712 INFO:tasks.workunit.client.1.smithi167.stdout:9/169: rename d4/c1a to d4/d9/d2b/c30 0 2024-09-17T01:41:19.713 INFO:tasks.workunit.client.1.smithi167.stdout:9/170: readlink d4/d9/l13 0 2024-09-17T01:41:19.714 INFO:tasks.workunit.client.1.smithi167.stdout:2/193: link d5/d10/d16/f1b d5/d3c/f40 0 2024-09-17T01:41:19.716 INFO:tasks.workunit.client.1.smithi167.stdout:3/167: symlink d7/d8/l30 0 2024-09-17T01:41:19.717 INFO:tasks.workunit.client.1.smithi167.stdout:3/168: write d7/d8/d10/d14/d2c/f2f [904575,36869] 0 2024-09-17T01:41:19.717 INFO:tasks.workunit.client.1.smithi167.stdout:5/116: mkdir d0/d9/d1c 0 2024-09-17T01:41:19.718 INFO:tasks.workunit.client.1.smithi167.stdout:5/117: readlink d0/d9/ld 0 2024-09-17T01:41:19.718 INFO:tasks.workunit.client.1.smithi167.stdout:3/169: read - d7/d8/d10/d14/d2c/f2d zero size 2024-09-17T01:41:19.719 INFO:tasks.workunit.client.1.smithi167.stdout:4/209: link d0/d4/c8 d0/d4/d7/d10/d19/c45 0 2024-09-17T01:41:19.720 INFO:tasks.workunit.client.1.smithi167.stdout:2/194: write d5/d1f/f20 [1020991,86741] 0 2024-09-17T01:41:19.720 INFO:tasks.workunit.client.1.smithi167.stdout:9/171: dread d4/f17 [0,4194304] 0 2024-09-17T01:41:19.722 INFO:tasks.workunit.client.1.smithi167.stdout:2/195: fdatasync d5/d1f/f26 0 2024-09-17T01:41:19.722 INFO:tasks.workunit.client.1.smithi167.stdout:3/170: truncate d7/d8/d10/d14/f26 1598108 0 2024-09-17T01:41:19.722 INFO:tasks.workunit.client.1.smithi167.stdout:4/210: rmdir d0/d4 39 2024-09-17T01:41:19.723 INFO:tasks.workunit.client.1.smithi167.stdout:1/177: getdents d0/d9/d16/d22 0 2024-09-17T01:41:19.724 INFO:tasks.workunit.client.1.smithi167.stdout:3/171: chown d7/d8/d10/d14/d25/c11 8 1 2024-09-17T01:41:19.726 INFO:tasks.workunit.client.1.smithi167.stdout:2/196: symlink d5/l41 0 2024-09-17T01:41:19.728 INFO:tasks.workunit.client.1.smithi167.stdout:5/118: creat d0/f1d x:0 0 0 2024-09-17T01:41:19.729 INFO:tasks.workunit.client.1.smithi167.stdout:5/119: chown d0/d9/ff 836 1 2024-09-17T01:41:19.729 INFO:tasks.workunit.client.1.smithi167.stdout:1/178: symlink d0/d5/d34/l3d 0 2024-09-17T01:41:19.730 INFO:tasks.workunit.client.1.smithi167.stdout:1/179: chown d0/d9/d16/c38 68996689 1 2024-09-17T01:41:19.733 INFO:tasks.workunit.client.1.smithi167.stdout:2/197: creat d5/d10/f42 x:0 0 0 2024-09-17T01:41:19.734 INFO:tasks.workunit.client.1.smithi167.stdout:4/211: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:19.735 INFO:tasks.workunit.client.1.smithi167.stdout:3/172: rename d7/d8/d1f/c23 to d7/d8/d10/d14/d2c/c31 0 2024-09-17T01:41:19.737 INFO:tasks.workunit.client.1.smithi167.stdout:1/180: write d0/d5/d34/f14 [2228786,76807] 0 2024-09-17T01:41:19.742 INFO:tasks.workunit.client.1.smithi167.stdout:4/212: unlink d0/d4/f28 0 2024-09-17T01:41:19.743 INFO:tasks.workunit.client.1.smithi167.stdout:2/198: dwrite d5/d8/f9 [0,4194304] 0 2024-09-17T01:41:19.743 INFO:tasks.workunit.client.1.smithi167.stdout:9/172: write f1 [529313,13170] 0 2024-09-17T01:41:19.745 INFO:tasks.workunit.client.1.smithi167.stdout:2/199: stat d5/d10 0 2024-09-17T01:41:19.750 INFO:tasks.workunit.client.1.smithi167.stdout:9/173: write d4/d9/f28 [612274,50238] 0 2024-09-17T01:41:19.750 INFO:tasks.workunit.client.1.smithi167.stdout:1/181: truncate d0/d5/d34/d3c/f2b 808923 0 2024-09-17T01:41:19.751 INFO:tasks.workunit.client.1.smithi167.stdout:2/200: mknod d5/d1f/c43 0 2024-09-17T01:41:19.752 INFO:tasks.workunit.client.1.smithi167.stdout:3/173: dwrite f3 [4194304,4194304] 0 2024-09-17T01:41:19.754 INFO:tasks.workunit.client.1.smithi167.stdout:1/182: fdatasync d0/d9/f31 0 2024-09-17T01:41:19.754 INFO:tasks.workunit.client.1.smithi167.stdout:2/201: stat d5/d10/d16/f1b 0 2024-09-17T01:41:19.757 INFO:tasks.workunit.client.1.smithi167.stdout:4/213: rename d0/d4/d7/ff to d0/d4/d7/d10/d19/d2d/d2e/d31/f46 0 2024-09-17T01:41:19.758 INFO:tasks.workunit.client.1.smithi167.stdout:2/202: creat d5/f44 x:0 0 0 2024-09-17T01:41:19.759 INFO:tasks.workunit.client.1.smithi167.stdout:5/120: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:19.760 INFO:tasks.workunit.client.1.smithi167.stdout:1/183: write d0/d5/d34/f30 [1327706,111904] 0 2024-09-17T01:41:19.760 INFO:tasks.workunit.client.1.smithi167.stdout:3/174: creat d7/d8/d10/d14/d24/f32 x:0 0 0 2024-09-17T01:41:19.764 INFO:tasks.workunit.client.1.smithi167.stdout:5/121: fdatasync d0/f19 0 2024-09-17T01:41:19.764 INFO:tasks.workunit.client.1.smithi167.stdout:0/151: sync 2024-09-17T01:41:19.766 INFO:tasks.workunit.client.1.smithi167.stdout:2/203: write d5/f44 [906648,121066] 0 2024-09-17T01:41:19.768 INFO:tasks.workunit.client.1.smithi167.stdout:3/175: mknod d7/d8/d10/d29/c33 0 2024-09-17T01:41:19.770 INFO:tasks.workunit.client.1.smithi167.stdout:9/174: dwrite d4/d9/f2a [0,4194304] 0 2024-09-17T01:41:19.770 INFO:tasks.workunit.client.1.smithi167.stdout:5/122: fdatasync d0/f18 0 2024-09-17T01:41:19.771 INFO:tasks.workunit.client.1.smithi167.stdout:4/214: dread d0/d4/d7/d10/f3f [0,4194304] 0 2024-09-17T01:41:19.773 INFO:tasks.workunit.client.1.smithi167.stdout:9/175: chown d4/d9/f28 10075 1 2024-09-17T01:41:19.773 INFO:tasks.workunit.client.1.smithi167.stdout:2/204: read d5/f7 [1401711,14200] 0 2024-09-17T01:41:19.774 INFO:tasks.workunit.client.1.smithi167.stdout:9/176: chown d4/d9/d21 175254 1 2024-09-17T01:41:19.775 INFO:tasks.workunit.client.1.smithi167.stdout:3/176: symlink d7/d1e/l34 0 2024-09-17T01:41:19.776 INFO:tasks.workunit.client.1.smithi167.stdout:0/152: creat d5/d8/d9/f2c x:0 0 0 2024-09-17T01:41:19.778 INFO:tasks.workunit.client.1.smithi167.stdout:1/184: dread d0/f2e [0,4194304] 0 2024-09-17T01:41:19.778 INFO:tasks.workunit.client.1.smithi167.stdout:5/123: symlink d0/l1e 0 2024-09-17T01:41:19.779 INFO:tasks.workunit.client.1.smithi167.stdout:3/177: truncate d7/d8/f15 191057 0 2024-09-17T01:41:19.781 INFO:tasks.workunit.client.1.smithi167.stdout:2/205: fdatasync d5/d10/d1a/d2e/f3b 0 2024-09-17T01:41:19.782 INFO:tasks.workunit.client.1.smithi167.stdout:0/153: unlink d5/d8/c16 0 2024-09-17T01:41:19.784 INFO:tasks.workunit.client.1.smithi167.stdout:4/215: getdents d0/d4/d7/d10/d19 0 2024-09-17T01:41:19.786 INFO:tasks.workunit.client.1.smithi167.stdout:1/185: dread d0/d9/f31 [0,4194304] 0 2024-09-17T01:41:19.787 INFO:tasks.workunit.client.1.smithi167.stdout:2/206: rename d5/d8 to d5/d10/d1a/d45 0 2024-09-17T01:41:19.788 INFO:tasks.workunit.client.1.smithi167.stdout:9/177: dwrite f1 [0,4194304] 0 2024-09-17T01:41:19.793 INFO:tasks.workunit.client.1.smithi167.stdout:5/124: dwrite d0/d9/ff [0,4194304] 0 2024-09-17T01:41:19.794 INFO:tasks.workunit.client.1.smithi167.stdout:4/216: dread d0/fd [0,4194304] 0 2024-09-17T01:41:19.797 INFO:tasks.workunit.client.1.smithi167.stdout:0/154: link d5/d8/d9/d19/l13 d5/d8/l2d 0 2024-09-17T01:41:19.799 INFO:tasks.workunit.client.1.smithi167.stdout:5/125: rmdir d0 39 2024-09-17T01:41:19.802 INFO:tasks.workunit.client.1.smithi167.stdout:9/178: mknod d4/d9/d21/d2d/d2e/c31 0 2024-09-17T01:41:19.804 INFO:tasks.workunit.client.1.smithi167.stdout:9/179: mknod d4/d9/d21/c32 0 2024-09-17T01:41:19.808 INFO:tasks.workunit.client.1.smithi167.stdout:4/217: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:19.812 INFO:tasks.workunit.client.1.smithi167.stdout:4/218: chown d0/d4/d7/d6/l2f 43758 1 2024-09-17T01:41:19.813 INFO:tasks.workunit.client.1.smithi167.stdout:5/126: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:19.814 INFO:tasks.workunit.client.1.smithi167.stdout:4/219: dread - d0/f44 zero size 2024-09-17T01:41:19.815 INFO:tasks.workunit.client.1.smithi167.stdout:5/127: chown d0/f14 0 1 2024-09-17T01:41:19.818 INFO:tasks.workunit.client.1.smithi167.stdout:5/128: write d0/f14 [930985,13605] 0 2024-09-17T01:41:19.821 INFO:tasks.workunit.client.1.smithi167.stdout:3/178: write d7/d8/f15 [297573,13615] 0 2024-09-17T01:41:19.822 INFO:tasks.workunit.client.1.smithi167.stdout:5/129: symlink d0/d9/l1f 0 2024-09-17T01:41:19.826 INFO:tasks.workunit.client.1.smithi167.stdout:5/130: creat d0/f20 x:0 0 0 2024-09-17T01:41:19.827 INFO:tasks.workunit.client.1.smithi167.stdout:2/207: dwrite d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:19.830 INFO:tasks.workunit.client.1.smithi167.stdout:9/180: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:41:19.834 INFO:tasks.workunit.client.1.smithi167.stdout:2/208: fsync d5/d10/d16/f2d 0 2024-09-17T01:41:19.836 INFO:tasks.workunit.client.1.smithi167.stdout:3/179: dwrite d7/d8/d2a/f2e [0,4194304] 0 2024-09-17T01:41:19.839 INFO:tasks.workunit.client.1.smithi167.stdout:9/181: mkdir d4/d9/d21/d2d/d33 0 2024-09-17T01:41:19.839 INFO:tasks.workunit.client.1.smithi167.stdout:4/220: write d0/d4/d7/d10/d19/d2d/d2e/f3d [1152621,78633] 0 2024-09-17T01:41:19.841 INFO:tasks.workunit.client.1.smithi167.stdout:2/209: mkdir d5/d10/d1a/d46 0 2024-09-17T01:41:19.843 INFO:tasks.workunit.client.1.smithi167.stdout:9/182: symlink d4/d9/l34 0 2024-09-17T01:41:19.845 INFO:tasks.workunit.client.1.smithi167.stdout:5/131: rename d0/d9/f15 to d0/f21 0 2024-09-17T01:41:19.847 INFO:tasks.workunit.client.1.smithi167.stdout:3/180: dread d7/d8/d10/f13 [0,4194304] 0 2024-09-17T01:41:19.847 INFO:tasks.workunit.client.1.smithi167.stdout:2/210: mknod d5/d10/d1a/d45/c47 0 2024-09-17T01:41:19.849 INFO:tasks.workunit.client.1.smithi167.stdout:2/211: stat d5/d10/c15 0 2024-09-17T01:41:19.850 INFO:tasks.workunit.client.1.smithi167.stdout:4/221: link d0/f2 d0/d4/f47 0 2024-09-17T01:41:19.853 INFO:tasks.workunit.client.1.smithi167.stdout:5/132: rename d0/f8 to d0/f22 0 2024-09-17T01:41:19.855 INFO:tasks.workunit.client.1.smithi167.stdout:9/183: dwrite d4/d9/f19 [0,4194304] 0 2024-09-17T01:41:19.856 INFO:tasks.workunit.client.1.smithi167.stdout:4/222: rename d0/d4/d7/d10/d19/d2d/d2e/d31/d3c to d0/d4/d7/da/d48 0 2024-09-17T01:41:19.857 INFO:tasks.workunit.client.1.smithi167.stdout:9/184: symlink d4/d9/l35 0 2024-09-17T01:41:19.859 INFO:tasks.workunit.client.1.smithi167.stdout:9/185: symlink d4/l36 0 2024-09-17T01:41:19.860 INFO:tasks.workunit.client.1.smithi167.stdout:9/186: fsync d4/f16 0 2024-09-17T01:41:19.862 INFO:tasks.workunit.client.1.smithi167.stdout:9/187: write d4/f18 [608847,78647] 0 2024-09-17T01:41:19.864 INFO:tasks.workunit.client.1.smithi167.stdout:4/223: dwrite d0/d4/d7/d6/f29 [0,4194304] 0 2024-09-17T01:41:19.866 INFO:tasks.workunit.client.1.smithi167.stdout:4/224: write d0/d4/d7/d10/d19/f24 [165854,6963] 0 2024-09-17T01:41:19.867 INFO:tasks.workunit.client.1.smithi167.stdout:9/188: rename d4/d9/d21/d2d/d2e to d4/d9/d21/d37 0 2024-09-17T01:41:19.868 INFO:tasks.workunit.client.1.smithi167.stdout:4/225: mknod d0/d4/d7/da/c49 0 2024-09-17T01:41:19.869 INFO:tasks.workunit.client.1.smithi167.stdout:4/226: write d0/d4/d7/d10/d19/d2d/d2e/f34 [1481621,63312] 0 2024-09-17T01:41:19.870 INFO:tasks.workunit.client.1.smithi167.stdout:9/189: rename d4/f17 to d4/f38 0 2024-09-17T01:41:19.871 INFO:tasks.workunit.client.1.smithi167.stdout:9/190: chown d4/d9/d21/f27 61000 1 2024-09-17T01:41:19.872 INFO:tasks.workunit.client.1.smithi167.stdout:9/191: write d4/d9/f28 [3325061,50478] 0 2024-09-17T01:41:19.872 INFO:tasks.workunit.client.1.smithi167.stdout:9/192: fdatasync d4/d9/f20 0 2024-09-17T01:41:19.873 INFO:tasks.workunit.client.1.smithi167.stdout:6/250: sync 2024-09-17T01:41:19.873 INFO:tasks.workunit.client.1.smithi167.stdout:4/227: mknod d0/d4/d7/d10/d19/d2d/d2e/d31/c4a 0 2024-09-17T01:41:19.874 INFO:tasks.workunit.client.1.smithi167.stdout:6/251: write d7/d12/f2b [498541,11816] 0 2024-09-17T01:41:19.877 INFO:tasks.workunit.client.1.smithi167.stdout:4/228: mknod d0/d4/d7/d10/d19/d2d/d2e/c4b 0 2024-09-17T01:41:19.882 INFO:tasks.workunit.client.1.smithi167.stdout:6/252: rename d7/d11/d13/d2f/d30/d32/f57 to d7/d12/d27/d3a/f5a 0 2024-09-17T01:41:19.885 INFO:tasks.workunit.client.1.smithi167.stdout:3/181: truncate d7/d8/f15 275391 0 2024-09-17T01:41:19.887 INFO:tasks.workunit.client.1.smithi167.stdout:6/253: fdatasync f0 0 2024-09-17T01:41:19.888 INFO:tasks.workunit.client.1.smithi167.stdout:5/133: dread d0/f3 [4194304,4194304] 0 2024-09-17T01:41:19.890 INFO:tasks.workunit.client.1.smithi167.stdout:6/254: stat d7/d11/d13/d2f/d30/f59 0 2024-09-17T01:41:19.891 INFO:tasks.workunit.client.1.smithi167.stdout:5/134: write d0/f20 [951799,20587] 0 2024-09-17T01:41:19.892 INFO:tasks.workunit.client.1.smithi167.stdout:4/229: rename d0/d4/d7/da/d48/c42 to d0/d4/d7/d10/c4c 0 2024-09-17T01:41:19.893 INFO:tasks.workunit.client.1.smithi167.stdout:3/182: dread d7/d8/d10/d14/f26 [0,4194304] 0 2024-09-17T01:41:19.893 INFO:tasks.workunit.client.1.smithi167.stdout:9/193: rmdir d4/d9/d21/d37 39 2024-09-17T01:41:19.894 INFO:tasks.workunit.client.1.smithi167.stdout:5/135: write d0/f18 [4060913,95394] 0 2024-09-17T01:41:19.895 INFO:tasks.workunit.client.1.smithi167.stdout:2/212: dwrite d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:19.896 INFO:tasks.workunit.client.1.smithi167.stdout:9/194: read d4/d9/d21/f27 [709258,43432] 0 2024-09-17T01:41:19.898 INFO:tasks.workunit.client.1.smithi167.stdout:2/213: read d5/d10/d16/f19 [2532885,69517] 0 2024-09-17T01:41:19.899 INFO:tasks.workunit.client.1.smithi167.stdout:2/214: chown d5 166938371 1 2024-09-17T01:41:19.900 INFO:tasks.workunit.client.1.smithi167.stdout:4/230: creat d0/d4/d7/da/f4d x:0 0 0 2024-09-17T01:41:19.900 INFO:tasks.workunit.client.1.smithi167.stdout:2/215: read d5/f44 [174009,32121] 0 2024-09-17T01:41:19.908 INFO:tasks.workunit.client.1.smithi167.stdout:3/183: rename d7/d8/d1f/c2b to d7/d8/d2a/c35 0 2024-09-17T01:41:19.908 INFO:tasks.workunit.client.1.smithi167.stdout:9/195: symlink d4/d9/d2b/l39 0 2024-09-17T01:41:19.908 INFO:tasks.workunit.client.1.smithi167.stdout:5/136: truncate d0/f22 246984 0 2024-09-17T01:41:19.909 INFO:tasks.workunit.client.1.smithi167.stdout:6/255: link d7/d11/d13/d2f/d30/d32/f58 d7/d11/f5b 0 2024-09-17T01:41:19.911 INFO:tasks.workunit.client.1.smithi167.stdout:6/256: truncate d7/d11/d13/d2f/d30/d32/f41 97514 0 2024-09-17T01:41:19.921 INFO:tasks.workunit.client.1.smithi167.stdout:2/216: dread d5/d1f/f26 [0,4194304] 0 2024-09-17T01:41:19.925 INFO:tasks.workunit.client.1.smithi167.stdout:4/231: mknod d0/d4/d7/d10/c4e 0 2024-09-17T01:41:19.927 INFO:tasks.workunit.client.1.smithi167.stdout:9/196: mkdir d4/d9/d21/d2d/d33/d3a 0 2024-09-17T01:41:19.928 INFO:tasks.workunit.client.1.smithi167.stdout:5/137: link d0/f11 d0/d9/d1c/f23 0 2024-09-17T01:41:19.928 INFO:tasks.workunit.client.1.smithi167.stdout:2/217: mkdir d5/d33/d48 0 2024-09-17T01:41:19.929 INFO:tasks.workunit.client.1.smithi167.stdout:4/232: mkdir d0/d4/d7/d10/d19/d2d/d2e/d31/d4f 0 2024-09-17T01:41:19.929 INFO:tasks.workunit.client.1.smithi167.stdout:3/184: dread d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:19.930 INFO:tasks.workunit.client.1.smithi167.stdout:5/138: write d0/d9/fb [662505,82052] 0 2024-09-17T01:41:19.930 INFO:tasks.workunit.client.1.smithi167.stdout:6/257: creat d7/f5c x:0 0 0 2024-09-17T01:41:19.931 INFO:tasks.workunit.client.1.smithi167.stdout:2/218: fdatasync d5/f7 0 2024-09-17T01:41:19.932 INFO:tasks.workunit.client.1.smithi167.stdout:9/197: truncate d4/f16 964729 0 2024-09-17T01:41:19.933 INFO:tasks.workunit.client.1.smithi167.stdout:4/233: read d0/d4/d7/d10/f3f [185012,52126] 0 2024-09-17T01:41:19.933 INFO:tasks.workunit.client.1.smithi167.stdout:3/185: unlink d7/d8/d10/d14/d24/f32 0 2024-09-17T01:41:19.934 INFO:tasks.workunit.client.1.smithi167.stdout:6/258: chown d7/d12/d27/d3a/l53 251864 1 2024-09-17T01:41:19.936 INFO:tasks.workunit.client.1.smithi167.stdout:2/219: mkdir d5/d10/d1a/d2e/d49 0 2024-09-17T01:41:19.938 INFO:tasks.workunit.client.1.smithi167.stdout:6/259: rmdir d7/d11/d13/d2f 39 2024-09-17T01:41:19.939 INFO:tasks.workunit.client.1.smithi167.stdout:4/234: dread d0/d4/d7/d10/d19/f3a [0,4194304] 0 2024-09-17T01:41:19.943 INFO:tasks.workunit.client.1.smithi167.stdout:5/139: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:41:19.944 INFO:tasks.workunit.client.1.smithi167.stdout:6/260: mknod d7/c5d 0 2024-09-17T01:41:19.946 INFO:tasks.workunit.client.1.smithi167.stdout:9/198: dwrite d4/d9/f20 [0,4194304] 0 2024-09-17T01:41:19.946 INFO:tasks.workunit.client.1.smithi167.stdout:2/220: creat d5/d10/d1a/d45/d3f/f4a x:0 0 0 2024-09-17T01:41:19.946 INFO:tasks.workunit.client.1.smithi167.stdout:2/221: stat c3 0 2024-09-17T01:41:19.948 INFO:tasks.workunit.client.1.smithi167.stdout:4/235: rename d0/d4/d7/d10/d19/c2a to d0/d4/d7/da/c50 0 2024-09-17T01:41:19.952 INFO:tasks.workunit.client.1.smithi167.stdout:6/261: truncate d7/d11/d13/d2f/d30/d32/f58 548508 0 2024-09-17T01:41:19.953 INFO:tasks.workunit.client.1.smithi167.stdout:7/179: sync 2024-09-17T01:41:19.953 INFO:tasks.workunit.client.1.smithi167.stdout:8/333: sync 2024-09-17T01:41:19.953 INFO:tasks.workunit.client.1.smithi167.stdout:2/222: creat d5/d10/d1a/d2e/f4b x:0 0 0 2024-09-17T01:41:19.955 INFO:tasks.workunit.client.1.smithi167.stdout:6/262: fdatasync d7/d11/d13/d2f/d30/d32/f47 0 2024-09-17T01:41:19.957 INFO:tasks.workunit.client.1.smithi167.stdout:4/236: dwrite d0/d4/d7/d10/d19/d2d/d2e/f34 [0,4194304] 0 2024-09-17T01:41:19.960 INFO:tasks.workunit.client.1.smithi167.stdout:2/223: unlink d5/d10/c12 0 2024-09-17T01:41:19.961 INFO:tasks.workunit.client.1.smithi167.stdout:8/334: dread dc/d1a/f49 [0,4194304] 0 2024-09-17T01:41:19.962 INFO:tasks.workunit.client.1.smithi167.stdout:5/140: getdents d0/d9 0 2024-09-17T01:41:19.963 INFO:tasks.workunit.client.1.smithi167.stdout:6/263: rename d7/d11/l2e to d7/d52/l5e 0 2024-09-17T01:41:19.964 INFO:tasks.workunit.client.1.smithi167.stdout:7/180: dread d0/d2/d14/d19/d26/f1c [0,4194304] 0 2024-09-17T01:41:19.965 INFO:tasks.workunit.client.1.smithi167.stdout:2/224: mkdir d5/d3c/d4c 0 2024-09-17T01:41:19.966 INFO:tasks.workunit.client.1.smithi167.stdout:7/181: fdatasync d0/d2/d14/d23/f38 0 2024-09-17T01:41:19.968 INFO:tasks.workunit.client.1.smithi167.stdout:7/182: dread - d0/d2/d14/d19/d26/f35 zero size 2024-09-17T01:41:19.969 INFO:tasks.workunit.client.1.smithi167.stdout:8/335: dread f7 [0,4194304] 0 2024-09-17T01:41:19.969 INFO:tasks.workunit.client.1.smithi167.stdout:2/225: unlink d5/f7 0 2024-09-17T01:41:19.970 INFO:tasks.workunit.client.1.smithi167.stdout:6/264: symlink d7/d11/l5f 0 2024-09-17T01:41:19.972 INFO:tasks.workunit.client.1.smithi167.stdout:2/226: mkdir d5/d3c/d4c/d4d 0 2024-09-17T01:41:19.974 INFO:tasks.workunit.client.1.smithi167.stdout:6/265: mkdir d7/d11/d13/d60 0 2024-09-17T01:41:19.975 INFO:tasks.workunit.client.1.smithi167.stdout:9/199: getdents d4/d9/d21/d2d/d33 0 2024-09-17T01:41:19.977 INFO:tasks.workunit.client.1.smithi167.stdout:3/186: fdatasync d7/d8/f15 0 2024-09-17T01:41:19.978 INFO:tasks.workunit.client.1.smithi167.stdout:7/183: dwrite d0/d2/d14/d19/f30 [0,4194304] 0 2024-09-17T01:41:19.980 INFO:tasks.workunit.client.1.smithi167.stdout:6/266: write d7/d11/d13/f49 [790031,100916] 0 2024-09-17T01:41:19.987 INFO:tasks.workunit.client.1.smithi167.stdout:2/227: dwrite d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:19.987 INFO:tasks.workunit.client.1.smithi167.stdout:4/237: rename d0/d4/d7/d10/d19 to d0/d4/d7/da/d48/d40/d51 0 2024-09-17T01:41:19.991 INFO:tasks.workunit.client.1.smithi167.stdout:2/228: write d5/d10/d1a/f31 [4513008,94073] 0 2024-09-17T01:41:19.992 INFO:tasks.workunit.client.1.smithi167.stdout:3/187: dread f6 [0,4194304] 0 2024-09-17T01:41:19.993 INFO:tasks.workunit.client.1.smithi167.stdout:6/267: mkdir d7/d12/d27/d3a/d61 0 2024-09-17T01:41:19.994 INFO:tasks.workunit.client.1.smithi167.stdout:4/238: write d0/d4/d7/da/d48/d40/d51/f24 [1628955,104560] 0 2024-09-17T01:41:19.995 INFO:tasks.workunit.client.1.smithi167.stdout:2/229: fsync d5/f2f 0 2024-09-17T01:41:19.996 INFO:tasks.workunit.client.1.smithi167.stdout:7/184: dread d0/d2/d14/d19/f30 [0,4194304] 0 2024-09-17T01:41:19.996 INFO:tasks.workunit.client.1.smithi167.stdout:8/336: rename dc/d1a/f4a to dc/d21/d6b/f78 0 2024-09-17T01:41:19.996 INFO:tasks.workunit.client.1.smithi167.stdout:9/200: creat d4/d9/d21/f3b x:0 0 0 2024-09-17T01:41:19.999 INFO:tasks.workunit.client.1.smithi167.stdout:8/337: mknod dc/d1a/c79 0 2024-09-17T01:41:20.000 INFO:tasks.workunit.client.1.smithi167.stdout:7/185: fsync d0/d2/d14/d19/d26/f1c 0 2024-09-17T01:41:20.000 INFO:tasks.workunit.client.1.smithi167.stdout:8/338: stat dc/d1a/l26 0 2024-09-17T01:41:20.001 INFO:tasks.workunit.client.1.smithi167.stdout:3/188: dread d7/d8/d10/d14/d2c/f2f [0,4194304] 0 2024-09-17T01:41:20.001 INFO:tasks.workunit.client.1.smithi167.stdout:2/230: truncate d5/d10/d1a/d2e/f36 567481 0 2024-09-17T01:41:20.001 INFO:tasks.workunit.client.1.smithi167.stdout:4/239: creat d0/f52 x:0 0 0 2024-09-17T01:41:20.002 INFO:tasks.workunit.client.1.smithi167.stdout:2/231: rename d5 to d5/d10/d1a/d39/d4e 22 2024-09-17T01:41:20.003 INFO:tasks.workunit.client.1.smithi167.stdout:4/240: write d0/f52 [868511,33177] 0 2024-09-17T01:41:20.003 INFO:tasks.workunit.client.1.smithi167.stdout:9/201: dread d4/f18 [0,4194304] 0 2024-09-17T01:41:20.004 INFO:tasks.workunit.client.1.smithi167.stdout:6/268: getdents d7/d12/d27 0 2024-09-17T01:41:20.004 INFO:tasks.workunit.client.1.smithi167.stdout:3/189: fsync d7/d8/d10/f13 0 2024-09-17T01:41:20.005 INFO:tasks.workunit.client.1.smithi167.stdout:7/186: creat d0/d2/d14/d23/f39 x:0 0 0 2024-09-17T01:41:20.007 INFO:tasks.workunit.client.1.smithi167.stdout:9/202: unlink d4/d9/f19 0 2024-09-17T01:41:20.009 INFO:tasks.workunit.client.1.smithi167.stdout:8/339: creat dc/f7a x:0 0 0 2024-09-17T01:41:20.011 INFO:tasks.workunit.client.1.smithi167.stdout:6/269: rename d7/d12/f4e to d7/d12/f62 0 2024-09-17T01:41:20.012 INFO:tasks.workunit.client.1.smithi167.stdout:2/232: creat d5/d10/d1a/d46/f4f x:0 0 0 2024-09-17T01:41:20.015 INFO:tasks.workunit.client.1.smithi167.stdout:7/187: mknod d0/d2/d14/c3a 0 2024-09-17T01:41:20.019 INFO:tasks.workunit.client.1.smithi167.stdout:6/270: creat d7/d12/d27/d3a/f63 x:0 0 0 2024-09-17T01:41:20.019 INFO:tasks.workunit.client.1.smithi167.stdout:8/340: dread dc/f3c [0,4194304] 0 2024-09-17T01:41:20.019 INFO:tasks.workunit.client.1.smithi167.stdout:2/233: symlink d5/d10/d16/l50 0 2024-09-17T01:41:20.021 INFO:tasks.workunit.client.1.smithi167.stdout:4/241: creat d0/d4/d7/f53 x:0 0 0 2024-09-17T01:41:20.024 INFO:tasks.workunit.client.1.smithi167.stdout:7/188: rmdir d0/d2/d14/d19 39 2024-09-17T01:41:20.026 INFO:tasks.workunit.client.1.smithi167.stdout:4/242: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [0,4194304] 0 2024-09-17T01:41:20.027 INFO:tasks.workunit.client.1.smithi167.stdout:2/234: creat d5/d10/d1a/d2e/f51 x:0 0 0 2024-09-17T01:41:20.027 INFO:tasks.workunit.client.1.smithi167.stdout:2/235: stat d5/d33/d48 0 2024-09-17T01:41:20.028 INFO:tasks.workunit.client.1.smithi167.stdout:3/190: link d7/d8/l30 d7/d8/d10/l36 0 2024-09-17T01:41:20.029 INFO:tasks.workunit.client.1.smithi167.stdout:2/236: write d5/d10/d1a/d45/d3f/f4a [818943,93604] 0 2024-09-17T01:41:20.029 INFO:tasks.workunit.client.1.smithi167.stdout:9/203: creat d4/d9/d21/f3c x:0 0 0 2024-09-17T01:41:20.030 INFO:tasks.workunit.client.1.smithi167.stdout:6/271: mkdir d7/d11/d13/d2f/d64 0 2024-09-17T01:41:20.031 INFO:tasks.workunit.client.1.smithi167.stdout:7/189: read - d0/d2/d14/d19/f2f zero size 2024-09-17T01:41:20.032 INFO:tasks.workunit.client.1.smithi167.stdout:4/243: unlink d0/d4/d7/d6/f32 0 2024-09-17T01:41:20.033 INFO:tasks.workunit.client.1.smithi167.stdout:6/272: fsync d7/d11/d13/d2f/f4d 0 2024-09-17T01:41:20.036 INFO:tasks.workunit.client.1.smithi167.stdout:7/190: mknod d0/d2/c3b 0 2024-09-17T01:41:20.037 INFO:tasks.workunit.client.1.smithi167.stdout:4/244: symlink d0/d4/d7/da/d48/l54 0 2024-09-17T01:41:20.043 INFO:tasks.workunit.client.1.smithi167.stdout:7/191: chown d0/d2/d14/d19/d26/ff 1 1 2024-09-17T01:41:20.043 INFO:tasks.workunit.client.1.smithi167.stdout:3/191: dwrite d7/d8/d10/d14/d2c/f2d [0,4194304] 0 2024-09-17T01:41:20.049 INFO:tasks.workunit.client.1.smithi167.stdout:9/204: dwrite d4/d9/d21/f26 [0,4194304] 0 2024-09-17T01:41:20.049 INFO:tasks.workunit.client.1.smithi167.stdout:2/237: dwrite d5/d10/d1a/d46/f4f [0,4194304] 0 2024-09-17T01:41:20.059 INFO:tasks.workunit.client.1.smithi167.stdout:4/245: dwrite d0/f52 [0,4194304] 0 2024-09-17T01:41:20.059 INFO:tasks.workunit.client.1.smithi167.stdout:9/205: creat d4/d9/f3d x:0 0 0 2024-09-17T01:41:20.059 INFO:tasks.workunit.client.1.smithi167.stdout:1/186: sync 2024-09-17T01:41:20.059 INFO:tasks.workunit.client.1.smithi167.stdout:0/155: sync 2024-09-17T01:41:20.061 INFO:tasks.workunit.client.1.smithi167.stdout:4/246: fsync d0/d4/d7/da/d48/d40/d51/d2d/d2e/f34 0 2024-09-17T01:41:20.061 INFO:tasks.workunit.client.1.smithi167.stdout:2/238: truncate d5/d10/d1a/d2e/f3b 90366 0 2024-09-17T01:41:20.061 INFO:tasks.workunit.client.1.smithi167.stdout:7/192: rmdir d0/d2/d14/d23/d37 0 2024-09-17T01:41:20.063 INFO:tasks.workunit.client.1.smithi167.stdout:7/193: write d0/f5 [5186024,65637] 0 2024-09-17T01:41:20.066 INFO:tasks.workunit.client.1.smithi167.stdout:2/239: symlink d5/d1f/l52 0 2024-09-17T01:41:20.067 INFO:tasks.workunit.client.1.smithi167.stdout:2/240: stat d5/d1f/c43 0 2024-09-17T01:41:20.069 INFO:tasks.workunit.client.1.smithi167.stdout:7/194: unlink d0/f2c 0 2024-09-17T01:41:20.069 INFO:tasks.workunit.client.1.smithi167.stdout:9/206: link d4/l6 d4/d9/d21/d37/l3e 0 2024-09-17T01:41:20.071 INFO:tasks.workunit.client.1.smithi167.stdout:2/241: creat d5/d10/d1a/d39/f53 x:0 0 0 2024-09-17T01:41:20.072 INFO:tasks.workunit.client.1.smithi167.stdout:9/207: write d4/d9/f2a [203365,117357] 0 2024-09-17T01:41:20.072 INFO:tasks.workunit.client.1.smithi167.stdout:0/156: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:20.074 INFO:tasks.workunit.client.1.smithi167.stdout:7/195: mknod d0/d2/d14/c3c 0 2024-09-17T01:41:20.075 INFO:tasks.workunit.client.1.smithi167.stdout:7/196: dread - d0/d2/f2e zero size 2024-09-17T01:41:20.078 INFO:tasks.workunit.client.1.smithi167.stdout:2/242: rename d5/fe to d5/d10/d16/f54 0 2024-09-17T01:41:20.082 INFO:tasks.workunit.client.1.smithi167.stdout:6/273: dread d7/d12/f62 [0,4194304] 0 2024-09-17T01:41:20.083 INFO:tasks.workunit.client.1.smithi167.stdout:4/247: dread d0/d4/d7/da/d48/d40/d51/f24 [0,4194304] 0 2024-09-17T01:41:20.083 INFO:tasks.workunit.client.1.smithi167.stdout:3/192: write d7/d8/d10/f13 [2559709,125461] 0 2024-09-17T01:41:20.083 INFO:tasks.workunit.client.1.smithi167.stdout:7/197: mknod d0/d2/c3d 0 2024-09-17T01:41:20.087 INFO:tasks.workunit.client.1.smithi167.stdout:9/208: dread d4/d9/d21/f26 [0,4194304] 0 2024-09-17T01:41:20.087 INFO:tasks.workunit.client.1.smithi167.stdout:2/243: getdents d5/d10/d1a 0 2024-09-17T01:41:20.087 INFO:tasks.workunit.client.1.smithi167.stdout:7/198: readlink d0/d2/d14/d19/l20 0 2024-09-17T01:41:20.089 INFO:tasks.workunit.client.1.smithi167.stdout:6/274: creat d7/d11/d13/f65 x:0 0 0 2024-09-17T01:41:20.091 INFO:tasks.workunit.client.1.smithi167.stdout:0/157: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:41:20.091 INFO:tasks.workunit.client.1.smithi167.stdout:9/209: write d4/d9/f1d [1020455,97528] 0 2024-09-17T01:41:20.093 INFO:tasks.workunit.client.1.smithi167.stdout:2/244: symlink d5/d10/d1a/d2e/l55 0 2024-09-17T01:41:20.094 INFO:tasks.workunit.client.1.smithi167.stdout:6/275: symlink d7/d12/d27/d3a/l66 0 2024-09-17T01:41:20.096 INFO:tasks.workunit.client.1.smithi167.stdout:2/245: dread - d5/d10/f22 zero size 2024-09-17T01:41:20.096 INFO:tasks.workunit.client.1.smithi167.stdout:0/158: rmdir d5/d8/d9/d19 39 2024-09-17T01:41:20.096 INFO:tasks.workunit.client.1.smithi167.stdout:9/210: read d4/f18 [313615,124550] 0 2024-09-17T01:41:20.099 INFO:tasks.workunit.client.1.smithi167.stdout:6/276: mknod d7/d52/c67 0 2024-09-17T01:41:20.103 INFO:tasks.workunit.client.1.smithi167.stdout:1/187: dwrite d0/d5/d34/d3c/f2b [0,4194304] 0 2024-09-17T01:41:20.105 INFO:tasks.workunit.client.1.smithi167.stdout:7/199: dwrite d0/d2/f2e [0,4194304] 0 2024-09-17T01:41:20.105 INFO:tasks.workunit.client.1.smithi167.stdout:9/211: unlink d4/d9/f20 0 2024-09-17T01:41:20.107 INFO:tasks.workunit.client.1.smithi167.stdout:1/188: write d0/d5/f12 [564777,9544] 0 2024-09-17T01:41:20.109 INFO:tasks.workunit.client.1.smithi167.stdout:3/193: truncate f6 3023731 0 2024-09-17T01:41:20.109 INFO:tasks.workunit.client.1.smithi167.stdout:7/200: readlink d0/d2/d14/d19/l20 0 2024-09-17T01:41:20.110 INFO:tasks.workunit.client.1.smithi167.stdout:4/248: link d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/l33 d0/d4/d7/l55 0 2024-09-17T01:41:20.112 INFO:tasks.workunit.client.1.smithi167.stdout:7/201: stat d0/d2/c3d 0 2024-09-17T01:41:20.113 INFO:tasks.workunit.client.1.smithi167.stdout:0/159: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/2: sync 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/3: dwrite - no filename 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/4: link - no file 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/5: rmdir - no directory 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/6: chown . 73 1 2024-09-17T01:41:20.114 INFO:tasks.workunit.client.0.smithi082.stdout:3/7: dwrite - no filename 2024-09-17T01:41:20.115 INFO:tasks.workunit.client.1.smithi167.stdout:3/194: mkdir d7/d8/d10/d37 0 2024-09-17T01:41:20.116 INFO:tasks.workunit.client.1.smithi167.stdout:7/202: fdatasync d0/f1 0 2024-09-17T01:41:20.119 INFO:tasks.workunit.client.1.smithi167.stdout:7/203: write d0/f1 [595752,128760] 0 2024-09-17T01:41:20.119 INFO:tasks.workunit.client.0.smithi082.stdout:3/8: creat f0 x:0 0 0 2024-09-17T01:41:20.121 INFO:tasks.workunit.client.1.smithi167.stdout:4/249: symlink d0/d4/d7/da/d48/d40/d51/l56 0 2024-09-17T01:41:20.121 INFO:tasks.workunit.client.1.smithi167.stdout:9/212: creat d4/d9/d21/d2d/d33/d3a/f3f x:0 0 0 2024-09-17T01:41:20.122 INFO:tasks.workunit.client.1.smithi167.stdout:7/204: chown d0/d2/c3 249681530 1 2024-09-17T01:41:20.122 INFO:tasks.workunit.client.1.smithi167.stdout:4/250: readlink d0/l1 0 2024-09-17T01:41:20.122 INFO:tasks.workunit.client.1.smithi167.stdout:3/195: symlink d7/d8/d10/d14/d2c/l38 0 2024-09-17T01:41:20.122 INFO:tasks.workunit.client.0.smithi082.stdout:3/9: creat f1 x:0 0 0 2024-09-17T01:41:20.123 INFO:tasks.workunit.client.0.smithi082.stdout:3/10: dread - f0 zero size 2024-09-17T01:41:20.124 INFO:tasks.workunit.client.1.smithi167.stdout:1/189: dwrite d0/d9/f31 [0,4194304] 0 2024-09-17T01:41:20.125 INFO:tasks.workunit.client.1.smithi167.stdout:3/196: chown d7/d8/d10/d14/d2c 371 1 2024-09-17T01:41:20.127 INFO:tasks.workunit.client.1.smithi167.stdout:0/160: mkdir d5/d8/d2e 0 2024-09-17T01:41:20.128 INFO:tasks.workunit.client.0.smithi082.stdout:3/11: symlink l2 0 2024-09-17T01:41:20.129 INFO:tasks.workunit.client.1.smithi167.stdout:9/213: creat d4/d9/d21/d2d/d33/d3a/f40 x:0 0 0 2024-09-17T01:41:20.132 INFO:tasks.workunit.client.1.smithi167.stdout:9/214: write f1 [3406039,130503] 0 2024-09-17T01:41:20.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/12: creat f3 x:0 0 0 2024-09-17T01:41:20.135 INFO:tasks.workunit.client.1.smithi167.stdout:4/251: mkdir d0/d4/d7/da/d48/d40/d57 0 2024-09-17T01:41:20.136 INFO:tasks.workunit.client.1.smithi167.stdout:6/277: dwrite f0 [0,4194304] 0 2024-09-17T01:41:20.136 INFO:tasks.workunit.client.1.smithi167.stdout:3/197: symlink d7/l39 0 2024-09-17T01:41:20.137 INFO:tasks.workunit.client.0.smithi082.stdout:3/13: mknod c4 0 2024-09-17T01:41:20.138 INFO:tasks.workunit.client.1.smithi167.stdout:9/215: dread - d4/d9/d21/d2d/d33/d3a/f40 zero size 2024-09-17T01:41:20.138 INFO:tasks.workunit.client.0.smithi082.stdout:3/14: fdatasync f0 0 2024-09-17T01:41:20.139 INFO:tasks.workunit.client.0.smithi082.stdout:3/15: truncate f3 944587 0 2024-09-17T01:41:20.139 INFO:tasks.workunit.client.1.smithi167.stdout:1/190: creat d0/d9/d16/d36/f3e x:0 0 0 2024-09-17T01:41:20.140 INFO:tasks.workunit.client.0.smithi082.stdout:3/16: truncate f3 1454249 0 2024-09-17T01:41:20.141 INFO:tasks.workunit.client.1.smithi167.stdout:2/246: dwrite d5/f2a [0,4194304] 0 2024-09-17T01:41:20.142 INFO:tasks.workunit.client.1.smithi167.stdout:9/216: truncate d4/d9/f25 1890746 0 2024-09-17T01:41:20.142 INFO:tasks.workunit.client.1.smithi167.stdout:4/252: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/c4a 749001612 1 2024-09-17T01:41:20.142 INFO:tasks.workunit.client.0.smithi082.stdout:3/17: dread f3 [0,4194304] 0 2024-09-17T01:41:20.146 INFO:tasks.workunit.client.1.smithi167.stdout:5/141: sync 2024-09-17T01:41:20.149 INFO:tasks.workunit.client.1.smithi167.stdout:1/191: dwrite d0/d5/d34/f14 [0,4194304] 0 2024-09-17T01:41:20.151 INFO:tasks.workunit.client.0.smithi082.stdout:3/18: dwrite f1 [0,4194304] 0 2024-09-17T01:41:20.151 INFO:tasks.workunit.client.1.smithi167.stdout:1/192: fsync d0/d5/d34/f30 0 2024-09-17T01:41:20.157 INFO:tasks.workunit.client.0.smithi082.stdout:3/19: creat f5 x:0 0 0 2024-09-17T01:41:20.161 INFO:tasks.workunit.client.1.smithi167.stdout:6/278: symlink d7/d12/d27/l68 0 2024-09-17T01:41:20.163 INFO:tasks.workunit.client.0.smithi082.stdout:3/20: rename f3 to f6 0 2024-09-17T01:41:20.164 INFO:tasks.workunit.client.0.smithi082.stdout:3/21: chown f5 3227 1 2024-09-17T01:41:20.166 INFO:tasks.workunit.client.1.smithi167.stdout:6/279: write d7/d11/d13/d2f/d30/d32/f47 [850461,64696] 0 2024-09-17T01:41:20.168 INFO:tasks.workunit.client.0.smithi082.stdout:3/22: creat f7 x:0 0 0 2024-09-17T01:41:20.169 INFO:tasks.workunit.client.0.smithi082.stdout:3/23: read - f0 zero size 2024-09-17T01:41:20.171 INFO:tasks.workunit.client.1.smithi167.stdout:2/247: creat d5/d10/d1a/f56 x:0 0 0 2024-09-17T01:41:20.171 INFO:tasks.workunit.client.1.smithi167.stdout:4/253: mknod d0/d4/d7/d6/c58 0 2024-09-17T01:41:20.171 INFO:tasks.workunit.client.0.smithi082.stdout:3/24: truncate f0 598802 0 2024-09-17T01:41:20.171 INFO:tasks.workunit.client.0.smithi082.stdout:3/25: write f1 [3871563,66228] 0 2024-09-17T01:41:20.173 INFO:tasks.workunit.client.0.smithi082.stdout:5/4: sync 2024-09-17T01:41:20.173 INFO:tasks.workunit.client.0.smithi082.stdout:9/12: sync 2024-09-17T01:41:20.173 INFO:tasks.workunit.client.0.smithi082.stdout:6/30: sync 2024-09-17T01:41:20.174 INFO:tasks.workunit.client.1.smithi167.stdout:9/217: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:41:20.175 INFO:tasks.workunit.client.1.smithi167.stdout:2/248: read d5/d10/d1a/f31 [3641252,105975] 0 2024-09-17T01:41:20.176 INFO:tasks.workunit.client.1.smithi167.stdout:9/218: fsync d4/d9/f3d 0 2024-09-17T01:41:20.177 INFO:tasks.workunit.client.0.smithi082.stdout:3/26: creat f8 x:0 0 0 2024-09-17T01:41:20.179 INFO:tasks.workunit.client.1.smithi167.stdout:7/205: dread d0/d2/d14/d19/f1e [0,4194304] 0 2024-09-17T01:41:20.180 INFO:tasks.workunit.client.0.smithi082.stdout:9/13: mkdir d4 0 2024-09-17T01:41:20.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/31: symlink d1/la 0 2024-09-17T01:41:20.183 INFO:tasks.workunit.client.0.smithi082.stdout:6/32: stat d1/l2 0 2024-09-17T01:41:20.184 INFO:tasks.workunit.client.0.smithi082.stdout:6/33: truncate f0 5037846 0 2024-09-17T01:41:20.184 INFO:tasks.workunit.client.1.smithi167.stdout:7/206: dwrite d0/d2/f2e [0,4194304] 0 2024-09-17T01:41:20.185 INFO:tasks.workunit.client.1.smithi167.stdout:7/207: chown d0/d2/d14/d19/d22 5169858 1 2024-09-17T01:41:20.185 INFO:tasks.workunit.client.0.smithi082.stdout:3/27: mkdir d9 0 2024-09-17T01:41:20.185 INFO:tasks.workunit.client.1.smithi167.stdout:7/208: chown d0/f5 327 1 2024-09-17T01:41:20.186 INFO:tasks.workunit.client.1.smithi167.stdout:7/209: stat d0/d2/d14/f1b 0 2024-09-17T01:41:20.188 INFO:tasks.workunit.client.1.smithi167.stdout:7/210: stat d0/d2/d14/d19/d22/c29 0 2024-09-17T01:41:20.189 INFO:tasks.workunit.client.0.smithi082.stdout:6/34: dread f0 [0,4194304] 0 2024-09-17T01:41:20.193 INFO:tasks.workunit.client.1.smithi167.stdout:3/198: write d7/d8/d2a/f22 [2153654,54239] 0 2024-09-17T01:41:20.193 INFO:tasks.workunit.client.1.smithi167.stdout:3/199: readlink l5 0 2024-09-17T01:41:20.194 INFO:tasks.workunit.client.1.smithi167.stdout:3/200: write d7/d8/d2a/f22 [4646322,66175] 0 2024-09-17T01:41:20.195 INFO:tasks.workunit.client.1.smithi167.stdout:3/201: stat d7/d8/d10/f13 0 2024-09-17T01:41:20.196 INFO:tasks.workunit.client.1.smithi167.stdout:8/341: sync 2024-09-17T01:41:20.196 INFO:tasks.workunit.client.1.smithi167.stdout:3/202: chown d7/d8/d10/d14/d25/l1b 167740476 1 2024-09-17T01:41:20.196 INFO:tasks.workunit.client.1.smithi167.stdout:4/254: mknod d0/d4/d7/da/d48/d40/d51/d2d/c59 0 2024-09-17T01:41:20.198 INFO:tasks.workunit.client.1.smithi167.stdout:2/249: creat d5/d33/f57 x:0 0 0 2024-09-17T01:41:20.199 INFO:tasks.workunit.client.0.smithi082.stdout:5/5: link c0 c1 0 2024-09-17T01:41:20.201 INFO:tasks.workunit.client.0.smithi082.stdout:6/35: write f0 [4438348,107579] 0 2024-09-17T01:41:20.202 INFO:tasks.workunit.client.0.smithi082.stdout:9/14: mknod d4/c5 0 2024-09-17T01:41:20.204 INFO:tasks.workunit.client.1.smithi167.stdout:5/142: dwrite d0/d9/d1c/f23 [0,4194304] 0 2024-09-17T01:41:20.204 INFO:tasks.workunit.client.0.smithi082.stdout:3/28: creat d9/fa x:0 0 0 2024-09-17T01:41:20.205 INFO:tasks.workunit.client.1.smithi167.stdout:5/143: write d0/d9/ff [4350285,67778] 0 2024-09-17T01:41:20.206 INFO:tasks.workunit.client.1.smithi167.stdout:0/161: getdents d5/d8 0 2024-09-17T01:41:20.207 INFO:tasks.workunit.client.0.smithi082.stdout:5/6: symlink l2 0 2024-09-17T01:41:20.208 INFO:tasks.workunit.client.0.smithi082.stdout:5/7: write - no filename 2024-09-17T01:41:20.209 INFO:tasks.workunit.client.1.smithi167.stdout:7/211: creat d0/d2/d14/d19/f3e x:0 0 0 2024-09-17T01:41:20.211 INFO:tasks.workunit.client.0.smithi082.stdout:6/36: unlink d1/d7/l9 0 2024-09-17T01:41:20.214 INFO:tasks.workunit.client.0.smithi082.stdout:9/15: mknod d4/c6 0 2024-09-17T01:41:20.214 INFO:tasks.workunit.client.1.smithi167.stdout:7/212: dwrite d0/d2/d14/f1b [0,4194304] 0 2024-09-17T01:41:20.215 INFO:tasks.workunit.client.0.smithi082.stdout:5/8: creat f3 x:0 0 0 2024-09-17T01:41:20.221 INFO:tasks.workunit.client.0.smithi082.stdout:9/16: symlink d4/l7 0 2024-09-17T01:41:20.222 INFO:tasks.workunit.client.0.smithi082.stdout:9/17: dread - no filename 2024-09-17T01:41:20.226 INFO:tasks.workunit.client.1.smithi167.stdout:2/250: creat d5/d1f/f58 x:0 0 0 2024-09-17T01:41:20.227 INFO:tasks.workunit.client.1.smithi167.stdout:2/251: write d5/d10/d1a/d2e/f3b [4152529,91858] 0 2024-09-17T01:41:20.228 INFO:tasks.workunit.client.0.smithi082.stdout:5/9: dwrite f3 [0,4194304] 0 2024-09-17T01:41:20.228 INFO:tasks.workunit.client.1.smithi167.stdout:2/252: dread - d5/d10/f22 zero size 2024-09-17T01:41:20.229 INFO:tasks.workunit.client.0.smithi082.stdout:6/37: creat d1/d7/d8/fb x:0 0 0 2024-09-17T01:41:20.230 INFO:tasks.workunit.client.0.smithi082.stdout:9/18: creat d4/f8 x:0 0 0 2024-09-17T01:41:20.230 INFO:tasks.workunit.client.0.smithi082.stdout:6/38: readlink d1/la 0 2024-09-17T01:41:20.233 INFO:tasks.workunit.client.0.smithi082.stdout:5/10: creat f4 x:0 0 0 2024-09-17T01:41:20.234 INFO:tasks.workunit.client.1.smithi167.stdout:5/144: rmdir d0 39 2024-09-17T01:41:20.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/19: creat d4/f9 x:0 0 0 2024-09-17T01:41:20.237 INFO:tasks.workunit.client.1.smithi167.stdout:6/280: mknod d7/d12/d27/c69 0 2024-09-17T01:41:20.237 INFO:tasks.workunit.client.1.smithi167.stdout:0/162: read d5/d8/f20 [1025868,31251] 0 2024-09-17T01:41:20.238 INFO:tasks.workunit.client.0.smithi082.stdout:6/39: mkdir d1/d7/d8/dc 0 2024-09-17T01:41:20.238 INFO:tasks.workunit.client.1.smithi167.stdout:6/281: dread - d7/d11/d13/f2d zero size 2024-09-17T01:41:20.241 INFO:tasks.workunit.client.1.smithi167.stdout:2/253: write d5/d10/f22 [1733,27760] 0 2024-09-17T01:41:20.242 INFO:tasks.workunit.client.1.smithi167.stdout:2/254: fdatasync d5/d10/d1a/f37 0 2024-09-17T01:41:20.242 INFO:tasks.workunit.client.0.smithi082.stdout:5/11: symlink l5 0 2024-09-17T01:41:20.243 INFO:tasks.workunit.client.1.smithi167.stdout:8/342: symlink dc/l7b 0 2024-09-17T01:41:20.244 INFO:tasks.workunit.client.0.smithi082.stdout:9/20: mkdir d4/da 0 2024-09-17T01:41:20.246 INFO:tasks.workunit.client.0.smithi082.stdout:9/21: dread - d4/f8 zero size 2024-09-17T01:41:20.246 INFO:tasks.workunit.client.1.smithi167.stdout:8/343: dread dc/d18/f46 [0,4194304] 0 2024-09-17T01:41:20.247 INFO:tasks.workunit.client.0.smithi082.stdout:5/12: creat f6 x:0 0 0 2024-09-17T01:41:20.247 INFO:tasks.workunit.client.0.smithi082.stdout:6/40: dwrite d1/d7/d8/fb [0,4194304] 0 2024-09-17T01:41:20.248 INFO:tasks.workunit.client.0.smithi082.stdout:5/13: truncate f4 646087 0 2024-09-17T01:41:20.250 INFO:tasks.workunit.client.1.smithi167.stdout:4/255: mkdir d0/d4/d7/da/d48/d40/d57/d5a 0 2024-09-17T01:41:20.252 INFO:tasks.workunit.client.1.smithi167.stdout:8/344: dwrite dc/d56/f62 [0,4194304] 0 2024-09-17T01:41:20.254 INFO:tasks.workunit.client.1.smithi167.stdout:1/193: getdents d0/d5/d34/d3c 0 2024-09-17T01:41:20.256 INFO:tasks.workunit.client.0.smithi082.stdout:5/14: creat f7 x:0 0 0 2024-09-17T01:41:20.257 INFO:tasks.workunit.client.1.smithi167.stdout:9/219: link d4/lc d4/d9/l41 0 2024-09-17T01:41:20.257 INFO:tasks.workunit.client.0.smithi082.stdout:5/15: stat f7 0 2024-09-17T01:41:20.258 INFO:tasks.workunit.client.0.smithi082.stdout:6/41: symlink d1/d7/ld 0 2024-09-17T01:41:20.259 INFO:tasks.workunit.client.1.smithi167.stdout:9/220: dread - d4/d9/d21/d2d/d33/d3a/f40 zero size 2024-09-17T01:41:20.260 INFO:tasks.workunit.client.1.smithi167.stdout:1/194: dwrite d0/d5/f12 [4194304,4194304] 0 2024-09-17T01:41:20.261 INFO:tasks.workunit.client.0.smithi082.stdout:9/22: getdents d4/da 0 2024-09-17T01:41:20.262 INFO:tasks.workunit.client.1.smithi167.stdout:0/163: readlink d5/d8/l14 0 2024-09-17T01:41:20.267 INFO:tasks.workunit.client.0.smithi082.stdout:6/42: dread d1/d7/d8/fb [0,4194304] 0 2024-09-17T01:41:20.267 INFO:tasks.workunit.client.1.smithi167.stdout:9/221: dwrite d4/d9/d21/f2f [0,4194304] 0 2024-09-17T01:41:20.268 INFO:tasks.workunit.client.1.smithi167.stdout:3/203: truncate f3 3656637 0 2024-09-17T01:41:20.270 INFO:tasks.workunit.client.0.smithi082.stdout:5/16: link f3 f8 0 2024-09-17T01:41:20.271 INFO:tasks.workunit.client.0.smithi082.stdout:9/23: dwrite d4/f9 [0,4194304] 0 2024-09-17T01:41:20.272 INFO:tasks.workunit.client.1.smithi167.stdout:2/255: creat d5/d10/d1a/d2e/f59 x:0 0 0 2024-09-17T01:41:20.272 INFO:tasks.workunit.client.1.smithi167.stdout:2/256: stat d5/d1f/l52 0 2024-09-17T01:41:20.272 INFO:tasks.workunit.client.0.smithi082.stdout:9/24: read d4/f9 [36019,114252] 0 2024-09-17T01:41:20.273 INFO:tasks.workunit.client.0.smithi082.stdout:9/25: stat d4/f8 0 2024-09-17T01:41:20.277 INFO:tasks.workunit.client.1.smithi167.stdout:4/256: rename d0/l1 to d0/d4/d7/da/d48/l5b 0 2024-09-17T01:41:20.285 INFO:tasks.workunit.client.0.smithi082.stdout:9/26: unlink d4/l7 0 2024-09-17T01:41:20.288 INFO:tasks.workunit.client.0.smithi082.stdout:5/17: link f7 f9 0 2024-09-17T01:41:20.290 INFO:tasks.workunit.client.0.smithi082.stdout:5/18: dread f4 [0,4194304] 0 2024-09-17T01:41:20.295 INFO:tasks.workunit.client.1.smithi167.stdout:7/213: creat d0/f3f x:0 0 0 2024-09-17T01:41:20.297 INFO:tasks.workunit.client.0.smithi082.stdout:9/27: creat d4/da/fb x:0 0 0 2024-09-17T01:41:20.297 INFO:tasks.workunit.client.1.smithi167.stdout:8/345: dwrite dc/d21/f44 [0,4194304] 0 2024-09-17T01:41:20.297 INFO:tasks.workunit.client.1.smithi167.stdout:7/214: chown d0/d2/d14/f18 44 1 2024-09-17T01:41:20.299 INFO:tasks.workunit.client.1.smithi167.stdout:9/222: mknod d4/d9/d21/d37/c42 0 2024-09-17T01:41:20.299 INFO:tasks.workunit.client.0.smithi082.stdout:9/28: dread - d4/f8 zero size 2024-09-17T01:41:20.299 INFO:tasks.workunit.client.0.smithi082.stdout:5/19: dwrite f6 [0,4194304] 0 2024-09-17T01:41:20.300 INFO:tasks.workunit.client.0.smithi082.stdout:9/29: dread - d4/f8 zero size 2024-09-17T01:41:20.307 INFO:tasks.workunit.client.0.smithi082.stdout:9/30: mknod d4/da/cc 0 2024-09-17T01:41:20.308 INFO:tasks.workunit.client.1.smithi167.stdout:4/257: write d0/d4/d7/d10/f3f [58236,48782] 0 2024-09-17T01:41:20.308 INFO:tasks.workunit.client.1.smithi167.stdout:4/258: stat d0/d4/d7/d10/c1c 0 2024-09-17T01:41:20.309 INFO:tasks.workunit.client.1.smithi167.stdout:4/259: chown d0/d4/f47 16 1 2024-09-17T01:41:20.310 INFO:tasks.workunit.client.1.smithi167.stdout:5/145: mkdir d0/d24 0 2024-09-17T01:41:20.310 INFO:tasks.workunit.client.0.smithi082.stdout:9/31: dread d4/f9 [0,4194304] 0 2024-09-17T01:41:20.311 INFO:tasks.workunit.client.0.smithi082.stdout:5/20: write f9 [440131,102522] 0 2024-09-17T01:41:20.311 INFO:tasks.workunit.client.1.smithi167.stdout:1/195: getdents d0/d9/d16/d22 0 2024-09-17T01:41:20.311 INFO:tasks.workunit.client.0.smithi082.stdout:5/21: chown l5 2840 1 2024-09-17T01:41:20.312 INFO:tasks.workunit.client.1.smithi167.stdout:0/164: mkdir d5/d8/d9/d2f 0 2024-09-17T01:41:20.313 INFO:tasks.workunit.client.0.smithi082.stdout:9/32: creat d4/fd x:0 0 0 2024-09-17T01:41:20.314 INFO:tasks.workunit.client.0.smithi082.stdout:9/33: fdatasync d4/f8 0 2024-09-17T01:41:20.315 INFO:tasks.workunit.client.0.smithi082.stdout:5/22: rename f4 to fa 0 2024-09-17T01:41:20.315 INFO:tasks.workunit.client.0.smithi082.stdout:5/23: chown f3 840435322 1 2024-09-17T01:41:20.316 INFO:tasks.workunit.client.1.smithi167.stdout:7/215: chown d0/d2/cc 121 1 2024-09-17T01:41:20.316 INFO:tasks.workunit.client.0.smithi082.stdout:9/34: readlink l3 0 2024-09-17T01:41:20.320 INFO:tasks.workunit.client.1.smithi167.stdout:6/282: rename d7/l15 to d7/d12/d27/d3a/d56/l6a 0 2024-09-17T01:41:20.320 INFO:tasks.workunit.client.1.smithi167.stdout:6/283: dread - d7/f5c zero size 2024-09-17T01:41:20.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/35: link d4/c5 d4/da/ce 0 2024-09-17T01:41:20.321 INFO:tasks.workunit.client.1.smithi167.stdout:1/196: rmdir d0/d5 39 2024-09-17T01:41:20.321 INFO:tasks.workunit.client.1.smithi167.stdout:6/284: dread - d7/d11/d13/f2d zero size 2024-09-17T01:41:20.323 INFO:tasks.workunit.client.0.smithi082.stdout:9/36: symlink d4/lf 0 2024-09-17T01:41:20.323 INFO:tasks.workunit.client.1.smithi167.stdout:6/285: truncate d7/d11/d13/f49 1163062 0 2024-09-17T01:41:20.324 INFO:tasks.workunit.client.0.smithi082.stdout:9/37: read d4/f9 [3333172,47175] 0 2024-09-17T01:41:20.324 INFO:tasks.workunit.client.1.smithi167.stdout:5/146: mkdir d0/d9/d1c/d25 0 2024-09-17T01:41:20.325 INFO:tasks.workunit.client.1.smithi167.stdout:4/260: rename d0/d4/d7/d6/f1d to d0/d4/d7/da/d48/d40/d57/d5a/f5c 0 2024-09-17T01:41:20.326 INFO:tasks.workunit.client.1.smithi167.stdout:1/197: stat d0/d5/fd 0 2024-09-17T01:41:20.326 INFO:tasks.workunit.client.1.smithi167.stdout:4/261: chown d0/d4/d7/d10/f3f 12984593 1 2024-09-17T01:41:20.329 INFO:tasks.workunit.client.0.smithi082.stdout:9/38: chown d4/da/ce 115 1 2024-09-17T01:41:20.329 INFO:tasks.workunit.client.0.smithi082.stdout:9/39: dread - d4/fd zero size 2024-09-17T01:41:20.331 INFO:tasks.workunit.client.1.smithi167.stdout:3/204: truncate d7/d8/d2a/f2e 3537276 0 2024-09-17T01:41:20.333 INFO:tasks.workunit.client.1.smithi167.stdout:2/257: truncate d5/d10/d16/f18 1620127 0 2024-09-17T01:41:20.334 INFO:tasks.workunit.client.1.smithi167.stdout:5/147: rmdir d0 39 2024-09-17T01:41:20.336 INFO:tasks.workunit.client.0.smithi082.stdout:5/24: fsync fa 0 2024-09-17T01:41:20.336 INFO:tasks.workunit.client.0.smithi082.stdout:5/25: rmdir - no directory 2024-09-17T01:41:20.337 INFO:tasks.workunit.client.0.smithi082.stdout:5/26: fsync f6 0 2024-09-17T01:41:20.337 INFO:tasks.workunit.client.1.smithi167.stdout:9/223: write d4/f16 [383521,127628] 0 2024-09-17T01:41:20.337 INFO:tasks.workunit.client.1.smithi167.stdout:1/198: rmdir d0/d9/d16 39 2024-09-17T01:41:20.338 INFO:tasks.workunit.client.0.smithi082.stdout:9/40: chown d4/c5 45833 1 2024-09-17T01:41:20.339 INFO:tasks.workunit.client.1.smithi167.stdout:4/262: mkdir d0/d4/d7/d6/d5d 0 2024-09-17T01:41:20.341 INFO:tasks.workunit.client.1.smithi167.stdout:0/165: write d5/d8/d9/d19/f22 [3972831,109572] 0 2024-09-17T01:41:20.344 INFO:tasks.workunit.client.1.smithi167.stdout:6/286: mkdir d7/d11/d13/d2f/d64/d6b 0 2024-09-17T01:41:20.345 INFO:tasks.workunit.client.1.smithi167.stdout:6/287: dread - d7/d12/d27/d3a/f63 zero size 2024-09-17T01:41:20.345 INFO:tasks.workunit.client.0.smithi082.stdout:5/27: mkdir db 0 2024-09-17T01:41:20.347 INFO:tasks.workunit.client.1.smithi167.stdout:3/205: dread d7/d8/d10/d14/f26 [0,4194304] 0 2024-09-17T01:41:20.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/41: rename d4/f9 to d4/f10 0 2024-09-17T01:41:20.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/42: read - d4/da/fb zero size 2024-09-17T01:41:20.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/43: read - d4/fd zero size 2024-09-17T01:41:20.350 INFO:tasks.workunit.client.0.smithi082.stdout:9/44: dread - d4/fd zero size 2024-09-17T01:41:20.350 INFO:tasks.workunit.client.0.smithi082.stdout:9/45: write d4/da/fb [477311,66485] 0 2024-09-17T01:41:20.351 INFO:tasks.workunit.client.0.smithi082.stdout:5/28: rename f8 to db/fc 0 2024-09-17T01:41:20.352 INFO:tasks.workunit.client.0.smithi082.stdout:5/29: write f7 [409762,32622] 0 2024-09-17T01:41:20.353 INFO:tasks.workunit.client.1.smithi167.stdout:5/148: write d0/f14 [914895,106216] 0 2024-09-17T01:41:20.354 INFO:tasks.workunit.client.0.smithi082.stdout:9/46: mkdir d4/da/d11 0 2024-09-17T01:41:20.356 INFO:tasks.workunit.client.0.smithi082.stdout:5/30: mknod db/cd 0 2024-09-17T01:41:20.356 INFO:tasks.workunit.client.0.smithi082.stdout:5/31: truncate f7 1574196 0 2024-09-17T01:41:20.357 INFO:tasks.workunit.client.0.smithi082.stdout:9/47: mknod d4/da/d11/c12 0 2024-09-17T01:41:20.357 INFO:tasks.workunit.client.0.smithi082.stdout:5/32: write f9 [666336,102508] 0 2024-09-17T01:41:20.358 INFO:tasks.workunit.client.1.smithi167.stdout:9/224: dwrite d4/d9/d21/f26 [0,4194304] 0 2024-09-17T01:41:20.359 INFO:tasks.workunit.client.1.smithi167.stdout:2/258: mknod d5/d3c/d4c/d4d/c5a 0 2024-09-17T01:41:20.363 INFO:tasks.workunit.client.1.smithi167.stdout:1/199: truncate d0/f17 3451903 0 2024-09-17T01:41:20.365 INFO:tasks.workunit.client.1.smithi167.stdout:0/166: mknod d5/d8/d9/c30 0 2024-09-17T01:41:20.366 INFO:tasks.workunit.client.1.smithi167.stdout:6/288: symlink d7/d11/d13/l6c 0 2024-09-17T01:41:20.368 INFO:tasks.workunit.client.1.smithi167.stdout:2/259: mknod d5/d10/d1a/d39/c5b 0 2024-09-17T01:41:20.368 INFO:tasks.workunit.client.1.smithi167.stdout:0/167: fdatasync d5/d8/d9/d19/f22 0 2024-09-17T01:41:20.368 INFO:tasks.workunit.client.1.smithi167.stdout:5/149: mknod d0/d24/c26 0 2024-09-17T01:41:20.369 INFO:tasks.workunit.client.1.smithi167.stdout:2/260: fdatasync d5/f2f 0 2024-09-17T01:41:20.370 INFO:tasks.workunit.client.1.smithi167.stdout:0/168: write d5/d8/d9/d19/f22 [3993302,78306] 0 2024-09-17T01:41:20.372 INFO:tasks.workunit.client.1.smithi167.stdout:1/200: dwrite d0/d5/d34/f14 [0,4194304] 0 2024-09-17T01:41:20.372 INFO:tasks.workunit.client.1.smithi167.stdout:2/261: write d5/d10/d1a/d45/f9 [4547984,114875] 0 2024-09-17T01:41:20.373 INFO:tasks.workunit.client.1.smithi167.stdout:5/150: chown d0/f21 18 1 2024-09-17T01:41:20.374 INFO:tasks.workunit.client.1.smithi167.stdout:2/262: write d5/d10/d1a/d45/f9 [3311874,79284] 0 2024-09-17T01:41:20.376 INFO:tasks.workunit.client.1.smithi167.stdout:6/289: mknod d7/d12/d27/d3a/d61/c6d 0 2024-09-17T01:41:20.377 INFO:tasks.workunit.client.0.smithi082.stdout:5/33: write fa [283800,53461] 0 2024-09-17T01:41:20.378 INFO:tasks.workunit.client.0.smithi082.stdout:5/34: write f6 [43743,43850] 0 2024-09-17T01:41:20.380 INFO:tasks.workunit.client.1.smithi167.stdout:0/169: fsync d5/d8/f20 0 2024-09-17T01:41:20.381 INFO:tasks.workunit.client.1.smithi167.stdout:5/151: dwrite d0/f11 [0,4194304] 0 2024-09-17T01:41:20.382 INFO:tasks.workunit.client.1.smithi167.stdout:2/263: creat d5/d10/d1a/f5c x:0 0 0 2024-09-17T01:41:20.383 INFO:tasks.workunit.client.1.smithi167.stdout:2/264: chown d5/f44 1614883 1 2024-09-17T01:41:20.384 INFO:tasks.workunit.client.1.smithi167.stdout:1/201: mkdir d0/d9/d16/d3f 0 2024-09-17T01:41:20.385 INFO:tasks.workunit.client.0.smithi082.stdout:5/35: fdatasync f3 0 2024-09-17T01:41:20.388 INFO:tasks.workunit.client.1.smithi167.stdout:6/290: symlink d7/d12/d27/d3a/d56/l6e 0 2024-09-17T01:41:20.388 INFO:tasks.workunit.client.1.smithi167.stdout:4/263: truncate d0/d4/d7/f26 1301551 0 2024-09-17T01:41:20.390 INFO:tasks.workunit.client.1.smithi167.stdout:5/152: dwrite d0/d9/d1c/f23 [4194304,4194304] 0 2024-09-17T01:41:20.391 INFO:tasks.workunit.client.1.smithi167.stdout:9/225: dread d4/d9/f1d [0,4194304] 0 2024-09-17T01:41:20.392 INFO:tasks.workunit.client.1.smithi167.stdout:9/226: fsync d4/d9/f2a 0 2024-09-17T01:41:20.392 INFO:tasks.workunit.client.1.smithi167.stdout:3/206: truncate d7/d8/d10/d14/d2c/f2f 352349 0 2024-09-17T01:41:20.393 INFO:tasks.workunit.client.0.smithi082.stdout:5/36: mkdir db/de 0 2024-09-17T01:41:20.394 INFO:tasks.workunit.client.1.smithi167.stdout:2/265: symlink d5/d10/d1a/d45/d3f/l5d 0 2024-09-17T01:41:20.398 INFO:tasks.workunit.client.1.smithi167.stdout:0/170: creat d5/d8/d9/d2f/f31 x:0 0 0 2024-09-17T01:41:20.400 INFO:tasks.workunit.client.1.smithi167.stdout:3/207: dwrite d7/d8/d10/d14/d25/f1c [0,4194304] 0 2024-09-17T01:41:20.405 INFO:tasks.workunit.client.0.smithi082.stdout:5/37: write f3 [2667937,121452] 0 2024-09-17T01:41:20.405 INFO:tasks.workunit.client.0.smithi082.stdout:5/38: chown f6 23279796 1 2024-09-17T01:41:20.407 INFO:tasks.workunit.client.0.smithi082.stdout:5/39: symlink db/lf 0 2024-09-17T01:41:20.412 INFO:tasks.workunit.client.0.smithi082.stdout:5/40: dwrite db/fc [0,4194304] 0 2024-09-17T01:41:20.415 INFO:tasks.workunit.client.0.smithi082.stdout:5/41: creat db/f10 x:0 0 0 2024-09-17T01:41:20.421 INFO:tasks.workunit.client.0.smithi082.stdout:5/42: dwrite f7 [0,4194304] 0 2024-09-17T01:41:20.424 INFO:tasks.workunit.client.0.smithi082.stdout:5/43: creat db/f11 x:0 0 0 2024-09-17T01:41:20.432 INFO:tasks.workunit.client.0.smithi082.stdout:5/44: dwrite db/f10 [0,4194304] 0 2024-09-17T01:41:20.434 INFO:tasks.workunit.client.0.smithi082.stdout:5/45: rmdir db 39 2024-09-17T01:41:20.459 INFO:tasks.workunit.client.0.smithi082.stdout:5/46: getdents db 0 2024-09-17T01:41:20.461 INFO:tasks.workunit.client.0.smithi082.stdout:5/47: dread db/fc [0,4194304] 0 2024-09-17T01:41:20.471 INFO:tasks.workunit.client.1.smithi167.stdout:2/266: mkdir d5/d10/d1a/d39/d5e 0 2024-09-17T01:41:20.471 INFO:tasks.workunit.client.1.smithi167.stdout:6/291: mknod d7/d11/c6f 0 2024-09-17T01:41:20.471 INFO:tasks.workunit.client.1.smithi167.stdout:4/264: mknod d0/d4/d7/d10/c5e 0 2024-09-17T01:41:20.471 INFO:tasks.workunit.client.1.smithi167.stdout:0/171: symlink d5/d8/l32 0 2024-09-17T01:41:20.472 INFO:tasks.workunit.client.1.smithi167.stdout:3/208: creat d7/d1e/f3a x:0 0 0 2024-09-17T01:41:20.472 INFO:tasks.workunit.client.1.smithi167.stdout:4/265: readlink d0/d4/lc 0 2024-09-17T01:41:20.473 INFO:tasks.workunit.client.1.smithi167.stdout:2/267: fsync d5/d10/d1a/d45/f9 0 2024-09-17T01:41:20.475 INFO:tasks.workunit.client.1.smithi167.stdout:3/209: chown d7/d8/d10/d14/d25/l1b 1107296 1 2024-09-17T01:41:20.479 INFO:tasks.workunit.client.1.smithi167.stdout:2/268: dread d5/d1f/f20 [0,4194304] 0 2024-09-17T01:41:20.480 INFO:tasks.workunit.client.1.smithi167.stdout:4/266: dread d0/d4/d7/f23 [0,4194304] 0 2024-09-17T01:41:20.481 INFO:tasks.workunit.client.1.smithi167.stdout:6/292: dread d7/d12/f1c [0,4194304] 0 2024-09-17T01:41:20.482 INFO:tasks.workunit.client.1.smithi167.stdout:1/202: dread d0/f2e [0,4194304] 0 2024-09-17T01:41:20.482 INFO:tasks.workunit.client.1.smithi167.stdout:4/267: write d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [3116080,21385] 0 2024-09-17T01:41:20.528 INFO:tasks.workunit.client.1.smithi167.stdout:8/346: sync 2024-09-17T01:41:20.528 INFO:tasks.workunit.client.1.smithi167.stdout:7/216: sync 2024-09-17T01:41:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/51: sync 2024-09-17T01:41:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:2/39: sync 2024-09-17T01:41:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:4/67: sync 2024-09-17T01:41:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:0/48: sync 2024-09-17T01:41:20.532 INFO:tasks.workunit.client.0.smithi082.stdout:7/72: sync 2024-09-17T01:41:20.533 INFO:tasks.workunit.client.0.smithi082.stdout:8/51: sync 2024-09-17T01:41:20.533 INFO:tasks.workunit.client.0.smithi082.stdout:1/52: stat d2/cc 0 2024-09-17T01:41:20.534 INFO:tasks.workunit.client.1.smithi167.stdout:7/217: dread d0/d2/f2e [0,4194304] 0 2024-09-17T01:41:20.534 INFO:tasks.workunit.client.1.smithi167.stdout:8/347: dwrite dc/d21/f25 [4194304,4194304] 0 2024-09-17T01:41:20.535 INFO:tasks.workunit.client.1.smithi167.stdout:7/218: chown d0/f5 1379 1 2024-09-17T01:41:20.535 INFO:tasks.workunit.client.0.smithi082.stdout:8/52: truncate d3/fb 4211018 0 2024-09-17T01:41:20.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/48: mkdir db/d12 0 2024-09-17T01:41:20.539 INFO:tasks.workunit.client.0.smithi082.stdout:5/49: dread f9 [0,4194304] 0 2024-09-17T01:41:20.565 INFO:tasks.workunit.client.1.smithi167.stdout:9/227: sync 2024-09-17T01:41:20.669 INFO:tasks.workunit.client.0.smithi082.stdout:0/49: rename f6 to da/fe 0 2024-09-17T01:41:20.671 INFO:tasks.workunit.client.0.smithi082.stdout:2/40: rename d1/f4 to d1/f9 0 2024-09-17T01:41:20.674 INFO:tasks.workunit.client.0.smithi082.stdout:1/53: symlink d2/da/l12 0 2024-09-17T01:41:20.675 INFO:tasks.workunit.client.0.smithi082.stdout:8/53: rmdir d3/dd 39 2024-09-17T01:41:20.678 INFO:tasks.workunit.client.0.smithi082.stdout:4/68: mkdir d9/d15/d16 0 2024-09-17T01:41:20.680 INFO:tasks.workunit.client.0.smithi082.stdout:7/73: dwrite d0/fa [0,4194304] 0 2024-09-17T01:41:20.681 INFO:tasks.workunit.client.0.smithi082.stdout:0/50: mkdir da/df 0 2024-09-17T01:41:20.687 INFO:tasks.workunit.client.0.smithi082.stdout:2/41: dread d1/f9 [0,4194304] 0 2024-09-17T01:41:20.687 INFO:tasks.workunit.client.1.smithi167.stdout:8/348: rmdir dc/d21 39 2024-09-17T01:41:20.690 INFO:tasks.workunit.client.1.smithi167.stdout:7/219: mkdir d0/d2/d14/d19/d22/d40 0 2024-09-17T01:41:20.690 INFO:tasks.workunit.client.1.smithi167.stdout:7/220: fdatasync d0/d2/d14/d19/d26/f35 0 2024-09-17T01:41:20.691 INFO:tasks.workunit.client.1.smithi167.stdout:7/221: write d0/d2/f17 [1769112,83097] 0 2024-09-17T01:41:20.694 INFO:tasks.workunit.client.1.smithi167.stdout:7/222: read d0/f13 [3584394,124742] 0 2024-09-17T01:41:20.696 INFO:tasks.workunit.client.0.smithi082.stdout:7/74: creat d0/dd/f12 x:0 0 0 2024-09-17T01:41:20.696 INFO:tasks.workunit.client.0.smithi082.stdout:0/51: mknod da/c10 0 2024-09-17T01:41:20.697 INFO:tasks.workunit.client.0.smithi082.stdout:7/75: dread - d0/dd/f12 zero size 2024-09-17T01:41:20.702 INFO:tasks.workunit.client.0.smithi082.stdout:8/54: dwrite d3/fa [0,4194304] 0 2024-09-17T01:41:20.703 INFO:tasks.workunit.client.0.smithi082.stdout:4/69: write d9/fa [1997193,20348] 0 2024-09-17T01:41:20.704 INFO:tasks.workunit.client.0.smithi082.stdout:7/76: dread d0/fa [0,4194304] 0 2024-09-17T01:41:20.705 INFO:tasks.workunit.client.0.smithi082.stdout:4/70: rename d9 to d9/d15/d16/d17 22 2024-09-17T01:41:20.705 INFO:tasks.workunit.client.0.smithi082.stdout:5/50: rmdir db/de 0 2024-09-17T01:41:20.707 INFO:tasks.workunit.client.1.smithi167.stdout:2/269: fdatasync d5/d10/d16/f18 0 2024-09-17T01:41:20.708 INFO:tasks.workunit.client.1.smithi167.stdout:2/270: write d5/d10/d1a/d2e/f3b [1643697,51877] 0 2024-09-17T01:41:20.708 INFO:tasks.workunit.client.1.smithi167.stdout:6/293: mknod d7/d11/d13/c70 0 2024-09-17T01:41:20.709 INFO:tasks.workunit.client.1.smithi167.stdout:6/294: truncate d7/d11/f5b 792404 0 2024-09-17T01:41:20.711 INFO:tasks.workunit.client.0.smithi082.stdout:0/52: mknod da/c11 0 2024-09-17T01:41:20.712 INFO:tasks.workunit.client.0.smithi082.stdout:2/42: write d1/f5 [2916411,28430] 0 2024-09-17T01:41:20.713 INFO:tasks.workunit.client.0.smithi082.stdout:1/54: link d2/f4 d2/dd/f13 0 2024-09-17T01:41:20.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:20 smithi082 ceph-mon[28077]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 16 MiB/s wr, 228 op/s 2024-09-17T01:41:20.715 INFO:tasks.workunit.client.1.smithi167.stdout:4/268: creat d0/d4/d7/d6/d5d/f5f x:0 0 0 2024-09-17T01:41:20.715 INFO:tasks.workunit.client.0.smithi082.stdout:0/53: dread f0 [0,4194304] 0 2024-09-17T01:41:20.715 INFO:tasks.workunit.client.1.smithi167.stdout:4/269: fsync d0/f3 0 2024-09-17T01:41:20.718 INFO:tasks.workunit.client.1.smithi167.stdout:5/153: link d0/c4 d0/c27 0 2024-09-17T01:41:20.719 INFO:tasks.workunit.client.0.smithi082.stdout:7/77: creat d0/f13 x:0 0 0 2024-09-17T01:41:20.720 INFO:tasks.workunit.client.1.smithi167.stdout:7/223: creat d0/d2/f41 x:0 0 0 2024-09-17T01:41:20.720 INFO:tasks.workunit.client.0.smithi082.stdout:4/71: dread - d9/fd zero size 2024-09-17T01:41:20.720 INFO:tasks.workunit.client.1.smithi167.stdout:9/228: mkdir d4/d9/d21/d43 0 2024-09-17T01:41:20.721 INFO:tasks.workunit.client.1.smithi167.stdout:9/229: chown d4/l1b 6841 1 2024-09-17T01:41:20.721 INFO:tasks.workunit.client.0.smithi082.stdout:2/43: mknod d1/ca 0 2024-09-17T01:41:20.721 INFO:tasks.workunit.client.1.smithi167.stdout:0/172: link d5/d8/d9/d19/l28 d5/d8/d2e/l33 0 2024-09-17T01:41:20.722 INFO:tasks.workunit.client.0.smithi082.stdout:1/55: truncate d2/da/fe 231248 0 2024-09-17T01:41:20.722 INFO:tasks.workunit.client.1.smithi167.stdout:3/210: truncate d7/d8/d10/d14/d2c/f2f 55218 0 2024-09-17T01:41:20.723 INFO:tasks.workunit.client.0.smithi082.stdout:0/54: symlink da/l12 0 2024-09-17T01:41:20.723 INFO:tasks.workunit.client.1.smithi167.stdout:0/173: write d5/f1d [5219502,100494] 0 2024-09-17T01:41:20.725 INFO:tasks.workunit.client.1.smithi167.stdout:0/174: dread - d5/d8/d9/f2c zero size 2024-09-17T01:41:20.726 INFO:tasks.workunit.client.1.smithi167.stdout:0/175: stat d5/d8/d2e 0 2024-09-17T01:41:20.727 INFO:tasks.workunit.client.0.smithi082.stdout:8/55: rename d3/fa to d3/dd/ff 0 2024-09-17T01:41:20.727 INFO:tasks.workunit.client.1.smithi167.stdout:7/224: dwrite d0/d2/d14/f16 [0,4194304] 0 2024-09-17T01:41:20.728 INFO:tasks.workunit.client.1.smithi167.stdout:2/271: creat d5/d3c/d4c/f5f x:0 0 0 2024-09-17T01:41:20.729 INFO:tasks.workunit.client.0.smithi082.stdout:7/78: creat d0/d3/db/f14 x:0 0 0 2024-09-17T01:41:20.729 INFO:tasks.workunit.client.0.smithi082.stdout:4/72: read - d9/f14 zero size 2024-09-17T01:41:20.731 INFO:tasks.workunit.client.0.smithi082.stdout:4/73: fdatasync d9/fa 0 2024-09-17T01:41:20.733 INFO:tasks.workunit.client.1.smithi167.stdout:4/270: rename d0/d4/d7/f17 to d0/d4/d7/d6/f60 0 2024-09-17T01:41:20.734 INFO:tasks.workunit.client.1.smithi167.stdout:8/349: dread dc/d21/f25 [0,4194304] 0 2024-09-17T01:41:20.739 INFO:tasks.workunit.client.0.smithi082.stdout:7/79: rename d0/dd/f12 to d0/d3/f15 0 2024-09-17T01:41:20.739 INFO:tasks.workunit.client.0.smithi082.stdout:7/80: chown d0/dd 221881 1 2024-09-17T01:41:20.740 INFO:tasks.workunit.client.1.smithi167.stdout:3/211: rmdir d7/d8/d10 39 2024-09-17T01:41:20.741 INFO:tasks.workunit.client.1.smithi167.stdout:9/230: dread f1 [0,4194304] 0 2024-09-17T01:41:20.742 INFO:tasks.workunit.client.0.smithi082.stdout:4/74: rmdir d9/d15 39 2024-09-17T01:41:20.743 INFO:tasks.workunit.client.1.smithi167.stdout:0/176: chown d5/d8/l2d 1 1 2024-09-17T01:41:20.745 INFO:tasks.workunit.client.1.smithi167.stdout:1/203: getdents d0/d5 0 2024-09-17T01:41:20.746 INFO:tasks.workunit.client.0.smithi082.stdout:1/56: fsync d2/da/fe 0 2024-09-17T01:41:20.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/81: creat d0/dd/f16 x:0 0 0 2024-09-17T01:41:20.750 INFO:tasks.workunit.client.0.smithi082.stdout:7/82: write d0/dd/f16 [194718,96170] 0 2024-09-17T01:41:20.750 INFO:tasks.workunit.client.1.smithi167.stdout:0/177: dwrite d5/d8/d9/f2c [0,4194304] 0 2024-09-17T01:41:20.751 INFO:tasks.workunit.client.0.smithi082.stdout:4/75: chown d9/cb 0 1 2024-09-17T01:41:20.753 INFO:tasks.workunit.client.1.smithi167.stdout:5/154: mkdir d0/d28 0 2024-09-17T01:41:20.753 INFO:tasks.workunit.client.1.smithi167.stdout:1/204: dwrite d0/d5/f12 [4194304,4194304] 0 2024-09-17T01:41:20.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:20 smithi167 ceph-mon[35643]: pgmap v13: 65 pgs: 65 active+clean; 308 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 16 MiB/s wr, 228 op/s 2024-09-17T01:41:20.755 INFO:tasks.workunit.client.1.smithi167.stdout:8/350: unlink dc/d1a/l3d 0 2024-09-17T01:41:20.758 INFO:tasks.workunit.client.1.smithi167.stdout:4/271: rename d0/d4/d7/da/d48/d40/d57/d5a/f5c to d0/d4/d7/da/d48/d40/d51/d2d/f61 0 2024-09-17T01:41:20.761 INFO:tasks.workunit.client.0.smithi082.stdout:2/44: truncate d1/f5 6157732 0 2024-09-17T01:41:20.761 INFO:tasks.workunit.client.0.smithi082.stdout:0/55: dwrite f8 [0,4194304] 0 2024-09-17T01:41:20.763 INFO:tasks.workunit.client.1.smithi167.stdout:1/205: dwrite d0/d5/d34/d3c/f2b [4194304,4194304] 0 2024-09-17T01:41:20.765 INFO:tasks.workunit.client.1.smithi167.stdout:9/231: symlink d4/d9/d21/d2d/l44 0 2024-09-17T01:41:20.766 INFO:tasks.workunit.client.0.smithi082.stdout:4/76: fsync d9/f14 0 2024-09-17T01:41:20.767 INFO:tasks.workunit.client.1.smithi167.stdout:9/232: fsync d4/d9/f28 0 2024-09-17T01:41:20.768 INFO:tasks.workunit.client.0.smithi082.stdout:4/77: readlink l4 0 2024-09-17T01:41:20.768 INFO:tasks.workunit.client.0.smithi082.stdout:4/78: chown l0 65404 1 2024-09-17T01:41:20.771 INFO:tasks.workunit.client.0.smithi082.stdout:1/57: creat d2/dd/f14 x:0 0 0 2024-09-17T01:41:20.772 INFO:tasks.workunit.client.1.smithi167.stdout:7/225: symlink d0/d2/d14/d19/d32/l42 0 2024-09-17T01:41:20.772 INFO:tasks.workunit.client.0.smithi082.stdout:1/58: chown d2/dd 64230107 1 2024-09-17T01:41:20.773 INFO:tasks.workunit.client.0.smithi082.stdout:8/56: link d3/f7 d3/f10 0 2024-09-17T01:41:20.774 INFO:tasks.workunit.client.1.smithi167.stdout:0/178: symlink d5/d8/l34 0 2024-09-17T01:41:20.775 INFO:tasks.workunit.client.1.smithi167.stdout:0/179: dread - d5/d8/d9/d19/f2b zero size 2024-09-17T01:41:20.782 INFO:tasks.workunit.client.1.smithi167.stdout:1/206: fsync d0/f2e 0 2024-09-17T01:41:20.782 INFO:tasks.workunit.client.0.smithi082.stdout:0/56: symlink da/df/l13 0 2024-09-17T01:41:20.783 INFO:tasks.workunit.client.1.smithi167.stdout:1/207: truncate d0/d9/f37 109804 0 2024-09-17T01:41:20.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/57: rename f2 to d3/dd/f11 0 2024-09-17T01:41:20.786 INFO:tasks.workunit.client.1.smithi167.stdout:6/295: getdents d7/d12 0 2024-09-17T01:41:20.788 INFO:tasks.workunit.client.0.smithi082.stdout:8/58: dread d3/dd/ff [0,4194304] 0 2024-09-17T01:41:20.789 INFO:tasks.workunit.client.1.smithi167.stdout:1/208: dwrite d0/d9/f37 [0,4194304] 0 2024-09-17T01:41:20.790 INFO:tasks.workunit.client.0.smithi082.stdout:1/59: mknod d2/df/c15 0 2024-09-17T01:41:20.790 INFO:tasks.workunit.client.0.smithi082.stdout:1/60: chown d2/c9 24 1 2024-09-17T01:41:20.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/83: write d0/fa [305753,14544] 0 2024-09-17T01:41:20.791 INFO:tasks.workunit.client.0.smithi082.stdout:0/57: read - da/fd zero size 2024-09-17T01:41:20.792 INFO:tasks.workunit.client.1.smithi167.stdout:7/226: mknod d0/d2/d14/d19/d22/c43 0 2024-09-17T01:41:20.794 INFO:tasks.workunit.client.1.smithi167.stdout:5/155: symlink d0/l29 0 2024-09-17T01:41:20.795 INFO:tasks.workunit.client.1.smithi167.stdout:8/351: mknod dc/c7c 0 2024-09-17T01:41:20.798 INFO:tasks.workunit.client.0.smithi082.stdout:0/58: truncate f0 4846044 0 2024-09-17T01:41:20.801 INFO:tasks.workunit.client.0.smithi082.stdout:7/84: truncate d0/d3/f4 2941367 0 2024-09-17T01:41:20.802 INFO:tasks.workunit.client.0.smithi082.stdout:7/85: write d0/f13 [519393,103775] 0 2024-09-17T01:41:20.802 INFO:tasks.workunit.client.1.smithi167.stdout:8/352: dwrite dc/d56/f70 [0,4194304] 0 2024-09-17T01:41:20.803 INFO:tasks.workunit.client.1.smithi167.stdout:3/212: write d7/d8/d10/d14/f26 [2170845,125654] 0 2024-09-17T01:41:20.803 INFO:tasks.workunit.client.0.smithi082.stdout:7/86: fsync d0/dd/f16 0 2024-09-17T01:41:20.805 INFO:tasks.workunit.client.0.smithi082.stdout:0/59: truncate f7 593090 0 2024-09-17T01:41:20.805 INFO:tasks.workunit.client.0.smithi082.stdout:7/87: write d0/dd/f16 [262974,20137] 0 2024-09-17T01:41:20.807 INFO:tasks.workunit.client.0.smithi082.stdout:0/60: chown da/l12 8 1 2024-09-17T01:41:20.808 INFO:tasks.workunit.client.1.smithi167.stdout:9/233: creat d4/d9/d21/d43/f45 x:0 0 0 2024-09-17T01:41:20.809 INFO:tasks.workunit.client.0.smithi082.stdout:4/79: dwrite f7 [0,4194304] 0 2024-09-17T01:41:20.811 INFO:tasks.workunit.client.0.smithi082.stdout:7/88: truncate d0/d3/db/f14 868980 0 2024-09-17T01:41:20.813 INFO:tasks.workunit.client.0.smithi082.stdout:4/80: write d9/fa [500722,13390] 0 2024-09-17T01:41:20.814 INFO:tasks.workunit.client.1.smithi167.stdout:5/156: dread d0/f18 [0,4194304] 0 2024-09-17T01:41:20.814 INFO:tasks.workunit.client.1.smithi167.stdout:2/272: sync 2024-09-17T01:41:20.815 INFO:tasks.workunit.client.0.smithi082.stdout:8/59: getdents d3 0 2024-09-17T01:41:20.816 INFO:tasks.workunit.client.0.smithi082.stdout:2/45: dwrite d1/f5 [0,4194304] 0 2024-09-17T01:41:20.822 INFO:tasks.workunit.client.0.smithi082.stdout:2/46: dread d1/f5 [0,4194304] 0 2024-09-17T01:41:20.823 INFO:tasks.workunit.client.0.smithi082.stdout:8/60: mknod d3/dd/c12 0 2024-09-17T01:41:20.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/61: chown d3/dd 5 1 2024-09-17T01:41:20.824 INFO:tasks.workunit.client.0.smithi082.stdout:2/47: read d1/f5 [711982,16092] 0 2024-09-17T01:41:20.826 INFO:tasks.workunit.client.0.smithi082.stdout:7/89: fsync d0/d3/f4 0 2024-09-17T01:41:20.827 INFO:tasks.workunit.client.0.smithi082.stdout:1/61: dwrite f0 [0,4194304] 0 2024-09-17T01:41:20.828 INFO:tasks.workunit.client.0.smithi082.stdout:7/90: dread d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:20.829 INFO:tasks.workunit.client.1.smithi167.stdout:4/272: dwrite d0/d4/d7/da/f2c [0,4194304] 0 2024-09-17T01:41:20.829 INFO:tasks.workunit.client.0.smithi082.stdout:7/91: chown d0/d3 4 1 2024-09-17T01:41:20.829 INFO:tasks.workunit.client.1.smithi167.stdout:8/353: write dc/d21/f25 [504274,84630] 0 2024-09-17T01:41:20.832 INFO:tasks.workunit.client.1.smithi167.stdout:4/273: fsync d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d 0 2024-09-17T01:41:20.832 INFO:tasks.workunit.client.1.smithi167.stdout:3/213: creat d7/d8/d10/d29/f3b x:0 0 0 2024-09-17T01:41:20.833 INFO:tasks.workunit.client.1.smithi167.stdout:3/214: write d7/d1e/f3a [120681,110033] 0 2024-09-17T01:41:20.834 INFO:tasks.workunit.client.0.smithi082.stdout:2/48: creat d1/fb x:0 0 0 2024-09-17T01:41:20.834 INFO:tasks.workunit.client.1.smithi167.stdout:4/274: write d0/d4/d7/d6/d5d/f5f [460500,23452] 0 2024-09-17T01:41:20.836 INFO:tasks.workunit.client.1.smithi167.stdout:6/296: creat d7/d42/f71 x:0 0 0 2024-09-17T01:41:20.837 INFO:tasks.workunit.client.1.smithi167.stdout:6/297: fdatasync d7/d12/f23 0 2024-09-17T01:41:20.841 INFO:tasks.workunit.client.1.smithi167.stdout:1/209: fdatasync d0/f17 0 2024-09-17T01:41:20.843 INFO:tasks.workunit.client.1.smithi167.stdout:3/215: dwrite d7/d8/d10/d14/f26 [0,4194304] 0 2024-09-17T01:41:20.844 INFO:tasks.workunit.client.0.smithi082.stdout:1/62: mkdir d2/da/d16 0 2024-09-17T01:41:20.844 INFO:tasks.workunit.client.1.smithi167.stdout:1/210: write d0/d9/f31 [347967,21685] 0 2024-09-17T01:41:20.845 INFO:tasks.workunit.client.1.smithi167.stdout:1/211: readlink d0/d5/d34/d3c/l33 0 2024-09-17T01:41:20.845 INFO:tasks.workunit.client.0.smithi082.stdout:1/63: write d2/dd/f14 [296302,110262] 0 2024-09-17T01:41:20.845 INFO:tasks.workunit.client.0.smithi082.stdout:4/81: mkdir d9/d15/d16/d18 0 2024-09-17T01:41:20.846 INFO:tasks.workunit.client.0.smithi082.stdout:1/64: chown d2/dd/f13 91437475 1 2024-09-17T01:41:20.847 INFO:tasks.workunit.client.1.smithi167.stdout:0/180: rename d5/d8/d9/f1a to d5/d8/d9/f35 0 2024-09-17T01:41:20.848 INFO:tasks.workunit.client.0.smithi082.stdout:1/65: chown d2/c8 20046 1 2024-09-17T01:41:20.849 INFO:tasks.workunit.client.0.smithi082.stdout:7/92: creat d0/dd/f17 x:0 0 0 2024-09-17T01:41:20.849 INFO:tasks.workunit.client.0.smithi082.stdout:1/66: dread - d2/f10 zero size 2024-09-17T01:41:20.850 INFO:tasks.workunit.client.1.smithi167.stdout:3/216: dread d7/d8/d2a/f22 [4194304,4194304] 0 2024-09-17T01:41:20.851 INFO:tasks.workunit.client.1.smithi167.stdout:3/217: readlink d7/d8/d10/d14/d25/lb 0 2024-09-17T01:41:20.851 INFO:tasks.workunit.client.1.smithi167.stdout:8/354: creat dc/d1a/f7d x:0 0 0 2024-09-17T01:41:20.852 INFO:tasks.workunit.client.1.smithi167.stdout:8/355: write dc/d56/f5e [785739,49672] 0 2024-09-17T01:41:20.852 INFO:tasks.workunit.client.1.smithi167.stdout:8/356: fdatasync fb 0 2024-09-17T01:41:20.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/62: truncate d3/dd/f11 4327457 0 2024-09-17T01:41:20.854 INFO:tasks.workunit.client.0.smithi082.stdout:4/82: dwrite f7 [0,4194304] 0 2024-09-17T01:41:20.855 INFO:tasks.workunit.client.1.smithi167.stdout:9/234: truncate d4/d9/f2a 2921616 0 2024-09-17T01:41:20.856 INFO:tasks.workunit.client.1.smithi167.stdout:9/235: chown d4/d9/d21/d43 42484976 1 2024-09-17T01:41:20.857 INFO:tasks.workunit.client.0.smithi082.stdout:7/93: creat d0/d3/db/f18 x:0 0 0 2024-09-17T01:41:20.859 INFO:tasks.workunit.client.1.smithi167.stdout:5/157: creat d0/d28/f2a x:0 0 0 2024-09-17T01:41:20.860 INFO:tasks.workunit.client.0.smithi082.stdout:2/49: dwrite d1/f9 [0,4194304] 0 2024-09-17T01:41:20.860 INFO:tasks.workunit.client.0.smithi082.stdout:8/63: creat d3/f13 x:0 0 0 2024-09-17T01:41:20.861 INFO:tasks.workunit.client.1.smithi167.stdout:5/158: read d0/f20 [841706,29854] 0 2024-09-17T01:41:20.861 INFO:tasks.workunit.client.0.smithi082.stdout:2/50: write d1/fb [120018,24964] 0 2024-09-17T01:41:20.863 INFO:tasks.workunit.client.0.smithi082.stdout:2/51: dread d1/f5 [4194304,4194304] 0 2024-09-17T01:41:20.868 INFO:tasks.workunit.client.0.smithi082.stdout:2/52: dwrite d1/fb [0,4194304] 0 2024-09-17T01:41:20.880 INFO:tasks.workunit.client.0.smithi082.stdout:4/83: creat d9/d15/f19 x:0 0 0 2024-09-17T01:41:20.882 INFO:tasks.workunit.client.1.smithi167.stdout:4/275: unlink d0/d4/d7/da/d48/d40/d51/f24 0 2024-09-17T01:41:20.885 INFO:tasks.workunit.client.1.smithi167.stdout:4/276: truncate d0/d4/d7/d6/d5d/f5f 948733 0 2024-09-17T01:41:20.885 INFO:tasks.workunit.client.1.smithi167.stdout:4/277: chown d0/c3b 1266069 1 2024-09-17T01:41:20.886 INFO:tasks.workunit.client.1.smithi167.stdout:2/273: symlink d5/d10/d1a/d2e/d49/l60 0 2024-09-17T01:41:20.889 INFO:tasks.workunit.client.1.smithi167.stdout:7/227: link d0/d2/cc d0/d2/d14/d23/c44 0 2024-09-17T01:41:20.889 INFO:tasks.workunit.client.0.smithi082.stdout:4/84: dwrite f7 [0,4194304] 0 2024-09-17T01:41:20.891 INFO:tasks.workunit.client.0.smithi082.stdout:4/85: fdatasync d9/fa 0 2024-09-17T01:41:20.893 INFO:tasks.workunit.client.0.smithi082.stdout:7/94: dwrite d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:20.895 INFO:tasks.workunit.client.1.smithi167.stdout:1/212: symlink d0/d5/d34/l40 0 2024-09-17T01:41:20.896 INFO:tasks.workunit.client.1.smithi167.stdout:1/213: write d0/d9/f31 [2726040,2575] 0 2024-09-17T01:41:20.897 INFO:tasks.workunit.client.1.smithi167.stdout:1/214: read d0/d9/f31 [1909740,49505] 0 2024-09-17T01:41:20.903 INFO:tasks.workunit.client.1.smithi167.stdout:8/357: mkdir dc/d56/d57/d7e 0 2024-09-17T01:41:20.907 INFO:tasks.workunit.client.0.smithi082.stdout:4/86: read d9/fc [1192239,62951] 0 2024-09-17T01:41:20.908 INFO:tasks.workunit.client.0.smithi082.stdout:7/95: creat d0/d3/db/d10/f19 x:0 0 0 2024-09-17T01:41:20.908 INFO:tasks.workunit.client.0.smithi082.stdout:1/67: dwrite d2/f3 [0,4194304] 0 2024-09-17T01:41:20.911 INFO:tasks.workunit.client.0.smithi082.stdout:2/53: link d1/c3 d1/cc 0 2024-09-17T01:41:20.912 INFO:tasks.workunit.client.1.smithi167.stdout:5/159: mkdir d0/d24/d2b 0 2024-09-17T01:41:20.912 INFO:tasks.workunit.client.1.smithi167.stdout:9/236: dread d4/d9/d21/f27 [0,4194304] 0 2024-09-17T01:41:20.913 INFO:tasks.workunit.client.0.smithi082.stdout:8/64: chown d3/fb 1 1 2024-09-17T01:41:20.913 INFO:tasks.workunit.client.1.smithi167.stdout:9/237: dread - d4/d9/d21/d43/f45 zero size 2024-09-17T01:41:20.915 INFO:tasks.workunit.client.0.smithi082.stdout:4/87: rename d9/cb to d9/d15/c1a 0 2024-09-17T01:41:20.917 INFO:tasks.workunit.client.0.smithi082.stdout:7/96: mknod d0/dd/c1a 0 2024-09-17T01:41:20.918 INFO:tasks.workunit.client.1.smithi167.stdout:9/238: dread d4/f16 [0,4194304] 0 2024-09-17T01:41:20.919 INFO:tasks.workunit.client.1.smithi167.stdout:9/239: write d4/d9/d21/f26 [777690,107373] 0 2024-09-17T01:41:20.919 INFO:tasks.workunit.client.1.smithi167.stdout:3/218: write d7/d8/f15 [738181,87323] 0 2024-09-17T01:41:20.919 INFO:tasks.workunit.client.1.smithi167.stdout:9/240: readlink d4/d9/l13 0 2024-09-17T01:41:20.921 INFO:tasks.workunit.client.0.smithi082.stdout:1/68: creat d2/df/f17 x:0 0 0 2024-09-17T01:41:20.922 INFO:tasks.workunit.client.1.smithi167.stdout:1/215: creat d0/d5/d34/d3c/f41 x:0 0 0 2024-09-17T01:41:20.923 INFO:tasks.workunit.client.0.smithi082.stdout:2/54: write d1/f5 [5026343,25800] 0 2024-09-17T01:41:20.923 INFO:tasks.workunit.client.1.smithi167.stdout:6/298: sync 2024-09-17T01:41:20.923 INFO:tasks.workunit.client.1.smithi167.stdout:6/299: fsync d7/d12/d27/d3a/f63 0 2024-09-17T01:41:20.925 INFO:tasks.workunit.client.0.smithi082.stdout:4/88: dwrite d9/d15/f19 [0,4194304] 0 2024-09-17T01:41:20.926 INFO:tasks.workunit.client.1.smithi167.stdout:8/358: symlink dc/d18/l7f 0 2024-09-17T01:41:20.927 INFO:tasks.workunit.client.0.smithi082.stdout:4/89: read d9/fa [715956,78181] 0 2024-09-17T01:41:20.932 INFO:tasks.workunit.client.1.smithi167.stdout:7/228: mknod d0/d2/d14/c45 0 2024-09-17T01:41:20.932 INFO:tasks.workunit.client.1.smithi167.stdout:7/229: stat d0/d2/d14/d19/d26/d34 0 2024-09-17T01:41:20.934 INFO:tasks.workunit.client.0.smithi082.stdout:4/90: dread d9/fa [0,4194304] 0 2024-09-17T01:41:20.937 INFO:tasks.workunit.client.1.smithi167.stdout:3/219: creat d7/d1e/f3c x:0 0 0 2024-09-17T01:41:20.939 INFO:tasks.workunit.client.1.smithi167.stdout:9/241: symlink d4/d9/d21/d2d/l46 0 2024-09-17T01:41:20.940 INFO:tasks.workunit.client.1.smithi167.stdout:9/242: dread - d4/d9/d21/d2d/d33/d3a/f40 zero size 2024-09-17T01:41:20.941 INFO:tasks.workunit.client.1.smithi167.stdout:1/216: unlink d0/d5/c20 0 2024-09-17T01:41:20.941 INFO:tasks.workunit.client.0.smithi082.stdout:4/91: symlink d9/l1b 0 2024-09-17T01:41:20.942 INFO:tasks.workunit.client.1.smithi167.stdout:1/217: chown d0/d5/d34/d3c/f2b 24 1 2024-09-17T01:41:20.943 INFO:tasks.workunit.client.1.smithi167.stdout:0/181: rename d5/d8/d9/d2f/f31 to d5/d8/d9/f36 0 2024-09-17T01:41:20.943 INFO:tasks.workunit.client.1.smithi167.stdout:1/218: read d0/d5/d34/f30 [8401,105266] 0 2024-09-17T01:41:20.944 INFO:tasks.workunit.client.1.smithi167.stdout:0/182: write d5/d8/d9/f2c [4599683,75592] 0 2024-09-17T01:41:20.945 INFO:tasks.workunit.client.1.smithi167.stdout:6/300: fsync d7/d11/f1b 0 2024-09-17T01:41:20.945 INFO:tasks.workunit.client.0.smithi082.stdout:1/69: write d2/f4 [694391,13655] 0 2024-09-17T01:41:20.947 INFO:tasks.workunit.client.0.smithi082.stdout:7/97: truncate d0/d3/db/f14 3194419 0 2024-09-17T01:41:20.947 INFO:tasks.workunit.client.0.smithi082.stdout:7/98: readlink d0/l8 0 2024-09-17T01:41:20.948 INFO:tasks.workunit.client.1.smithi167.stdout:1/219: dread d0/d5/f12 [4194304,4194304] 0 2024-09-17T01:41:20.949 INFO:tasks.workunit.client.0.smithi082.stdout:1/70: unlink d2/df/c15 0 2024-09-17T01:41:20.950 INFO:tasks.workunit.client.0.smithi082.stdout:1/71: write d2/df/f17 [345755,117559] 0 2024-09-17T01:41:20.950 INFO:tasks.workunit.client.1.smithi167.stdout:5/160: symlink d0/d24/d2b/l2c 0 2024-09-17T01:41:20.951 INFO:tasks.workunit.client.0.smithi082.stdout:8/65: write d3/dd/f11 [237676,96646] 0 2024-09-17T01:41:20.951 INFO:tasks.workunit.client.0.smithi082.stdout:1/72: stat d2/da/d16 0 2024-09-17T01:41:20.952 INFO:tasks.workunit.client.0.smithi082.stdout:4/92: creat d9/f1c x:0 0 0 2024-09-17T01:41:20.952 INFO:tasks.workunit.client.0.smithi082.stdout:8/66: dread - d3/f13 zero size 2024-09-17T01:41:20.954 INFO:tasks.workunit.client.0.smithi082.stdout:2/55: truncate d1/f9 1069079 0 2024-09-17T01:41:20.955 INFO:tasks.workunit.client.0.smithi082.stdout:7/99: creat d0/d3/db/f1b x:0 0 0 2024-09-17T01:41:20.955 INFO:tasks.workunit.client.0.smithi082.stdout:3/29: sync 2024-09-17T01:41:20.957 INFO:tasks.workunit.client.0.smithi082.stdout:1/73: creat d2/f18 x:0 0 0 2024-09-17T01:41:20.957 INFO:tasks.workunit.client.1.smithi167.stdout:3/220: symlink d7/d8/d10/d14/d24/l3d 0 2024-09-17T01:41:20.959 INFO:tasks.workunit.client.1.smithi167.stdout:9/243: truncate d4/d9/d21/f27 1025050 0 2024-09-17T01:41:21.032 INFO:tasks.workunit.client.0.smithi082.stdout:6/43: sync 2024-09-17T01:41:21.096 INFO:tasks.workunit.client.1.smithi167.stdout:2/274: rename d5/d10/d1a/d45/l1d to d5/d10/d1a/d39/l61 0 2024-09-17T01:41:21.097 INFO:tasks.workunit.client.1.smithi167.stdout:2/275: write d5/d10/d1a/d2e/f59 [470691,53656] 0 2024-09-17T01:41:21.097 INFO:tasks.workunit.client.0.smithi082.stdout:3/30: unlink c4 0 2024-09-17T01:41:21.099 INFO:tasks.workunit.client.0.smithi082.stdout:3/31: dread f6 [0,4194304] 0 2024-09-17T01:41:21.099 INFO:tasks.workunit.client.0.smithi082.stdout:3/32: dread - f8 zero size 2024-09-17T01:41:21.100 INFO:tasks.workunit.client.1.smithi167.stdout:7/230: write d0/d2/f2e [3777946,94686] 0 2024-09-17T01:41:21.101 INFO:tasks.workunit.client.1.smithi167.stdout:2/276: dread d5/d10/d1a/d2e/f59 [0,4194304] 0 2024-09-17T01:41:21.102 INFO:tasks.workunit.client.0.smithi082.stdout:1/74: dread - d2/f11 zero size 2024-09-17T01:41:21.102 INFO:tasks.workunit.client.0.smithi082.stdout:2/56: read d1/f5 [656782,90649] 0 2024-09-17T01:41:21.103 INFO:tasks.workunit.client.1.smithi167.stdout:6/301: chown d7/d12/d27/d28 28862066 1 2024-09-17T01:41:21.105 INFO:tasks.workunit.client.0.smithi082.stdout:4/93: mknod d9/c1d 0 2024-09-17T01:41:21.108 INFO:tasks.workunit.client.1.smithi167.stdout:4/278: link d0/d4/d7/da/d48/d40/d51/d2d/d2e/c38 d0/d4/d7/d10/c62 0 2024-09-17T01:41:21.109 INFO:tasks.workunit.client.1.smithi167.stdout:7/231: dwrite d0/f3f [0,4194304] 0 2024-09-17T01:41:21.110 INFO:tasks.workunit.client.0.smithi082.stdout:3/33: mkdir d9/db 0 2024-09-17T01:41:21.112 INFO:tasks.workunit.client.1.smithi167.stdout:1/220: creat d0/d5/d34/d3c/f42 x:0 0 0 2024-09-17T01:41:21.113 INFO:tasks.workunit.client.1.smithi167.stdout:5/161: read d0/f18 [1498966,57642] 0 2024-09-17T01:41:21.113 INFO:tasks.workunit.client.1.smithi167.stdout:8/359: dwrite dc/d18/f33 [0,4194304] 0 2024-09-17T01:41:21.114 INFO:tasks.workunit.client.0.smithi082.stdout:1/75: fdatasync d2/f10 0 2024-09-17T01:41:21.115 INFO:tasks.workunit.client.1.smithi167.stdout:8/360: write dc/f7a [482758,48944] 0 2024-09-17T01:41:21.115 INFO:tasks.workunit.client.0.smithi082.stdout:1/76: fdatasync f0 0 2024-09-17T01:41:21.115 INFO:tasks.workunit.client.1.smithi167.stdout:8/361: write dc/f7a [949794,115351] 0 2024-09-17T01:41:21.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/57: creat d1/fd x:0 0 0 2024-09-17T01:41:21.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/58: readlink - no filename 2024-09-17T01:41:21.117 INFO:tasks.workunit.client.1.smithi167.stdout:3/221: chown d7/d8/l30 3 1 2024-09-17T01:41:21.120 INFO:tasks.workunit.client.1.smithi167.stdout:9/244: mkdir d4/d9/d21/d43/d47 0 2024-09-17T01:41:21.120 INFO:tasks.workunit.client.0.smithi082.stdout:7/100: dwrite d0/d3/db/fe [0,4194304] 0 2024-09-17T01:41:21.121 INFO:tasks.workunit.client.0.smithi082.stdout:4/94: creat d9/d15/f1e x:0 0 0 2024-09-17T01:41:21.121 INFO:tasks.workunit.client.0.smithi082.stdout:4/95: chown c5 61855627 1 2024-09-17T01:41:21.121 INFO:tasks.workunit.client.0.smithi082.stdout:8/67: truncate d3/fb 3741904 0 2024-09-17T01:41:21.124 INFO:tasks.workunit.client.0.smithi082.stdout:4/96: dread d9/fa [0,4194304] 0 2024-09-17T01:41:21.124 INFO:tasks.workunit.client.0.smithi082.stdout:6/44: mknod d1/d7/d8/dc/ce 0 2024-09-17T01:41:21.126 INFO:tasks.workunit.client.0.smithi082.stdout:8/68: dread d3/dd/f11 [0,4194304] 0 2024-09-17T01:41:21.128 INFO:tasks.workunit.client.0.smithi082.stdout:8/69: write d3/f13 [727781,107823] 0 2024-09-17T01:41:21.135 INFO:tasks.workunit.client.1.smithi167.stdout:6/302: mknod d7/d12/d27/d3a/c72 0 2024-09-17T01:41:21.136 INFO:tasks.workunit.client.0.smithi082.stdout:2/59: creat d1/fe x:0 0 0 2024-09-17T01:41:21.136 INFO:tasks.workunit.client.0.smithi082.stdout:2/60: chown d1/fb 101644465 1 2024-09-17T01:41:21.137 INFO:tasks.workunit.client.0.smithi082.stdout:1/77: creat d2/dd/f19 x:0 0 0 2024-09-17T01:41:21.139 INFO:tasks.workunit.client.1.smithi167.stdout:0/183: mkdir d5/d8/d2e/d37 0 2024-09-17T01:41:21.140 INFO:tasks.workunit.client.0.smithi082.stdout:7/101: mknod d0/c1c 0 2024-09-17T01:41:21.142 INFO:tasks.workunit.client.0.smithi082.stdout:6/45: symlink d1/d7/lf 0 2024-09-17T01:41:21.143 INFO:tasks.workunit.client.1.smithi167.stdout:4/279: creat d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 x:0 0 0 2024-09-17T01:41:21.145 INFO:tasks.workunit.client.1.smithi167.stdout:4/280: truncate d0/d4/d7/d6/d5d/f5f 986006 0 2024-09-17T01:41:21.147 INFO:tasks.workunit.client.0.smithi082.stdout:3/34: symlink d9/db/lc 0 2024-09-17T01:41:21.147 INFO:tasks.workunit.client.1.smithi167.stdout:4/281: write d0/d4/d7/f53 [999356,76175] 0 2024-09-17T01:41:21.148 INFO:tasks.workunit.client.1.smithi167.stdout:9/245: dread d4/d9/f28 [0,4194304] 0 2024-09-17T01:41:21.148 INFO:tasks.workunit.client.0.smithi082.stdout:3/35: read f1 [767841,18259] 0 2024-09-17T01:41:21.149 INFO:tasks.workunit.client.0.smithi082.stdout:2/61: creat d1/ff x:0 0 0 2024-09-17T01:41:21.150 INFO:tasks.workunit.client.1.smithi167.stdout:8/362: chown dc/f15 455 1 2024-09-17T01:41:21.150 INFO:tasks.workunit.client.1.smithi167.stdout:8/363: fsync dc/f2f 0 2024-09-17T01:41:21.151 INFO:tasks.workunit.client.0.smithi082.stdout:2/62: read d1/fb [2100023,52083] 0 2024-09-17T01:41:21.152 INFO:tasks.workunit.client.1.smithi167.stdout:8/364: dread dc/d21/d61/f6f [0,4194304] 0 2024-09-17T01:41:21.152 INFO:tasks.workunit.client.1.smithi167.stdout:8/365: dread - dc/d1a/d45/f54 zero size 2024-09-17T01:41:21.153 INFO:tasks.workunit.client.0.smithi082.stdout:8/70: dwrite d3/dd/ff [0,4194304] 0 2024-09-17T01:41:21.153 INFO:tasks.workunit.client.1.smithi167.stdout:8/366: readlink dc/d21/l37 0 2024-09-17T01:41:21.158 INFO:tasks.workunit.client.0.smithi082.stdout:6/46: mkdir d1/d7/d10 0 2024-09-17T01:41:21.159 INFO:tasks.workunit.client.0.smithi082.stdout:6/47: chown d1/d7/ld 1012 1 2024-09-17T01:41:21.159 INFO:tasks.workunit.client.1.smithi167.stdout:2/277: mknod d5/d10/d1a/d39/d5e/c62 0 2024-09-17T01:41:21.160 INFO:tasks.workunit.client.0.smithi082.stdout:4/97: mknod d9/d15/d16/d18/c1f 0 2024-09-17T01:41:21.164 INFO:tasks.workunit.client.1.smithi167.stdout:0/184: creat d5/d8/d9/d19/f38 x:0 0 0 2024-09-17T01:41:21.165 INFO:tasks.workunit.client.0.smithi082.stdout:3/36: mknod d9/db/cd 0 2024-09-17T01:41:21.167 INFO:tasks.workunit.client.1.smithi167.stdout:6/303: dwrite d7/d12/d27/f26 [4194304,4194304] 0 2024-09-17T01:41:21.167 INFO:tasks.workunit.client.1.smithi167.stdout:7/232: mkdir d0/d2/d14/d46 0 2024-09-17T01:41:21.169 INFO:tasks.workunit.client.0.smithi082.stdout:7/102: link d0/f13 d0/dd/f1d 0 2024-09-17T01:41:21.173 INFO:tasks.workunit.client.1.smithi167.stdout:7/233: dwrite d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:21.175 INFO:tasks.workunit.client.1.smithi167.stdout:5/162: link d0/d9/d1c/f23 d0/d9/f2d 0 2024-09-17T01:41:21.175 INFO:tasks.workunit.client.1.smithi167.stdout:4/282: stat d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/l33 0 2024-09-17T01:41:21.177 INFO:tasks.workunit.client.0.smithi082.stdout:7/103: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:21.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/104: write d0/d3/db/f1b [571136,51160] 0 2024-09-17T01:41:21.179 INFO:tasks.workunit.client.1.smithi167.stdout:9/246: symlink d4/d9/d21/d2d/d33/d3a/l48 0 2024-09-17T01:41:21.179 INFO:tasks.workunit.client.0.smithi082.stdout:7/105: chown d0/dd/f16 665622437 1 2024-09-17T01:41:21.181 INFO:tasks.workunit.client.0.smithi082.stdout:7/106: chown d0/dd/lf 199020145 1 2024-09-17T01:41:21.182 INFO:tasks.workunit.client.0.smithi082.stdout:7/107: dread - d0/d3/db/d10/f19 zero size 2024-09-17T01:41:21.182 INFO:tasks.workunit.client.1.smithi167.stdout:5/163: dwrite d0/d9/ff [0,4194304] 0 2024-09-17T01:41:21.183 INFO:tasks.workunit.client.0.smithi082.stdout:4/98: rename d9/f1c to d9/d15/d16/d18/f20 0 2024-09-17T01:41:21.188 INFO:tasks.workunit.client.1.smithi167.stdout:1/221: write d0/f17 [2640350,125231] 0 2024-09-17T01:41:21.193 INFO:tasks.workunit.client.1.smithi167.stdout:6/304: creat d7/d12/d27/d3a/d61/f73 x:0 0 0 2024-09-17T01:41:21.193 INFO:tasks.workunit.client.1.smithi167.stdout:6/305: chown d7/d12/d27/d3a/d61 6 1 2024-09-17T01:41:21.194 INFO:tasks.workunit.client.0.smithi082.stdout:4/99: chown c6 1473901559 1 2024-09-17T01:41:21.195 INFO:tasks.workunit.client.1.smithi167.stdout:7/234: mknod d0/d2/d14/d19/c47 0 2024-09-17T01:41:21.196 INFO:tasks.workunit.client.1.smithi167.stdout:7/235: stat d0/ca 0 2024-09-17T01:41:21.196 INFO:tasks.workunit.client.0.smithi082.stdout:7/108: creat d0/d3/db/d10/f1e x:0 0 0 2024-09-17T01:41:21.198 INFO:tasks.workunit.client.0.smithi082.stdout:3/37: rename f8 to d9/fe 0 2024-09-17T01:41:21.199 INFO:tasks.workunit.client.1.smithi167.stdout:6/306: dwrite d7/d11/d13/d2f/d30/f59 [0,4194304] 0 2024-09-17T01:41:21.200 INFO:tasks.workunit.client.0.smithi082.stdout:4/100: truncate d9/fd 657593 0 2024-09-17T01:41:21.202 INFO:tasks.workunit.client.1.smithi167.stdout:5/164: symlink d0/d24/l2e 0 2024-09-17T01:41:21.203 INFO:tasks.workunit.client.1.smithi167.stdout:8/367: mknod dc/c80 0 2024-09-17T01:41:21.207 INFO:tasks.workunit.client.0.smithi082.stdout:4/101: dwrite f7 [0,4194304] 0 2024-09-17T01:41:21.209 INFO:tasks.workunit.client.1.smithi167.stdout:8/368: dwrite dc/d21/f47 [4194304,4194304] 0 2024-09-17T01:41:21.212 INFO:tasks.workunit.client.0.smithi082.stdout:7/109: link d0/d3/db/f14 d0/dd/f1f 0 2024-09-17T01:41:21.212 INFO:tasks.workunit.client.0.smithi082.stdout:2/63: write d1/fb [4281223,102468] 0 2024-09-17T01:41:21.214 INFO:tasks.workunit.client.0.smithi082.stdout:2/64: dread - d1/ff zero size 2024-09-17T01:41:21.214 INFO:tasks.workunit.client.1.smithi167.stdout:7/236: symlink d0/d2/l48 0 2024-09-17T01:41:21.215 INFO:tasks.workunit.client.1.smithi167.stdout:3/222: sync 2024-09-17T01:41:21.215 INFO:tasks.workunit.client.1.smithi167.stdout:7/237: write d0/d2/f2e [1897802,26269] 0 2024-09-17T01:41:21.216 INFO:tasks.workunit.client.0.smithi082.stdout:3/38: link f5 d9/ff 0 2024-09-17T01:41:21.218 INFO:tasks.workunit.client.1.smithi167.stdout:3/223: dread d7/d1e/f3a [0,4194304] 0 2024-09-17T01:41:21.220 INFO:tasks.workunit.client.0.smithi082.stdout:2/65: write d1/f5 [116127,28340] 0 2024-09-17T01:41:21.222 INFO:tasks.workunit.client.1.smithi167.stdout:2/278: write d5/d10/d16/f2d [2137875,78221] 0 2024-09-17T01:41:21.223 INFO:tasks.workunit.client.0.smithi082.stdout:2/66: dread - d1/fd zero size 2024-09-17T01:41:21.224 INFO:tasks.workunit.client.0.smithi082.stdout:7/110: dwrite d0/d3/db/f18 [0,4194304] 0 2024-09-17T01:41:21.225 INFO:tasks.workunit.client.0.smithi082.stdout:8/71: write d3/f7 [1247453,90887] 0 2024-09-17T01:41:21.227 INFO:tasks.workunit.client.0.smithi082.stdout:6/48: truncate d1/d7/d8/fb 1702875 0 2024-09-17T01:41:21.228 INFO:tasks.workunit.client.0.smithi082.stdout:3/39: dwrite f7 [0,4194304] 0 2024-09-17T01:41:21.229 INFO:tasks.workunit.client.0.smithi082.stdout:7/111: rmdir d0 39 2024-09-17T01:41:21.231 INFO:tasks.workunit.client.1.smithi167.stdout:0/185: creat d5/d8/d9/f39 x:0 0 0 2024-09-17T01:41:21.234 INFO:tasks.workunit.client.0.smithi082.stdout:8/72: fdatasync d3/f9 0 2024-09-17T01:41:21.234 INFO:tasks.workunit.client.1.smithi167.stdout:8/369: mknod dc/d56/d57/c81 0 2024-09-17T01:41:21.236 INFO:tasks.workunit.client.0.smithi082.stdout:2/67: mkdir d1/d10 0 2024-09-17T01:41:21.238 INFO:tasks.workunit.client.0.smithi082.stdout:6/49: dwrite f0 [4194304,4194304] 0 2024-09-17T01:41:21.240 INFO:tasks.workunit.client.1.smithi167.stdout:9/247: write d4/f16 [1973612,78961] 0 2024-09-17T01:41:21.241 INFO:tasks.workunit.client.1.smithi167.stdout:9/248: dread - d4/d9/d21/d2d/d33/d3a/f3f zero size 2024-09-17T01:41:21.244 INFO:tasks.workunit.client.1.smithi167.stdout:3/224: rename d7/d8/f15 to d7/f3e 0 2024-09-17T01:41:21.244 INFO:tasks.workunit.client.1.smithi167.stdout:0/186: rename d5/d8/d9/d2f to d5/d8/d9/d2f/d3a 22 2024-09-17T01:41:21.245 INFO:tasks.workunit.client.1.smithi167.stdout:3/225: read - d7/d1e/f3c zero size 2024-09-17T01:41:21.246 INFO:tasks.workunit.client.1.smithi167.stdout:4/283: creat d0/f64 x:0 0 0 2024-09-17T01:41:21.246 INFO:tasks.workunit.client.1.smithi167.stdout:0/187: stat d5/d8/d9/d2f 0 2024-09-17T01:41:21.247 INFO:tasks.workunit.client.0.smithi082.stdout:8/73: truncate d3/dd/f11 3667809 0 2024-09-17T01:41:21.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/226: truncate d7/d8/d10/d14/d2c/f2d 4284050 0 2024-09-17T01:41:21.250 INFO:tasks.workunit.client.1.smithi167.stdout:6/307: write f6 [508300,5032] 0 2024-09-17T01:41:21.252 INFO:tasks.workunit.client.1.smithi167.stdout:5/165: unlink d0/f11 0 2024-09-17T01:41:21.255 INFO:tasks.workunit.client.0.smithi082.stdout:8/74: dwrite d3/dd/ff [4194304,4194304] 0 2024-09-17T01:41:21.256 INFO:tasks.workunit.client.0.smithi082.stdout:7/112: mknod d0/dd/c20 0 2024-09-17T01:41:21.257 INFO:tasks.workunit.client.1.smithi167.stdout:8/370: mkdir dc/d56/d59/d82 0 2024-09-17T01:41:21.258 INFO:tasks.workunit.client.1.smithi167.stdout:8/371: fdatasync dc/d1a/f7d 0 2024-09-17T01:41:21.258 INFO:tasks.workunit.client.0.smithi082.stdout:3/40: link f0 d9/f10 0 2024-09-17T01:41:21.259 INFO:tasks.workunit.client.0.smithi082.stdout:3/41: dread d9/f10 [0,4194304] 0 2024-09-17T01:41:21.266 INFO:tasks.workunit.client.1.smithi167.stdout:9/249: rename d4/d9/d21/d2d/l46 to d4/d9/d2b/l49 0 2024-09-17T01:41:21.270 INFO:tasks.workunit.client.1.smithi167.stdout:0/188: creat d5/d8/d9/d2f/f3b x:0 0 0 2024-09-17T01:41:21.271 INFO:tasks.workunit.client.1.smithi167.stdout:0/189: dread - d5/d8/d9/d2f/f3b zero size 2024-09-17T01:41:21.273 INFO:tasks.workunit.client.1.smithi167.stdout:4/284: creat d0/d4/d7/da/d48/d40/d51/d2d/f65 x:0 0 0 2024-09-17T01:41:21.276 INFO:tasks.workunit.client.0.smithi082.stdout:3/42: write d9/fe [559329,40070] 0 2024-09-17T01:41:21.276 INFO:tasks.workunit.client.1.smithi167.stdout:6/308: rmdir d7/d11 39 2024-09-17T01:41:21.278 INFO:tasks.workunit.client.0.smithi082.stdout:2/68: link d1/c2 d1/d10/c11 0 2024-09-17T01:41:21.280 INFO:tasks.workunit.client.1.smithi167.stdout:1/222: getdents d0/d9 0 2024-09-17T01:41:21.281 INFO:tasks.workunit.client.1.smithi167.stdout:1/223: readlink d0/d5/d34/l40 0 2024-09-17T01:41:21.286 INFO:tasks.workunit.client.1.smithi167.stdout:7/238: rmdir d0/d2/d14/d46 0 2024-09-17T01:41:21.286 INFO:tasks.workunit.client.0.smithi082.stdout:2/69: dwrite d1/fb [4194304,4194304] 0 2024-09-17T01:41:21.289 INFO:tasks.workunit.client.0.smithi082.stdout:3/43: creat d9/db/f11 x:0 0 0 2024-09-17T01:41:21.290 INFO:tasks.workunit.client.1.smithi167.stdout:3/227: rename d7/d8/d10/d14/d25/f1c to d7/d8/d2a/f3f 0 2024-09-17T01:41:21.298 INFO:tasks.workunit.client.0.smithi082.stdout:8/75: creat d3/f14 x:0 0 0 2024-09-17T01:41:21.300 INFO:tasks.workunit.client.0.smithi082.stdout:7/113: link d0/d3/db/f14 d0/d3/f21 0 2024-09-17T01:41:21.308 INFO:tasks.workunit.client.0.smithi082.stdout:7/114: dwrite d0/dd/f16 [0,4194304] 0 2024-09-17T01:41:21.310 INFO:tasks.workunit.client.0.smithi082.stdout:7/115: write d0/dd/f16 [2333225,69226] 0 2024-09-17T01:41:21.312 INFO:tasks.workunit.client.0.smithi082.stdout:3/44: symlink d9/l12 0 2024-09-17T01:41:21.315 INFO:tasks.workunit.client.1.smithi167.stdout:8/372: mkdir dc/d21/d6b/d74/d83 0 2024-09-17T01:41:21.317 INFO:tasks.workunit.client.1.smithi167.stdout:7/239: mknod d0/d2/c49 0 2024-09-17T01:41:21.318 INFO:tasks.workunit.client.1.smithi167.stdout:7/240: fdatasync d0/d2/d14/f16 0 2024-09-17T01:41:21.320 INFO:tasks.workunit.client.0.smithi082.stdout:2/70: creat d1/d10/f12 x:0 0 0 2024-09-17T01:41:21.321 INFO:tasks.workunit.client.0.smithi082.stdout:3/45: dwrite d9/fa [0,4194304] 0 2024-09-17T01:41:21.321 INFO:tasks.workunit.client.1.smithi167.stdout:8/373: dwrite dc/d56/f70 [0,4194304] 0 2024-09-17T01:41:21.321 INFO:tasks.workunit.client.1.smithi167.stdout:3/228: creat d7/d8/d10/f40 x:0 0 0 2024-09-17T01:41:21.322 INFO:tasks.workunit.client.0.smithi082.stdout:3/46: write d9/fe [108155,26053] 0 2024-09-17T01:41:21.324 INFO:tasks.workunit.client.0.smithi082.stdout:6/50: truncate d1/d7/d8/fb 1627998 0 2024-09-17T01:41:21.325 INFO:tasks.workunit.client.0.smithi082.stdout:3/47: readlink d9/db/lc 0 2024-09-17T01:41:21.325 INFO:tasks.workunit.client.1.smithi167.stdout:0/190: mknod d5/d8/d9/c3c 0 2024-09-17T01:41:21.325 INFO:tasks.workunit.client.0.smithi082.stdout:8/76: creat d3/dd/f15 x:0 0 0 2024-09-17T01:41:21.327 INFO:tasks.workunit.client.1.smithi167.stdout:0/191: dread - d5/d8/d9/d19/f38 zero size 2024-09-17T01:41:21.328 INFO:tasks.workunit.client.1.smithi167.stdout:7/241: dwrite d0/d2/d14/d23/f38 [0,4194304] 0 2024-09-17T01:41:21.328 INFO:tasks.workunit.client.1.smithi167.stdout:0/192: write d5/f1d [4816207,113067] 0 2024-09-17T01:41:21.332 INFO:tasks.workunit.client.1.smithi167.stdout:2/279: link d5/d10/d16/c25 d5/d3c/c63 0 2024-09-17T01:41:21.335 INFO:tasks.workunit.client.0.smithi082.stdout:2/71: rename d1/c8 to d1/d10/c13 0 2024-09-17T01:41:21.335 INFO:tasks.workunit.client.0.smithi082.stdout:2/72: chown d1/fe 0 1 2024-09-17T01:41:21.339 INFO:tasks.workunit.client.0.smithi082.stdout:3/48: creat d9/db/f13 x:0 0 0 2024-09-17T01:41:21.340 INFO:tasks.workunit.client.0.smithi082.stdout:3/49: truncate d9/ff 666300 0 2024-09-17T01:41:21.342 INFO:tasks.workunit.client.0.smithi082.stdout:6/51: creat d1/d7/d10/f11 x:0 0 0 2024-09-17T01:41:21.342 INFO:tasks.workunit.client.0.smithi082.stdout:2/73: chown d1/c2 1694148 1 2024-09-17T01:41:21.343 INFO:tasks.workunit.client.0.smithi082.stdout:3/50: mknod d9/c14 0 2024-09-17T01:41:21.346 INFO:tasks.workunit.client.1.smithi167.stdout:5/166: link d0/d24/c26 d0/d9/c2f 0 2024-09-17T01:41:21.347 INFO:tasks.workunit.client.1.smithi167.stdout:9/250: dwrite d4/d9/d21/f27 [0,4194304] 0 2024-09-17T01:41:21.347 INFO:tasks.workunit.client.1.smithi167.stdout:9/251: readlink d4/d9/ld 0 2024-09-17T01:41:21.348 INFO:tasks.workunit.client.0.smithi082.stdout:6/52: creat d1/d7/d8/f12 x:0 0 0 2024-09-17T01:41:21.349 INFO:tasks.workunit.client.0.smithi082.stdout:6/53: readlink d1/l2 0 2024-09-17T01:41:21.352 INFO:tasks.workunit.client.0.smithi082.stdout:2/74: dwrite d1/d10/f12 [0,4194304] 0 2024-09-17T01:41:21.354 INFO:tasks.workunit.client.1.smithi167.stdout:0/193: creat d5/d8/d9/d19/f3d x:0 0 0 2024-09-17T01:41:21.356 INFO:tasks.workunit.client.0.smithi082.stdout:9/48: sync 2024-09-17T01:41:21.357 INFO:tasks.workunit.client.1.smithi167.stdout:2/280: creat d5/d10/d1a/d2e/d49/f64 x:0 0 0 2024-09-17T01:41:21.357 INFO:tasks.workunit.client.0.smithi082.stdout:9/49: rename d4/da to d4/da/d11/d13 22 2024-09-17T01:41:21.358 INFO:tasks.workunit.client.0.smithi082.stdout:2/75: unlink d1/fb 0 2024-09-17T01:41:21.358 INFO:tasks.workunit.client.1.smithi167.stdout:2/281: truncate d5/d10/d1a/d45/f17 231539 0 2024-09-17T01:41:21.359 INFO:tasks.workunit.client.0.smithi082.stdout:2/76: truncate d1/fd 941284 0 2024-09-17T01:41:21.359 INFO:tasks.workunit.client.0.smithi082.stdout:2/77: readlink - no filename 2024-09-17T01:41:21.360 INFO:tasks.workunit.client.1.smithi167.stdout:1/224: link d0/d5/d34/l21 d0/d5/d34/l43 0 2024-09-17T01:41:21.361 INFO:tasks.workunit.client.1.smithi167.stdout:1/225: dread - d0/d5/d34/d3c/f41 zero size 2024-09-17T01:41:21.367 INFO:tasks.workunit.client.0.smithi082.stdout:6/54: link d1/l2 d1/d3/l13 0 2024-09-17T01:41:21.367 INFO:tasks.workunit.client.1.smithi167.stdout:4/285: getdents d0/d4/d7/d6/d5d 0 2024-09-17T01:41:21.368 INFO:tasks.workunit.client.0.smithi082.stdout:9/50: dwrite d4/da/fb [0,4194304] 0 2024-09-17T01:41:21.368 INFO:tasks.workunit.client.0.smithi082.stdout:2/78: fdatasync d1/d10/f12 0 2024-09-17T01:41:21.370 INFO:tasks.workunit.client.1.smithi167.stdout:7/242: link d0/f3f d0/d2/d14/d19/d22/d40/f4a 0 2024-09-17T01:41:21.371 INFO:tasks.workunit.client.0.smithi082.stdout:6/55: dread - d1/d7/d10/f11 zero size 2024-09-17T01:41:21.371 INFO:tasks.workunit.client.0.smithi082.stdout:9/51: read - d4/f8 zero size 2024-09-17T01:41:21.373 INFO:tasks.workunit.client.0.smithi082.stdout:8/77: dwrite d3/dd/f11 [4194304,4194304] 0 2024-09-17T01:41:21.375 INFO:tasks.workunit.client.1.smithi167.stdout:2/282: creat d5/d10/d16/f65 x:0 0 0 2024-09-17T01:41:21.376 INFO:tasks.workunit.client.0.smithi082.stdout:2/79: creat d1/d10/f14 x:0 0 0 2024-09-17T01:41:21.376 INFO:tasks.workunit.client.1.smithi167.stdout:9/252: dread d4/f38 [0,4194304] 0 2024-09-17T01:41:21.376 INFO:tasks.workunit.client.1.smithi167.stdout:2/283: stat d5/d10/d1a/d46/f4f 0 2024-09-17T01:41:21.376 INFO:tasks.workunit.client.1.smithi167.stdout:2/284: fsync d5/f2f 0 2024-09-17T01:41:21.377 INFO:tasks.workunit.client.1.smithi167.stdout:9/253: chown d4/d9/f28 0 1 2024-09-17T01:41:21.377 INFO:tasks.workunit.client.0.smithi082.stdout:2/80: dread - d1/d10/f14 zero size 2024-09-17T01:41:21.379 INFO:tasks.workunit.client.1.smithi167.stdout:6/309: rename d7/d12/d27/d3a/d56/l6e to d7/d11/l74 0 2024-09-17T01:41:21.380 INFO:tasks.workunit.client.0.smithi082.stdout:6/56: symlink d1/d7/l14 0 2024-09-17T01:41:21.381 INFO:tasks.workunit.client.1.smithi167.stdout:3/229: truncate d7/d8/d10/f13 1003444 0 2024-09-17T01:41:21.382 INFO:tasks.workunit.client.1.smithi167.stdout:1/226: chown d0/d9/l2a 107 1 2024-09-17T01:41:21.383 INFO:tasks.workunit.client.0.smithi082.stdout:9/52: symlink d4/da/d11/l14 0 2024-09-17T01:41:21.383 INFO:tasks.workunit.client.0.smithi082.stdout:9/53: chown d4/da 967099381 1 2024-09-17T01:41:21.384 INFO:tasks.workunit.client.1.smithi167.stdout:4/286: creat d0/d4/d7/d6/f66 x:0 0 0 2024-09-17T01:41:21.386 INFO:tasks.workunit.client.1.smithi167.stdout:4/287: fdatasync d0/f13 0 2024-09-17T01:41:21.386 INFO:tasks.workunit.client.1.smithi167.stdout:6/310: dwrite d7/d11/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:21.387 INFO:tasks.workunit.client.0.smithi082.stdout:2/81: unlink d1/f5 0 2024-09-17T01:41:21.389 INFO:tasks.workunit.client.0.smithi082.stdout:6/57: symlink d1/d7/d8/dc/l15 0 2024-09-17T01:41:21.390 INFO:tasks.workunit.client.0.smithi082.stdout:6/58: write f0 [4727153,59445] 0 2024-09-17T01:41:21.390 INFO:tasks.workunit.client.1.smithi167.stdout:1/227: dwrite d0/f17 [0,4194304] 0 2024-09-17T01:41:21.391 INFO:tasks.workunit.client.1.smithi167.stdout:9/254: mkdir d4/d4a 0 2024-09-17T01:41:21.392 INFO:tasks.workunit.client.0.smithi082.stdout:6/59: truncate d1/d7/d8/f12 331703 0 2024-09-17T01:41:21.393 INFO:tasks.workunit.client.1.smithi167.stdout:1/228: truncate d0/d9/fb 4388737 0 2024-09-17T01:41:21.393 INFO:tasks.workunit.client.0.smithi082.stdout:9/54: mknod d4/c15 0 2024-09-17T01:41:21.394 INFO:tasks.workunit.client.1.smithi167.stdout:1/229: write d0/d9/fb [3877804,77046] 0 2024-09-17T01:41:21.396 INFO:tasks.workunit.client.1.smithi167.stdout:2/285: mknod d5/d3c/d4c/d4d/c66 0 2024-09-17T01:41:21.401 INFO:tasks.workunit.client.1.smithi167.stdout:8/374: rename dc/l7b to dc/d56/d57/l84 0 2024-09-17T01:41:21.402 INFO:tasks.workunit.client.1.smithi167.stdout:9/255: dwrite d4/d9/d21/d2d/d33/d3a/f40 [0,4194304] 0 2024-09-17T01:41:21.405 INFO:tasks.workunit.client.1.smithi167.stdout:3/230: creat d7/f41 x:0 0 0 2024-09-17T01:41:21.406 INFO:tasks.workunit.client.1.smithi167.stdout:0/194: truncate d5/f1d 990008 0 2024-09-17T01:41:21.410 INFO:tasks.workunit.client.1.smithi167.stdout:4/288: dread d0/d4/d7/d6/f60 [4194304,4194304] 0 2024-09-17T01:41:21.411 INFO:tasks.workunit.client.0.smithi082.stdout:6/60: creat d1/d7/d10/f16 x:0 0 0 2024-09-17T01:41:21.414 INFO:tasks.workunit.client.0.smithi082.stdout:9/55: unlink d4/da/d11/l14 0 2024-09-17T01:41:21.414 INFO:tasks.workunit.client.1.smithi167.stdout:3/231: dwrite d7/f41 [0,4194304] 0 2024-09-17T01:41:21.415 INFO:tasks.workunit.client.1.smithi167.stdout:3/232: stat d7/f41 0 2024-09-17T01:41:21.415 INFO:tasks.workunit.client.0.smithi082.stdout:8/78: creat d3/f16 x:0 0 0 2024-09-17T01:41:21.416 INFO:tasks.workunit.client.0.smithi082.stdout:8/79: dread - d3/dd/f15 zero size 2024-09-17T01:41:21.418 INFO:tasks.workunit.client.0.smithi082.stdout:6/61: unlink f0 0 2024-09-17T01:41:21.421 INFO:tasks.workunit.client.0.smithi082.stdout:9/56: creat d4/da/f16 x:0 0 0 2024-09-17T01:41:21.426 INFO:tasks.workunit.client.0.smithi082.stdout:8/80: symlink d3/dd/l17 0 2024-09-17T01:41:21.426 INFO:tasks.workunit.client.1.smithi167.stdout:2/286: dread d5/d1f/f26 [0,4194304] 0 2024-09-17T01:41:21.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/57: creat d4/f17 x:0 0 0 2024-09-17T01:41:21.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/58: fdatasync d4/da/f16 0 2024-09-17T01:41:21.429 INFO:tasks.workunit.client.0.smithi082.stdout:9/59: readlink l3 0 2024-09-17T01:41:21.429 INFO:tasks.workunit.client.0.smithi082.stdout:9/60: truncate d4/f8 963263 0 2024-09-17T01:41:21.430 INFO:tasks.workunit.client.0.smithi082.stdout:2/82: getdents d1 0 2024-09-17T01:41:21.431 INFO:tasks.workunit.client.0.smithi082.stdout:9/61: write d4/fd [325590,49053] 0 2024-09-17T01:41:21.434 INFO:tasks.workunit.client.1.smithi167.stdout:8/375: mkdir dc/d56/d59/d82/d85 0 2024-09-17T01:41:21.436 INFO:tasks.workunit.client.1.smithi167.stdout:8/376: write dc/d56/f5e [1226833,47511] 0 2024-09-17T01:41:21.436 INFO:tasks.workunit.client.0.smithi082.stdout:2/83: rename d1/c7 to d1/c15 0 2024-09-17T01:41:21.436 INFO:tasks.workunit.client.1.smithi167.stdout:0/195: getdents d5/d8/d2e/d37 0 2024-09-17T01:41:21.438 INFO:tasks.workunit.client.0.smithi082.stdout:9/62: creat d4/da/f18 x:0 0 0 2024-09-17T01:41:21.441 INFO:tasks.workunit.client.1.smithi167.stdout:1/230: link d0/d9/c39 d0/d9/d16/c44 0 2024-09-17T01:41:21.443 INFO:tasks.workunit.client.0.smithi082.stdout:2/84: dwrite d1/fe [0,4194304] 0 2024-09-17T01:41:21.444 INFO:tasks.workunit.client.1.smithi167.stdout:6/311: rename d7/d12/d27/d3a/f5a to d7/d11/d13/f75 0 2024-09-17T01:41:21.445 INFO:tasks.workunit.client.1.smithi167.stdout:6/312: chown d7/d11/d13/d2f/f4d 538 1 2024-09-17T01:41:21.446 INFO:tasks.workunit.client.1.smithi167.stdout:6/313: chown d7/d12/l22 12720 1 2024-09-17T01:41:21.448 INFO:tasks.workunit.client.1.smithi167.stdout:8/377: creat dc/d1a/f86 x:0 0 0 2024-09-17T01:41:21.448 INFO:tasks.workunit.client.1.smithi167.stdout:3/233: dwrite d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:21.449 INFO:tasks.workunit.client.1.smithi167.stdout:8/378: chown dc/d21/f44 778 1 2024-09-17T01:41:21.453 INFO:tasks.workunit.client.1.smithi167.stdout:4/289: creat d0/d4/d7/f67 x:0 0 0 2024-09-17T01:41:21.453 INFO:tasks.workunit.client.0.smithi082.stdout:6/62: dwrite d1/d7/d8/fb [0,4194304] 0 2024-09-17T01:41:21.456 INFO:tasks.workunit.client.0.smithi082.stdout:9/63: write d4/da/fb [4398200,104293] 0 2024-09-17T01:41:21.457 INFO:tasks.workunit.client.0.smithi082.stdout:6/63: chown d1/d7/d8/dc/ce 1485252 1 2024-09-17T01:41:21.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/81: dwrite d3/fb [0,4194304] 0 2024-09-17T01:41:21.462 INFO:tasks.workunit.client.1.smithi167.stdout:6/314: creat d7/d11/d34/f76 x:0 0 0 2024-09-17T01:41:21.463 INFO:tasks.workunit.client.0.smithi082.stdout:9/64: mknod d4/da/d11/c19 0 2024-09-17T01:41:21.463 INFO:tasks.workunit.client.1.smithi167.stdout:6/315: fdatasync d7/d11/d13/f17 0 2024-09-17T01:41:21.464 INFO:tasks.workunit.client.0.smithi082.stdout:6/64: symlink d1/d7/l17 0 2024-09-17T01:41:21.469 INFO:tasks.workunit.client.0.smithi082.stdout:8/82: mkdir d3/dd/d18 0 2024-09-17T01:41:21.471 INFO:tasks.workunit.client.0.smithi082.stdout:6/65: mknod d1/d7/c18 0 2024-09-17T01:41:21.472 INFO:tasks.workunit.client.0.smithi082.stdout:9/65: dwrite d4/da/fb [0,4194304] 0 2024-09-17T01:41:21.475 INFO:tasks.workunit.client.0.smithi082.stdout:8/83: symlink d3/dd/d18/l19 0 2024-09-17T01:41:21.476 INFO:tasks.workunit.client.0.smithi082.stdout:6/66: creat d1/f19 x:0 0 0 2024-09-17T01:41:21.476 INFO:tasks.workunit.client.0.smithi082.stdout:2/85: dwrite d1/f9 [0,4194304] 0 2024-09-17T01:41:21.476 INFO:tasks.workunit.client.1.smithi167.stdout:7/243: sync 2024-09-17T01:41:21.476 INFO:tasks.workunit.client.1.smithi167.stdout:5/167: sync 2024-09-17T01:41:21.477 INFO:tasks.workunit.client.0.smithi082.stdout:9/66: creat d4/f1a x:0 0 0 2024-09-17T01:41:21.478 INFO:tasks.workunit.client.0.smithi082.stdout:6/67: write d1/d7/d10/f11 [106939,45021] 0 2024-09-17T01:41:21.478 INFO:tasks.workunit.client.1.smithi167.stdout:6/316: truncate d7/f21 2035896 0 2024-09-17T01:41:21.478 INFO:tasks.workunit.client.1.smithi167.stdout:3/234: dread d7/d8/d10/f13 [0,4194304] 0 2024-09-17T01:41:21.479 INFO:tasks.workunit.client.0.smithi082.stdout:2/86: creat d1/f16 x:0 0 0 2024-09-17T01:41:21.481 INFO:tasks.workunit.client.1.smithi167.stdout:8/379: dwrite dc/d1a/f49 [0,4194304] 0 2024-09-17T01:41:21.481 INFO:tasks.workunit.client.0.smithi082.stdout:2/87: stat d1/c2 0 2024-09-17T01:41:21.482 INFO:tasks.workunit.client.1.smithi167.stdout:4/290: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:21.482 INFO:tasks.workunit.client.1.smithi167.stdout:1/231: dwrite d0/d9/f31 [0,4194304] 0 2024-09-17T01:41:21.486 INFO:tasks.workunit.client.0.smithi082.stdout:2/88: mkdir d1/d17 0 2024-09-17T01:41:21.487 INFO:tasks.workunit.client.0.smithi082.stdout:6/68: dwrite d1/d7/d10/f16 [0,4194304] 0 2024-09-17T01:41:21.488 INFO:tasks.workunit.client.1.smithi167.stdout:6/317: read - d7/d11/d34/f76 zero size 2024-09-17T01:41:21.488 INFO:tasks.workunit.client.0.smithi082.stdout:2/89: write d1/f9 [2278296,62861] 0 2024-09-17T01:41:21.488 INFO:tasks.workunit.client.1.smithi167.stdout:8/380: chown dc/d21/f44 364899104 1 2024-09-17T01:41:21.489 INFO:tasks.workunit.client.0.smithi082.stdout:2/90: fdatasync d1/d10/f14 0 2024-09-17T01:41:21.492 INFO:tasks.workunit.client.0.smithi082.stdout:6/69: creat d1/d7/d10/f1a x:0 0 0 2024-09-17T01:41:21.495 INFO:tasks.workunit.client.1.smithi167.stdout:3/235: creat d7/d8/d10/f42 x:0 0 0 2024-09-17T01:41:21.497 INFO:tasks.workunit.client.1.smithi167.stdout:5/168: dread d0/f14 [0,4194304] 0 2024-09-17T01:41:21.499 INFO:tasks.workunit.client.0.smithi082.stdout:6/70: rename d1/f19 to d1/d3/f1b 0 2024-09-17T01:41:21.499 INFO:tasks.workunit.client.1.smithi167.stdout:1/232: dwrite d0/d5/d34/d3c/f42 [0,4194304] 0 2024-09-17T01:41:21.500 INFO:tasks.workunit.client.0.smithi082.stdout:6/71: chown d1/d3/l5 556160 1 2024-09-17T01:41:21.503 INFO:tasks.workunit.client.1.smithi167.stdout:8/381: rename dc/d18/l7f to dc/d1a/l87 0 2024-09-17T01:41:21.504 INFO:tasks.workunit.client.1.smithi167.stdout:0/196: write d5/f1d [941487,130791] 0 2024-09-17T01:41:21.504 INFO:tasks.workunit.client.0.smithi082.stdout:2/91: creat d1/d17/f18 x:0 0 0 2024-09-17T01:41:21.507 INFO:tasks.workunit.client.1.smithi167.stdout:3/236: creat d7/d1e/f43 x:0 0 0 2024-09-17T01:41:21.509 INFO:tasks.workunit.client.0.smithi082.stdout:6/72: creat d1/d7/d8/f1c x:0 0 0 2024-09-17T01:41:21.511 INFO:tasks.workunit.client.0.smithi082.stdout:2/92: creat d1/d10/f19 x:0 0 0 2024-09-17T01:41:21.512 INFO:tasks.workunit.client.1.smithi167.stdout:6/318: mknod d7/d11/d13/d60/c77 0 2024-09-17T01:41:21.514 INFO:tasks.workunit.client.0.smithi082.stdout:6/73: dread d1/d7/d8/fb [0,4194304] 0 2024-09-17T01:41:21.514 INFO:tasks.workunit.client.0.smithi082.stdout:6/74: readlink d1/d3/l5 0 2024-09-17T01:41:21.516 INFO:tasks.workunit.client.0.smithi082.stdout:2/93: mkdir d1/d1a 0 2024-09-17T01:41:21.517 INFO:tasks.workunit.client.1.smithi167.stdout:1/233: mknod d0/d5/d34/d3c/c45 0 2024-09-17T01:41:21.518 INFO:tasks.workunit.client.0.smithi082.stdout:9/67: truncate d4/da/fb 1293756 0 2024-09-17T01:41:21.519 INFO:tasks.workunit.client.1.smithi167.stdout:8/382: write dc/f15 [232634,34311] 0 2024-09-17T01:41:21.520 INFO:tasks.workunit.client.0.smithi082.stdout:6/75: write d1/d3/f1b [773196,3480] 0 2024-09-17T01:41:21.521 INFO:tasks.workunit.client.1.smithi167.stdout:0/197: rename d5/d8/l34 to d5/d8/d2e/d37/l3e 0 2024-09-17T01:41:21.523 INFO:tasks.workunit.client.0.smithi082.stdout:2/94: creat d1/f1b x:0 0 0 2024-09-17T01:41:21.524 INFO:tasks.workunit.client.0.smithi082.stdout:6/76: dread d1/d7/d8/fb [0,4194304] 0 2024-09-17T01:41:21.525 INFO:tasks.workunit.client.1.smithi167.stdout:3/237: unlink d7/d8/d10/d14/f26 0 2024-09-17T01:41:21.526 INFO:tasks.workunit.client.0.smithi082.stdout:6/77: dread d1/d7/d10/f11 [0,4194304] 0 2024-09-17T01:41:21.529 INFO:tasks.workunit.client.0.smithi082.stdout:6/78: mkdir d1/d7/d8/dc/d1d 0 2024-09-17T01:41:21.530 INFO:tasks.workunit.client.1.smithi167.stdout:7/244: dwrite d0/d2/f21 [0,4194304] 0 2024-09-17T01:41:21.533 INFO:tasks.workunit.client.1.smithi167.stdout:8/383: creat dc/d21/d61/f88 x:0 0 0 2024-09-17T01:41:21.535 INFO:tasks.workunit.client.0.smithi082.stdout:6/79: write d1/d7/d10/f11 [501052,59390] 0 2024-09-17T01:41:21.539 INFO:tasks.workunit.client.1.smithi167.stdout:3/238: unlink d7/l39 0 2024-09-17T01:41:21.540 INFO:tasks.workunit.client.1.smithi167.stdout:3/239: dread d7/d8/d10/f13 [0,4194304] 0 2024-09-17T01:41:21.541 INFO:tasks.workunit.client.0.smithi082.stdout:9/68: read d4/da/fb [953817,98552] 0 2024-09-17T01:41:21.541 INFO:tasks.workunit.client.0.smithi082.stdout:9/69: dread - d4/f17 zero size 2024-09-17T01:41:21.544 INFO:tasks.workunit.client.1.smithi167.stdout:6/319: mknod d7/c78 0 2024-09-17T01:41:21.544 INFO:tasks.workunit.client.1.smithi167.stdout:6/320: write d7/d12/f23 [1237676,34893] 0 2024-09-17T01:41:21.546 INFO:tasks.workunit.client.1.smithi167.stdout:6/321: write d7/d42/f71 [156013,10952] 0 2024-09-17T01:41:21.546 INFO:tasks.workunit.client.1.smithi167.stdout:6/322: stat d7/d54 0 2024-09-17T01:41:21.546 INFO:tasks.workunit.client.0.smithi082.stdout:9/70: rename d4/fd to d4/da/f1b 0 2024-09-17T01:41:21.547 INFO:tasks.workunit.client.0.smithi082.stdout:9/71: truncate d4/f1a 684758 0 2024-09-17T01:41:21.549 INFO:tasks.workunit.client.1.smithi167.stdout:8/384: creat dc/d56/d57/d5c/f89 x:0 0 0 2024-09-17T01:41:21.550 INFO:tasks.workunit.client.0.smithi082.stdout:9/72: creat d4/da/f1c x:0 0 0 2024-09-17T01:41:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:9/73: stat d4/da/f1b 0 2024-09-17T01:41:21.551 INFO:tasks.workunit.client.0.smithi082.stdout:9/74: fdatasync d4/da/f16 0 2024-09-17T01:41:21.553 INFO:tasks.workunit.client.1.smithi167.stdout:3/240: dread d7/d1e/f3a [0,4194304] 0 2024-09-17T01:41:21.553 INFO:tasks.workunit.client.0.smithi082.stdout:9/75: rmdir d4 39 2024-09-17T01:41:21.554 INFO:tasks.workunit.client.0.smithi082.stdout:6/80: truncate d1/d7/d10/f11 115872 0 2024-09-17T01:41:21.554 INFO:tasks.workunit.client.1.smithi167.stdout:3/241: dread - d7/d1e/f43 zero size 2024-09-17T01:41:21.555 INFO:tasks.workunit.client.1.smithi167.stdout:6/323: mkdir d7/d52/d79 0 2024-09-17T01:41:21.557 INFO:tasks.workunit.client.0.smithi082.stdout:9/76: stat d4/da/f1b 0 2024-09-17T01:41:21.557 INFO:tasks.workunit.client.1.smithi167.stdout:7/245: mknod d0/c4b 0 2024-09-17T01:41:21.559 INFO:tasks.workunit.client.0.smithi082.stdout:6/81: symlink d1/d7/d8/dc/l1e 0 2024-09-17T01:41:21.559 INFO:tasks.workunit.client.0.smithi082.stdout:6/82: fdatasync d1/d3/f1b 0 2024-09-17T01:41:21.560 INFO:tasks.workunit.client.0.smithi082.stdout:6/83: chown d1/d7/d8/fb 1190 1 2024-09-17T01:41:21.560 INFO:tasks.workunit.client.1.smithi167.stdout:0/198: creat d5/d8/d9/f3f x:0 0 0 2024-09-17T01:41:21.563 INFO:tasks.workunit.client.1.smithi167.stdout:8/385: creat dc/d56/d57/f8a x:0 0 0 2024-09-17T01:41:21.564 INFO:tasks.workunit.client.1.smithi167.stdout:5/169: link d0/d9/c2f d0/d24/c30 0 2024-09-17T01:41:21.565 INFO:tasks.workunit.client.0.smithi082.stdout:6/84: mkdir d1/d1f 0 2024-09-17T01:41:21.565 INFO:tasks.workunit.client.0.smithi082.stdout:6/85: chown d1/d7 202 1 2024-09-17T01:41:21.566 INFO:tasks.workunit.client.1.smithi167.stdout:1/234: getdents d0/d5 0 2024-09-17T01:41:21.566 INFO:tasks.workunit.client.1.smithi167.stdout:9/256: sync 2024-09-17T01:41:21.568 INFO:tasks.workunit.client.0.smithi082.stdout:9/77: rename d4/da/f1c to d4/f1d 0 2024-09-17T01:41:21.569 INFO:tasks.workunit.client.1.smithi167.stdout:1/235: dread d0/d9/f31 [0,4194304] 0 2024-09-17T01:41:21.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/242: rename d7/d8/d10/d29/f3b to d7/d8/d1f/f44 0 2024-09-17T01:41:21.570 INFO:tasks.workunit.client.1.smithi167.stdout:9/257: dread d4/d9/f28 [0,4194304] 0 2024-09-17T01:41:21.570 INFO:tasks.workunit.client.0.smithi082.stdout:9/78: dread d4/da/f1b [0,4194304] 0 2024-09-17T01:41:21.571 INFO:tasks.workunit.client.0.smithi082.stdout:6/86: rmdir d1/d7/d8/dc 39 2024-09-17T01:41:21.571 INFO:tasks.workunit.client.1.smithi167.stdout:9/258: chown d4/f38 6 1 2024-09-17T01:41:21.571 INFO:tasks.workunit.client.1.smithi167.stdout:9/259: chown d4/d9 15 1 2024-09-17T01:41:21.573 INFO:tasks.workunit.client.1.smithi167.stdout:0/199: creat d5/d8/d9/d19/f40 x:0 0 0 2024-09-17T01:41:21.574 INFO:tasks.workunit.client.1.smithi167.stdout:1/236: dread d0/f17 [0,4194304] 0 2024-09-17T01:41:21.574 INFO:tasks.workunit.client.0.smithi082.stdout:9/79: mknod d4/c1e 0 2024-09-17T01:41:21.575 INFO:tasks.workunit.client.1.smithi167.stdout:1/237: write d0/d5/d34/f14 [2304289,121380] 0 2024-09-17T01:41:21.575 INFO:tasks.workunit.client.0.smithi082.stdout:9/80: dread - d4/da/f16 zero size 2024-09-17T01:41:21.578 INFO:tasks.workunit.client.1.smithi167.stdout:3/243: mknod d7/d8/d10/d14/c45 0 2024-09-17T01:41:21.579 INFO:tasks.workunit.client.0.smithi082.stdout:6/87: creat d1/d7/d8/f20 x:0 0 0 2024-09-17T01:41:21.580 INFO:tasks.workunit.client.0.smithi082.stdout:6/88: read - d1/d7/d8/f20 zero size 2024-09-17T01:41:21.580 INFO:tasks.workunit.client.1.smithi167.stdout:7/246: mkdir d0/d2/d14/d4c 0 2024-09-17T01:41:21.581 INFO:tasks.workunit.client.1.smithi167.stdout:1/238: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:21.582 INFO:tasks.workunit.client.1.smithi167.stdout:1/239: dread - d0/d9/d16/d36/f3e zero size 2024-09-17T01:41:21.582 INFO:tasks.workunit.client.1.smithi167.stdout:4/291: sync 2024-09-17T01:41:21.582 INFO:tasks.workunit.client.1.smithi167.stdout:2/287: sync 2024-09-17T01:41:21.583 INFO:tasks.workunit.client.1.smithi167.stdout:2/288: stat d5/d10/d1a/d2e/l55 0 2024-09-17T01:41:21.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/260: chown d4/l6 571 1 2024-09-17T01:41:21.584 INFO:tasks.workunit.client.1.smithi167.stdout:8/386: mknod dc/c8b 0 2024-09-17T01:41:21.585 INFO:tasks.workunit.client.0.smithi082.stdout:6/89: creat d1/d1f/f21 x:0 0 0 2024-09-17T01:41:21.586 INFO:tasks.workunit.client.0.smithi082.stdout:6/90: write d1/d3/f1b [1030114,37365] 0 2024-09-17T01:41:21.587 INFO:tasks.workunit.client.1.smithi167.stdout:5/170: symlink d0/d9/d1c/l31 0 2024-09-17T01:41:21.588 INFO:tasks.workunit.client.1.smithi167.stdout:0/200: symlink d5/d8/d9/d19/l41 0 2024-09-17T01:41:21.590 INFO:tasks.workunit.client.1.smithi167.stdout:2/289: dwrite d5/d10/d1a/d2e/f3b [4194304,4194304] 0 2024-09-17T01:41:21.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/91: dwrite d1/d7/d8/fb [4194304,4194304] 0 2024-09-17T01:41:21.595 INFO:tasks.workunit.client.1.smithi167.stdout:3/244: mkdir d7/d8/d10/d14/d24/d46 0 2024-09-17T01:41:21.596 INFO:tasks.workunit.client.1.smithi167.stdout:7/247: creat d0/d2/d14/d19/d32/f4d x:0 0 0 2024-09-17T01:41:21.597 INFO:tasks.workunit.client.1.smithi167.stdout:1/240: read d0/d9/f31 [2931346,15655] 0 2024-09-17T01:41:21.598 INFO:tasks.workunit.client.1.smithi167.stdout:7/248: read - d0/d2/d14/d19/f2f zero size 2024-09-17T01:41:21.599 INFO:tasks.workunit.client.1.smithi167.stdout:6/324: truncate f0 9066 0 2024-09-17T01:41:21.599 INFO:tasks.workunit.client.1.smithi167.stdout:1/241: chown d0/d5/d34/d3c/c45 24462 1 2024-09-17T01:41:21.599 INFO:tasks.workunit.client.1.smithi167.stdout:7/249: readlink d0/d2/d14/d19/d32/l42 0 2024-09-17T01:41:21.600 INFO:tasks.workunit.client.1.smithi167.stdout:4/292: creat d0/d4/d7/d6/d5d/f68 x:0 0 0 2024-09-17T01:41:21.602 INFO:tasks.workunit.client.0.smithi082.stdout:6/92: symlink d1/d7/d10/l22 0 2024-09-17T01:41:21.604 INFO:tasks.workunit.client.0.smithi082.stdout:6/93: truncate d1/d7/d8/f20 338538 0 2024-09-17T01:41:21.607 INFO:tasks.workunit.client.1.smithi167.stdout:0/201: mknod d5/d8/d9/d19/c42 0 2024-09-17T01:41:21.609 INFO:tasks.workunit.client.1.smithi167.stdout:1/242: write d0/d9/f31 [313197,13232] 0 2024-09-17T01:41:21.609 INFO:tasks.workunit.client.1.smithi167.stdout:0/202: readlink d5/d8/l14 0 2024-09-17T01:41:21.609 INFO:tasks.workunit.client.0.smithi082.stdout:6/94: dwrite d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:21.612 INFO:tasks.workunit.client.0.smithi082.stdout:9/81: truncate d4/da/fb 786069 0 2024-09-17T01:41:21.613 INFO:tasks.workunit.client.1.smithi167.stdout:8/387: write dc/d18/f2e [91843,120111] 0 2024-09-17T01:41:21.613 INFO:tasks.workunit.client.0.smithi082.stdout:6/95: mkdir d1/d7/d23 0 2024-09-17T01:41:21.615 INFO:tasks.workunit.client.1.smithi167.stdout:3/245: symlink d7/d8/l47 0 2024-09-17T01:41:21.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/203: mknod d5/d8/c43 0 2024-09-17T01:41:21.617 INFO:tasks.workunit.client.0.smithi082.stdout:6/96: creat d1/d7/f24 x:0 0 0 2024-09-17T01:41:21.618 INFO:tasks.workunit.client.0.smithi082.stdout:6/97: chown d1/d7/f24 110418 1 2024-09-17T01:41:21.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/82: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:41:21.619 INFO:tasks.workunit.client.0.smithi082.stdout:6/98: chown d1/d7/d10 0 1 2024-09-17T01:41:21.620 INFO:tasks.workunit.client.0.smithi082.stdout:6/99: stat d1/d7/f24 0 2024-09-17T01:41:21.621 INFO:tasks.workunit.client.0.smithi082.stdout:6/100: write d1/d7/d10/f16 [350976,67632] 0 2024-09-17T01:41:21.624 INFO:tasks.workunit.client.1.smithi167.stdout:4/293: mkdir d0/d4/d69 0 2024-09-17T01:41:21.628 INFO:tasks.workunit.client.0.smithi082.stdout:6/101: symlink d1/d1f/l25 0 2024-09-17T01:41:21.629 INFO:tasks.workunit.client.1.smithi167.stdout:5/171: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:21.630 INFO:tasks.workunit.client.1.smithi167.stdout:0/204: creat d5/d8/f44 x:0 0 0 2024-09-17T01:41:21.631 INFO:tasks.workunit.client.1.smithi167.stdout:0/205: chown d5/d8/f20 0 1 2024-09-17T01:41:21.631 INFO:tasks.workunit.client.1.smithi167.stdout:0/206: chown d5/d8/c2a 0 1 2024-09-17T01:41:21.633 INFO:tasks.workunit.client.1.smithi167.stdout:3/246: rename d7/d1e/f3a to d7/d8/d10/d14/d25/f48 0 2024-09-17T01:41:21.634 INFO:tasks.workunit.client.1.smithi167.stdout:1/243: getdents d0/d9/d16/d22 0 2024-09-17T01:41:21.636 INFO:tasks.workunit.client.0.smithi082.stdout:6/102: dwrite d1/d7/d8/f12 [0,4194304] 0 2024-09-17T01:41:21.637 INFO:tasks.workunit.client.1.smithi167.stdout:9/261: getdents d4/d9/d21/d2d/d33/d3a 0 2024-09-17T01:41:21.637 INFO:tasks.workunit.client.1.smithi167.stdout:9/262: fsync d4/f18 0 2024-09-17T01:41:21.638 INFO:tasks.workunit.client.1.smithi167.stdout:5/172: write d0/d9/fb [1428984,24747] 0 2024-09-17T01:41:21.638 INFO:tasks.workunit.client.1.smithi167.stdout:0/207: mkdir d5/d8/d2e/d37/d45 0 2024-09-17T01:41:21.639 INFO:tasks.workunit.client.1.smithi167.stdout:9/263: chown d4/d9/d21/d43/f45 225495388 1 2024-09-17T01:41:21.639 INFO:tasks.workunit.client.1.smithi167.stdout:3/247: symlink d7/d8/d10/d14/d25/l49 0 2024-09-17T01:41:21.640 INFO:tasks.workunit.client.1.smithi167.stdout:5/173: chown d0/f1d 17306630 1 2024-09-17T01:41:21.641 INFO:tasks.workunit.client.0.smithi082.stdout:6/103: rename d1/d7/d8/f1c to d1/d1f/f26 0 2024-09-17T01:41:21.641 INFO:tasks.workunit.client.1.smithi167.stdout:9/264: fsync d4/f16 0 2024-09-17T01:41:21.643 INFO:tasks.workunit.client.1.smithi167.stdout:0/208: creat d5/d8/f46 x:0 0 0 2024-09-17T01:41:21.644 INFO:tasks.workunit.client.0.smithi082.stdout:6/104: symlink d1/d3/l27 0 2024-09-17T01:41:21.644 INFO:tasks.workunit.client.1.smithi167.stdout:5/174: write d0/d28/f2a [335598,100949] 0 2024-09-17T01:41:21.644 INFO:tasks.workunit.client.1.smithi167.stdout:1/244: getdents d0/d9/d16/d22 0 2024-09-17T01:41:21.644 INFO:tasks.workunit.client.0.smithi082.stdout:6/105: readlink d1/la 0 2024-09-17T01:41:21.645 INFO:tasks.workunit.client.1.smithi167.stdout:3/248: truncate d7/d8/d10/f40 581424 0 2024-09-17T01:41:21.645 INFO:tasks.workunit.client.0.smithi082.stdout:6/106: symlink d1/l28 0 2024-09-17T01:41:21.645 INFO:tasks.workunit.client.1.smithi167.stdout:6/325: dwrite d7/d11/d13/d2f/d30/d32/f58 [0,4194304] 0 2024-09-17T01:41:21.646 INFO:tasks.workunit.client.0.smithi082.stdout:6/107: read - d1/d1f/f26 zero size 2024-09-17T01:41:21.649 INFO:tasks.workunit.client.1.smithi167.stdout:9/265: dread f1 [0,4194304] 0 2024-09-17T01:41:21.649 INFO:tasks.workunit.client.1.smithi167.stdout:6/326: chown d7/d11/l74 0 1 2024-09-17T01:41:21.649 INFO:tasks.workunit.client.1.smithi167.stdout:3/249: fsync f3 0 2024-09-17T01:41:21.652 INFO:tasks.workunit.client.0.smithi082.stdout:6/108: link d1/d7/d8/f12 d1/d7/d8/dc/f29 0 2024-09-17T01:41:21.653 INFO:tasks.workunit.client.1.smithi167.stdout:3/250: dread d7/f41 [0,4194304] 0 2024-09-17T01:41:21.653 INFO:tasks.workunit.client.1.smithi167.stdout:3/251: chown c4 56074599 1 2024-09-17T01:41:21.654 INFO:tasks.workunit.client.0.smithi082.stdout:6/109: write d1/d7/f24 [370223,30404] 0 2024-09-17T01:41:21.654 INFO:tasks.workunit.client.1.smithi167.stdout:9/266: mknod d4/d9/d21/d37/c4b 0 2024-09-17T01:41:21.655 INFO:tasks.workunit.client.1.smithi167.stdout:4/294: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [4194304,4194304] 0 2024-09-17T01:41:21.655 INFO:tasks.workunit.client.1.smithi167.stdout:4/295: readlink d0/l15 0 2024-09-17T01:41:21.656 INFO:tasks.workunit.client.1.smithi167.stdout:0/209: link c2 d5/d8/d9/d2f/c47 0 2024-09-17T01:41:21.656 INFO:tasks.workunit.client.1.smithi167.stdout:4/296: read d0/f13 [789275,77059] 0 2024-09-17T01:41:21.657 INFO:tasks.workunit.client.1.smithi167.stdout:0/210: stat d5/d8/d9/l27 0 2024-09-17T01:41:21.657 INFO:tasks.workunit.client.0.smithi082.stdout:6/110: creat d1/d7/d23/f2a x:0 0 0 2024-09-17T01:41:21.659 INFO:tasks.workunit.client.0.smithi082.stdout:6/111: mkdir d1/d7/d8/dc/d2b 0 2024-09-17T01:41:21.661 INFO:tasks.workunit.client.1.smithi167.stdout:9/267: link d4/d9/f2a d4/d9/f4c 0 2024-09-17T01:41:21.662 INFO:tasks.workunit.client.0.smithi082.stdout:6/112: mkdir d1/d7/d8/dc/d1d/d2c 0 2024-09-17T01:41:21.662 INFO:tasks.workunit.client.1.smithi167.stdout:0/211: dwrite d5/d8/d9/d19/f22 [4194304,4194304] 0 2024-09-17T01:41:21.663 INFO:tasks.workunit.client.0.smithi082.stdout:6/113: mknod d1/d7/d8/dc/d1d/c2d 0 2024-09-17T01:41:21.664 INFO:tasks.workunit.client.1.smithi167.stdout:9/268: creat d4/d9/d21/d2d/d33/d3a/f4d x:0 0 0 2024-09-17T01:41:21.668 INFO:tasks.workunit.client.1.smithi167.stdout:0/212: rename d5/c26 to d5/d8/d9/c48 0 2024-09-17T01:41:21.670 INFO:tasks.workunit.client.1.smithi167.stdout:9/269: dwrite d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:21.670 INFO:tasks.workunit.client.1.smithi167.stdout:0/213: chown d5/ce 3751 1 2024-09-17T01:41:21.670 INFO:tasks.workunit.client.0.smithi082.stdout:6/114: dwrite d1/d7/d8/f12 [0,4194304] 0 2024-09-17T01:41:21.670 INFO:tasks.workunit.client.1.smithi167.stdout:0/214: dread - d5/d8/f44 zero size 2024-09-17T01:41:21.671 INFO:tasks.workunit.client.0.smithi082.stdout:6/115: write d1/d7/d10/f1a [455421,1011] 0 2024-09-17T01:41:21.672 INFO:tasks.workunit.client.1.smithi167.stdout:0/215: chown d5/d8/d9/d19/f38 351911 1 2024-09-17T01:41:21.674 INFO:tasks.workunit.client.0.smithi082.stdout:6/116: rename d1/d7/d10/f1a to d1/d7/f2e 0 2024-09-17T01:41:21.674 INFO:tasks.workunit.client.1.smithi167.stdout:9/270: dread f1 [0,4194304] 0 2024-09-17T01:41:21.675 INFO:tasks.workunit.client.1.smithi167.stdout:9/271: chown d4/d9/d21 3851 1 2024-09-17T01:41:21.675 INFO:tasks.workunit.client.0.smithi082.stdout:6/117: write d1/d7/d8/dc/f29 [1977208,37609] 0 2024-09-17T01:41:21.676 INFO:tasks.workunit.client.0.smithi082.stdout:6/118: dread - d1/d7/d23/f2a zero size 2024-09-17T01:41:21.676 INFO:tasks.workunit.client.1.smithi167.stdout:0/216: dread d5/d8/f20 [4194304,4194304] 0 2024-09-17T01:41:21.679 INFO:tasks.workunit.client.0.smithi082.stdout:6/119: creat d1/d7/d8/dc/d1d/f2f x:0 0 0 2024-09-17T01:41:21.680 INFO:tasks.workunit.client.0.smithi082.stdout:6/120: read d1/d7/d8/f20 [39116,122707] 0 2024-09-17T01:41:21.681 INFO:tasks.workunit.client.1.smithi167.stdout:0/217: symlink d5/d8/d2e/d37/l49 0 2024-09-17T01:41:21.681 INFO:tasks.workunit.client.1.smithi167.stdout:0/218: dread - d5/d8/d9/f39 zero size 2024-09-17T01:41:21.681 INFO:tasks.workunit.client.1.smithi167.stdout:0/219: fdatasync d5/d8/d9/d19/f2b 0 2024-09-17T01:41:21.682 INFO:tasks.workunit.client.0.smithi082.stdout:6/121: write d1/d7/f2e [90678,37068] 0 2024-09-17T01:41:21.684 INFO:tasks.workunit.client.1.smithi167.stdout:0/220: unlink d5/d8/d9/d19/f3d 0 2024-09-17T01:41:21.684 INFO:tasks.workunit.client.0.smithi082.stdout:6/122: rmdir d1/d7/d8/dc 39 2024-09-17T01:41:21.686 INFO:tasks.workunit.client.0.smithi082.stdout:6/123: creat d1/d7/d8/f30 x:0 0 0 2024-09-17T01:41:21.688 INFO:tasks.workunit.client.0.smithi082.stdout:6/124: rmdir d1/d7/d23 39 2024-09-17T01:41:21.688 INFO:tasks.workunit.client.0.smithi082.stdout:6/125: stat d1/d7/f24 0 2024-09-17T01:41:21.695 INFO:tasks.workunit.client.0.smithi082.stdout:6/126: dwrite d1/d7/d10/f11 [0,4194304] 0 2024-09-17T01:41:21.696 INFO:tasks.workunit.client.0.smithi082.stdout:6/127: write d1/d7/f24 [728479,120556] 0 2024-09-17T01:41:21.702 INFO:tasks.workunit.client.1.smithi167.stdout:0/221: dread d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:21.715 INFO:tasks.workunit.client.0.smithi082.stdout:0/61: sync 2024-09-17T01:41:21.716 INFO:tasks.workunit.client.0.smithi082.stdout:5/51: sync 2024-09-17T01:41:21.716 INFO:tasks.workunit.client.1.smithi167.stdout:0/222: dwrite d5/d8/d9/d19/f38 [0,4194304] 0 2024-09-17T01:41:21.716 INFO:tasks.workunit.client.0.smithi082.stdout:0/62: chown f4 33990 1 2024-09-17T01:41:21.718 INFO:tasks.workunit.client.0.smithi082.stdout:5/52: fsync db/fc 0 2024-09-17T01:41:21.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/223: dread - d5/d8/d9/d19/f40 zero size 2024-09-17T01:41:21.719 INFO:tasks.workunit.client.0.smithi082.stdout:6/128: dread - d1/d7/d23/f2a zero size 2024-09-17T01:41:21.721 INFO:tasks.workunit.client.0.smithi082.stdout:0/63: dread f8 [0,4194304] 0 2024-09-17T01:41:21.721 INFO:tasks.workunit.client.0.smithi082.stdout:6/129: truncate d1/d7/d8/f30 392116 0 2024-09-17T01:41:21.722 INFO:tasks.workunit.client.0.smithi082.stdout:6/130: fdatasync d1/d7/d10/f16 0 2024-09-17T01:41:21.724 INFO:tasks.workunit.client.1.smithi167.stdout:7/250: dwrite d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:21.730 INFO:tasks.workunit.client.1.smithi167.stdout:7/251: symlink d0/d2/d14/d19/d26/l4e 0 2024-09-17T01:41:21.730 INFO:tasks.workunit.client.1.smithi167.stdout:0/224: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:21.730 INFO:tasks.workunit.client.1.smithi167.stdout:7/252: stat d0/ca 0 2024-09-17T01:41:21.734 INFO:tasks.workunit.client.1.smithi167.stdout:0/225: symlink d5/l4a 0 2024-09-17T01:41:21.734 INFO:tasks.workunit.client.0.smithi082.stdout:5/53: dwrite f7 [4194304,4194304] 0 2024-09-17T01:41:21.735 INFO:tasks.workunit.client.1.smithi167.stdout:7/253: write d0/d2/d14/d19/f1e [445345,57338] 0 2024-09-17T01:41:21.735 INFO:tasks.workunit.client.1.smithi167.stdout:0/226: read d5/d8/d9/d19/f38 [2520611,91575] 0 2024-09-17T01:41:21.736 INFO:tasks.workunit.client.0.smithi082.stdout:6/131: mknod d1/d7/d8/dc/d1d/d2c/c31 0 2024-09-17T01:41:21.736 INFO:tasks.workunit.client.0.smithi082.stdout:9/83: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T01:41:21.738 INFO:tasks.workunit.client.1.smithi167.stdout:7/254: unlink d0/d2/d14/d19/c1d 0 2024-09-17T01:41:21.741 INFO:tasks.workunit.client.1.smithi167.stdout:7/255: rmdir d0/d2 39 2024-09-17T01:41:21.743 INFO:tasks.workunit.client.0.smithi082.stdout:5/54: symlink db/d12/l13 0 2024-09-17T01:41:21.745 INFO:tasks.workunit.client.0.smithi082.stdout:6/132: dwrite d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:21.745 INFO:tasks.workunit.client.0.smithi082.stdout:5/55: stat c1 0 2024-09-17T01:41:21.747 INFO:tasks.workunit.client.1.smithi167.stdout:0/227: fsync d5/d8/f44 0 2024-09-17T01:41:21.749 INFO:tasks.workunit.client.0.smithi082.stdout:5/56: mkdir db/d12/d14 0 2024-09-17T01:41:21.750 INFO:tasks.workunit.client.1.smithi167.stdout:2/290: sync 2024-09-17T01:41:21.751 INFO:tasks.workunit.client.1.smithi167.stdout:3/252: dread d7/d8/d10/d14/d25/f48 [0,4194304] 0 2024-09-17T01:41:21.751 INFO:tasks.workunit.client.1.smithi167.stdout:7/256: creat d0/f4f x:0 0 0 2024-09-17T01:41:21.753 INFO:tasks.workunit.client.0.smithi082.stdout:5/57: creat db/d12/f15 x:0 0 0 2024-09-17T01:41:21.760 INFO:tasks.workunit.client.1.smithi167.stdout:6/327: dwrite d7/d11/f10 [0,4194304] 0 2024-09-17T01:41:21.825 INFO:tasks.workunit.client.1.smithi167.stdout:8/388: sync 2024-09-17T01:41:21.860 INFO:tasks.workunit.client.0.smithi082.stdout:5/58: creat db/f16 x:0 0 0 2024-09-17T01:41:21.861 INFO:tasks.workunit.client.0.smithi082.stdout:5/59: dread - db/f16 zero size 2024-09-17T01:41:21.861 INFO:tasks.workunit.client.1.smithi167.stdout:2/291: creat d5/d3c/f67 x:0 0 0 2024-09-17T01:41:21.863 INFO:tasks.workunit.client.1.smithi167.stdout:7/257: chown d0/d2/d14/d19/d26/l4e 173 1 2024-09-17T01:41:21.864 INFO:tasks.workunit.client.1.smithi167.stdout:0/228: link d5/d8/d9/f36 d5/d8/d2e/d37/d45/f4b 0 2024-09-17T01:41:21.865 INFO:tasks.workunit.client.1.smithi167.stdout:5/175: dwrite d0/d9/f2d [4194304,4194304] 0 2024-09-17T01:41:21.867 INFO:tasks.workunit.client.1.smithi167.stdout:8/389: read - dc/d18/f4f zero size 2024-09-17T01:41:21.867 INFO:tasks.workunit.client.0.smithi082.stdout:1/78: sync 2024-09-17T01:41:21.868 INFO:tasks.workunit.client.1.smithi167.stdout:3/253: unlink d7/d8/d10/c19 0 2024-09-17T01:41:21.868 INFO:tasks.workunit.client.0.smithi082.stdout:5/60: dwrite db/f16 [0,4194304] 0 2024-09-17T01:41:21.871 INFO:tasks.workunit.client.1.smithi167.stdout:2/292: rename d5/d3c/d4c/f5f to d5/d10/d1a/d45/f68 0 2024-09-17T01:41:21.871 INFO:tasks.workunit.client.1.smithi167.stdout:2/293: fsync d5/d3c/f40 0 2024-09-17T01:41:21.872 INFO:tasks.workunit.client.1.smithi167.stdout:7/258: rmdir d0/d2 39 2024-09-17T01:41:21.872 INFO:tasks.workunit.client.1.smithi167.stdout:4/297: write d0/d4/f47 [5065404,99519] 0 2024-09-17T01:41:21.874 INFO:tasks.workunit.client.1.smithi167.stdout:1/245: sync 2024-09-17T01:41:21.876 INFO:tasks.workunit.client.0.smithi082.stdout:5/61: creat db/f17 x:0 0 0 2024-09-17T01:41:21.878 INFO:tasks.workunit.client.0.smithi082.stdout:1/79: symlink d2/da/d16/l1a 0 2024-09-17T01:41:21.880 INFO:tasks.workunit.client.0.smithi082.stdout:5/62: mkdir db/d12/d18 0 2024-09-17T01:41:21.881 INFO:tasks.workunit.client.1.smithi167.stdout:1/246: dwrite d0/d5/d34/f14 [4194304,4194304] 0 2024-09-17T01:41:21.882 INFO:tasks.workunit.client.0.smithi082.stdout:1/80: unlink d2/f3 0 2024-09-17T01:41:21.884 INFO:tasks.workunit.client.1.smithi167.stdout:1/247: fdatasync d0/d5/d34/f30 0 2024-09-17T01:41:21.884 INFO:tasks.workunit.client.0.smithi082.stdout:5/63: creat db/f19 x:0 0 0 2024-09-17T01:41:21.886 INFO:tasks.workunit.client.1.smithi167.stdout:8/390: write f7 [674465,78199] 0 2024-09-17T01:41:21.887 INFO:tasks.workunit.client.1.smithi167.stdout:3/254: mknod d7/d8/d2a/c4a 0 2024-09-17T01:41:21.888 INFO:tasks.workunit.client.1.smithi167.stdout:5/176: dread d0/f20 [0,4194304] 0 2024-09-17T01:41:21.888 INFO:tasks.workunit.client.0.smithi082.stdout:1/81: unlink d2/da/d16/l1a 0 2024-09-17T01:41:21.889 INFO:tasks.workunit.client.0.smithi082.stdout:1/82: chown d2/f10 181174 1 2024-09-17T01:41:21.889 INFO:tasks.workunit.client.1.smithi167.stdout:3/255: readlink d7/d8/l47 0 2024-09-17T01:41:21.890 INFO:tasks.workunit.client.0.smithi082.stdout:1/83: fdatasync d2/dd/f13 0 2024-09-17T01:41:21.890 INFO:tasks.workunit.client.1.smithi167.stdout:5/177: read d0/f18 [1760596,41414] 0 2024-09-17T01:41:21.896 INFO:tasks.workunit.client.1.smithi167.stdout:2/294: creat d5/d3c/f69 x:0 0 0 2024-09-17T01:41:21.896 INFO:tasks.workunit.client.1.smithi167.stdout:0/229: write d5/d8/d9/d19/f38 [4361817,74494] 0 2024-09-17T01:41:21.898 INFO:tasks.workunit.client.0.smithi082.stdout:5/64: rmdir db/d12/d14 0 2024-09-17T01:41:21.900 INFO:tasks.workunit.client.1.smithi167.stdout:9/272: dwrite d4/d9/f4c [0,4194304] 0 2024-09-17T01:41:21.901 INFO:tasks.workunit.client.1.smithi167.stdout:1/248: dwrite d0/d5/d34/d3c/f41 [0,4194304] 0 2024-09-17T01:41:21.902 INFO:tasks.workunit.client.0.smithi082.stdout:0/64: write f7 [302405,1165] 0 2024-09-17T01:41:21.902 INFO:tasks.workunit.client.1.smithi167.stdout:4/298: mkdir d0/d4/d7/da/d48/d40/d57/d6a 0 2024-09-17T01:41:21.903 INFO:tasks.workunit.client.0.smithi082.stdout:5/65: rename db/lf to db/d12/l1a 0 2024-09-17T01:41:21.904 INFO:tasks.workunit.client.0.smithi082.stdout:5/66: chown db/f10 624 1 2024-09-17T01:41:21.905 INFO:tasks.workunit.client.1.smithi167.stdout:6/328: creat d7/d11/d13/d2f/f7a x:0 0 0 2024-09-17T01:41:21.906 INFO:tasks.workunit.client.0.smithi082.stdout:0/65: read f0 [2413904,15569] 0 2024-09-17T01:41:21.907 INFO:tasks.workunit.client.1.smithi167.stdout:3/256: fsync d7/d8/d10/f13 0 2024-09-17T01:41:21.907 INFO:tasks.workunit.client.1.smithi167.stdout:8/391: dwrite dc/d1a/f52 [0,4194304] 0 2024-09-17T01:41:21.908 INFO:tasks.workunit.client.0.smithi082.stdout:5/67: symlink db/l1b 0 2024-09-17T01:41:21.908 INFO:tasks.workunit.client.1.smithi167.stdout:6/329: chown d7/f5c 3910703 1 2024-09-17T01:41:21.909 INFO:tasks.workunit.client.0.smithi082.stdout:5/68: dread - db/f11 zero size 2024-09-17T01:41:21.909 INFO:tasks.workunit.client.1.smithi167.stdout:8/392: dread - dc/d1a/f7d zero size 2024-09-17T01:41:21.910 INFO:tasks.workunit.client.0.smithi082.stdout:5/69: dread - db/f17 zero size 2024-09-17T01:41:21.910 INFO:tasks.workunit.client.1.smithi167.stdout:4/299: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d 35555 1 2024-09-17T01:41:21.911 INFO:tasks.workunit.client.1.smithi167.stdout:8/393: readlink dc/d21/l75 0 2024-09-17T01:41:21.912 INFO:tasks.workunit.client.0.smithi082.stdout:0/66: write da/fb [437810,127092] 0 2024-09-17T01:41:21.915 INFO:tasks.workunit.client.1.smithi167.stdout:2/295: symlink d5/l6a 0 2024-09-17T01:41:21.915 INFO:tasks.workunit.client.1.smithi167.stdout:5/178: write d0/f14 [1272975,64040] 0 2024-09-17T01:41:21.916 INFO:tasks.workunit.client.0.smithi082.stdout:5/70: dread fa [0,4194304] 0 2024-09-17T01:41:21.917 INFO:tasks.workunit.client.1.smithi167.stdout:1/249: dread d0/d5/d34/d3c/f2b [4194304,4194304] 0 2024-09-17T01:41:21.917 INFO:tasks.workunit.client.0.smithi082.stdout:5/71: write db/f11 [366517,84702] 0 2024-09-17T01:41:21.918 INFO:tasks.workunit.client.1.smithi167.stdout:5/179: chown d0/c4 53 1 2024-09-17T01:41:21.918 INFO:tasks.workunit.client.1.smithi167.stdout:2/296: fsync d5/d10/d1a/d2e/f36 0 2024-09-17T01:41:21.919 INFO:tasks.workunit.client.1.smithi167.stdout:2/297: read - d5/d10/d1a/f5c zero size 2024-09-17T01:41:21.919 INFO:tasks.workunit.client.1.smithi167.stdout:9/273: creat d4/f4e x:0 0 0 2024-09-17T01:41:21.920 INFO:tasks.workunit.client.0.smithi082.stdout:0/67: creat da/f14 x:0 0 0 2024-09-17T01:41:21.921 INFO:tasks.workunit.client.0.smithi082.stdout:6/133: truncate d1/d7/d8/fb 4151695 0 2024-09-17T01:41:21.922 INFO:tasks.workunit.client.1.smithi167.stdout:5/180: dread d0/f18 [0,4194304] 0 2024-09-17T01:41:21.925 INFO:tasks.workunit.client.0.smithi082.stdout:5/72: creat db/d12/f1c x:0 0 0 2024-09-17T01:41:21.926 INFO:tasks.workunit.client.1.smithi167.stdout:3/257: rmdir d7 39 2024-09-17T01:41:21.928 INFO:tasks.workunit.client.0.smithi082.stdout:5/73: truncate db/f17 52440 0 2024-09-17T01:41:21.929 INFO:tasks.workunit.client.0.smithi082.stdout:0/68: dwrite da/f14 [0,4194304] 0 2024-09-17T01:41:21.931 INFO:tasks.workunit.client.1.smithi167.stdout:8/394: mknod dc/d21/d61/c8c 0 2024-09-17T01:41:21.931 INFO:tasks.workunit.client.0.smithi082.stdout:6/134: dwrite d1/d7/d8/f30 [0,4194304] 0 2024-09-17T01:41:21.936 INFO:tasks.workunit.client.1.smithi167.stdout:7/259: mknod d0/d2/d14/d4c/c50 0 2024-09-17T01:41:21.937 INFO:tasks.workunit.client.1.smithi167.stdout:7/260: stat d0/d2/d14/d19/f30 0 2024-09-17T01:41:21.941 INFO:tasks.workunit.client.0.smithi082.stdout:0/69: link f8 da/df/f15 0 2024-09-17T01:41:21.942 INFO:tasks.workunit.client.0.smithi082.stdout:0/70: write da/f14 [743513,118975] 0 2024-09-17T01:41:21.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/71: chown da/c10 9 1 2024-09-17T01:41:21.944 INFO:tasks.workunit.client.0.smithi082.stdout:6/135: mkdir d1/d7/d8/d32 0 2024-09-17T01:41:21.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/136: write d1/d3/f1b [2596936,89463] 0 2024-09-17T01:41:21.945 INFO:tasks.workunit.client.1.smithi167.stdout:9/274: write d4/f38 [1616689,49431] 0 2024-09-17T01:41:21.946 INFO:tasks.workunit.client.0.smithi082.stdout:6/137: read - d1/d1f/f21 zero size 2024-09-17T01:41:21.946 INFO:tasks.workunit.client.0.smithi082.stdout:6/138: readlink d1/l28 0 2024-09-17T01:41:21.948 INFO:tasks.workunit.client.1.smithi167.stdout:2/298: unlink d5/d10/d1a/d45/f17 0 2024-09-17T01:41:21.949 INFO:tasks.workunit.client.0.smithi082.stdout:0/72: mkdir da/d16 0 2024-09-17T01:41:21.949 INFO:tasks.workunit.client.1.smithi167.stdout:9/275: dread f1 [0,4194304] 0 2024-09-17T01:41:21.949 INFO:tasks.workunit.client.1.smithi167.stdout:2/299: chown d5/d10/d1a/f31 67101 1 2024-09-17T01:41:21.956 INFO:tasks.workunit.client.0.smithi082.stdout:6/139: dread d1/d7/d8/f20 [0,4194304] 0 2024-09-17T01:41:21.957 INFO:tasks.workunit.client.0.smithi082.stdout:1/84: dwrite d2/f11 [0,4194304] 0 2024-09-17T01:41:21.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/73: symlink da/d16/l17 0 2024-09-17T01:41:21.960 INFO:tasks.workunit.client.0.smithi082.stdout:0/74: write f7 [713018,121280] 0 2024-09-17T01:41:21.962 INFO:tasks.workunit.client.0.smithi082.stdout:1/85: creat d2/f1b x:0 0 0 2024-09-17T01:41:21.965 INFO:tasks.workunit.client.1.smithi167.stdout:2/300: dread d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:21.968 INFO:tasks.workunit.client.1.smithi167.stdout:5/181: mkdir d0/d9/d32 0 2024-09-17T01:41:21.969 INFO:tasks.workunit.client.0.smithi082.stdout:6/140: dwrite d1/d1f/f21 [0,4194304] 0 2024-09-17T01:41:21.975 INFO:tasks.workunit.client.0.smithi082.stdout:1/86: dwrite d2/f18 [0,4194304] 0 2024-09-17T01:41:21.994 INFO:tasks.workunit.client.1.smithi167.stdout:3/258: rename d7/d8/l21 to d7/d1e/l4b 0 2024-09-17T01:41:21.995 INFO:tasks.workunit.client.1.smithi167.stdout:6/330: creat d7/f7b x:0 0 0 2024-09-17T01:41:21.996 INFO:tasks.workunit.client.1.smithi167.stdout:6/331: chown d7/d11/f5b 20772 1 2024-09-17T01:41:21.997 INFO:tasks.workunit.client.1.smithi167.stdout:6/332: chown d7/d12/d27/d28/f46 418442353 1 2024-09-17T01:41:21.997 INFO:tasks.workunit.client.0.smithi082.stdout:0/75: truncate da/df/f15 2116127 0 2024-09-17T01:41:21.998 INFO:tasks.workunit.client.1.smithi167.stdout:6/333: write d7/d11/d13/d2f/f7a [425900,15957] 0 2024-09-17T01:41:21.999 INFO:tasks.workunit.client.1.smithi167.stdout:6/334: fsync d7/d11/d13/f49 0 2024-09-17T01:41:21.999 INFO:tasks.workunit.client.1.smithi167.stdout:6/335: chown d7/l2c 961973 1 2024-09-17T01:41:22.000 INFO:tasks.workunit.client.1.smithi167.stdout:6/336: stat d7/d11/d13/c70 0 2024-09-17T01:41:22.000 INFO:tasks.workunit.client.1.smithi167.stdout:6/337: fsync d7/d11/d13/d2f/d30/f59 0 2024-09-17T01:41:22.022 INFO:tasks.workunit.client.0.smithi082.stdout:6/141: creat d1/d7/d10/f33 x:0 0 0 2024-09-17T01:41:22.022 INFO:tasks.workunit.client.0.smithi082.stdout:6/142: fdatasync d1/d7/f24 0 2024-09-17T01:41:22.024 INFO:tasks.workunit.client.0.smithi082.stdout:6/143: dread - d1/d7/d10/f33 zero size 2024-09-17T01:41:22.025 INFO:tasks.workunit.client.0.smithi082.stdout:0/76: mknod da/d16/c18 0 2024-09-17T01:41:22.028 INFO:tasks.workunit.client.0.smithi082.stdout:6/144: dread d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:22.029 INFO:tasks.workunit.client.0.smithi082.stdout:1/87: link d2/df/f17 d2/da/d16/f1c 0 2024-09-17T01:41:22.030 INFO:tasks.workunit.client.1.smithi167.stdout:0/230: sync 2024-09-17T01:41:22.030 INFO:tasks.workunit.client.1.smithi167.stdout:1/250: sync 2024-09-17T01:41:22.031 INFO:tasks.workunit.client.1.smithi167.stdout:1/251: fdatasync d0/d5/d34/f14 0 2024-09-17T01:41:22.031 INFO:tasks.workunit.client.1.smithi167.stdout:0/231: readlink d5/d8/l2d 0 2024-09-17T01:41:22.031 INFO:tasks.workunit.client.1.smithi167.stdout:1/252: chown d0/d5/d34/l3d 153205732 1 2024-09-17T01:41:22.032 INFO:tasks.workunit.client.0.smithi082.stdout:0/77: symlink da/df/l19 0 2024-09-17T01:41:22.033 INFO:tasks.workunit.client.0.smithi082.stdout:1/88: dread d2/f11 [0,4194304] 0 2024-09-17T01:41:22.033 INFO:tasks.workunit.client.0.smithi082.stdout:1/89: chown d2/cc 203 1 2024-09-17T01:41:22.034 INFO:tasks.workunit.client.1.smithi167.stdout:4/300: getdents d0/d4/d7/da/d48/d40 0 2024-09-17T01:41:22.035 INFO:tasks.workunit.client.1.smithi167.stdout:4/301: write d0/d4/d7/da/f2c [97092,127500] 0 2024-09-17T01:41:22.036 INFO:tasks.workunit.client.1.smithi167.stdout:4/302: fdatasync d0/d4/d7/f67 0 2024-09-17T01:41:22.040 INFO:tasks.workunit.client.1.smithi167.stdout:7/261: truncate d0/d2/d14/d19/f3e 2754553 0 2024-09-17T01:41:22.041 INFO:tasks.workunit.client.1.smithi167.stdout:7/262: write d0/f5 [3579173,23072] 0 2024-09-17T01:41:22.041 INFO:tasks.workunit.client.0.smithi082.stdout:6/145: mknod d1/d7/c34 0 2024-09-17T01:41:22.044 INFO:tasks.workunit.client.0.smithi082.stdout:0/78: dread da/df/f15 [0,4194304] 0 2024-09-17T01:41:22.044 INFO:tasks.workunit.client.0.smithi082.stdout:0/79: chown f8 1013 1 2024-09-17T01:41:22.045 INFO:tasks.workunit.client.1.smithi167.stdout:0/232: mknod d5/d8/d2e/c4c 0 2024-09-17T01:41:22.046 INFO:tasks.workunit.client.0.smithi082.stdout:1/90: creat d2/df/f1d x:0 0 0 2024-09-17T01:41:22.046 INFO:tasks.workunit.client.0.smithi082.stdout:0/80: dread da/df/f15 [0,4194304] 0 2024-09-17T01:41:22.047 INFO:tasks.workunit.client.0.smithi082.stdout:0/81: fsync f7 0 2024-09-17T01:41:22.050 INFO:tasks.workunit.client.1.smithi167.stdout:9/276: link d4/l6 d4/d9/d21/l4f 0 2024-09-17T01:41:22.050 INFO:tasks.workunit.client.1.smithi167.stdout:0/233: dwrite d5/d8/d9/d2f/f3b [0,4194304] 0 2024-09-17T01:41:22.053 INFO:tasks.workunit.client.0.smithi082.stdout:1/91: mkdir d2/dd/d1e 0 2024-09-17T01:41:22.054 INFO:tasks.workunit.client.1.smithi167.stdout:5/182: creat d0/d9/f33 x:0 0 0 2024-09-17T01:41:22.056 INFO:tasks.workunit.client.1.smithi167.stdout:3/259: creat d7/d8/f4c x:0 0 0 2024-09-17T01:41:22.059 INFO:tasks.workunit.client.0.smithi082.stdout:0/82: symlink da/d16/l1a 0 2024-09-17T01:41:22.061 INFO:tasks.workunit.client.0.smithi082.stdout:6/146: creat d1/d7/d8/dc/d2b/f35 x:0 0 0 2024-09-17T01:41:22.062 INFO:tasks.workunit.client.1.smithi167.stdout:7/263: rename d0/d2/d14/c2d to d0/d2/d14/d19/d26/d34/c51 0 2024-09-17T01:41:22.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/83: fsync f8 0 2024-09-17T01:41:22.065 INFO:tasks.workunit.client.0.smithi082.stdout:6/147: mkdir d1/d7/d8/dc/d1d/d36 0 2024-09-17T01:41:22.066 INFO:tasks.workunit.client.1.smithi167.stdout:4/303: creat d0/d4/d69/f6b x:0 0 0 2024-09-17T01:41:22.067 INFO:tasks.workunit.client.0.smithi082.stdout:1/92: truncate d2/da/d16/f1c 81062 0 2024-09-17T01:41:22.068 INFO:tasks.workunit.client.0.smithi082.stdout:0/84: fdatasync da/fd 0 2024-09-17T01:41:22.070 INFO:tasks.workunit.client.1.smithi167.stdout:5/183: unlink d0/f3 0 2024-09-17T01:41:22.070 INFO:tasks.workunit.client.0.smithi082.stdout:6/148: symlink d1/d3/l37 0 2024-09-17T01:41:22.072 INFO:tasks.workunit.client.1.smithi167.stdout:3/260: mknod d7/d8/d2a/c4d 0 2024-09-17T01:41:22.073 INFO:tasks.workunit.client.0.smithi082.stdout:1/93: creat d2/da/f1f x:0 0 0 2024-09-17T01:41:22.073 INFO:tasks.workunit.client.1.smithi167.stdout:3/261: chown d7/d8/d10/d14/d2c/l38 265739929 1 2024-09-17T01:41:22.073 INFO:tasks.workunit.client.1.smithi167.stdout:5/184: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:22.075 INFO:tasks.workunit.client.1.smithi167.stdout:5/185: dread d0/f18 [0,4194304] 0 2024-09-17T01:41:22.076 INFO:tasks.workunit.client.1.smithi167.stdout:0/234: rename d5/d8/d9/d19 to d5/d8/d2e/d4d 0 2024-09-17T01:41:22.078 INFO:tasks.workunit.client.0.smithi082.stdout:0/85: rmdir da/df 39 2024-09-17T01:41:22.079 INFO:tasks.workunit.client.0.smithi082.stdout:1/94: dwrite d2/df/f1d [0,4194304] 0 2024-09-17T01:41:22.079 INFO:tasks.workunit.client.0.smithi082.stdout:0/86: write da/f14 [3695638,20010] 0 2024-09-17T01:41:22.082 INFO:tasks.workunit.client.0.smithi082.stdout:6/149: rename d1/d7/d8/dc/d1d/f2f to d1/d7/d10/f38 0 2024-09-17T01:41:22.083 INFO:tasks.workunit.client.0.smithi082.stdout:6/150: write d1/d7/d10/f33 [614940,43321] 0 2024-09-17T01:41:22.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/151: write d1/d7/f2e [173972,44877] 0 2024-09-17T01:41:22.086 INFO:tasks.workunit.client.0.smithi082.stdout:6/152: truncate d1/d7/d10/f33 1211670 0 2024-09-17T01:41:22.088 INFO:tasks.workunit.client.1.smithi167.stdout:9/277: mknod d4/d9/d21/d43/d47/c50 0 2024-09-17T01:41:22.090 INFO:tasks.workunit.client.0.smithi082.stdout:0/87: chown da/df/l19 13659378 1 2024-09-17T01:41:22.094 INFO:tasks.workunit.client.1.smithi167.stdout:3/262: rmdir d7/d8 39 2024-09-17T01:41:22.096 INFO:tasks.workunit.client.0.smithi082.stdout:0/88: unlink da/df/l19 0 2024-09-17T01:41:22.096 INFO:tasks.workunit.client.1.smithi167.stdout:0/235: mknod d5/d8/d2e/c4e 0 2024-09-17T01:41:22.098 INFO:tasks.workunit.client.1.smithi167.stdout:1/253: getdents d0/d9/d16/d36 0 2024-09-17T01:41:22.098 INFO:tasks.workunit.client.0.smithi082.stdout:6/153: mknod d1/d7/d8/c39 0 2024-09-17T01:41:22.099 INFO:tasks.workunit.client.1.smithi167.stdout:1/254: chown d0/d5/d34/c1c 35214251 1 2024-09-17T01:41:22.100 INFO:tasks.workunit.client.0.smithi082.stdout:6/154: write d1/d7/d8/f12 [3610471,125286] 0 2024-09-17T01:41:22.101 INFO:tasks.workunit.client.0.smithi082.stdout:6/155: fsync d1/d1f/f21 0 2024-09-17T01:41:22.102 INFO:tasks.workunit.client.0.smithi082.stdout:6/156: chown d1 11 1 2024-09-17T01:41:22.102 INFO:tasks.workunit.client.0.smithi082.stdout:6/157: readlink d1/d7/ld 0 2024-09-17T01:41:22.104 INFO:tasks.workunit.client.0.smithi082.stdout:0/89: mkdir da/d1b 0 2024-09-17T01:41:22.106 INFO:tasks.workunit.client.0.smithi082.stdout:1/95: getdents d2/da 0 2024-09-17T01:41:22.107 INFO:tasks.workunit.client.0.smithi082.stdout:1/96: write d2/df/f1d [1162857,81241] 0 2024-09-17T01:41:22.108 INFO:tasks.workunit.client.1.smithi167.stdout:8/395: sync 2024-09-17T01:41:22.109 INFO:tasks.workunit.client.0.smithi082.stdout:1/97: creat d2/f20 x:0 0 0 2024-09-17T01:41:22.112 INFO:tasks.workunit.client.1.smithi167.stdout:5/186: creat d0/d9/f34 x:0 0 0 2024-09-17T01:41:22.112 INFO:tasks.workunit.client.1.smithi167.stdout:7/264: dwrite d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:22.113 INFO:tasks.workunit.client.0.smithi082.stdout:6/158: creat d1/d7/d8/f3a x:0 0 0 2024-09-17T01:41:22.113 INFO:tasks.workunit.client.0.smithi082.stdout:6/159: fsync d1/d7/d10/f16 0 2024-09-17T01:41:22.114 INFO:tasks.workunit.client.1.smithi167.stdout:7/265: write d0/f5 [4105674,83416] 0 2024-09-17T01:41:22.116 INFO:tasks.workunit.client.1.smithi167.stdout:4/304: getdents d0/d4/d7 0 2024-09-17T01:41:22.118 INFO:tasks.workunit.client.0.smithi082.stdout:1/98: link d2/l5 d2/l21 0 2024-09-17T01:41:22.119 INFO:tasks.workunit.client.1.smithi167.stdout:3/263: dwrite d7/d8/d2a/f3f [0,4194304] 0 2024-09-17T01:41:22.120 INFO:tasks.workunit.client.1.smithi167.stdout:0/236: link d5/d8/d9/c1f d5/d8/d2e/d37/c4f 0 2024-09-17T01:41:22.120 INFO:tasks.workunit.client.0.smithi082.stdout:6/160: getdents d1/d3 0 2024-09-17T01:41:22.121 INFO:tasks.workunit.client.0.smithi082.stdout:6/161: chown d1/d7/d10/l22 3616 1 2024-09-17T01:41:22.121 INFO:tasks.workunit.client.1.smithi167.stdout:0/237: chown d5/d8 1002 1 2024-09-17T01:41:22.122 INFO:tasks.workunit.client.1.smithi167.stdout:1/255: creat d0/f46 x:0 0 0 2024-09-17T01:41:22.122 INFO:tasks.workunit.client.1.smithi167.stdout:9/278: getdents d4/d9/d21 0 2024-09-17T01:41:22.123 INFO:tasks.workunit.client.1.smithi167.stdout:3/264: truncate d7/d1e/f43 132451 0 2024-09-17T01:41:22.124 INFO:tasks.workunit.client.0.smithi082.stdout:6/162: creat d1/d3/f3b x:0 0 0 2024-09-17T01:41:22.125 INFO:tasks.workunit.client.0.smithi082.stdout:6/163: chown d1/d7 266 1 2024-09-17T01:41:22.125 INFO:tasks.workunit.client.0.smithi082.stdout:1/99: link c1 d2/dd/c22 0 2024-09-17T01:41:22.129 INFO:tasks.workunit.client.1.smithi167.stdout:3/265: fsync d7/d8/d10/f13 0 2024-09-17T01:41:22.129 INFO:tasks.workunit.client.1.smithi167.stdout:1/256: mknod d0/d5/d34/d3c/c47 0 2024-09-17T01:41:22.129 INFO:tasks.workunit.client.1.smithi167.stdout:7/266: link d0/d2/c49 d0/d2/d14/d4c/c52 0 2024-09-17T01:41:22.129 INFO:tasks.workunit.client.1.smithi167.stdout:0/238: mknod d5/d8/d2e/d37/d45/c50 0 2024-09-17T01:41:22.130 INFO:tasks.workunit.client.1.smithi167.stdout:8/396: dread f8 [0,4194304] 0 2024-09-17T01:41:22.131 INFO:tasks.workunit.client.1.smithi167.stdout:5/187: getdents d0/d9/d1c 0 2024-09-17T01:41:22.131 INFO:tasks.workunit.client.1.smithi167.stdout:9/279: dread d4/f38 [0,4194304] 0 2024-09-17T01:41:22.131 INFO:tasks.workunit.client.1.smithi167.stdout:3/266: fdatasync d7/d8/d10/f40 0 2024-09-17T01:41:22.132 INFO:tasks.workunit.client.1.smithi167.stdout:1/257: mkdir d0/d9/d16/d48 0 2024-09-17T01:41:22.132 INFO:tasks.workunit.client.1.smithi167.stdout:8/397: stat dc/d56/d57/f5b 0 2024-09-17T01:41:22.133 INFO:tasks.workunit.client.1.smithi167.stdout:0/239: fdatasync d5/d8/d9/f36 0 2024-09-17T01:41:22.134 INFO:tasks.workunit.client.1.smithi167.stdout:0/240: chown d5/d8 0 1 2024-09-17T01:41:22.134 INFO:tasks.workunit.client.1.smithi167.stdout:7/267: creat d0/d2/d14/d19/f53 x:0 0 0 2024-09-17T01:41:22.135 INFO:tasks.workunit.client.1.smithi167.stdout:9/280: symlink d4/l51 0 2024-09-17T01:41:22.135 INFO:tasks.workunit.client.1.smithi167.stdout:1/258: write d0/d5/d34/d3c/f41 [2274727,82238] 0 2024-09-17T01:41:22.136 INFO:tasks.workunit.client.1.smithi167.stdout:5/188: creat d0/d24/f35 x:0 0 0 2024-09-17T01:41:22.138 INFO:tasks.workunit.client.1.smithi167.stdout:5/189: stat d0/f13 0 2024-09-17T01:41:22.140 INFO:tasks.workunit.client.1.smithi167.stdout:3/267: rename d7/d8/d10/d14/d24/d46 to d7/d8/d2a/d4e 0 2024-09-17T01:41:22.141 INFO:tasks.workunit.client.1.smithi167.stdout:0/241: symlink d5/d8/d9/d2f/l51 0 2024-09-17T01:41:22.143 INFO:tasks.workunit.client.1.smithi167.stdout:9/281: mknod d4/d4a/c52 0 2024-09-17T01:41:22.145 INFO:tasks.workunit.client.1.smithi167.stdout:8/398: dwrite dc/d56/f5e [0,4194304] 0 2024-09-17T01:41:22.146 INFO:tasks.workunit.client.1.smithi167.stdout:7/268: write d0/d2/d14/d19/f30 [4685076,109406] 0 2024-09-17T01:41:22.147 INFO:tasks.workunit.client.1.smithi167.stdout:3/268: creat d7/d1e/f4f x:0 0 0 2024-09-17T01:41:22.148 INFO:tasks.workunit.client.1.smithi167.stdout:8/399: chown dc/f36 2221 1 2024-09-17T01:41:22.150 INFO:tasks.workunit.client.1.smithi167.stdout:9/282: fsync d4/d9/f4c 0 2024-09-17T01:41:22.150 INFO:tasks.workunit.client.1.smithi167.stdout:7/269: readlink d0/d2/d14/d19/l20 0 2024-09-17T01:41:22.151 INFO:tasks.workunit.client.1.smithi167.stdout:0/242: truncate d5/d8/d2e/d4d/f40 997078 0 2024-09-17T01:41:22.151 INFO:tasks.workunit.client.1.smithi167.stdout:2/301: sync 2024-09-17T01:41:22.151 INFO:tasks.workunit.client.1.smithi167.stdout:6/338: sync 2024-09-17T01:41:22.158 INFO:tasks.workunit.client.1.smithi167.stdout:9/283: chown d4/l1e 780416132 1 2024-09-17T01:41:22.160 INFO:tasks.workunit.client.1.smithi167.stdout:5/190: dwrite d0/d9/f34 [0,4194304] 0 2024-09-17T01:41:22.162 INFO:tasks.workunit.client.1.smithi167.stdout:2/302: write d5/d10/d1a/d39/f53 [1043795,125051] 0 2024-09-17T01:41:22.162 INFO:tasks.workunit.client.1.smithi167.stdout:4/305: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [0,4194304] 0 2024-09-17T01:41:22.164 INFO:tasks.workunit.client.1.smithi167.stdout:7/270: mknod d0/d2/d14/d19/d22/c54 0 2024-09-17T01:41:22.171 INFO:tasks.workunit.client.1.smithi167.stdout:6/339: dwrite d7/fa [0,4194304] 0 2024-09-17T01:41:22.172 INFO:tasks.workunit.client.1.smithi167.stdout:1/259: truncate d0/d9/f37 2477063 0 2024-09-17T01:41:22.173 INFO:tasks.workunit.client.1.smithi167.stdout:0/243: dwrite d5/d8/f46 [0,4194304] 0 2024-09-17T01:41:22.175 INFO:tasks.workunit.client.1.smithi167.stdout:3/269: dwrite d7/d8/d10/d14/d2c/f2d [0,4194304] 0 2024-09-17T01:41:22.183 INFO:tasks.workunit.client.1.smithi167.stdout:0/244: write d5/d8/d9/f35 [1181965,10315] 0 2024-09-17T01:41:22.184 INFO:tasks.workunit.client.1.smithi167.stdout:7/271: unlink d0/f5 0 2024-09-17T01:41:22.187 INFO:tasks.workunit.client.1.smithi167.stdout:0/245: symlink d5/d8/d2e/l52 0 2024-09-17T01:41:22.189 INFO:tasks.workunit.client.1.smithi167.stdout:7/272: chown d0/c12 241517 1 2024-09-17T01:41:22.189 INFO:tasks.workunit.client.1.smithi167.stdout:4/306: mknod d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d4f/c6c 0 2024-09-17T01:41:22.189 INFO:tasks.workunit.client.1.smithi167.stdout:3/270: dread d7/d8/d10/d14/d2c/f2f [0,4194304] 0 2024-09-17T01:41:22.190 INFO:tasks.workunit.client.1.smithi167.stdout:5/191: link d0/d24/d2b/l2c d0/d9/d32/l36 0 2024-09-17T01:41:22.191 INFO:tasks.workunit.client.1.smithi167.stdout:9/284: getdents d4/d9/d21/d43/d47 0 2024-09-17T01:41:22.192 INFO:tasks.workunit.client.1.smithi167.stdout:0/246: unlink d5/d8/d2e/l33 0 2024-09-17T01:41:22.193 INFO:tasks.workunit.client.1.smithi167.stdout:1/260: getdents d0/d5/d34 0 2024-09-17T01:41:22.193 INFO:tasks.workunit.client.1.smithi167.stdout:5/192: write d0/f1d [268659,18585] 0 2024-09-17T01:41:22.193 INFO:tasks.workunit.client.1.smithi167.stdout:7/273: mkdir d0/d55 0 2024-09-17T01:41:22.193 INFO:tasks.workunit.client.1.smithi167.stdout:6/340: dwrite d7/d11/d13/f17 [0,4194304] 0 2024-09-17T01:41:22.195 INFO:tasks.workunit.client.1.smithi167.stdout:3/271: unlink d7/d8/l30 0 2024-09-17T01:41:22.195 INFO:tasks.workunit.client.1.smithi167.stdout:9/285: unlink d4/d9/l12 0 2024-09-17T01:41:22.196 INFO:tasks.workunit.client.1.smithi167.stdout:4/307: mkdir d0/d4/d7/d6/d2b/d6d 0 2024-09-17T01:41:22.198 INFO:tasks.workunit.client.1.smithi167.stdout:0/247: symlink d5/d8/d9/d2f/l53 0 2024-09-17T01:41:22.199 INFO:tasks.workunit.client.1.smithi167.stdout:7/274: symlink d0/d2/d14/d23/l56 0 2024-09-17T01:41:22.202 INFO:tasks.workunit.client.1.smithi167.stdout:6/341: mknod d7/d11/d13/d2f/d64/d6b/c7c 0 2024-09-17T01:41:22.203 INFO:tasks.workunit.client.1.smithi167.stdout:5/193: truncate d0/d9/fb 5161926 0 2024-09-17T01:41:22.203 INFO:tasks.workunit.client.1.smithi167.stdout:1/261: dread d0/d5/d34/d3c/f42 [0,4194304] 0 2024-09-17T01:41:22.204 INFO:tasks.workunit.client.1.smithi167.stdout:0/248: creat d5/d8/d2e/f54 x:0 0 0 2024-09-17T01:41:22.205 INFO:tasks.workunit.client.1.smithi167.stdout:5/194: write d0/f19 [4873737,111968] 0 2024-09-17T01:41:22.206 INFO:tasks.workunit.client.1.smithi167.stdout:7/275: mknod d0/c57 0 2024-09-17T01:41:22.208 INFO:tasks.workunit.client.1.smithi167.stdout:0/249: readlink d5/d8/l23 0 2024-09-17T01:41:22.209 INFO:tasks.workunit.client.1.smithi167.stdout:9/286: getdents d4/d9/d21/d2d 0 2024-09-17T01:41:22.209 INFO:tasks.workunit.client.1.smithi167.stdout:7/276: dread - d0/d2/f41 zero size 2024-09-17T01:41:22.211 INFO:tasks.workunit.client.1.smithi167.stdout:1/262: rename d0/d5/d34/f30 to d0/d5/d34/f49 0 2024-09-17T01:41:22.211 INFO:tasks.workunit.client.1.smithi167.stdout:4/308: dwrite d0/d4/d7/d6/f66 [0,4194304] 0 2024-09-17T01:41:22.212 INFO:tasks.workunit.client.1.smithi167.stdout:8/400: truncate dc/d18/f2d 1731205 0 2024-09-17T01:41:22.213 INFO:tasks.workunit.client.1.smithi167.stdout:0/250: chown d5/d8/d9/d2f/l51 0 1 2024-09-17T01:41:22.214 INFO:tasks.workunit.client.1.smithi167.stdout:9/287: symlink d4/d4a/l53 0 2024-09-17T01:41:22.215 INFO:tasks.workunit.client.1.smithi167.stdout:4/309: write d0/f64 [21601,37658] 0 2024-09-17T01:41:22.217 INFO:tasks.workunit.client.1.smithi167.stdout:1/263: creat d0/d9/d16/d36/f4a x:0 0 0 2024-09-17T01:41:22.220 INFO:tasks.workunit.client.1.smithi167.stdout:2/303: dwrite d5/d10/d1a/d2e/f59 [0,4194304] 0 2024-09-17T01:41:22.220 INFO:tasks.workunit.client.1.smithi167.stdout:1/264: stat d0/d5/d34/l3d 0 2024-09-17T01:41:22.222 INFO:tasks.workunit.client.1.smithi167.stdout:1/265: chown d0/l3a 493233 1 2024-09-17T01:41:22.222 INFO:tasks.workunit.client.1.smithi167.stdout:7/277: rename d0/f1 to d0/d2/d14/d23/f58 0 2024-09-17T01:41:22.224 INFO:tasks.workunit.client.1.smithi167.stdout:9/288: symlink d4/d9/l54 0 2024-09-17T01:41:22.225 INFO:tasks.workunit.client.1.smithi167.stdout:0/251: rename d5/l4a to d5/l55 0 2024-09-17T01:41:22.225 INFO:tasks.workunit.client.1.smithi167.stdout:8/401: dwrite dc/f2f [0,4194304] 0 2024-09-17T01:41:22.226 INFO:tasks.workunit.client.1.smithi167.stdout:7/278: fsync d0/d2/d14/d19/d26/f35 0 2024-09-17T01:41:22.229 INFO:tasks.workunit.client.1.smithi167.stdout:1/266: truncate d0/d9/d16/d36/f3e 289190 0 2024-09-17T01:41:22.235 INFO:tasks.workunit.client.1.smithi167.stdout:2/304: mkdir d5/d10/d1a/d45/d6b 0 2024-09-17T01:41:22.235 INFO:tasks.workunit.client.1.smithi167.stdout:4/310: creat d0/d4/d7/da/f6e x:0 0 0 2024-09-17T01:41:22.236 INFO:tasks.workunit.client.1.smithi167.stdout:9/289: rename d4/d9/f2a to d4/d4a/f55 0 2024-09-17T01:41:22.239 INFO:tasks.workunit.client.1.smithi167.stdout:7/279: dwrite d0/d2/f21 [0,4194304] 0 2024-09-17T01:41:22.240 INFO:tasks.workunit.client.1.smithi167.stdout:9/290: read d4/d9/d21/d2d/d33/d3a/f40 [2607437,7433] 0 2024-09-17T01:41:22.240 INFO:tasks.workunit.client.1.smithi167.stdout:2/305: fdatasync d5/d10/d16/f2d 0 2024-09-17T01:41:22.240 INFO:tasks.workunit.client.1.smithi167.stdout:6/342: dread d7/f21 [0,4194304] 0 2024-09-17T01:41:22.245 INFO:tasks.workunit.client.1.smithi167.stdout:7/280: chown d0/d2/d14/d19/d26/c36 16576592 1 2024-09-17T01:41:22.246 INFO:tasks.workunit.client.1.smithi167.stdout:6/343: stat d7/d11/d13/c70 0 2024-09-17T01:41:22.246 INFO:tasks.workunit.client.1.smithi167.stdout:2/306: stat d5/d10/d1a/d45/c47 0 2024-09-17T01:41:22.247 INFO:tasks.workunit.client.1.smithi167.stdout:9/291: truncate d4/d9/f1d 4949075 0 2024-09-17T01:41:22.250 INFO:tasks.workunit.client.1.smithi167.stdout:4/311: dwrite d0/f64 [0,4194304] 0 2024-09-17T01:41:22.251 INFO:tasks.workunit.client.1.smithi167.stdout:7/281: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:22.373 INFO:tasks.workunit.client.1.smithi167.stdout:8/402: rename dc/d18/c6a to dc/d21/d6b/d74/d83/c8d 0 2024-09-17T01:41:22.374 INFO:tasks.workunit.client.1.smithi167.stdout:9/292: mknod d4/d9/c56 0 2024-09-17T01:41:22.375 INFO:tasks.workunit.client.1.smithi167.stdout:2/307: symlink d5/d10/d16/l6c 0 2024-09-17T01:41:22.376 INFO:tasks.workunit.client.1.smithi167.stdout:4/312: mkdir d0/d4/d7/da/d48/d40/d57/d5a/d6f 0 2024-09-17T01:41:22.377 INFO:tasks.workunit.client.1.smithi167.stdout:9/293: dread d4/d4a/f55 [0,4194304] 0 2024-09-17T01:41:22.378 INFO:tasks.workunit.client.1.smithi167.stdout:7/282: creat d0/d2/d14/d19/d26/f59 x:0 0 0 2024-09-17T01:41:22.378 INFO:tasks.workunit.client.1.smithi167.stdout:7/283: dread - d0/f4f zero size 2024-09-17T01:41:22.379 INFO:tasks.workunit.client.1.smithi167.stdout:7/284: readlink d0/d2/l48 0 2024-09-17T01:41:22.379 INFO:tasks.workunit.client.1.smithi167.stdout:0/252: write d5/d8/d2e/d37/d45/f4b [452817,73825] 0 2024-09-17T01:41:22.379 INFO:tasks.workunit.client.1.smithi167.stdout:7/285: fdatasync d0/d2/f41 0 2024-09-17T01:41:22.381 INFO:tasks.workunit.client.1.smithi167.stdout:6/344: rename d7/d11/f10 to d7/d52/d79/f7d 0 2024-09-17T01:41:22.381 INFO:tasks.workunit.client.1.smithi167.stdout:1/267: write d0/f17 [1812379,30299] 0 2024-09-17T01:41:22.387 INFO:tasks.workunit.client.1.smithi167.stdout:5/195: sync 2024-09-17T01:41:22.387 INFO:tasks.workunit.client.1.smithi167.stdout:3/272: sync 2024-09-17T01:41:22.387 INFO:tasks.workunit.client.1.smithi167.stdout:8/403: symlink dc/d56/d57/l8e 0 2024-09-17T01:41:22.388 INFO:tasks.workunit.client.1.smithi167.stdout:2/308: mkdir d5/d6d 0 2024-09-17T01:41:22.389 INFO:tasks.workunit.client.1.smithi167.stdout:0/253: unlink d5/d8/d2e/d4d/l13 0 2024-09-17T01:41:22.390 INFO:tasks.workunit.client.1.smithi167.stdout:9/294: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:41:22.393 INFO:tasks.workunit.client.1.smithi167.stdout:1/268: rename d0 to d0/d4b 22 2024-09-17T01:41:22.394 INFO:tasks.workunit.client.1.smithi167.stdout:2/309: chown d5/d10/d1a/f37 6425 1 2024-09-17T01:41:22.394 INFO:tasks.workunit.client.1.smithi167.stdout:3/273: write d7/d8/d2a/f22 [1775020,118484] 0 2024-09-17T01:41:22.394 INFO:tasks.workunit.client.1.smithi167.stdout:5/196: creat d0/d28/f37 x:0 0 0 2024-09-17T01:41:22.395 INFO:tasks.workunit.client.1.smithi167.stdout:6/345: mkdir d7/d11/d13/d2f/d64/d7e 0 2024-09-17T01:41:22.395 INFO:tasks.workunit.client.1.smithi167.stdout:8/404: rmdir dc/d21/d6b/d74 39 2024-09-17T01:41:22.395 INFO:tasks.workunit.client.1.smithi167.stdout:0/254: rmdir d5/d8/d2e 39 2024-09-17T01:41:22.397 INFO:tasks.workunit.client.1.smithi167.stdout:6/346: fsync d7/f29 0 2024-09-17T01:41:22.397 INFO:tasks.workunit.client.1.smithi167.stdout:2/310: unlink d5/d3c/c3e 0 2024-09-17T01:41:22.398 INFO:tasks.workunit.client.1.smithi167.stdout:5/197: write d0/d28/f2a [967240,38653] 0 2024-09-17T01:41:22.398 INFO:tasks.workunit.client.1.smithi167.stdout:1/269: chown d0/d9/d16/c38 122263332 1 2024-09-17T01:41:22.401 INFO:tasks.workunit.client.1.smithi167.stdout:2/311: stat d5/d10/f22 0 2024-09-17T01:41:22.401 INFO:tasks.workunit.client.1.smithi167.stdout:7/286: dwrite d0/d2/d14/d19/f53 [0,4194304] 0 2024-09-17T01:41:22.405 INFO:tasks.workunit.client.1.smithi167.stdout:2/312: fsync d5/d10/d16/f1b 0 2024-09-17T01:41:22.406 INFO:tasks.workunit.client.1.smithi167.stdout:9/295: write d4/d9/d21/d2d/d33/d3a/f40 [2249107,79189] 0 2024-09-17T01:41:22.411 INFO:tasks.workunit.client.1.smithi167.stdout:5/198: creat d0/d24/f38 x:0 0 0 2024-09-17T01:41:22.411 INFO:tasks.workunit.client.1.smithi167.stdout:3/274: mknod d7/d8/d10/c50 0 2024-09-17T01:41:22.411 INFO:tasks.workunit.client.1.smithi167.stdout:7/287: mknod d0/d2/d14/d19/d26/c5a 0 2024-09-17T01:41:22.412 INFO:tasks.workunit.client.1.smithi167.stdout:0/255: mkdir d5/d8/d2e/d4d/d56 0 2024-09-17T01:41:22.412 INFO:tasks.workunit.client.1.smithi167.stdout:5/199: write d0/f19 [5426155,111192] 0 2024-09-17T01:41:22.415 INFO:tasks.workunit.client.1.smithi167.stdout:2/313: symlink d5/d10/d1a/d39/l6e 0 2024-09-17T01:41:22.416 INFO:tasks.workunit.client.1.smithi167.stdout:3/275: write d7/d1e/f4f [847358,40709] 0 2024-09-17T01:41:22.416 INFO:tasks.workunit.client.1.smithi167.stdout:1/270: getdents d0/d9/d16/d22 0 2024-09-17T01:41:22.417 INFO:tasks.workunit.client.1.smithi167.stdout:9/296: mknod d4/d9/c57 0 2024-09-17T01:41:22.419 INFO:tasks.workunit.client.1.smithi167.stdout:6/347: dwrite d7/d11/d13/f3f [0,4194304] 0 2024-09-17T01:41:22.420 INFO:tasks.workunit.client.1.smithi167.stdout:7/288: mkdir d0/d55/d5b 0 2024-09-17T01:41:22.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/405: getdents dc/d21/d6b/d74/d83 0 2024-09-17T01:41:22.421 INFO:tasks.workunit.client.1.smithi167.stdout:5/200: creat d0/d24/d2b/f39 x:0 0 0 2024-09-17T01:41:22.422 INFO:tasks.workunit.client.1.smithi167.stdout:2/314: creat d5/d10/d1a/d45/d6b/f6f x:0 0 0 2024-09-17T01:41:22.424 INFO:tasks.workunit.client.1.smithi167.stdout:8/406: chown dc/f7a 61 1 2024-09-17T01:41:22.426 INFO:tasks.workunit.client.1.smithi167.stdout:7/289: rename d0/d2/c3b to d0/d2/d14/d19/d26/c5c 0 2024-09-17T01:41:22.429 INFO:tasks.workunit.client.1.smithi167.stdout:6/348: mkdir d7/d11/d13/d2f/d7f 0 2024-09-17T01:41:22.429 INFO:tasks.workunit.client.1.smithi167.stdout:0/256: dread d5/d8/d2e/d4d/f40 [0,4194304] 0 2024-09-17T01:41:22.430 INFO:tasks.workunit.client.1.smithi167.stdout:2/315: rmdir d5/d3c/d4c/d4d 39 2024-09-17T01:41:22.431 INFO:tasks.workunit.client.1.smithi167.stdout:0/257: write d5/d8/d2e/f54 [223626,53684] 0 2024-09-17T01:41:22.432 INFO:tasks.workunit.client.1.smithi167.stdout:0/258: fdatasync d5/f1d 0 2024-09-17T01:41:22.434 INFO:tasks.workunit.client.1.smithi167.stdout:7/290: creat d0/d2/d14/d19/d26/d34/f5d x:0 0 0 2024-09-17T01:41:22.435 INFO:tasks.workunit.client.1.smithi167.stdout:7/291: dread - d0/d2/d14/d19/f2f zero size 2024-09-17T01:41:22.437 INFO:tasks.workunit.client.1.smithi167.stdout:2/316: read d5/d10/d1a/f31 [3080768,45638] 0 2024-09-17T01:41:22.439 INFO:tasks.workunit.client.1.smithi167.stdout:9/297: truncate d4/d9/f25 1431533 0 2024-09-17T01:41:22.440 INFO:tasks.workunit.client.1.smithi167.stdout:3/276: unlink d7/d8/d10/f13 0 2024-09-17T01:41:22.441 INFO:tasks.workunit.client.1.smithi167.stdout:6/349: unlink d7/d11/lc 0 2024-09-17T01:41:22.442 INFO:tasks.workunit.client.1.smithi167.stdout:1/271: truncate d0/d5/d34/d3c/f41 1899912 0 2024-09-17T01:41:22.442 INFO:tasks.workunit.client.1.smithi167.stdout:5/201: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:22.443 INFO:tasks.workunit.client.1.smithi167.stdout:2/317: mknod d5/d10/d16/c70 0 2024-09-17T01:41:22.444 INFO:tasks.workunit.client.1.smithi167.stdout:0/259: unlink d5/d8/l32 0 2024-09-17T01:41:22.445 INFO:tasks.workunit.client.1.smithi167.stdout:2/318: truncate d5/d10/d1a/f5c 839635 0 2024-09-17T01:41:22.445 INFO:tasks.workunit.client.1.smithi167.stdout:6/350: chown d7/d12/d27/c3d 7417 1 2024-09-17T01:41:22.447 INFO:tasks.workunit.client.1.smithi167.stdout:1/272: mkdir d0/d5/d34/d4c 0 2024-09-17T01:41:22.447 INFO:tasks.workunit.client.1.smithi167.stdout:5/202: mkdir d0/d28/d3a 0 2024-09-17T01:41:22.450 INFO:tasks.workunit.client.1.smithi167.stdout:2/319: mkdir d5/d71 0 2024-09-17T01:41:22.452 INFO:tasks.workunit.client.1.smithi167.stdout:5/203: rmdir d0/d9/d32 39 2024-09-17T01:41:22.452 INFO:tasks.workunit.client.1.smithi167.stdout:3/277: rename d7/c12 to d7/c51 0 2024-09-17T01:41:22.452 INFO:tasks.workunit.client.1.smithi167.stdout:6/351: rename d7/d11/d13/c70 to d7/d52/c80 0 2024-09-17T01:41:22.454 INFO:tasks.workunit.client.1.smithi167.stdout:9/298: getdents d4/d4a 0 2024-09-17T01:41:22.456 INFO:tasks.workunit.client.1.smithi167.stdout:2/320: mkdir d5/d33/d48/d72 0 2024-09-17T01:41:22.457 INFO:tasks.workunit.client.1.smithi167.stdout:7/292: dread d0/d2/f17 [0,4194304] 0 2024-09-17T01:41:22.460 INFO:tasks.workunit.client.0.smithi082.stdout:8/84: sync 2024-09-17T01:41:22.460 INFO:tasks.workunit.client.0.smithi082.stdout:3/51: sync 2024-09-17T01:41:22.460 INFO:tasks.workunit.client.0.smithi082.stdout:7/116: sync 2024-09-17T01:41:22.461 INFO:tasks.workunit.client.0.smithi082.stdout:4/102: sync 2024-09-17T01:41:22.461 INFO:tasks.workunit.client.1.smithi167.stdout:9/299: symlink d4/d9/d21/d43/l58 0 2024-09-17T01:41:22.461 INFO:tasks.workunit.client.1.smithi167.stdout:0/260: dread d5/d8/d9/d2f/f3b [0,4194304] 0 2024-09-17T01:41:22.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/117: dread - d0/d3/db/d10/f19 zero size 2024-09-17T01:41:22.462 INFO:tasks.workunit.client.1.smithi167.stdout:1/273: dwrite d0/f46 [0,4194304] 0 2024-09-17T01:41:22.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/118: dread - d0/dd/f17 zero size 2024-09-17T01:41:22.464 INFO:tasks.workunit.client.1.smithi167.stdout:3/278: rename d7/d1e/l4b to d7/l52 0 2024-09-17T01:41:22.465 INFO:tasks.workunit.client.1.smithi167.stdout:0/261: fsync d5/d8/d9/f3f 0 2024-09-17T01:41:22.465 INFO:tasks.workunit.client.1.smithi167.stdout:5/204: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:22.467 INFO:tasks.workunit.client.1.smithi167.stdout:7/293: write d0/d2/d14/d19/d22/f2a [2129094,17311] 0 2024-09-17T01:41:22.467 INFO:tasks.workunit.client.0.smithi082.stdout:8/85: mknod d3/dd/c1a 0 2024-09-17T01:41:22.468 INFO:tasks.workunit.client.0.smithi082.stdout:8/86: stat d3/dd/l17 0 2024-09-17T01:41:22.469 INFO:tasks.workunit.client.1.smithi167.stdout:0/262: readlink d5/d8/d2e/d4d/l12 0 2024-09-17T01:41:22.473 INFO:tasks.workunit.client.1.smithi167.stdout:6/352: dwrite d7/d11/d13/d2f/d30/d32/f47 [0,4194304] 0 2024-09-17T01:41:22.474 INFO:tasks.workunit.client.1.smithi167.stdout:7/294: write d0/d2/d14/d23/f39 [662765,75571] 0 2024-09-17T01:41:22.475 INFO:tasks.workunit.client.0.smithi082.stdout:7/119: creat d0/d3/db/d10/f22 x:0 0 0 2024-09-17T01:41:22.477 INFO:tasks.workunit.client.0.smithi082.stdout:7/120: write d0/d3/db/d10/f19 [954892,89563] 0 2024-09-17T01:41:22.478 INFO:tasks.workunit.client.1.smithi167.stdout:9/300: dwrite d4/f16 [0,4194304] 0 2024-09-17T01:41:22.479 INFO:tasks.workunit.client.1.smithi167.stdout:5/205: mkdir d0/d9/d32/d3b 0 2024-09-17T01:41:22.481 INFO:tasks.workunit.client.1.smithi167.stdout:5/206: write d0/d24/f35 [868813,130458] 0 2024-09-17T01:41:22.482 INFO:tasks.workunit.client.0.smithi082.stdout:8/87: rename d3/dd/f15 to d3/dd/f1b 0 2024-09-17T01:41:22.483 INFO:tasks.workunit.client.1.smithi167.stdout:5/207: write d0/d24/f38 [99975,121895] 0 2024-09-17T01:41:22.483 INFO:tasks.workunit.client.0.smithi082.stdout:8/88: write d3/f16 [458279,24131] 0 2024-09-17T01:41:22.484 INFO:tasks.workunit.client.0.smithi082.stdout:8/89: rename d3 to d3/dd/d18/d1c 22 2024-09-17T01:41:22.485 INFO:tasks.workunit.client.0.smithi082.stdout:8/90: chown d3/f16 303 1 2024-09-17T01:41:22.487 INFO:tasks.workunit.client.0.smithi082.stdout:9/84: sync 2024-09-17T01:41:22.487 INFO:tasks.workunit.client.0.smithi082.stdout:0/90: sync 2024-09-17T01:41:22.487 INFO:tasks.workunit.client.0.smithi082.stdout:5/74: sync 2024-09-17T01:41:22.487 INFO:tasks.workunit.client.0.smithi082.stdout:2/95: sync 2024-09-17T01:41:22.488 INFO:tasks.workunit.client.1.smithi167.stdout:5/208: dread d0/d9/d1c/f23 [4194304,4194304] 0 2024-09-17T01:41:22.488 INFO:tasks.workunit.client.0.smithi082.stdout:5/75: readlink l5 0 2024-09-17T01:41:22.488 INFO:tasks.workunit.client.0.smithi082.stdout:2/96: rename d1 to d1/d1c 22 2024-09-17T01:41:22.489 INFO:tasks.workunit.client.1.smithi167.stdout:0/263: mknod d5/d8/d2e/d37/c57 0 2024-09-17T01:41:22.493 INFO:tasks.workunit.client.1.smithi167.stdout:1/274: fdatasync d0/d9/f37 0 2024-09-17T01:41:22.495 INFO:tasks.workunit.client.0.smithi082.stdout:8/91: mknod d3/dd/c1d 0 2024-09-17T01:41:22.496 INFO:tasks.workunit.client.1.smithi167.stdout:6/353: readlink d7/d12/d27/l33 0 2024-09-17T01:41:22.496 INFO:tasks.workunit.client.0.smithi082.stdout:2/97: rmdir d1/d10 39 2024-09-17T01:41:22.497 INFO:tasks.workunit.client.1.smithi167.stdout:7/295: creat d0/d2/d14/d19/d22/f5e x:0 0 0 2024-09-17T01:41:22.498 INFO:tasks.workunit.client.1.smithi167.stdout:7/296: readlink d0/d2/l48 0 2024-09-17T01:41:22.499 INFO:tasks.workunit.client.1.smithi167.stdout:7/297: write d0/d2/d14/d19/d26/f35 [347252,88625] 0 2024-09-17T01:41:22.499 INFO:tasks.workunit.client.0.smithi082.stdout:3/52: getdents d9 0 2024-09-17T01:41:22.500 INFO:tasks.workunit.client.0.smithi082.stdout:9/85: rmdir d4/da 39 2024-09-17T01:41:22.501 INFO:tasks.workunit.client.0.smithi082.stdout:9/86: fsync d4/f17 0 2024-09-17T01:41:22.503 INFO:tasks.workunit.client.0.smithi082.stdout:5/76: rename db/f11 to db/d12/d18/f1d 0 2024-09-17T01:41:22.504 INFO:tasks.workunit.client.1.smithi167.stdout:5/209: symlink d0/d28/l3c 0 2024-09-17T01:41:22.504 INFO:tasks.workunit.client.1.smithi167.stdout:5/210: chown d0/f20 21919 1 2024-09-17T01:41:22.505 INFO:tasks.workunit.client.1.smithi167.stdout:5/211: chown d0/d28/f37 155046456 1 2024-09-17T01:41:22.505 INFO:tasks.workunit.client.0.smithi082.stdout:4/103: truncate d9/d15/f19 1951174 0 2024-09-17T01:41:22.507 INFO:tasks.workunit.client.0.smithi082.stdout:8/92: creat d3/dd/d18/f1e x:0 0 0 2024-09-17T01:41:22.508 INFO:tasks.workunit.client.0.smithi082.stdout:4/104: dread f7 [0,4194304] 0 2024-09-17T01:41:22.511 INFO:tasks.workunit.client.1.smithi167.stdout:1/275: creat d0/d9/d16/d22/f4d x:0 0 0 2024-09-17T01:41:22.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/105: dread f7 [0,4194304] 0 2024-09-17T01:41:22.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/106: stat d9/lf 0 2024-09-17T01:41:22.513 INFO:tasks.workunit.client.0.smithi082.stdout:3/53: unlink d9/f10 0 2024-09-17T01:41:22.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/321: getdents d5/d33/d48 0 2024-09-17T01:41:22.515 INFO:tasks.workunit.client.1.smithi167.stdout:6/354: stat d7/d52/c80 0 2024-09-17T01:41:22.516 INFO:tasks.workunit.client.1.smithi167.stdout:1/276: dwrite d0/f46 [0,4194304] 0 2024-09-17T01:41:22.517 INFO:tasks.workunit.client.0.smithi082.stdout:5/77: mkdir db/d1e 0 2024-09-17T01:41:22.519 INFO:tasks.workunit.client.0.smithi082.stdout:0/91: dwrite da/fc [0,4194304] 0 2024-09-17T01:41:22.520 INFO:tasks.workunit.client.0.smithi082.stdout:5/78: truncate db/f19 693829 0 2024-09-17T01:41:22.520 INFO:tasks.workunit.client.1.smithi167.stdout:6/355: dread d7/d11/d13/f49 [0,4194304] 0 2024-09-17T01:41:22.521 INFO:tasks.workunit.client.1.smithi167.stdout:5/212: truncate d0/f22 880049 0 2024-09-17T01:41:22.521 INFO:tasks.workunit.client.0.smithi082.stdout:0/92: chown da/d16/l1a 723356276 1 2024-09-17T01:41:22.521 INFO:tasks.workunit.client.1.smithi167.stdout:6/356: stat d7/d52 0 2024-09-17T01:41:22.524 INFO:tasks.workunit.client.0.smithi082.stdout:8/93: write d3/f7 [104679,42202] 0 2024-09-17T01:41:22.526 INFO:tasks.workunit.client.0.smithi082.stdout:2/98: symlink d1/l1d 0 2024-09-17T01:41:22.527 INFO:tasks.workunit.client.0.smithi082.stdout:9/87: mknod d4/da/c1f 0 2024-09-17T01:41:22.529 INFO:tasks.workunit.client.1.smithi167.stdout:3/279: getdents d7/d8/d10 0 2024-09-17T01:41:22.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/121: link d0/d3/db/f14 d0/f23 0 2024-09-17T01:41:22.530 INFO:tasks.workunit.client.1.smithi167.stdout:3/280: write d7/d1e/f3c [617324,1363] 0 2024-09-17T01:41:22.530 INFO:tasks.workunit.client.0.smithi082.stdout:7/122: chown d0/d3/f15 3 1 2024-09-17T01:41:22.531 INFO:tasks.workunit.client.1.smithi167.stdout:1/277: creat d0/d5/d34/d3c/f4e x:0 0 0 2024-09-17T01:41:22.531 INFO:tasks.workunit.client.1.smithi167.stdout:4/313: sync 2024-09-17T01:41:22.533 INFO:tasks.workunit.client.0.smithi082.stdout:7/123: write d0/d3/db/f1b [1631496,42333] 0 2024-09-17T01:41:22.534 INFO:tasks.workunit.client.0.smithi082.stdout:9/88: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T01:41:22.535 INFO:tasks.workunit.client.1.smithi167.stdout:5/213: write d0/d9/f2d [4686406,108768] 0 2024-09-17T01:41:22.535 INFO:tasks.workunit.client.0.smithi082.stdout:9/89: chown d4/f1a 364955 1 2024-09-17T01:41:22.535 INFO:tasks.workunit.client.1.smithi167.stdout:6/357: symlink d7/d12/l81 0 2024-09-17T01:41:22.536 INFO:tasks.workunit.client.1.smithi167.stdout:6/358: readlink d7/d12/d27/l33 0 2024-09-17T01:41:22.538 INFO:tasks.workunit.client.1.smithi167.stdout:6/359: fsync d7/d11/d13/f55 0 2024-09-17T01:41:22.539 INFO:tasks.workunit.client.1.smithi167.stdout:9/301: getdents d4 0 2024-09-17T01:41:22.540 INFO:tasks.workunit.client.0.smithi082.stdout:5/79: mknod db/d1e/c1f 0 2024-09-17T01:41:22.542 INFO:tasks.workunit.client.1.smithi167.stdout:3/281: creat d7/d8/d10/d14/f53 x:0 0 0 2024-09-17T01:41:22.542 INFO:tasks.workunit.client.0.smithi082.stdout:9/90: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T01:41:22.545 INFO:tasks.workunit.client.0.smithi082.stdout:0/93: mkdir da/d1c 0 2024-09-17T01:41:22.546 INFO:tasks.workunit.client.0.smithi082.stdout:5/80: dread f3 [0,4194304] 0 2024-09-17T01:41:22.552 INFO:tasks.workunit.client.1.smithi167.stdout:0/264: getdents d5/d8 0 2024-09-17T01:41:22.556 INFO:tasks.workunit.client.1.smithi167.stdout:5/214: dwrite d0/d9/ff [0,4194304] 0 2024-09-17T01:41:22.557 INFO:tasks.workunit.client.1.smithi167.stdout:5/215: write d0/f1d [892337,77996] 0 2024-09-17T01:41:22.558 INFO:tasks.workunit.client.1.smithi167.stdout:6/360: creat d7/d11/d13/d2f/d64/d6b/f82 x:0 0 0 2024-09-17T01:41:22.561 INFO:tasks.workunit.client.1.smithi167.stdout:1/278: symlink d0/d5/d34/d4c/l4f 0 2024-09-17T01:41:22.563 INFO:tasks.workunit.client.0.smithi082.stdout:5/81: mkdir db/d1e/d20 0 2024-09-17T01:41:22.564 INFO:tasks.workunit.client.0.smithi082.stdout:9/91: dwrite d4/da/f1b [0,4194304] 0 2024-09-17T01:41:22.564 INFO:tasks.workunit.client.0.smithi082.stdout:5/82: chown db/f17 309 1 2024-09-17T01:41:22.565 INFO:tasks.workunit.client.0.smithi082.stdout:8/94: creat d3/f1f x:0 0 0 2024-09-17T01:41:22.566 INFO:tasks.workunit.client.0.smithi082.stdout:0/94: dread f4 [0,4194304] 0 2024-09-17T01:41:22.567 INFO:tasks.workunit.client.0.smithi082.stdout:9/92: dread d4/f8 [0,4194304] 0 2024-09-17T01:41:22.568 INFO:tasks.workunit.client.1.smithi167.stdout:7/298: truncate d0/d2/f21 2953528 0 2024-09-17T01:41:22.569 INFO:tasks.workunit.client.1.smithi167.stdout:0/265: mkdir d5/d8/d2e/d4d/d58 0 2024-09-17T01:41:22.570 INFO:tasks.workunit.client.0.smithi082.stdout:5/83: dread f6 [0,4194304] 0 2024-09-17T01:41:22.571 INFO:tasks.workunit.client.1.smithi167.stdout:2/322: getdents d5/d10/d1a/d45 0 2024-09-17T01:41:22.572 INFO:tasks.workunit.client.0.smithi082.stdout:4/107: write d9/fd [793653,41338] 0 2024-09-17T01:41:22.572 INFO:tasks.workunit.client.0.smithi082.stdout:5/84: write f9 [3989062,99125] 0 2024-09-17T01:41:22.574 INFO:tasks.workunit.client.1.smithi167.stdout:0/266: dread d5/d8/d9/d2f/f3b [0,4194304] 0 2024-09-17T01:41:22.574 INFO:tasks.workunit.client.0.smithi082.stdout:5/85: fdatasync db/f10 0 2024-09-17T01:41:22.575 INFO:tasks.workunit.client.1.smithi167.stdout:0/267: chown d5/d8/d9/l27 447378 1 2024-09-17T01:41:22.575 INFO:tasks.workunit.client.0.smithi082.stdout:4/108: truncate d9/fd 908259 0 2024-09-17T01:41:22.576 INFO:tasks.workunit.client.0.smithi082.stdout:5/86: read - db/d12/f15 zero size 2024-09-17T01:41:22.576 INFO:tasks.workunit.client.0.smithi082.stdout:5/87: stat db/d1e/c1f 0 2024-09-17T01:41:22.580 INFO:tasks.workunit.client.1.smithi167.stdout:0/268: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:22.580 INFO:tasks.workunit.client.0.smithi082.stdout:2/99: rename d1/c15 to d1/c1e 0 2024-09-17T01:41:22.580 INFO:tasks.workunit.client.0.smithi082.stdout:7/124: write d0/d3/db/f14 [1087667,120152] 0 2024-09-17T01:41:22.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/125: write d0/d3/f4 [1375018,37321] 0 2024-09-17T01:41:22.586 INFO:tasks.workunit.client.1.smithi167.stdout:2/323: creat d5/d10/d16/f73 x:0 0 0 2024-09-17T01:41:22.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/109: dwrite d9/fa [0,4194304] 0 2024-09-17T01:41:22.590 INFO:tasks.workunit.client.0.smithi082.stdout:5/88: dwrite f9 [0,4194304] 0 2024-09-17T01:41:22.591 INFO:tasks.workunit.client.1.smithi167.stdout:3/282: creat d7/f54 x:0 0 0 2024-09-17T01:41:22.592 INFO:tasks.workunit.client.1.smithi167.stdout:3/283: chown d7/d8 0 1 2024-09-17T01:41:22.595 INFO:tasks.workunit.client.1.smithi167.stdout:4/314: getdents d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31 0 2024-09-17T01:41:22.598 INFO:tasks.workunit.client.0.smithi082.stdout:9/93: dwrite d4/da/f1b [4194304,4194304] 0 2024-09-17T01:41:22.600 INFO:tasks.workunit.client.1.smithi167.stdout:2/324: creat d5/d10/d1a/d45/d3f/f74 x:0 0 0 2024-09-17T01:41:22.602 INFO:tasks.workunit.client.1.smithi167.stdout:6/361: creat d7/d11/d13/d2f/f83 x:0 0 0 2024-09-17T01:41:22.603 INFO:tasks.workunit.client.1.smithi167.stdout:2/325: chown d5/d10/d1a/d45/d6b 17245 1 2024-09-17T01:41:22.604 INFO:tasks.workunit.client.1.smithi167.stdout:7/299: dwrite d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:22.605 INFO:tasks.workunit.client.1.smithi167.stdout:2/326: fdatasync d5/d10/f42 0 2024-09-17T01:41:22.606 INFO:tasks.workunit.client.0.smithi082.stdout:2/100: write d1/d10/f12 [855420,50599] 0 2024-09-17T01:41:22.606 INFO:tasks.workunit.client.0.smithi082.stdout:0/95: mkdir da/d1c/d1d 0 2024-09-17T01:41:22.607 INFO:tasks.workunit.client.0.smithi082.stdout:0/96: write da/f14 [733032,62872] 0 2024-09-17T01:41:22.610 INFO:tasks.workunit.client.0.smithi082.stdout:0/97: dread f8 [0,4194304] 0 2024-09-17T01:41:22.614 INFO:tasks.workunit.client.0.smithi082.stdout:7/126: symlink d0/l24 0 2024-09-17T01:41:22.614 INFO:tasks.workunit.client.1.smithi167.stdout:6/362: rmdir d7/d11/d13/d60 39 2024-09-17T01:41:22.615 INFO:tasks.workunit.client.0.smithi082.stdout:0/98: dread da/f14 [0,4194304] 0 2024-09-17T01:41:22.615 INFO:tasks.workunit.client.0.smithi082.stdout:7/127: chown d0/d3/db/cc 75212970 1 2024-09-17T01:41:22.621 INFO:tasks.workunit.client.1.smithi167.stdout:0/269: truncate d5/d8/d9/f35 1221641 0 2024-09-17T01:41:22.622 INFO:tasks.workunit.client.1.smithi167.stdout:4/315: mkdir d0/d4/d7/d10/d70 0 2024-09-17T01:41:22.623 INFO:tasks.workunit.client.1.smithi167.stdout:3/284: dwrite d7/d8/d10/d14/d2c/f2f [0,4194304] 0 2024-09-17T01:41:22.624 INFO:tasks.workunit.client.1.smithi167.stdout:3/285: chown l2 23744872 1 2024-09-17T01:41:22.625 INFO:tasks.workunit.client.1.smithi167.stdout:8/407: sync 2024-09-17T01:41:22.625 INFO:tasks.workunit.client.0.smithi082.stdout:9/94: truncate d4/f8 1748881 0 2024-09-17T01:41:22.628 INFO:tasks.workunit.client.1.smithi167.stdout:2/327: creat d5/d3c/d4c/d4d/f75 x:0 0 0 2024-09-17T01:41:22.630 INFO:tasks.workunit.client.0.smithi082.stdout:9/95: dread d4/da/f1b [4194304,4194304] 0 2024-09-17T01:41:22.632 INFO:tasks.workunit.client.0.smithi082.stdout:8/95: truncate d3/f10 756705 0 2024-09-17T01:41:22.633 INFO:tasks.workunit.client.0.smithi082.stdout:8/96: truncate d3/dd/d18/f1e 291897 0 2024-09-17T01:41:22.634 INFO:tasks.workunit.client.0.smithi082.stdout:8/97: chown d3/dd/ff 242173 1 2024-09-17T01:41:22.635 INFO:tasks.workunit.client.0.smithi082.stdout:8/98: write d3/f16 [331550,29677] 0 2024-09-17T01:41:22.636 INFO:tasks.workunit.client.0.smithi082.stdout:8/99: truncate d3/f1f 148405 0 2024-09-17T01:41:22.636 INFO:tasks.workunit.client.1.smithi167.stdout:4/316: chown d0/d4/d7/da/c36 127 1 2024-09-17T01:41:22.639 INFO:tasks.workunit.client.1.smithi167.stdout:3/286: unlink l2 0 2024-09-17T01:41:22.640 INFO:tasks.workunit.client.1.smithi167.stdout:3/287: write d7/d1e/f3c [1248758,10875] 0 2024-09-17T01:41:22.641 INFO:tasks.workunit.client.0.smithi082.stdout:8/100: dread d3/f16 [0,4194304] 0 2024-09-17T01:41:22.643 INFO:tasks.workunit.client.1.smithi167.stdout:4/317: dwrite d0/d4/d7/da/f30 [0,4194304] 0 2024-09-17T01:41:22.643 INFO:tasks.workunit.client.1.smithi167.stdout:4/318: fdatasync d0/f13 0 2024-09-17T01:41:22.643 INFO:tasks.workunit.client.0.smithi082.stdout:5/89: truncate db/f16 4083803 0 2024-09-17T01:41:22.644 INFO:tasks.workunit.client.1.smithi167.stdout:8/408: mkdir dc/d56/d59/d82/d8f 0 2024-09-17T01:41:22.646 INFO:tasks.workunit.client.1.smithi167.stdout:0/270: creat d5/d8/d2e/d4d/d56/f59 x:0 0 0 2024-09-17T01:41:22.647 INFO:tasks.workunit.client.0.smithi082.stdout:9/96: chown d4/da/fb 516038 1 2024-09-17T01:41:22.649 INFO:tasks.workunit.client.1.smithi167.stdout:6/363: rmdir d7/d11/d13/d2f/d64/d7e 0 2024-09-17T01:41:22.652 INFO:tasks.workunit.client.1.smithi167.stdout:4/319: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/f34 [0,4194304] 0 2024-09-17T01:41:22.652 INFO:tasks.workunit.client.1.smithi167.stdout:3/288: mknod d7/d8/d10/c55 0 2024-09-17T01:41:22.653 INFO:tasks.workunit.client.0.smithi082.stdout:0/99: mkdir da/d1e 0 2024-09-17T01:41:22.653 INFO:tasks.workunit.client.1.smithi167.stdout:7/300: getdents d0/d2/d14/d4c 0 2024-09-17T01:41:22.654 INFO:tasks.workunit.client.0.smithi082.stdout:9/97: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:41:22.657 INFO:tasks.workunit.client.1.smithi167.stdout:0/271: rename d5/d8/d9/f36 to d5/d8/d2e/d4d/f5a 0 2024-09-17T01:41:22.659 INFO:tasks.workunit.client.1.smithi167.stdout:0/272: write d5/d8/d2e/d4d/f2b [48998,87798] 0 2024-09-17T01:41:22.659 INFO:tasks.workunit.client.1.smithi167.stdout:4/320: mknod d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/c71 0 2024-09-17T01:41:22.660 INFO:tasks.workunit.client.1.smithi167.stdout:0/273: fdatasync d5/d8/f46 0 2024-09-17T01:41:22.660 INFO:tasks.workunit.client.1.smithi167.stdout:4/321: stat d0/d4/d7/f67 0 2024-09-17T01:41:22.661 INFO:tasks.workunit.client.0.smithi082.stdout:2/101: creat d1/f1f x:0 0 0 2024-09-17T01:41:22.662 INFO:tasks.workunit.client.1.smithi167.stdout:8/409: mkdir dc/d56/d59/d82/d8f/d90 0 2024-09-17T01:41:22.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/110: getdents d9 0 2024-09-17T01:41:22.665 INFO:tasks.workunit.client.1.smithi167.stdout:6/364: mknod d7/d11/d13/c84 0 2024-09-17T01:41:22.669 INFO:tasks.workunit.client.0.smithi082.stdout:9/98: mkdir d4/da/d11/d20 0 2024-09-17T01:41:22.669 INFO:tasks.workunit.client.1.smithi167.stdout:0/274: readlink d5/d8/d2e/d37/l3e 0 2024-09-17T01:41:22.669 INFO:tasks.workunit.client.1.smithi167.stdout:8/410: chown dc/d18/f46 25829472 1 2024-09-17T01:41:22.671 INFO:tasks.workunit.client.0.smithi082.stdout:2/102: dwrite d1/f16 [0,4194304] 0 2024-09-17T01:41:22.672 INFO:tasks.workunit.client.0.smithi082.stdout:2/103: fdatasync d1/d10/f19 0 2024-09-17T01:41:22.672 INFO:tasks.workunit.client.0.smithi082.stdout:5/90: getdents db/d1e/d20 0 2024-09-17T01:41:22.674 INFO:tasks.workunit.client.1.smithi167.stdout:7/301: rename d0/d2/d14/d19/f53 to d0/f5f 0 2024-09-17T01:41:22.679 INFO:tasks.workunit.client.1.smithi167.stdout:8/411: dread dc/d18/f3b [0,4194304] 0 2024-09-17T01:41:22.681 INFO:tasks.workunit.client.1.smithi167.stdout:6/365: rename d7/d52/d79/f7d to d7/d12/f85 0 2024-09-17T01:41:22.682 INFO:tasks.workunit.client.1.smithi167.stdout:6/366: chown f0 966911748 1 2024-09-17T01:41:22.684 INFO:tasks.workunit.client.0.smithi082.stdout:8/101: creat d3/f20 x:0 0 0 2024-09-17T01:41:22.684 INFO:tasks.workunit.client.0.smithi082.stdout:6/164: sync 2024-09-17T01:41:22.685 INFO:tasks.workunit.client.0.smithi082.stdout:1/100: sync 2024-09-17T01:41:22.685 INFO:tasks.workunit.client.1.smithi167.stdout:7/302: write d0/d2/f17 [3368310,29689] 0 2024-09-17T01:41:22.685 INFO:tasks.workunit.client.0.smithi082.stdout:8/102: chown d3/f1f 12029149 1 2024-09-17T01:41:22.686 INFO:tasks.workunit.client.0.smithi082.stdout:6/165: dread - d1/d7/d10/f38 zero size 2024-09-17T01:41:22.686 INFO:tasks.workunit.client.0.smithi082.stdout:6/166: write d1/d1f/f21 [4087483,23955] 0 2024-09-17T01:41:22.687 INFO:tasks.workunit.client.1.smithi167.stdout:7/303: truncate d0/d2/d14/f1b 4774226 0 2024-09-17T01:41:22.687 INFO:tasks.workunit.client.0.smithi082.stdout:7/128: link d0/d3/db/d10/c11 d0/dd/c25 0 2024-09-17T01:41:22.689 INFO:tasks.workunit.client.0.smithi082.stdout:7/129: read d0/d3/db/f14 [2937944,108733] 0 2024-09-17T01:41:22.691 INFO:tasks.workunit.client.0.smithi082.stdout:6/167: dread d1/d7/f2e [0,4194304] 0 2024-09-17T01:41:22.692 INFO:tasks.workunit.client.0.smithi082.stdout:7/130: truncate d0/dd/f1d 839050 0 2024-09-17T01:41:22.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/99: dwrite d4/f10 [0,4194304] 0 2024-09-17T01:41:22.693 INFO:tasks.workunit.client.1.smithi167.stdout:6/367: unlink d7/d11/d13/d2f/d30/d32/f41 0 2024-09-17T01:41:22.694 INFO:tasks.workunit.client.1.smithi167.stdout:4/322: dread d0/d4/d7/d6/f60 [0,4194304] 0 2024-09-17T01:41:22.695 INFO:tasks.workunit.client.0.smithi082.stdout:0/100: rename da/c11 to da/c1f 0 2024-09-17T01:41:22.698 INFO:tasks.workunit.client.0.smithi082.stdout:1/101: chown d2/dd/c22 4722 1 2024-09-17T01:41:22.699 INFO:tasks.workunit.client.0.smithi082.stdout:1/102: write d2/dd/f13 [613193,10696] 0 2024-09-17T01:41:22.699 INFO:tasks.workunit.client.1.smithi167.stdout:8/412: creat dc/d56/d57/d7e/f91 x:0 0 0 2024-09-17T01:41:22.700 INFO:tasks.workunit.client.0.smithi082.stdout:8/103: rmdir d3 39 2024-09-17T01:41:22.702 INFO:tasks.workunit.client.1.smithi167.stdout:8/413: read dc/d1a/f30 [527535,63672] 0 2024-09-17T01:41:22.708 INFO:tasks.workunit.client.1.smithi167.stdout:7/304: dread d0/d2/d14/d19/f1e [0,4194304] 0 2024-09-17T01:41:22.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:22 smithi082 ceph-mon[28077]: pgmap v14: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s rd, 75 MiB/s wr, 322 op/s 2024-09-17T01:41:22.730 INFO:tasks.workunit.client.0.smithi082.stdout:6/168: fdatasync d1/d1f/f26 0 2024-09-17T01:41:22.733 INFO:tasks.workunit.client.0.smithi082.stdout:7/131: symlink d0/dd/l26 0 2024-09-17T01:41:22.735 INFO:tasks.workunit.client.0.smithi082.stdout:4/111: dwrite f7 [0,4194304] 0 2024-09-17T01:41:22.736 INFO:tasks.workunit.client.1.smithi167.stdout:7/305: dread d0/d2/d14/d19/d22/f25 [0,4194304] 0 2024-09-17T01:41:22.742 INFO:tasks.workunit.client.1.smithi167.stdout:7/306: dwrite d0/d2/d14/d19/d26/d34/f5d [0,4194304] 0 2024-09-17T01:41:22.742 INFO:tasks.workunit.client.0.smithi082.stdout:0/101: truncate f0 874961 0 2024-09-17T01:41:22.743 INFO:tasks.workunit.client.0.smithi082.stdout:0/102: chown da/d16 674 1 2024-09-17T01:41:22.747 INFO:tasks.workunit.client.1.smithi167.stdout:6/368: link d7/d11/f5b d7/d11/d13/d2f/d7f/f86 0 2024-09-17T01:41:22.748 INFO:tasks.workunit.client.1.smithi167.stdout:6/369: write d7/d42/f71 [188051,42962] 0 2024-09-17T01:41:22.750 INFO:tasks.workunit.client.1.smithi167.stdout:4/323: mknod d0/d4/d7/da/d48/d40/d57/d5a/d6f/c72 0 2024-09-17T01:41:22.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:22 smithi167 ceph-mon[35643]: pgmap v14: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s rd, 75 MiB/s wr, 322 op/s 2024-09-17T01:41:22.754 INFO:tasks.workunit.client.1.smithi167.stdout:9/302: sync 2024-09-17T01:41:22.756 INFO:tasks.workunit.client.1.smithi167.stdout:9/303: read d4/d9/d21/d2d/d33/d3a/f40 [3567836,32299] 0 2024-09-17T01:41:22.758 INFO:tasks.workunit.client.0.smithi082.stdout:2/104: link d1/ca d1/d10/c20 0 2024-09-17T01:41:22.760 INFO:tasks.workunit.client.0.smithi082.stdout:6/169: symlink d1/d1f/l3c 0 2024-09-17T01:41:22.761 INFO:tasks.workunit.client.0.smithi082.stdout:6/170: write d1/d7/d8/f3a [759417,89093] 0 2024-09-17T01:41:22.768 INFO:tasks.workunit.client.0.smithi082.stdout:9/100: mkdir d4/da/d11/d20/d21 0 2024-09-17T01:41:22.770 INFO:tasks.workunit.client.0.smithi082.stdout:7/132: dwrite d0/f23 [0,4194304] 0 2024-09-17T01:41:22.774 INFO:tasks.workunit.client.0.smithi082.stdout:1/103: truncate d2/df/f17 83486 0 2024-09-17T01:41:22.775 INFO:tasks.workunit.client.0.smithi082.stdout:1/104: chown c1 1206 1 2024-09-17T01:41:22.777 INFO:tasks.workunit.client.1.smithi167.stdout:9/304: unlink d4/d9/d21/f26 0 2024-09-17T01:41:22.778 INFO:tasks.workunit.client.1.smithi167.stdout:9/305: readlink d4/d9/d21/d2d/l44 0 2024-09-17T01:41:22.778 INFO:tasks.workunit.client.1.smithi167.stdout:9/306: readlink d4/d9/d2b/l39 0 2024-09-17T01:41:22.779 INFO:tasks.workunit.client.0.smithi082.stdout:8/104: unlink d3/f13 0 2024-09-17T01:41:22.780 INFO:tasks.workunit.client.0.smithi082.stdout:8/105: chown d3/dd/c1d 13 1 2024-09-17T01:41:22.782 INFO:tasks.workunit.client.0.smithi082.stdout:2/105: creat d1/d17/f21 x:0 0 0 2024-09-17T01:41:22.783 INFO:tasks.workunit.client.1.smithi167.stdout:7/307: link d0/d2/d14/d19/d22/f2a d0/d55/d5b/f60 0 2024-09-17T01:41:22.784 INFO:tasks.workunit.client.1.smithi167.stdout:7/308: chown d0/d55 34258 1 2024-09-17T01:41:22.785 INFO:tasks.workunit.client.0.smithi082.stdout:4/112: rename d9/d15/f19 to d9/d15/d16/d18/f21 0 2024-09-17T01:41:22.785 INFO:tasks.workunit.client.1.smithi167.stdout:9/307: dwrite d4/d9/d21/d43/f45 [0,4194304] 0 2024-09-17T01:41:22.785 INFO:tasks.workunit.client.1.smithi167.stdout:4/324: mknod d0/d4/d7/d10/d70/c73 0 2024-09-17T01:41:22.787 INFO:tasks.workunit.client.0.smithi082.stdout:9/101: rmdir d4/da/d11/d20 39 2024-09-17T01:41:22.789 INFO:tasks.workunit.client.0.smithi082.stdout:2/106: dwrite d1/f1b [0,4194304] 0 2024-09-17T01:41:22.790 INFO:tasks.workunit.client.0.smithi082.stdout:7/133: creat d0/d3/db/d10/f27 x:0 0 0 2024-09-17T01:41:22.790 INFO:tasks.workunit.client.0.smithi082.stdout:2/107: dread - d1/d10/f14 zero size 2024-09-17T01:41:22.791 INFO:tasks.workunit.client.0.smithi082.stdout:2/108: stat d1/d1a 0 2024-09-17T01:41:22.795 INFO:tasks.workunit.client.1.smithi167.stdout:8/414: getdents dc 0 2024-09-17T01:41:22.797 INFO:tasks.workunit.client.0.smithi082.stdout:8/106: mknod d3/dd/d18/c21 0 2024-09-17T01:41:22.799 INFO:tasks.workunit.client.1.smithi167.stdout:9/308: mknod d4/d9/d21/d43/c59 0 2024-09-17T01:41:22.802 INFO:tasks.workunit.client.1.smithi167.stdout:4/325: mkdir d0/d4/d7/da/d48/d40/d51/d2d/d74 0 2024-09-17T01:41:22.803 INFO:tasks.workunit.client.1.smithi167.stdout:8/415: dwrite dc/d21/d61/f88 [0,4194304] 0 2024-09-17T01:41:22.804 INFO:tasks.workunit.client.0.smithi082.stdout:6/171: rename d1/d7/d8/f3a to d1/d3/f3d 0 2024-09-17T01:41:22.805 INFO:tasks.workunit.client.1.smithi167.stdout:4/326: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d 136 1 2024-09-17T01:41:22.805 INFO:tasks.workunit.client.1.smithi167.stdout:4/327: readlink d0/l1a 0 2024-09-17T01:41:22.805 INFO:tasks.workunit.client.1.smithi167.stdout:4/328: chown d0/l1a 466667849 1 2024-09-17T01:41:22.806 INFO:tasks.workunit.client.1.smithi167.stdout:4/329: write d0/d4/d7/da/f30 [3595662,106425] 0 2024-09-17T01:41:22.807 INFO:tasks.workunit.client.0.smithi082.stdout:4/113: unlink d9/d15/d16/d18/c1f 0 2024-09-17T01:41:22.813 INFO:tasks.workunit.client.0.smithi082.stdout:9/102: unlink d4/da/f1b 0 2024-09-17T01:41:22.813 INFO:tasks.workunit.client.0.smithi082.stdout:9/103: fdatasync d4/f17 0 2024-09-17T01:41:22.815 INFO:tasks.workunit.client.1.smithi167.stdout:9/309: creat d4/d9/d21/d2d/f5a x:0 0 0 2024-09-17T01:41:22.816 INFO:tasks.workunit.client.0.smithi082.stdout:7/134: mknod d0/d3/c28 0 2024-09-17T01:41:22.820 INFO:tasks.workunit.client.0.smithi082.stdout:2/109: unlink d1/d10/c11 0 2024-09-17T01:41:22.820 INFO:tasks.workunit.client.0.smithi082.stdout:2/110: dread - d1/d10/f19 zero size 2024-09-17T01:41:22.821 INFO:tasks.workunit.client.0.smithi082.stdout:2/111: fdatasync d1/d10/f14 0 2024-09-17T01:41:22.822 INFO:tasks.workunit.client.0.smithi082.stdout:1/105: creat d2/dd/d1e/f23 x:0 0 0 2024-09-17T01:41:22.822 INFO:tasks.workunit.client.0.smithi082.stdout:1/106: read - d2/da/f1f zero size 2024-09-17T01:41:22.824 INFO:tasks.workunit.client.1.smithi167.stdout:8/416: dwrite dc/d1a/f30 [4194304,4194304] 0 2024-09-17T01:41:22.829 INFO:tasks.workunit.client.0.smithi082.stdout:6/172: rmdir d1/d7/d8/dc 39 2024-09-17T01:41:22.830 INFO:tasks.workunit.client.0.smithi082.stdout:6/173: read - d1/d7/d23/f2a zero size 2024-09-17T01:41:22.830 INFO:tasks.workunit.client.1.smithi167.stdout:3/289: truncate d7/d8/d10/d14/d2c/f2f 527009 0 2024-09-17T01:41:22.831 INFO:tasks.workunit.client.1.smithi167.stdout:8/417: dwrite dc/d21/d6b/f6c [0,4194304] 0 2024-09-17T01:41:22.832 INFO:tasks.workunit.client.1.smithi167.stdout:7/309: getdents d0 0 2024-09-17T01:41:22.835 INFO:tasks.workunit.client.1.smithi167.stdout:4/330: dread d0/f52 [0,4194304] 0 2024-09-17T01:41:22.836 INFO:tasks.workunit.client.1.smithi167.stdout:5/216: sync 2024-09-17T01:41:22.836 INFO:tasks.workunit.client.1.smithi167.stdout:2/328: sync 2024-09-17T01:41:22.836 INFO:tasks.workunit.client.1.smithi167.stdout:1/279: sync 2024-09-17T01:41:22.836 INFO:tasks.workunit.client.1.smithi167.stdout:5/217: chown d0 2066 1 2024-09-17T01:41:22.838 INFO:tasks.workunit.client.0.smithi082.stdout:9/104: mknod d4/da/c22 0 2024-09-17T01:41:22.843 INFO:tasks.workunit.client.1.smithi167.stdout:8/418: fdatasync dc/d56/d59/d65/f69 0 2024-09-17T01:41:22.845 INFO:tasks.workunit.client.1.smithi167.stdout:3/290: symlink d7/d8/d10/d14/d24/l56 0 2024-09-17T01:41:22.847 INFO:tasks.workunit.client.0.smithi082.stdout:6/174: write d1/d7/d8/dc/f29 [4066250,109644] 0 2024-09-17T01:41:22.848 INFO:tasks.workunit.client.0.smithi082.stdout:6/175: chown d1/d7/d8 6 1 2024-09-17T01:41:22.849 INFO:tasks.workunit.client.1.smithi167.stdout:8/419: dwrite dc/d21/f25 [0,4194304] 0 2024-09-17T01:41:22.850 INFO:tasks.workunit.client.1.smithi167.stdout:8/420: fdatasync dc/d56/d57/d5c/f89 0 2024-09-17T01:41:22.851 INFO:tasks.workunit.client.0.smithi082.stdout:9/105: truncate d4/da/fb 374188 0 2024-09-17T01:41:22.851 INFO:tasks.workunit.client.1.smithi167.stdout:4/331: unlink d0/d4/d7/da/d48/d40/d57/d5a/d6f/c72 0 2024-09-17T01:41:22.853 INFO:tasks.workunit.client.1.smithi167.stdout:2/329: rename d5/d10/c15 to d5/d10/d1a/d45/d3f/c76 0 2024-09-17T01:41:22.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/112: symlink d1/l22 0 2024-09-17T01:41:22.855 INFO:tasks.workunit.client.1.smithi167.stdout:2/330: dread - d5/d10/f42 zero size 2024-09-17T01:41:22.857 INFO:tasks.workunit.client.0.smithi082.stdout:0/103: dwrite da/f14 [0,4194304] 0 2024-09-17T01:41:22.858 INFO:tasks.workunit.client.1.smithi167.stdout:3/291: write d7/f3e [1684865,78903] 0 2024-09-17T01:41:22.859 INFO:tasks.workunit.client.1.smithi167.stdout:8/421: dwrite dc/d1a/f52 [4194304,4194304] 0 2024-09-17T01:41:22.860 INFO:tasks.workunit.client.1.smithi167.stdout:8/422: chown dc/d21/f47 124428 1 2024-09-17T01:41:22.862 INFO:tasks.workunit.client.0.smithi082.stdout:0/104: dread da/fb [0,4194304] 0 2024-09-17T01:41:22.862 INFO:tasks.workunit.client.1.smithi167.stdout:7/310: dread d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:22.866 INFO:tasks.workunit.client.0.smithi082.stdout:9/106: unlink d4/da/ce 0 2024-09-17T01:41:22.868 INFO:tasks.workunit.client.1.smithi167.stdout:9/310: getdents d4/d9 0 2024-09-17T01:41:22.870 INFO:tasks.workunit.client.1.smithi167.stdout:9/311: fsync d4/d9/d21/d2d/d33/d3a/f4d 0 2024-09-17T01:41:22.870 INFO:tasks.workunit.client.1.smithi167.stdout:7/311: dwrite d0/d2/d14/d19/d22/f5e [0,4194304] 0 2024-09-17T01:41:22.871 INFO:tasks.workunit.client.1.smithi167.stdout:4/332: mkdir d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d75 0 2024-09-17T01:41:22.872 INFO:tasks.workunit.client.1.smithi167.stdout:4/333: write d0/f13 [579354,98777] 0 2024-09-17T01:41:22.872 INFO:tasks.workunit.client.1.smithi167.stdout:5/218: rename d0/d9/d32 to d0/d24/d2b/d3d 0 2024-09-17T01:41:22.873 INFO:tasks.workunit.client.1.smithi167.stdout:5/219: write d0/d28/f2a [1803286,37915] 0 2024-09-17T01:41:22.874 INFO:tasks.workunit.client.1.smithi167.stdout:2/331: mknod d5/d10/d1a/d39/d5e/c77 0 2024-09-17T01:41:22.877 INFO:tasks.workunit.client.1.smithi167.stdout:3/292: creat d7/d8/d10/d14/f57 x:0 0 0 2024-09-17T01:41:22.878 INFO:tasks.workunit.client.1.smithi167.stdout:6/370: sync 2024-09-17T01:41:22.878 INFO:tasks.workunit.client.1.smithi167.stdout:0/275: sync 2024-09-17T01:41:22.881 INFO:tasks.workunit.client.0.smithi082.stdout:6/176: mkdir d1/d7/d8/dc/d1d/d36/d3e 0 2024-09-17T01:41:22.881 INFO:tasks.workunit.client.1.smithi167.stdout:5/220: dwrite d0/d24/f38 [0,4194304] 0 2024-09-17T01:41:22.882 INFO:tasks.workunit.client.0.smithi082.stdout:9/107: rename d4 to d4/d23 22 2024-09-17T01:41:22.882 INFO:tasks.workunit.client.0.smithi082.stdout:9/108: stat d4/c1e 0 2024-09-17T01:41:22.883 INFO:tasks.workunit.client.1.smithi167.stdout:9/312: creat d4/f5b x:0 0 0 2024-09-17T01:41:22.883 INFO:tasks.workunit.client.1.smithi167.stdout:5/221: write d0/d9/ff [4986018,3514] 0 2024-09-17T01:41:22.884 INFO:tasks.workunit.client.0.smithi082.stdout:1/107: getdents d2/dd 0 2024-09-17T01:41:22.886 INFO:tasks.workunit.client.0.smithi082.stdout:2/113: mknod d1/d1a/c23 0 2024-09-17T01:41:22.887 INFO:tasks.workunit.client.1.smithi167.stdout:1/280: dread d0/d5/d34/f14 [4194304,4194304] 0 2024-09-17T01:41:22.893 INFO:tasks.workunit.client.1.smithi167.stdout:1/281: dwrite d0/d5/d34/f14 [4194304,4194304] 0 2024-09-17T01:41:22.894 INFO:tasks.workunit.client.1.smithi167.stdout:2/332: symlink d5/d10/d1a/d45/d6b/l78 0 2024-09-17T01:41:22.894 INFO:tasks.workunit.client.0.smithi082.stdout:1/108: dwrite d2/dd/f13 [0,4194304] 0 2024-09-17T01:41:22.901 INFO:tasks.workunit.client.1.smithi167.stdout:3/293: creat d7/d8/d2a/d4e/f58 x:0 0 0 2024-09-17T01:41:22.904 INFO:tasks.workunit.client.1.smithi167.stdout:8/423: dread fb [0,4194304] 0 2024-09-17T01:41:22.904 INFO:tasks.workunit.client.0.smithi082.stdout:2/114: chown d1/d10/c20 92035124 1 2024-09-17T01:41:22.905 INFO:tasks.workunit.client.0.smithi082.stdout:2/115: dread - d1/d10/f19 zero size 2024-09-17T01:41:22.906 INFO:tasks.workunit.client.0.smithi082.stdout:2/116: dread - d1/d17/f21 zero size 2024-09-17T01:41:22.907 INFO:tasks.workunit.client.1.smithi167.stdout:5/222: readlink d0/d9/l1f 0 2024-09-17T01:41:22.908 INFO:tasks.workunit.client.0.smithi082.stdout:1/109: rename d2/dd/d1e to d2/dd/d24 0 2024-09-17T01:41:22.909 INFO:tasks.workunit.client.1.smithi167.stdout:9/313: symlink d4/d9/d21/d43/d47/l5c 0 2024-09-17T01:41:22.911 INFO:tasks.workunit.client.1.smithi167.stdout:4/334: mknod d0/d4/d7/da/d48/d40/d57/d6a/c76 0 2024-09-17T01:41:22.913 INFO:tasks.workunit.client.1.smithi167.stdout:7/312: link d0/f13 d0/f61 0 2024-09-17T01:41:22.915 INFO:tasks.workunit.client.0.smithi082.stdout:4/114: write d9/fc [890720,85088] 0 2024-09-17T01:41:22.917 INFO:tasks.workunit.client.0.smithi082.stdout:2/117: chown d1/c2 2016333 1 2024-09-17T01:41:22.918 INFO:tasks.workunit.client.1.smithi167.stdout:1/282: mknod d0/d9/c50 0 2024-09-17T01:41:22.918 INFO:tasks.workunit.client.0.smithi082.stdout:1/110: rmdir d2/da 39 2024-09-17T01:41:22.919 INFO:tasks.workunit.client.1.smithi167.stdout:1/283: chown d0/d9/d16/d48 61 1 2024-09-17T01:41:22.919 INFO:tasks.workunit.client.1.smithi167.stdout:1/284: dread - d0/d5/d34/d3c/f4e zero size 2024-09-17T01:41:22.925 INFO:tasks.workunit.client.1.smithi167.stdout:6/371: link f0 d7/d12/d27/d3a/d61/f87 0 2024-09-17T01:41:22.925 INFO:tasks.workunit.client.1.smithi167.stdout:6/372: readlink d7/d11/d13/d2f/d30/l44 0 2024-09-17T01:41:22.926 INFO:tasks.workunit.client.1.smithi167.stdout:6/373: chown f6 30 1 2024-09-17T01:41:22.926 INFO:tasks.workunit.client.0.smithi082.stdout:8/107: dwrite d3/f9 [0,4194304] 0 2024-09-17T01:41:22.926 INFO:tasks.workunit.client.1.smithi167.stdout:6/374: read - d7/d11/d13/d2f/f83 zero size 2024-09-17T01:41:22.927 INFO:tasks.workunit.client.0.smithi082.stdout:4/115: creat d9/d15/f22 x:0 0 0 2024-09-17T01:41:22.928 INFO:tasks.workunit.client.0.smithi082.stdout:8/108: write d3/dd/d18/f1e [381350,37237] 0 2024-09-17T01:41:22.928 INFO:tasks.workunit.client.0.smithi082.stdout:4/116: fdatasync d9/d15/f22 0 2024-09-17T01:41:22.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/109: dread - d3/f14 zero size 2024-09-17T01:41:22.930 INFO:tasks.workunit.client.1.smithi167.stdout:8/424: unlink dc/d56/d57/d5c/f89 0 2024-09-17T01:41:22.930 INFO:tasks.workunit.client.1.smithi167.stdout:8/425: dread - dc/d56/d59/f77 zero size 2024-09-17T01:41:22.932 INFO:tasks.workunit.client.1.smithi167.stdout:5/223: chown d0/c17 1039665581 1 2024-09-17T01:41:22.933 INFO:tasks.workunit.client.1.smithi167.stdout:5/224: chown d0/l29 0 1 2024-09-17T01:41:22.933 INFO:tasks.workunit.client.0.smithi082.stdout:1/111: symlink d2/dd/d24/l25 0 2024-09-17T01:41:22.935 INFO:tasks.workunit.client.0.smithi082.stdout:6/177: link d1/d7/d8/fb d1/d7/d8/d32/f3f 0 2024-09-17T01:41:22.936 INFO:tasks.workunit.client.0.smithi082.stdout:6/178: truncate d1/d3/f3d 921399 0 2024-09-17T01:41:22.936 INFO:tasks.workunit.client.0.smithi082.stdout:6/179: chown d1/d7/d8/dc/d2b/f35 41 1 2024-09-17T01:41:22.937 INFO:tasks.workunit.client.1.smithi167.stdout:4/335: creat d0/d4/d7/f77 x:0 0 0 2024-09-17T01:41:22.939 INFO:tasks.workunit.client.1.smithi167.stdout:9/314: dwrite d4/d9/f1d [0,4194304] 0 2024-09-17T01:41:22.939 INFO:tasks.workunit.client.1.smithi167.stdout:9/315: readlink d4/d9/ld 0 2024-09-17T01:41:22.940 INFO:tasks.workunit.client.0.smithi082.stdout:6/180: dread d1/d7/d8/dc/f29 [0,4194304] 0 2024-09-17T01:41:22.946 INFO:tasks.workunit.client.0.smithi082.stdout:4/117: rename l0 to d9/l23 0 2024-09-17T01:41:22.948 INFO:tasks.workunit.client.0.smithi082.stdout:8/110: mknod d3/dd/c22 0 2024-09-17T01:41:22.950 INFO:tasks.workunit.client.0.smithi082.stdout:2/118: link d1/fe d1/d1a/f24 0 2024-09-17T01:41:22.950 INFO:tasks.workunit.client.0.smithi082.stdout:3/54: sync 2024-09-17T01:41:22.954 INFO:tasks.workunit.client.1.smithi167.stdout:1/285: mknod d0/d9/d16/d36/c51 0 2024-09-17T01:41:22.958 INFO:tasks.workunit.client.1.smithi167.stdout:3/294: fdatasync d7/d8/d2a/f2e 0 2024-09-17T01:41:22.959 INFO:tasks.workunit.client.1.smithi167.stdout:3/295: chown d7/d1e/f4f 3 1 2024-09-17T01:41:22.959 INFO:tasks.workunit.client.1.smithi167.stdout:4/336: dread d0/f2 [0,4194304] 0 2024-09-17T01:41:22.960 INFO:tasks.workunit.client.0.smithi082.stdout:8/111: creat d3/dd/f23 x:0 0 0 2024-09-17T01:41:22.961 INFO:tasks.workunit.client.0.smithi082.stdout:8/112: write d3/f20 [200214,113598] 0 2024-09-17T01:41:22.961 INFO:tasks.workunit.client.1.smithi167.stdout:6/375: mkdir d7/d11/d13/d2f/d30/d88 0 2024-09-17T01:41:22.962 INFO:tasks.workunit.client.0.smithi082.stdout:8/113: fsync d3/f9 0 2024-09-17T01:41:22.963 INFO:tasks.workunit.client.0.smithi082.stdout:2/119: rename d1/fe to d1/d1a/f25 0 2024-09-17T01:41:22.965 INFO:tasks.workunit.client.1.smithi167.stdout:3/296: dwrite d7/f54 [0,4194304] 0 2024-09-17T01:41:22.966 INFO:tasks.workunit.client.0.smithi082.stdout:3/55: symlink d9/db/l15 0 2024-09-17T01:41:22.968 INFO:tasks.workunit.client.0.smithi082.stdout:8/114: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:41:22.968 INFO:tasks.workunit.client.0.smithi082.stdout:1/112: link d2/dd/f13 d2/dd/f26 0 2024-09-17T01:41:22.970 INFO:tasks.workunit.client.1.smithi167.stdout:0/276: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:22.976 INFO:tasks.workunit.client.1.smithi167.stdout:9/316: rmdir d4/d9/d21/d2d 39 2024-09-17T01:41:22.977 INFO:tasks.workunit.client.0.smithi082.stdout:9/109: truncate d4/da/fb 6062 0 2024-09-17T01:41:22.977 INFO:tasks.workunit.client.1.smithi167.stdout:9/317: readlink d4/d9/l13 0 2024-09-17T01:41:22.978 INFO:tasks.workunit.client.0.smithi082.stdout:6/181: mknod d1/d7/d8/dc/d1d/d36/d3e/c40 0 2024-09-17T01:41:22.978 INFO:tasks.workunit.client.0.smithi082.stdout:8/115: dread d3/f9 [0,4194304] 0 2024-09-17T01:41:22.978 INFO:tasks.workunit.client.0.smithi082.stdout:9/110: readlink d4/lf 0 2024-09-17T01:41:22.979 INFO:tasks.workunit.client.1.smithi167.stdout:3/297: dread d7/d8/d10/d14/d25/f48 [0,4194304] 0 2024-09-17T01:41:22.980 INFO:tasks.workunit.client.0.smithi082.stdout:1/113: dwrite d2/dd/f14 [0,4194304] 0 2024-09-17T01:41:22.980 INFO:tasks.workunit.client.0.smithi082.stdout:0/105: truncate f0 1082090 0 2024-09-17T01:41:22.982 INFO:tasks.workunit.client.0.smithi082.stdout:0/106: write f8 [413022,106946] 0 2024-09-17T01:41:22.985 INFO:tasks.workunit.client.0.smithi082.stdout:2/120: creat d1/d10/f26 x:0 0 0 2024-09-17T01:41:22.986 INFO:tasks.workunit.client.0.smithi082.stdout:0/107: read f7 [188429,20328] 0 2024-09-17T01:41:22.988 INFO:tasks.workunit.client.0.smithi082.stdout:2/121: fdatasync d1/d10/f14 0 2024-09-17T01:41:22.989 INFO:tasks.workunit.client.0.smithi082.stdout:3/56: symlink d9/l16 0 2024-09-17T01:41:22.990 INFO:tasks.workunit.client.1.smithi167.stdout:6/376: creat d7/d12/d27/d3a/f89 x:0 0 0 2024-09-17T01:41:22.991 INFO:tasks.workunit.client.0.smithi082.stdout:6/182: dwrite d1/d7/d10/f16 [0,4194304] 0 2024-09-17T01:41:22.992 INFO:tasks.workunit.client.1.smithi167.stdout:6/377: write d7/d11/d13/d2f/d30/d32/f47 [230110,41333] 0 2024-09-17T01:41:22.993 INFO:tasks.workunit.client.0.smithi082.stdout:5/91: sync 2024-09-17T01:41:22.996 INFO:tasks.workunit.client.0.smithi082.stdout:7/135: sync 2024-09-17T01:41:22.996 INFO:tasks.workunit.client.0.smithi082.stdout:8/116: unlink d3/f16 0 2024-09-17T01:41:22.998 INFO:tasks.workunit.client.0.smithi082.stdout:8/117: readlink d3/dd/l17 0 2024-09-17T01:41:22.999 INFO:tasks.workunit.client.1.smithi167.stdout:5/225: creat d0/d24/d2b/d3d/d3b/f3e x:0 0 0 2024-09-17T01:41:23.000 INFO:tasks.workunit.client.1.smithi167.stdout:5/226: write d0/d9/f34 [3213841,39835] 0 2024-09-17T01:41:23.001 INFO:tasks.workunit.client.0.smithi082.stdout:1/114: mknod d2/dd/d24/c27 0 2024-09-17T01:41:23.002 INFO:tasks.workunit.client.0.smithi082.stdout:5/92: dread f9 [0,4194304] 0 2024-09-17T01:41:23.003 INFO:tasks.workunit.client.0.smithi082.stdout:0/108: mknod da/df/c20 0 2024-09-17T01:41:23.005 INFO:tasks.workunit.client.1.smithi167.stdout:9/318: stat d4/d9/d21/l4f 0 2024-09-17T01:41:23.005 INFO:tasks.workunit.client.0.smithi082.stdout:7/136: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:23.006 INFO:tasks.workunit.client.0.smithi082.stdout:2/122: symlink d1/d17/l27 0 2024-09-17T01:41:23.006 INFO:tasks.workunit.client.1.smithi167.stdout:2/333: getdents d5/d33 0 2024-09-17T01:41:23.007 INFO:tasks.workunit.client.1.smithi167.stdout:2/334: write d5/f2f [1171162,22990] 0 2024-09-17T01:41:23.007 INFO:tasks.workunit.client.0.smithi082.stdout:7/137: chown d0/dd/c20 991274840 1 2024-09-17T01:41:23.007 INFO:tasks.workunit.client.0.smithi082.stdout:2/123: chown d1/d10/c20 6247 1 2024-09-17T01:41:23.007 INFO:tasks.workunit.client.0.smithi082.stdout:1/115: dread f0 [0,4194304] 0 2024-09-17T01:41:23.008 INFO:tasks.workunit.client.0.smithi082.stdout:3/57: unlink d9/db/l15 0 2024-09-17T01:41:23.009 INFO:tasks.workunit.client.1.smithi167.stdout:3/298: creat d7/d8/d2a/d4e/f59 x:0 0 0 2024-09-17T01:41:23.009 INFO:tasks.workunit.client.1.smithi167.stdout:3/299: write d7/d1e/f3c [924675,29762] 0 2024-09-17T01:41:23.010 INFO:tasks.workunit.client.0.smithi082.stdout:7/138: dread - d0/dd/f17 zero size 2024-09-17T01:41:23.010 INFO:tasks.workunit.client.0.smithi082.stdout:1/116: chown d2/df/f1d 6508904 1 2024-09-17T01:41:23.010 INFO:tasks.workunit.client.0.smithi082.stdout:6/183: rmdir d1/d7/d8/dc/d1d/d36/d3e 39 2024-09-17T01:41:23.010 INFO:tasks.workunit.client.0.smithi082.stdout:7/139: chown d0/dd/f1f 164556691 1 2024-09-17T01:41:23.011 INFO:tasks.workunit.client.0.smithi082.stdout:3/58: truncate d9/db/f11 430570 0 2024-09-17T01:41:23.012 INFO:tasks.workunit.client.0.smithi082.stdout:3/59: chown f6 41833294 1 2024-09-17T01:41:23.013 INFO:tasks.workunit.client.1.smithi167.stdout:0/277: dread d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:23.015 INFO:tasks.workunit.client.1.smithi167.stdout:7/313: mkdir d0/d2/d14/d19/d32/d62 0 2024-09-17T01:41:23.016 INFO:tasks.workunit.client.0.smithi082.stdout:8/118: creat d3/dd/d18/f24 x:0 0 0 2024-09-17T01:41:23.023 INFO:tasks.workunit.client.0.smithi082.stdout:4/118: mknod d9/d15/d16/d18/c24 0 2024-09-17T01:41:23.027 INFO:tasks.workunit.client.0.smithi082.stdout:5/93: dwrite db/d12/d18/f1d [0,4194304] 0 2024-09-17T01:41:23.027 INFO:tasks.workunit.client.0.smithi082.stdout:5/94: fdatasync db/f10 0 2024-09-17T01:41:23.031 INFO:tasks.workunit.client.0.smithi082.stdout:7/140: rmdir d0/dd 39 2024-09-17T01:41:23.036 INFO:tasks.workunit.client.0.smithi082.stdout:3/60: creat d9/db/f17 x:0 0 0 2024-09-17T01:41:23.037 INFO:tasks.workunit.client.0.smithi082.stdout:9/111: getdents d4/da/d11/d20/d21 0 2024-09-17T01:41:23.040 INFO:tasks.workunit.client.1.smithi167.stdout:8/426: sync 2024-09-17T01:41:23.041 INFO:tasks.workunit.client.0.smithi082.stdout:4/119: truncate d9/fd 1042008 0 2024-09-17T01:41:23.041 INFO:tasks.workunit.client.1.smithi167.stdout:3/300: creat d7/d8/d10/d14/f5a x:0 0 0 2024-09-17T01:41:23.042 INFO:tasks.workunit.client.1.smithi167.stdout:0/278: dwrite d5/d8/d9/f2c [0,4194304] 0 2024-09-17T01:41:23.044 INFO:tasks.workunit.client.1.smithi167.stdout:5/227: creat d0/d28/d3a/f3f x:0 0 0 2024-09-17T01:41:23.045 INFO:tasks.workunit.client.1.smithi167.stdout:0/279: write d5/d8/f46 [4962456,31605] 0 2024-09-17T01:41:23.045 INFO:tasks.workunit.client.0.smithi082.stdout:5/95: symlink db/l21 0 2024-09-17T01:41:23.048 INFO:tasks.workunit.client.1.smithi167.stdout:9/319: mknod d4/d9/d21/d2d/d33/c5d 0 2024-09-17T01:41:23.049 INFO:tasks.workunit.client.1.smithi167.stdout:3/301: dread d7/d1e/f4f [0,4194304] 0 2024-09-17T01:41:23.050 INFO:tasks.workunit.client.1.smithi167.stdout:3/302: chown d7/d1e 33503 1 2024-09-17T01:41:23.050 INFO:tasks.workunit.client.1.smithi167.stdout:4/337: rename d0/d4/d7/da/c50 to d0/d4/d7/da/d48/d40/d57/d6a/c78 0 2024-09-17T01:41:23.051 INFO:tasks.workunit.client.1.smithi167.stdout:3/303: write d7/d8/d10/d14/f5a [1011728,121108] 0 2024-09-17T01:41:23.052 INFO:tasks.workunit.client.0.smithi082.stdout:7/141: creat d0/d3/db/f29 x:0 0 0 2024-09-17T01:41:23.052 INFO:tasks.workunit.client.1.smithi167.stdout:7/314: symlink d0/d2/d14/l63 0 2024-09-17T01:41:23.052 INFO:tasks.workunit.client.1.smithi167.stdout:4/338: read - d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 zero size 2024-09-17T01:41:23.054 INFO:tasks.workunit.client.1.smithi167.stdout:4/339: chown d0/d4/d7/da/d48/d40/d57/d6a 2991 1 2024-09-17T01:41:23.054 INFO:tasks.workunit.client.1.smithi167.stdout:6/378: creat d7/f8a x:0 0 0 2024-09-17T01:41:23.055 INFO:tasks.workunit.client.0.smithi082.stdout:2/124: write d1/d1a/f24 [4005293,106156] 0 2024-09-17T01:41:23.055 INFO:tasks.workunit.client.0.smithi082.stdout:1/117: write d2/f4 [3453608,25098] 0 2024-09-17T01:41:23.057 INFO:tasks.workunit.client.0.smithi082.stdout:7/142: chown d0/f23 1147809 1 2024-09-17T01:41:23.058 INFO:tasks.workunit.client.1.smithi167.stdout:5/228: fdatasync d0/d9/fb 0 2024-09-17T01:41:23.060 INFO:tasks.workunit.client.1.smithi167.stdout:0/280: symlink d5/d8/d2e/d4d/d56/l5b 0 2024-09-17T01:41:23.061 INFO:tasks.workunit.client.0.smithi082.stdout:5/96: dwrite db/f17 [0,4194304] 0 2024-09-17T01:41:23.061 INFO:tasks.workunit.client.0.smithi082.stdout:4/120: fsync d9/d15/d16/d18/f20 0 2024-09-17T01:41:23.062 INFO:tasks.workunit.client.1.smithi167.stdout:8/427: dread dc/f3c [0,4194304] 0 2024-09-17T01:41:23.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/109: dwrite da/fd [0,4194304] 0 2024-09-17T01:41:23.065 INFO:tasks.workunit.client.1.smithi167.stdout:3/304: symlink d7/d1e/l5b 0 2024-09-17T01:41:23.066 INFO:tasks.workunit.client.1.smithi167.stdout:3/305: chown d7/d8/d10/d14/d25/lf 507337 1 2024-09-17T01:41:23.067 INFO:tasks.workunit.client.1.smithi167.stdout:3/306: chown d7/d8/d10/d14/d24/l56 3 1 2024-09-17T01:41:23.074 INFO:tasks.workunit.client.1.smithi167.stdout:3/307: dwrite d7/d8/d2a/d4e/f59 [0,4194304] 0 2024-09-17T01:41:23.074 INFO:tasks.workunit.client.0.smithi082.stdout:6/184: dwrite d1/d7/d8/f12 [0,4194304] 0 2024-09-17T01:41:23.074 INFO:tasks.workunit.client.0.smithi082.stdout:8/119: link d3/dd/d18/f24 d3/f25 0 2024-09-17T01:41:23.075 INFO:tasks.workunit.client.0.smithi082.stdout:3/61: write f1 [4572300,126160] 0 2024-09-17T01:41:23.077 INFO:tasks.workunit.client.1.smithi167.stdout:6/379: unlink d7/f29 0 2024-09-17T01:41:23.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/97: dread f3 [0,4194304] 0 2024-09-17T01:41:23.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/125: dwrite d1/d17/f21 [0,4194304] 0 2024-09-17T01:41:23.080 INFO:tasks.workunit.client.1.smithi167.stdout:5/229: symlink d0/d24/d2b/d3d/l40 0 2024-09-17T01:41:23.082 INFO:tasks.workunit.client.1.smithi167.stdout:0/281: mkdir d5/d8/d5c 0 2024-09-17T01:41:23.082 INFO:tasks.workunit.client.1.smithi167.stdout:5/230: rename d0/d24/d2b/d3d/d3b to d0/d24/d2b/d3d/d3b/d41 22 2024-09-17T01:41:23.085 INFO:tasks.workunit.client.0.smithi082.stdout:2/126: dread - d1/d10/f19 zero size 2024-09-17T01:41:23.085 INFO:tasks.workunit.client.0.smithi082.stdout:3/62: dread d9/fe [0,4194304] 0 2024-09-17T01:41:23.087 INFO:tasks.workunit.client.1.smithi167.stdout:8/428: fdatasync dc/d56/d59/f77 0 2024-09-17T01:41:23.089 INFO:tasks.workunit.client.1.smithi167.stdout:7/315: truncate d0/d2/d14/d19/d22/f2a 2301640 0 2024-09-17T01:41:23.089 INFO:tasks.workunit.client.1.smithi167.stdout:8/429: fsync dc/d18/f2e 0 2024-09-17T01:41:23.090 INFO:tasks.workunit.client.1.smithi167.stdout:8/430: stat dc/d1a/c1f 0 2024-09-17T01:41:23.091 INFO:tasks.workunit.client.0.smithi082.stdout:3/63: write d9/db/f13 [347778,55398] 0 2024-09-17T01:41:23.092 INFO:tasks.workunit.client.0.smithi082.stdout:6/185: creat d1/d3/f41 x:0 0 0 2024-09-17T01:41:23.092 INFO:tasks.workunit.client.1.smithi167.stdout:8/431: write dc/d1a/f7d [306015,126350] 0 2024-09-17T01:41:23.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/120: dwrite d3/dd/ff [0,4194304] 0 2024-09-17T01:41:23.093 INFO:tasks.workunit.client.0.smithi082.stdout:9/112: link d4/c15 d4/da/d11/d20/c24 0 2024-09-17T01:41:23.095 INFO:tasks.workunit.client.1.smithi167.stdout:3/308: mknod d7/d8/d10/d14/c5c 0 2024-09-17T01:41:23.096 INFO:tasks.workunit.client.1.smithi167.stdout:8/432: read dc/d1a/f49 [658360,66841] 0 2024-09-17T01:41:23.097 INFO:tasks.workunit.client.0.smithi082.stdout:1/118: mknod d2/c28 0 2024-09-17T01:41:23.098 INFO:tasks.workunit.client.0.smithi082.stdout:2/127: dread d1/d1a/f25 [0,4194304] 0 2024-09-17T01:41:23.098 INFO:tasks.workunit.client.1.smithi167.stdout:6/380: symlink d7/d52/l8b 0 2024-09-17T01:41:23.101 INFO:tasks.workunit.client.0.smithi082.stdout:4/121: unlink d9/l13 0 2024-09-17T01:41:23.104 INFO:tasks.workunit.client.1.smithi167.stdout:9/320: truncate d4/d9/d21/f27 3936817 0 2024-09-17T01:41:23.105 INFO:tasks.workunit.client.1.smithi167.stdout:5/231: symlink d0/d28/d3a/l42 0 2024-09-17T01:41:23.106 INFO:tasks.workunit.client.0.smithi082.stdout:2/128: dwrite d1/d1a/f25 [0,4194304] 0 2024-09-17T01:41:23.115 INFO:tasks.workunit.client.1.smithi167.stdout:1/286: sync 2024-09-17T01:41:23.115 INFO:tasks.workunit.client.0.smithi082.stdout:6/186: chown d1/l2 115057 1 2024-09-17T01:41:23.116 INFO:tasks.workunit.client.1.smithi167.stdout:3/309: mknod d7/d8/d2a/c5d 0 2024-09-17T01:41:23.116 INFO:tasks.workunit.client.1.smithi167.stdout:3/310: dread - d7/d8/d10/d14/f53 zero size 2024-09-17T01:41:23.117 INFO:tasks.workunit.client.0.smithi082.stdout:8/121: creat d3/dd/f26 x:0 0 0 2024-09-17T01:41:23.118 INFO:tasks.workunit.client.1.smithi167.stdout:8/433: unlink dc/l39 0 2024-09-17T01:41:23.120 INFO:tasks.workunit.client.0.smithi082.stdout:3/64: rename f5 to d9/db/f18 0 2024-09-17T01:41:23.121 INFO:tasks.workunit.client.1.smithi167.stdout:6/381: chown d7/d11/d13/l3b 1828890793 1 2024-09-17T01:41:23.122 INFO:tasks.workunit.client.0.smithi082.stdout:9/113: mknod d4/da/d11/d20/c25 0 2024-09-17T01:41:23.123 INFO:tasks.workunit.client.1.smithi167.stdout:0/282: fsync d5/d8/f46 0 2024-09-17T01:41:23.123 INFO:tasks.workunit.client.0.smithi082.stdout:9/114: read - d4/da/f16 zero size 2024-09-17T01:41:23.123 INFO:tasks.workunit.client.1.smithi167.stdout:0/283: fdatasync d5/d8/f46 0 2024-09-17T01:41:23.125 INFO:tasks.workunit.client.1.smithi167.stdout:9/321: truncate d4/d9/f25 2071456 0 2024-09-17T01:41:23.127 INFO:tasks.workunit.client.1.smithi167.stdout:4/340: getdents d0/d4/d7/da/d48 0 2024-09-17T01:41:23.128 INFO:tasks.workunit.client.0.smithi082.stdout:0/110: dwrite da/fe [0,4194304] 0 2024-09-17T01:41:23.128 INFO:tasks.workunit.client.0.smithi082.stdout:7/143: truncate d0/d3/f4 1825868 0 2024-09-17T01:41:23.129 INFO:tasks.workunit.client.0.smithi082.stdout:0/111: fsync f7 0 2024-09-17T01:41:23.131 INFO:tasks.workunit.client.0.smithi082.stdout:7/144: chown d0/l1 10247 1 2024-09-17T01:41:23.133 INFO:tasks.workunit.client.0.smithi082.stdout:9/115: dwrite d4/da/f18 [0,4194304] 0 2024-09-17T01:41:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:2/129: creat d1/d10/f28 x:0 0 0 2024-09-17T01:41:23.135 INFO:tasks.workunit.client.0.smithi082.stdout:9/116: read d4/f10 [2984013,79831] 0 2024-09-17T01:41:23.136 INFO:tasks.workunit.client.1.smithi167.stdout:1/287: truncate d0/d9/f37 2792580 0 2024-09-17T01:41:23.136 INFO:tasks.workunit.client.0.smithi082.stdout:2/130: write d1/d10/f12 [962004,101193] 0 2024-09-17T01:41:23.137 INFO:tasks.workunit.client.0.smithi082.stdout:6/187: rmdir d1/d3 39 2024-09-17T01:41:23.138 INFO:tasks.workunit.client.0.smithi082.stdout:6/188: fdatasync d1/d7/d23/f2a 0 2024-09-17T01:41:23.139 INFO:tasks.workunit.client.0.smithi082.stdout:6/189: chown d1/d7/d23/f2a 4976 1 2024-09-17T01:41:23.143 INFO:tasks.workunit.client.0.smithi082.stdout:3/65: mknod d9/c19 0 2024-09-17T01:41:23.143 INFO:tasks.workunit.client.0.smithi082.stdout:3/66: stat d9/db/f11 0 2024-09-17T01:41:23.144 INFO:tasks.workunit.client.0.smithi082.stdout:3/67: chown d9/fa 4386213 1 2024-09-17T01:41:23.144 INFO:tasks.workunit.client.1.smithi167.stdout:6/382: mkdir d7/d52/d8c 0 2024-09-17T01:41:23.145 INFO:tasks.workunit.client.0.smithi082.stdout:1/119: creat d2/da/d16/f29 x:0 0 0 2024-09-17T01:41:23.146 INFO:tasks.workunit.client.0.smithi082.stdout:4/122: mkdir d9/d15/d25 0 2024-09-17T01:41:23.147 INFO:tasks.workunit.client.1.smithi167.stdout:0/284: readlink d5/d8/d9/l29 0 2024-09-17T01:41:23.149 INFO:tasks.workunit.client.1.smithi167.stdout:9/322: rename d4/d9/c56 to d4/d9/d21/d2d/c5e 0 2024-09-17T01:41:23.153 INFO:tasks.workunit.client.0.smithi082.stdout:0/112: rename f4 to da/d1c/f21 0 2024-09-17T01:41:23.154 INFO:tasks.workunit.client.1.smithi167.stdout:4/341: creat d0/d4/d7/da/d48/d40/d57/d5a/d6f/f79 x:0 0 0 2024-09-17T01:41:23.157 INFO:tasks.workunit.client.0.smithi082.stdout:0/113: dread da/fe [0,4194304] 0 2024-09-17T01:41:23.159 INFO:tasks.workunit.client.1.smithi167.stdout:3/311: mknod d7/c5e 0 2024-09-17T01:41:23.161 INFO:tasks.workunit.client.0.smithi082.stdout:2/131: mkdir d1/d17/d29 0 2024-09-17T01:41:23.162 INFO:tasks.workunit.client.0.smithi082.stdout:2/132: read d1/d1a/f25 [168348,43635] 0 2024-09-17T01:41:23.164 INFO:tasks.workunit.client.0.smithi082.stdout:2/133: truncate d1/d10/f26 180635 0 2024-09-17T01:41:23.169 INFO:tasks.workunit.client.0.smithi082.stdout:4/123: truncate d9/fa 4998031 0 2024-09-17T01:41:23.169 INFO:tasks.workunit.client.0.smithi082.stdout:7/145: mknod d0/c2a 0 2024-09-17T01:41:23.171 INFO:tasks.workunit.client.0.smithi082.stdout:7/146: write d0/d3/db/d10/f22 [107382,71124] 0 2024-09-17T01:41:23.171 INFO:tasks.workunit.client.1.smithi167.stdout:7/316: getdents d0/d2/d14/d19/d26/d34 0 2024-09-17T01:41:23.171 INFO:tasks.workunit.client.0.smithi082.stdout:7/147: chown d0/d3/db/d10 978124805 1 2024-09-17T01:41:23.171 INFO:tasks.workunit.client.0.smithi082.stdout:7/148: chown d0/l8 0 1 2024-09-17T01:41:23.176 INFO:tasks.workunit.client.0.smithi082.stdout:9/117: mkdir d4/da/d11/d26 0 2024-09-17T01:41:23.177 INFO:tasks.workunit.client.0.smithi082.stdout:9/118: chown d4/da/c22 7 1 2024-09-17T01:41:23.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/149: dwrite d0/f23 [4194304,4194304] 0 2024-09-17T01:41:23.180 INFO:tasks.workunit.client.0.smithi082.stdout:9/119: dread d4/f1a [0,4194304] 0 2024-09-17T01:41:23.180 INFO:tasks.workunit.client.0.smithi082.stdout:9/120: stat d4 0 2024-09-17T01:41:23.180 INFO:tasks.workunit.client.0.smithi082.stdout:7/150: truncate d0/d3/db/d10/f1e 179279 0 2024-09-17T01:41:23.180 INFO:tasks.workunit.client.0.smithi082.stdout:6/190: mkdir d1/d7/d8/dc/d1d/d36/d3e/d42 0 2024-09-17T01:41:23.182 INFO:tasks.workunit.client.0.smithi082.stdout:7/151: dread d0/d3/db/d10/f1e [0,4194304] 0 2024-09-17T01:41:23.182 INFO:tasks.workunit.client.0.smithi082.stdout:8/122: link d3/f25 d3/dd/f27 0 2024-09-17T01:41:23.183 INFO:tasks.workunit.client.0.smithi082.stdout:8/123: read d3/f7 [631832,71501] 0 2024-09-17T01:41:23.183 INFO:tasks.workunit.client.0.smithi082.stdout:7/152: write d0/d3/db/d10/f1e [382722,3265] 0 2024-09-17T01:41:23.185 INFO:tasks.workunit.client.0.smithi082.stdout:2/134: rename d1/c6 to d1/d17/d29/c2a 0 2024-09-17T01:41:23.185 INFO:tasks.workunit.client.0.smithi082.stdout:8/124: write d3/dd/f11 [2726744,118942] 0 2024-09-17T01:41:23.186 INFO:tasks.workunit.client.0.smithi082.stdout:2/135: truncate d1/f1f 782962 0 2024-09-17T01:41:23.187 INFO:tasks.workunit.client.0.smithi082.stdout:2/136: dread - d1/d10/f14 zero size 2024-09-17T01:41:23.193 INFO:tasks.workunit.client.0.smithi082.stdout:2/137: dread d1/f1b [0,4194304] 0 2024-09-17T01:41:23.194 INFO:tasks.workunit.client.0.smithi082.stdout:6/191: symlink d1/d7/d8/dc/l43 0 2024-09-17T01:41:23.196 INFO:tasks.workunit.client.0.smithi082.stdout:3/68: dwrite d9/db/f18 [0,4194304] 0 2024-09-17T01:41:23.197 INFO:tasks.workunit.client.0.smithi082.stdout:7/153: creat d0/d3/f2b x:0 0 0 2024-09-17T01:41:23.200 INFO:tasks.workunit.client.1.smithi167.stdout:3/312: creat d7/d8/d2a/d4e/f5f x:0 0 0 2024-09-17T01:41:23.200 INFO:tasks.workunit.client.1.smithi167.stdout:8/434: creat dc/d21/d6b/d74/f92 x:0 0 0 2024-09-17T01:41:23.201 INFO:tasks.workunit.client.0.smithi082.stdout:7/154: write d0/d3/db/f14 [4058091,99966] 0 2024-09-17T01:41:23.201 INFO:tasks.workunit.client.0.smithi082.stdout:3/69: dread f6 [0,4194304] 0 2024-09-17T01:41:23.201 INFO:tasks.workunit.client.0.smithi082.stdout:1/120: creat d2/f2a x:0 0 0 2024-09-17T01:41:23.202 INFO:tasks.workunit.client.1.smithi167.stdout:1/288: rename d0/d9/d16/c44 to d0/d5/c52 0 2024-09-17T01:41:23.202 INFO:tasks.workunit.client.1.smithi167.stdout:0/285: creat d5/d8/d2e/d4d/d58/f5d x:0 0 0 2024-09-17T01:41:23.203 INFO:tasks.workunit.client.0.smithi082.stdout:3/70: readlink d9/l16 0 2024-09-17T01:41:23.204 INFO:tasks.workunit.client.0.smithi082.stdout:3/71: chown d9/db/f11 49069 1 2024-09-17T01:41:23.205 INFO:tasks.workunit.client.1.smithi167.stdout:4/342: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [8388608,4194304] 0 2024-09-17T01:41:23.206 INFO:tasks.workunit.client.0.smithi082.stdout:3/72: rename d9/db to d9/db/d1a 22 2024-09-17T01:41:23.208 INFO:tasks.workunit.client.0.smithi082.stdout:8/125: dwrite d3/f7 [0,4194304] 0 2024-09-17T01:41:23.208 INFO:tasks.workunit.client.0.smithi082.stdout:0/114: link da/df/l13 da/d1b/l22 0 2024-09-17T01:41:23.209 INFO:tasks.workunit.client.0.smithi082.stdout:0/115: write f7 [758993,65989] 0 2024-09-17T01:41:23.211 INFO:tasks.workunit.client.1.smithi167.stdout:6/383: dwrite d7/d11/d13/d2f/d30/d32/f58 [4194304,4194304] 0 2024-09-17T01:41:23.214 INFO:tasks.workunit.client.1.smithi167.stdout:1/289: creat d0/d9/d16/d36/f53 x:0 0 0 2024-09-17T01:41:23.218 INFO:tasks.workunit.client.1.smithi167.stdout:7/317: creat d0/d2/d14/d19/d32/d62/f64 x:0 0 0 2024-09-17T01:41:23.219 INFO:tasks.workunit.client.1.smithi167.stdout:7/318: write d0/d2/f17 [215988,77061] 0 2024-09-17T01:41:23.221 INFO:tasks.workunit.client.1.smithi167.stdout:0/286: rename d5/d8/d2e/d37/d45/c50 to d5/d8/d9/d2f/c5e 0 2024-09-17T01:41:23.222 INFO:tasks.workunit.client.0.smithi082.stdout:2/138: symlink d1/d17/d29/l2b 0 2024-09-17T01:41:23.223 INFO:tasks.workunit.client.0.smithi082.stdout:2/139: dread - d1/d17/f18 zero size 2024-09-17T01:41:23.223 INFO:tasks.workunit.client.1.smithi167.stdout:4/343: mknod d0/d4/d7/da/d48/d40/d57/d5a/c7a 0 2024-09-17T01:41:23.228 INFO:tasks.workunit.client.0.smithi082.stdout:4/124: rmdir d9/d15/d25 0 2024-09-17T01:41:23.229 INFO:tasks.workunit.client.1.smithi167.stdout:6/384: fsync d7/d11/d13/f75 0 2024-09-17T01:41:23.230 INFO:tasks.workunit.client.0.smithi082.stdout:2/140: dwrite d1/d10/f14 [0,4194304] 0 2024-09-17T01:41:23.231 INFO:tasks.workunit.client.1.smithi167.stdout:2/335: sync 2024-09-17T01:41:23.232 INFO:tasks.workunit.client.0.smithi082.stdout:4/125: dread - d9/d15/d16/d18/f20 zero size 2024-09-17T01:41:23.232 INFO:tasks.workunit.client.0.smithi082.stdout:3/73: fdatasync f6 0 2024-09-17T01:41:23.233 INFO:tasks.workunit.client.0.smithi082.stdout:4/126: stat d9/d15/d16/d18/c24 0 2024-09-17T01:41:23.234 INFO:tasks.workunit.client.0.smithi082.stdout:8/126: symlink d3/dd/d18/l28 0 2024-09-17T01:41:23.235 INFO:tasks.workunit.client.0.smithi082.stdout:8/127: write d3/dd/d18/f1e [49664,45507] 0 2024-09-17T01:41:23.236 INFO:tasks.workunit.client.0.smithi082.stdout:4/127: write d9/d15/d16/d18/f20 [390530,11601] 0 2024-09-17T01:41:23.240 INFO:tasks.workunit.client.1.smithi167.stdout:7/319: unlink d0/d2/f17 0 2024-09-17T01:41:23.240 INFO:tasks.workunit.client.1.smithi167.stdout:7/320: chown d0/d2/d14/d19/d26/c36 1 1 2024-09-17T01:41:23.241 INFO:tasks.workunit.client.1.smithi167.stdout:7/321: chown d0/d2/d14/d19/d32/d62 227203343 1 2024-09-17T01:41:23.241 INFO:tasks.workunit.client.0.smithi082.stdout:6/192: symlink d1/d3/l44 0 2024-09-17T01:41:23.242 INFO:tasks.workunit.client.0.smithi082.stdout:0/116: dread da/fe [0,4194304] 0 2024-09-17T01:41:23.245 INFO:tasks.workunit.client.0.smithi082.stdout:1/121: unlink d2/f2a 0 2024-09-17T01:41:23.246 INFO:tasks.workunit.client.0.smithi082.stdout:8/128: dwrite d3/f20 [0,4194304] 0 2024-09-17T01:41:23.247 INFO:tasks.workunit.client.0.smithi082.stdout:8/129: write d3/dd/ff [3867807,16968] 0 2024-09-17T01:41:23.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/313: dwrite d7/d8/d10/d14/d2c/f2f [0,4194304] 0 2024-09-17T01:41:23.249 INFO:tasks.workunit.client.0.smithi082.stdout:2/141: symlink d1/d10/l2c 0 2024-09-17T01:41:23.251 INFO:tasks.workunit.client.0.smithi082.stdout:1/122: dread d2/dd/f26 [0,4194304] 0 2024-09-17T01:41:23.252 INFO:tasks.workunit.client.1.smithi167.stdout:1/290: dwrite d0/d5/d34/d3c/f2b [0,4194304] 0 2024-09-17T01:41:23.253 INFO:tasks.workunit.client.0.smithi082.stdout:4/128: symlink d9/d15/l26 0 2024-09-17T01:41:23.257 INFO:tasks.workunit.client.1.smithi167.stdout:7/322: mknod d0/d2/d14/d19/d26/c65 0 2024-09-17T01:41:23.259 INFO:tasks.workunit.client.0.smithi082.stdout:6/193: rmdir d1/d7/d8/dc/d1d/d36/d3e 39 2024-09-17T01:41:23.262 INFO:tasks.workunit.client.1.smithi167.stdout:4/344: rename d0/d4/d7/d6/d5d/f5f to d0/d4/d7/da/d48/d40/d57/d6a/f7b 0 2024-09-17T01:41:23.262 INFO:tasks.workunit.client.1.smithi167.stdout:4/345: write d0/f3 [1727351,52502] 0 2024-09-17T01:41:23.263 INFO:tasks.workunit.client.1.smithi167.stdout:4/346: write d0/f3 [1570254,49541] 0 2024-09-17T01:41:23.267 INFO:tasks.workunit.client.0.smithi082.stdout:8/130: symlink d3/dd/d18/l29 0 2024-09-17T01:41:23.268 INFO:tasks.workunit.client.1.smithi167.stdout:6/385: symlink d7/d11/d13/d2f/l8d 0 2024-09-17T01:41:23.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/74: link f7 d9/f1b 0 2024-09-17T01:41:23.271 INFO:tasks.workunit.client.1.smithi167.stdout:3/314: mknod d7/d8/d10/d14/d24/c60 0 2024-09-17T01:41:23.271 INFO:tasks.workunit.client.0.smithi082.stdout:0/117: write da/fb [1080314,32983] 0 2024-09-17T01:41:23.271 INFO:tasks.workunit.client.1.smithi167.stdout:3/315: chown d7/d8/d10 56431404 1 2024-09-17T01:41:23.272 INFO:tasks.workunit.client.0.smithi082.stdout:3/75: dread f6 [0,4194304] 0 2024-09-17T01:41:23.272 INFO:tasks.workunit.client.0.smithi082.stdout:0/118: truncate f8 2423816 0 2024-09-17T01:41:23.273 INFO:tasks.workunit.client.1.smithi167.stdout:3/316: fdatasync d7/d8/d10/d14/f53 0 2024-09-17T01:41:23.273 INFO:tasks.workunit.client.1.smithi167.stdout:5/232: sync 2024-09-17T01:41:23.274 INFO:tasks.workunit.client.1.smithi167.stdout:0/287: truncate d5/d8/d9/f35 807816 0 2024-09-17T01:41:23.274 INFO:tasks.workunit.client.0.smithi082.stdout:2/142: rename d1/d10/f26 to d1/d17/d29/f2d 0 2024-09-17T01:41:23.274 INFO:tasks.workunit.client.0.smithi082.stdout:3/76: write d9/db/f11 [1338150,11594] 0 2024-09-17T01:41:23.275 INFO:tasks.workunit.client.1.smithi167.stdout:8/435: getdents dc/d56 0 2024-09-17T01:41:23.277 INFO:tasks.workunit.client.1.smithi167.stdout:7/323: creat d0/d2/f66 x:0 0 0 2024-09-17T01:41:23.278 INFO:tasks.workunit.client.0.smithi082.stdout:1/123: dread d2/f11 [0,4194304] 0 2024-09-17T01:41:23.281 INFO:tasks.workunit.client.0.smithi082.stdout:8/131: mkdir d3/dd/d18/d2a 0 2024-09-17T01:41:23.282 INFO:tasks.workunit.client.1.smithi167.stdout:4/347: symlink d0/d4/d7/da/d48/d40/d51/d2d/l7c 0 2024-09-17T01:41:23.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/129: dwrite d9/fd [0,4194304] 0 2024-09-17T01:41:23.285 INFO:tasks.workunit.client.0.smithi082.stdout:4/130: write d9/fa [1840697,99877] 0 2024-09-17T01:41:23.297 INFO:tasks.workunit.client.1.smithi167.stdout:1/291: mkdir d0/d9/d16/d48/d54 0 2024-09-17T01:41:23.298 INFO:tasks.workunit.client.0.smithi082.stdout:6/194: write d1/d7/d8/f20 [333358,61520] 0 2024-09-17T01:41:23.299 INFO:tasks.workunit.client.1.smithi167.stdout:6/386: symlink d7/d11/d13/l8e 0 2024-09-17T01:41:23.300 INFO:tasks.workunit.client.1.smithi167.stdout:6/387: stat d7/d11/d13/d2f/f7a 0 2024-09-17T01:41:23.302 INFO:tasks.workunit.client.1.smithi167.stdout:7/324: dread d0/d2/d14/d19/d26/f1c [0,4194304] 0 2024-09-17T01:41:23.302 INFO:tasks.workunit.client.1.smithi167.stdout:3/317: rmdir d7/d8/d10/d29 39 2024-09-17T01:41:23.304 INFO:tasks.workunit.client.1.smithi167.stdout:3/318: truncate d7/d8/d1f/f44 77317 0 2024-09-17T01:41:23.304 INFO:tasks.workunit.client.0.smithi082.stdout:0/119: mkdir da/d1b/d23 0 2024-09-17T01:41:23.306 INFO:tasks.workunit.client.1.smithi167.stdout:2/336: getdents d5/d3c/d4c/d4d 0 2024-09-17T01:41:23.307 INFO:tasks.workunit.client.1.smithi167.stdout:2/337: dread - d5/d10/d1a/d2e/d49/f64 zero size 2024-09-17T01:41:23.308 INFO:tasks.workunit.client.1.smithi167.stdout:2/338: dread - d5/d10/d16/f73 zero size 2024-09-17T01:41:23.310 INFO:tasks.workunit.client.0.smithi082.stdout:1/124: symlink d2/l2b 0 2024-09-17T01:41:23.312 INFO:tasks.workunit.client.0.smithi082.stdout:3/77: dwrite f7 [0,4194304] 0 2024-09-17T01:41:23.312 INFO:tasks.workunit.client.0.smithi082.stdout:6/195: symlink d1/d7/d8/dc/d1d/d2c/l45 0 2024-09-17T01:41:23.312 INFO:tasks.workunit.client.1.smithi167.stdout:6/388: dread d7/fa [0,4194304] 0 2024-09-17T01:41:23.313 INFO:tasks.workunit.client.0.smithi082.stdout:3/78: write d9/ff [1175923,74728] 0 2024-09-17T01:41:23.314 INFO:tasks.workunit.client.1.smithi167.stdout:1/292: symlink d0/d9/d16/l55 0 2024-09-17T01:41:23.315 INFO:tasks.workunit.client.1.smithi167.stdout:1/293: chown d0/d5/d34/d3c/l33 58117990 1 2024-09-17T01:41:23.317 INFO:tasks.workunit.client.1.smithi167.stdout:0/288: truncate d5/d8/d2e/f54 227995 0 2024-09-17T01:41:23.318 INFO:tasks.workunit.client.1.smithi167.stdout:4/348: truncate d0/d4/d7/f26 2127754 0 2024-09-17T01:41:23.320 INFO:tasks.workunit.client.1.smithi167.stdout:9/323: sync 2024-09-17T01:41:23.320 INFO:tasks.workunit.client.1.smithi167.stdout:9/324: readlink d4/d9/ld 0 2024-09-17T01:41:23.322 INFO:tasks.workunit.client.0.smithi082.stdout:8/132: truncate d3/f20 160284 0 2024-09-17T01:41:23.323 INFO:tasks.workunit.client.1.smithi167.stdout:3/319: mknod d7/d1e/c61 0 2024-09-17T01:41:23.324 INFO:tasks.workunit.client.1.smithi167.stdout:5/233: link d0/l1e d0/d24/d2b/d3d/l43 0 2024-09-17T01:41:23.325 INFO:tasks.workunit.client.1.smithi167.stdout:5/234: chown d0/d24/d2b/d3d 120 1 2024-09-17T01:41:23.329 INFO:tasks.workunit.client.1.smithi167.stdout:0/289: dread d5/f1d [0,4194304] 0 2024-09-17T01:41:23.330 INFO:tasks.workunit.client.1.smithi167.stdout:2/339: creat d5/d10/d1a/d45/f79 x:0 0 0 2024-09-17T01:41:23.331 INFO:tasks.workunit.client.1.smithi167.stdout:5/235: dwrite d0/f1d [0,4194304] 0 2024-09-17T01:41:23.333 INFO:tasks.workunit.client.0.smithi082.stdout:3/79: mknod d9/c1c 0 2024-09-17T01:41:23.333 INFO:tasks.workunit.client.0.smithi082.stdout:4/131: dwrite d9/f14 [0,4194304] 0 2024-09-17T01:41:23.333 INFO:tasks.workunit.client.1.smithi167.stdout:5/236: write d0/d9/ff [1389149,32890] 0 2024-09-17T01:41:23.336 INFO:tasks.workunit.client.1.smithi167.stdout:6/389: rename d7/d12/f85 to d7/d12/d27/d3a/f8f 0 2024-09-17T01:41:23.338 INFO:tasks.workunit.client.0.smithi082.stdout:0/120: mkdir da/d24 0 2024-09-17T01:41:23.340 INFO:tasks.workunit.client.0.smithi082.stdout:0/121: chown f7 425929265 1 2024-09-17T01:41:23.340 INFO:tasks.workunit.client.0.smithi082.stdout:1/125: dwrite d2/dd/f13 [0,4194304] 0 2024-09-17T01:41:23.342 INFO:tasks.workunit.client.0.smithi082.stdout:8/133: rmdir d3/dd 39 2024-09-17T01:41:23.343 INFO:tasks.workunit.client.0.smithi082.stdout:4/132: dwrite d9/fa [0,4194304] 0 2024-09-17T01:41:23.344 INFO:tasks.workunit.client.1.smithi167.stdout:4/349: creat d0/d4/d7/d6/d2b/f7d x:0 0 0 2024-09-17T01:41:23.346 INFO:tasks.workunit.client.0.smithi082.stdout:2/143: getdents d1/d10 0 2024-09-17T01:41:23.349 INFO:tasks.workunit.client.1.smithi167.stdout:9/325: dread d4/d9/d21/d2d/d33/d3a/f40 [0,4194304] 0 2024-09-17T01:41:23.350 INFO:tasks.workunit.client.0.smithi082.stdout:3/80: mknod d9/db/c1d 0 2024-09-17T01:41:23.351 INFO:tasks.workunit.client.1.smithi167.stdout:0/290: symlink d5/d8/d2e/l5f 0 2024-09-17T01:41:23.352 INFO:tasks.workunit.client.1.smithi167.stdout:8/436: getdents dc/d21/d6b 0 2024-09-17T01:41:23.353 INFO:tasks.workunit.client.0.smithi082.stdout:0/122: creat da/d16/f25 x:0 0 0 2024-09-17T01:41:23.353 INFO:tasks.workunit.client.0.smithi082.stdout:0/123: readlink l5 0 2024-09-17T01:41:23.354 INFO:tasks.workunit.client.1.smithi167.stdout:2/340: symlink d5/d10/d16/l7a 0 2024-09-17T01:41:23.355 INFO:tasks.workunit.client.0.smithi082.stdout:3/81: dread f7 [0,4194304] 0 2024-09-17T01:41:23.356 INFO:tasks.workunit.client.1.smithi167.stdout:2/341: fdatasync d5/d1f/f26 0 2024-09-17T01:41:23.357 INFO:tasks.workunit.client.0.smithi082.stdout:4/133: creat d9/d15/f27 x:0 0 0 2024-09-17T01:41:23.358 INFO:tasks.workunit.client.1.smithi167.stdout:2/342: truncate d5/d10/d16/f65 660460 0 2024-09-17T01:41:23.359 INFO:tasks.workunit.client.1.smithi167.stdout:9/326: dwrite d4/d9/d21/d2d/d33/d3a/f4d [0,4194304] 0 2024-09-17T01:41:23.359 INFO:tasks.workunit.client.0.smithi082.stdout:2/144: mknod d1/d1a/c2e 0 2024-09-17T01:41:23.361 INFO:tasks.workunit.client.0.smithi082.stdout:2/145: dread d1/fd [0,4194304] 0 2024-09-17T01:41:23.361 INFO:tasks.workunit.client.0.smithi082.stdout:6/196: creat d1/d7/f46 x:0 0 0 2024-09-17T01:41:23.362 INFO:tasks.workunit.client.0.smithi082.stdout:2/146: dread - d1/d10/f28 zero size 2024-09-17T01:41:23.363 INFO:tasks.workunit.client.0.smithi082.stdout:2/147: dread - d1/ff zero size 2024-09-17T01:41:23.365 INFO:tasks.workunit.client.0.smithi082.stdout:2/148: dread d1/fd [0,4194304] 0 2024-09-17T01:41:23.365 INFO:tasks.workunit.client.1.smithi167.stdout:4/350: write d0/f52 [1641038,74098] 0 2024-09-17T01:41:23.368 INFO:tasks.workunit.client.0.smithi082.stdout:0/124: rename da/d1c/d1d to da/df/d26 0 2024-09-17T01:41:23.369 INFO:tasks.workunit.client.1.smithi167.stdout:7/325: creat d0/f67 x:0 0 0 2024-09-17T01:41:23.371 INFO:tasks.workunit.client.1.smithi167.stdout:4/351: dwrite d0/f52 [0,4194304] 0 2024-09-17T01:41:23.371 INFO:tasks.workunit.client.0.smithi082.stdout:8/134: creat d3/dd/f2b x:0 0 0 2024-09-17T01:41:23.373 INFO:tasks.workunit.client.1.smithi167.stdout:0/291: mknod d5/d8/d2e/d4d/d58/c60 0 2024-09-17T01:41:23.374 INFO:tasks.workunit.client.0.smithi082.stdout:4/134: readlink d9/l1b 0 2024-09-17T01:41:23.375 INFO:tasks.workunit.client.1.smithi167.stdout:8/437: fsync dc/d21/d6b/f78 0 2024-09-17T01:41:23.375 INFO:tasks.workunit.client.0.smithi082.stdout:4/135: read - d9/d15/f27 zero size 2024-09-17T01:41:23.377 INFO:tasks.workunit.client.1.smithi167.stdout:4/352: dwrite d0/d4/d7/f77 [0,4194304] 0 2024-09-17T01:41:23.378 INFO:tasks.workunit.client.1.smithi167.stdout:4/353: dread - d0/d4/d7/d6/d5d/f68 zero size 2024-09-17T01:41:23.385 INFO:tasks.workunit.client.0.smithi082.stdout:1/126: dwrite d2/f11 [0,4194304] 0 2024-09-17T01:41:23.385 INFO:tasks.workunit.client.1.smithi167.stdout:2/343: creat d5/d33/d48/f7b x:0 0 0 2024-09-17T01:41:23.385 INFO:tasks.workunit.client.1.smithi167.stdout:6/390: readlink d7/d11/d34/l3c 0 2024-09-17T01:41:23.387 INFO:tasks.workunit.client.1.smithi167.stdout:9/327: rename d4/d9/d21/d2d/l44 to d4/d4a/l5f 0 2024-09-17T01:41:23.388 INFO:tasks.workunit.client.1.smithi167.stdout:9/328: truncate d4/f5b 447543 0 2024-09-17T01:41:23.389 INFO:tasks.workunit.client.0.smithi082.stdout:4/136: symlink d9/d15/d16/l28 0 2024-09-17T01:41:23.391 INFO:tasks.workunit.client.1.smithi167.stdout:7/326: dread - d0/f4f zero size 2024-09-17T01:41:23.393 INFO:tasks.workunit.client.1.smithi167.stdout:3/320: mkdir d7/d8/d10/d14/d24/d62 0 2024-09-17T01:41:23.393 INFO:tasks.workunit.client.1.smithi167.stdout:3/321: chown d7/d8/d1f 0 1 2024-09-17T01:41:23.394 INFO:tasks.workunit.client.0.smithi082.stdout:2/149: unlink d1/c1e 0 2024-09-17T01:41:23.394 INFO:tasks.workunit.client.1.smithi167.stdout:0/292: dread - d5/d8/f44 zero size 2024-09-17T01:41:23.395 INFO:tasks.workunit.client.0.smithi082.stdout:1/127: mknod d2/da/d16/c2c 0 2024-09-17T01:41:23.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/125: fdatasync da/d1c/f21 0 2024-09-17T01:41:23.399 INFO:tasks.workunit.client.0.smithi082.stdout:4/137: rename c6 to d9/d15/c29 0 2024-09-17T01:41:23.405 INFO:tasks.workunit.client.0.smithi082.stdout:1/128: rmdir d2 39 2024-09-17T01:41:23.406 INFO:tasks.workunit.client.0.smithi082.stdout:8/135: dread d3/dd/f11 [4194304,4194304] 0 2024-09-17T01:41:23.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/438: read dc/f17 [3689567,69659] 0 2024-09-17T01:41:23.407 INFO:tasks.workunit.client.0.smithi082.stdout:8/136: chown d3/dd/f26 1080765 1 2024-09-17T01:41:23.407 INFO:tasks.workunit.client.0.smithi082.stdout:8/137: chown d3/dd/f11 0 1 2024-09-17T01:41:23.408 INFO:tasks.workunit.client.1.smithi167.stdout:1/294: getdents d0 0 2024-09-17T01:41:23.408 INFO:tasks.workunit.client.0.smithi082.stdout:8/138: read d3/dd/f11 [5216092,95828] 0 2024-09-17T01:41:23.409 INFO:tasks.workunit.client.1.smithi167.stdout:0/293: dwrite d5/d8/d9/f39 [0,4194304] 0 2024-09-17T01:41:23.409 INFO:tasks.workunit.client.1.smithi167.stdout:8/439: write dc/d21/f31 [5111827,12792] 0 2024-09-17T01:41:23.411 INFO:tasks.workunit.client.1.smithi167.stdout:4/354: mkdir d0/d4/d7/d6/d2b/d6d/d7e 0 2024-09-17T01:41:23.411 INFO:tasks.workunit.client.1.smithi167.stdout:0/294: chown d5/d8/d2e/d4d/c1c 1890705 1 2024-09-17T01:41:23.412 INFO:tasks.workunit.client.0.smithi082.stdout:4/138: mknod d9/d15/d16/c2a 0 2024-09-17T01:41:23.413 INFO:tasks.workunit.client.1.smithi167.stdout:0/295: write d5/d8/d2e/d4d/f38 [3959895,79532] 0 2024-09-17T01:41:23.413 INFO:tasks.workunit.client.1.smithi167.stdout:5/237: truncate d0/d24/f38 1420486 0 2024-09-17T01:41:23.414 INFO:tasks.workunit.client.0.smithi082.stdout:6/197: getdents d1/d7/d8/d32 0 2024-09-17T01:41:23.415 INFO:tasks.workunit.client.1.smithi167.stdout:5/238: truncate d0/d24/d2b/d3d/d3b/f3e 110239 0 2024-09-17T01:41:23.415 INFO:tasks.workunit.client.0.smithi082.stdout:6/198: fsync d1/d7/d10/f11 0 2024-09-17T01:41:23.422 INFO:tasks.workunit.client.0.smithi082.stdout:1/129: write d2/dd/d24/f23 [220890,111788] 0 2024-09-17T01:41:23.426 INFO:tasks.workunit.client.1.smithi167.stdout:1/295: unlink d0/d5/fd 0 2024-09-17T01:41:23.427 INFO:tasks.workunit.client.1.smithi167.stdout:1/296: chown d0/d5/d34 446682 1 2024-09-17T01:41:23.427 INFO:tasks.workunit.client.0.smithi082.stdout:4/139: readlink d9/l23 0 2024-09-17T01:41:23.427 INFO:tasks.workunit.client.1.smithi167.stdout:1/297: write d0/d5/d34/d3c/f2b [5371432,115840] 0 2024-09-17T01:41:23.430 INFO:tasks.workunit.client.1.smithi167.stdout:2/344: write d5/d10/d1a/f31 [4754237,75218] 0 2024-09-17T01:41:23.431 INFO:tasks.workunit.client.1.smithi167.stdout:2/345: chown d5/d10/d16/f2d 985 1 2024-09-17T01:41:23.431 INFO:tasks.workunit.client.0.smithi082.stdout:0/126: truncate da/d1c/f21 3218442 0 2024-09-17T01:41:23.433 INFO:tasks.workunit.client.0.smithi082.stdout:0/127: write da/d16/f25 [736327,107677] 0 2024-09-17T01:41:23.434 INFO:tasks.workunit.client.0.smithi082.stdout:0/128: read da/fb [590069,107977] 0 2024-09-17T01:41:23.437 INFO:tasks.workunit.client.0.smithi082.stdout:8/139: getdents d3/dd/d18/d2a 0 2024-09-17T01:41:23.438 INFO:tasks.workunit.client.0.smithi082.stdout:2/150: truncate d1/f1f 17446 0 2024-09-17T01:41:23.439 INFO:tasks.workunit.client.0.smithi082.stdout:2/151: truncate d1/d10/f28 978721 0 2024-09-17T01:41:23.439 INFO:tasks.workunit.client.0.smithi082.stdout:2/152: fdatasync d1/d17/f18 0 2024-09-17T01:41:23.441 INFO:tasks.workunit.client.0.smithi082.stdout:2/153: dread d1/d17/d29/f2d [0,4194304] 0 2024-09-17T01:41:23.441 INFO:tasks.workunit.client.1.smithi167.stdout:5/239: mkdir d0/d28/d3a/d44 0 2024-09-17T01:41:23.441 INFO:tasks.workunit.client.0.smithi082.stdout:2/154: read d1/d17/d29/f2d [76010,33873] 0 2024-09-17T01:41:23.442 INFO:tasks.workunit.client.0.smithi082.stdout:6/199: mkdir d1/d7/d47 0 2024-09-17T01:41:23.444 INFO:tasks.workunit.client.1.smithi167.stdout:9/329: creat d4/d9/d21/f60 x:0 0 0 2024-09-17T01:41:23.444 INFO:tasks.workunit.client.1.smithi167.stdout:3/322: dwrite f6 [0,4194304] 0 2024-09-17T01:41:23.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/155: dread d1/f1b [0,4194304] 0 2024-09-17T01:41:23.446 INFO:tasks.workunit.client.0.smithi082.stdout:2/156: dread - d1/d10/f19 zero size 2024-09-17T01:41:23.447 INFO:tasks.workunit.client.0.smithi082.stdout:1/130: fdatasync d2/da/d16/f1c 0 2024-09-17T01:41:23.448 INFO:tasks.workunit.client.0.smithi082.stdout:2/157: chown d1/f1b 97 1 2024-09-17T01:41:23.450 INFO:tasks.workunit.client.0.smithi082.stdout:0/129: rename da/d1c to da/df/d27 0 2024-09-17T01:41:23.456 INFO:tasks.workunit.client.0.smithi082.stdout:4/140: mkdir d9/d2b 0 2024-09-17T01:41:23.457 INFO:tasks.workunit.client.0.smithi082.stdout:2/158: dwrite d1/d10/f28 [0,4194304] 0 2024-09-17T01:41:23.458 INFO:tasks.workunit.client.0.smithi082.stdout:4/141: write d9/fa [1438122,87515] 0 2024-09-17T01:41:23.459 INFO:tasks.workunit.client.1.smithi167.stdout:2/346: rmdir d5/d10/d1a/d46 39 2024-09-17T01:41:23.460 INFO:tasks.workunit.client.1.smithi167.stdout:2/347: fdatasync d5/d33/f57 0 2024-09-17T01:41:23.464 INFO:tasks.workunit.client.0.smithi082.stdout:4/142: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:23.465 INFO:tasks.workunit.client.0.smithi082.stdout:1/131: mkdir d2/da/d2d 0 2024-09-17T01:41:23.467 INFO:tasks.workunit.client.0.smithi082.stdout:2/159: dwrite d1/d17/f21 [0,4194304] 0 2024-09-17T01:41:23.467 INFO:tasks.workunit.client.0.smithi082.stdout:4/143: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:23.468 INFO:tasks.workunit.client.1.smithi167.stdout:5/240: rmdir d0/d24/d2b/d3d/d3b 39 2024-09-17T01:41:23.468 INFO:tasks.workunit.client.0.smithi082.stdout:4/144: read d9/fd [1030818,70150] 0 2024-09-17T01:41:23.469 INFO:tasks.workunit.client.0.smithi082.stdout:2/160: truncate d1/f16 4252934 0 2024-09-17T01:41:23.469 INFO:tasks.workunit.client.0.smithi082.stdout:4/145: chown d9/d15/f1e 13089 1 2024-09-17T01:41:23.472 INFO:tasks.workunit.client.0.smithi082.stdout:6/200: rename d1/d7/d23 to d1/d7/d8/dc/d2b/d48 0 2024-09-17T01:41:23.472 INFO:tasks.workunit.client.0.smithi082.stdout:6/201: fdatasync d1/d7/d8/dc/d2b/f35 0 2024-09-17T01:41:23.472 INFO:tasks.workunit.client.0.smithi082.stdout:8/140: symlink d3/dd/d18/d2a/l2c 0 2024-09-17T01:41:23.473 INFO:tasks.workunit.client.1.smithi167.stdout:0/296: dwrite d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:23.473 INFO:tasks.workunit.client.1.smithi167.stdout:3/323: chown d7/c51 12826486 1 2024-09-17T01:41:23.473 INFO:tasks.workunit.client.1.smithi167.stdout:0/297: stat d5/d8/d2e/c4c 0 2024-09-17T01:41:23.473 INFO:tasks.workunit.client.1.smithi167.stdout:9/330: mknod d4/d9/d21/d2d/d33/c61 0 2024-09-17T01:41:23.475 INFO:tasks.workunit.client.0.smithi082.stdout:2/161: dread d1/f1b [0,4194304] 0 2024-09-17T01:41:23.476 INFO:tasks.workunit.client.0.smithi082.stdout:2/162: stat d1/d17/f18 0 2024-09-17T01:41:23.476 INFO:tasks.workunit.client.1.smithi167.stdout:7/327: rename d0/d2/d14/d19/d32/l42 to d0/d2/d14/l68 0 2024-09-17T01:41:23.478 INFO:tasks.workunit.client.0.smithi082.stdout:2/163: chown d1/d10/f28 124 1 2024-09-17T01:41:23.479 INFO:tasks.workunit.client.1.smithi167.stdout:2/348: creat d5/d1f/f7c x:0 0 0 2024-09-17T01:41:23.480 INFO:tasks.workunit.client.1.smithi167.stdout:2/349: readlink d5/l41 0 2024-09-17T01:41:23.480 INFO:tasks.workunit.client.1.smithi167.stdout:9/331: dwrite d4/d9/f3d [0,4194304] 0 2024-09-17T01:41:23.482 INFO:tasks.workunit.client.1.smithi167.stdout:9/332: truncate d4/f16 4405050 0 2024-09-17T01:41:23.484 INFO:tasks.workunit.client.0.smithi082.stdout:8/141: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:41:23.484 INFO:tasks.workunit.client.1.smithi167.stdout:9/333: read d4/d9/d21/d2d/d33/d3a/f40 [1613659,7606] 0 2024-09-17T01:41:23.484 INFO:tasks.workunit.client.0.smithi082.stdout:8/142: chown d3/dd/d18/c21 28064 1 2024-09-17T01:41:23.487 INFO:tasks.workunit.client.1.smithi167.stdout:5/241: write d0/d24/d2b/d3d/d3b/f3e [656915,103574] 0 2024-09-17T01:41:23.490 INFO:tasks.workunit.client.1.smithi167.stdout:0/298: chown d5/d8/d9/c1f 121842533 1 2024-09-17T01:41:23.490 INFO:tasks.workunit.client.1.smithi167.stdout:9/334: read d4/d9/d21/d2d/d33/d3a/f4d [1667707,130287] 0 2024-09-17T01:41:23.490 INFO:tasks.workunit.client.1.smithi167.stdout:2/350: dwrite d5/d10/d1a/d2e/d49/f64 [0,4194304] 0 2024-09-17T01:41:23.492 INFO:tasks.workunit.client.1.smithi167.stdout:0/299: write d5/d8/f20 [415939,26644] 0 2024-09-17T01:41:23.492 INFO:tasks.workunit.client.0.smithi082.stdout:4/146: write d9/fc [1152550,18362] 0 2024-09-17T01:41:23.493 INFO:tasks.workunit.client.1.smithi167.stdout:5/242: read d0/f19 [1626478,96489] 0 2024-09-17T01:41:23.493 INFO:tasks.workunit.client.1.smithi167.stdout:8/440: dread dc/d18/f2d [0,4194304] 0 2024-09-17T01:41:23.496 INFO:tasks.workunit.client.1.smithi167.stdout:2/351: write d5/d1f/f7c [202640,34824] 0 2024-09-17T01:41:23.502 INFO:tasks.workunit.client.0.smithi082.stdout:8/143: dread d3/f20 [0,4194304] 0 2024-09-17T01:41:23.503 INFO:tasks.workunit.client.0.smithi082.stdout:4/147: dwrite d9/f14 [4194304,4194304] 0 2024-09-17T01:41:23.503 INFO:tasks.workunit.client.0.smithi082.stdout:1/132: creat d2/da/d2d/f2e x:0 0 0 2024-09-17T01:41:23.504 INFO:tasks.workunit.client.1.smithi167.stdout:9/335: dwrite d4/d9/d21/d2d/d33/d3a/f4d [0,4194304] 0 2024-09-17T01:41:23.506 INFO:tasks.workunit.client.1.smithi167.stdout:7/328: dwrite d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:23.506 INFO:tasks.workunit.client.1.smithi167.stdout:4/355: link d0/d4/d7/d6/c58 d0/d4/d7/d10/c7f 0 2024-09-17T01:41:23.509 INFO:tasks.workunit.client.0.smithi082.stdout:0/130: rename da/df/l13 to da/d1e/l28 0 2024-09-17T01:41:23.511 INFO:tasks.workunit.client.0.smithi082.stdout:0/131: truncate da/df/f15 2472778 0 2024-09-17T01:41:23.512 INFO:tasks.workunit.client.1.smithi167.stdout:2/352: dwrite d5/f2f [0,4194304] 0 2024-09-17T01:41:23.512 INFO:tasks.workunit.client.1.smithi167.stdout:7/329: chown d0/d2/d14/d19/c47 106 1 2024-09-17T01:41:23.513 INFO:tasks.workunit.client.0.smithi082.stdout:8/144: readlink d3/lc 0 2024-09-17T01:41:23.514 INFO:tasks.workunit.client.0.smithi082.stdout:1/133: rmdir d2 39 2024-09-17T01:41:23.515 INFO:tasks.workunit.client.1.smithi167.stdout:4/356: dread - d0/d4/d7/da/d48/d40/d51/d2d/f65 zero size 2024-09-17T01:41:23.516 INFO:tasks.workunit.client.1.smithi167.stdout:6/391: sync 2024-09-17T01:41:23.517 INFO:tasks.workunit.client.0.smithi082.stdout:4/148: creat d9/d15/d16/f2c x:0 0 0 2024-09-17T01:41:23.517 INFO:tasks.workunit.client.1.smithi167.stdout:4/357: dread - d0/d4/d7/da/f4d zero size 2024-09-17T01:41:23.517 INFO:tasks.workunit.client.1.smithi167.stdout:9/336: fsync f1 0 2024-09-17T01:41:23.519 INFO:tasks.workunit.client.1.smithi167.stdout:9/337: chown d4/f4e 3807650 1 2024-09-17T01:41:23.519 INFO:tasks.workunit.client.1.smithi167.stdout:6/392: write d7/d11/d13/f65 [168037,50656] 0 2024-09-17T01:41:23.519 INFO:tasks.workunit.client.1.smithi167.stdout:0/300: dwrite d5/d8/d2e/d4d/f5a [0,4194304] 0 2024-09-17T01:41:23.521 INFO:tasks.workunit.client.1.smithi167.stdout:4/358: chown d0/d4/d7/da/d48/d40/d57/d6a 722143 1 2024-09-17T01:41:23.522 INFO:tasks.workunit.client.1.smithi167.stdout:9/338: write d4/d9/d21/f3c [545316,112299] 0 2024-09-17T01:41:23.523 INFO:tasks.workunit.client.1.smithi167.stdout:9/339: fdatasync d4/f18 0 2024-09-17T01:41:23.525 INFO:tasks.workunit.client.1.smithi167.stdout:9/340: dread - d4/d9/d21/d2d/f5a zero size 2024-09-17T01:41:23.525 INFO:tasks.workunit.client.0.smithi082.stdout:4/149: dwrite f7 [0,4194304] 0 2024-09-17T01:41:23.528 INFO:tasks.workunit.client.1.smithi167.stdout:0/301: dwrite d5/d8/d9/f2c [0,4194304] 0 2024-09-17T01:41:23.530 INFO:tasks.workunit.client.0.smithi082.stdout:6/202: rename d1/d7/d47 to d1/d7/d8/dc/d1d/d36/d3e/d42/d49 0 2024-09-17T01:41:23.538 INFO:tasks.workunit.client.1.smithi167.stdout:3/324: getdents d7/d8 0 2024-09-17T01:41:23.540 INFO:tasks.workunit.client.0.smithi082.stdout:4/150: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:23.541 INFO:tasks.workunit.client.1.smithi167.stdout:2/353: creat d5/d10/d1a/d2e/f7d x:0 0 0 2024-09-17T01:41:23.543 INFO:tasks.workunit.client.0.smithi082.stdout:2/164: truncate d1/f1b 813106 0 2024-09-17T01:41:23.543 INFO:tasks.workunit.client.1.smithi167.stdout:7/330: symlink d0/d2/l69 0 2024-09-17T01:41:23.545 INFO:tasks.workunit.client.0.smithi082.stdout:6/203: creat d1/d7/d10/f4a x:0 0 0 2024-09-17T01:41:23.546 INFO:tasks.workunit.client.0.smithi082.stdout:0/132: link da/df/f15 da/df/d27/f29 0 2024-09-17T01:41:23.546 INFO:tasks.workunit.client.1.smithi167.stdout:7/331: truncate d0/d2/d14/d19/d26/d34/f5d 4233308 0 2024-09-17T01:41:23.547 INFO:tasks.workunit.client.1.smithi167.stdout:4/359: creat d0/d4/d7/da/f80 x:0 0 0 2024-09-17T01:41:23.548 INFO:tasks.workunit.client.0.smithi082.stdout:1/134: mkdir d2/da/d2f 0 2024-09-17T01:41:23.548 INFO:tasks.workunit.client.1.smithi167.stdout:2/354: dwrite d5/f2f [0,4194304] 0 2024-09-17T01:41:23.548 INFO:tasks.workunit.client.0.smithi082.stdout:1/135: chown c1 432926 1 2024-09-17T01:41:23.549 INFO:tasks.workunit.client.1.smithi167.stdout:9/341: fsync d4/d9/f4c 0 2024-09-17T01:41:23.550 INFO:tasks.workunit.client.0.smithi082.stdout:0/133: dread da/fc [0,4194304] 0 2024-09-17T01:41:23.551 INFO:tasks.workunit.client.0.smithi082.stdout:2/165: rmdir d1/d1a 39 2024-09-17T01:41:23.552 INFO:tasks.workunit.client.1.smithi167.stdout:6/393: dread d7/d11/f1b [0,4194304] 0 2024-09-17T01:41:23.553 INFO:tasks.workunit.client.0.smithi082.stdout:2/166: write d1/d10/f12 [4965652,21112] 0 2024-09-17T01:41:23.553 INFO:tasks.workunit.client.0.smithi082.stdout:6/204: mknod d1/d7/d8/dc/d2b/c4b 0 2024-09-17T01:41:23.556 INFO:tasks.workunit.client.1.smithi167.stdout:7/332: creat d0/d2/d14/d19/d32/f6a x:0 0 0 2024-09-17T01:41:23.557 INFO:tasks.workunit.client.1.smithi167.stdout:1/298: sync 2024-09-17T01:41:23.558 INFO:tasks.workunit.client.0.smithi082.stdout:1/136: mknod d2/df/c30 0 2024-09-17T01:41:23.559 INFO:tasks.workunit.client.1.smithi167.stdout:9/342: mknod d4/d4a/c62 0 2024-09-17T01:41:23.560 INFO:tasks.workunit.client.0.smithi082.stdout:0/134: fdatasync da/fb 0 2024-09-17T01:41:23.560 INFO:tasks.workunit.client.1.smithi167.stdout:2/355: rmdir d5/d10/d1a/d45/d6b 39 2024-09-17T01:41:23.564 INFO:tasks.workunit.client.1.smithi167.stdout:3/325: link d7/d1e/f43 d7/d8/d2a/f63 0 2024-09-17T01:41:23.565 INFO:tasks.workunit.client.1.smithi167.stdout:6/394: dread - d7/d11/d34/f76 zero size 2024-09-17T01:41:23.565 INFO:tasks.workunit.client.0.smithi082.stdout:6/205: mkdir d1/d7/d8/dc/d1d/d36/d3e/d4c 0 2024-09-17T01:41:23.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/206: stat d1/d7/c34 0 2024-09-17T01:41:23.567 INFO:tasks.workunit.client.0.smithi082.stdout:1/137: unlink d2/c8 0 2024-09-17T01:41:23.568 INFO:tasks.workunit.client.1.smithi167.stdout:1/299: rename d0/d5/d34/c13 to d0/d9/d16/d36/c56 0 2024-09-17T01:41:23.570 INFO:tasks.workunit.client.1.smithi167.stdout:4/360: truncate d0/d4/d7/f26 2919463 0 2024-09-17T01:41:23.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/243: truncate d0/f14 430167 0 2024-09-17T01:41:23.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/244: chown d0/d24/c26 105641 1 2024-09-17T01:41:23.573 INFO:tasks.workunit.client.1.smithi167.stdout:5/245: read d0/f20 [366980,24315] 0 2024-09-17T01:41:23.574 INFO:tasks.workunit.client.1.smithi167.stdout:5/246: readlink d0/d9/l1f 0 2024-09-17T01:41:23.574 INFO:tasks.workunit.client.1.smithi167.stdout:8/441: truncate dc/d56/f62 3247183 0 2024-09-17T01:41:23.577 INFO:tasks.workunit.client.0.smithi082.stdout:2/167: link d1/d17/d29/f2d d1/d10/f2f 0 2024-09-17T01:41:23.577 INFO:tasks.workunit.client.1.smithi167.stdout:6/395: unlink d7/d12/f23 0 2024-09-17T01:41:23.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/343: rename d4/d9/d21/d43/d47/c50 to d4/d9/c63 0 2024-09-17T01:41:23.585 INFO:tasks.workunit.client.1.smithi167.stdout:9/344: readlink d4/l5 0 2024-09-17T01:41:23.585 INFO:tasks.workunit.client.0.smithi082.stdout:4/151: link d9/d15/c1a d9/d15/c2d 0 2024-09-17T01:41:23.587 INFO:tasks.workunit.client.1.smithi167.stdout:4/361: mkdir d0/d4/d7/da/d48/d40/d57/d6a/d81 0 2024-09-17T01:41:23.588 INFO:tasks.workunit.client.1.smithi167.stdout:4/362: chown d0/d4/d7/d6/d2b 1897 1 2024-09-17T01:41:23.588 INFO:tasks.workunit.client.0.smithi082.stdout:0/135: fsync da/df/f15 0 2024-09-17T01:41:23.591 INFO:tasks.workunit.client.1.smithi167.stdout:1/300: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:23.592 INFO:tasks.workunit.client.1.smithi167.stdout:1/301: chown d0/d9/fb 5729615 1 2024-09-17T01:41:23.592 INFO:tasks.workunit.client.0.smithi082.stdout:0/136: dread da/fe [0,4194304] 0 2024-09-17T01:41:23.594 INFO:tasks.workunit.client.1.smithi167.stdout:5/247: read d0/f21 [529911,45800] 0 2024-09-17T01:41:23.595 INFO:tasks.workunit.client.0.smithi082.stdout:4/152: creat d9/d15/f2e x:0 0 0 2024-09-17T01:41:23.596 INFO:tasks.workunit.client.1.smithi167.stdout:8/442: creat dc/d56/d57/d7e/f93 x:0 0 0 2024-09-17T01:41:23.596 INFO:tasks.workunit.client.1.smithi167.stdout:8/443: fdatasync dc/d21/d6b/f78 0 2024-09-17T01:41:23.599 INFO:tasks.workunit.client.1.smithi167.stdout:7/333: fsync d0/d55/d5b/f60 0 2024-09-17T01:41:23.601 INFO:tasks.workunit.client.1.smithi167.stdout:0/302: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:23.602 INFO:tasks.workunit.client.1.smithi167.stdout:2/356: rename d5/d1f/f7c to d5/d10/d1a/d45/d3f/f7e 0 2024-09-17T01:41:23.602 INFO:tasks.workunit.client.0.smithi082.stdout:4/153: rmdir d9/d15/d16 39 2024-09-17T01:41:23.605 INFO:tasks.workunit.client.0.smithi082.stdout:0/137: link da/fb da/d24/f2a 0 2024-09-17T01:41:23.607 INFO:tasks.workunit.client.1.smithi167.stdout:7/334: dwrite d0/d2/d14/d19/d26/f35 [0,4194304] 0 2024-09-17T01:41:23.609 INFO:tasks.workunit.client.0.smithi082.stdout:4/154: unlink c2 0 2024-09-17T01:41:23.610 INFO:tasks.workunit.client.1.smithi167.stdout:0/303: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:23.612 INFO:tasks.workunit.client.0.smithi082.stdout:0/138: mkdir da/df/d2b 0 2024-09-17T01:41:23.615 INFO:tasks.workunit.client.1.smithi167.stdout:3/326: creat d7/d8/d10/f64 x:0 0 0 2024-09-17T01:41:23.616 INFO:tasks.workunit.client.1.smithi167.stdout:3/327: dread - d7/d8/d2a/d4e/f5f zero size 2024-09-17T01:41:23.616 INFO:tasks.workunit.client.1.smithi167.stdout:3/328: fsync d7/d8/d2a/f22 0 2024-09-17T01:41:23.618 INFO:tasks.workunit.client.1.smithi167.stdout:5/248: chown d0/d9/ld 212 1 2024-09-17T01:41:23.621 INFO:tasks.workunit.client.0.smithi082.stdout:0/139: mknod da/df/d27/c2c 0 2024-09-17T01:41:23.621 INFO:tasks.workunit.client.1.smithi167.stdout:8/444: chown dc/f7a 185 1 2024-09-17T01:41:23.623 INFO:tasks.workunit.client.1.smithi167.stdout:8/445: chown dc/d18/f2e 7 1 2024-09-17T01:41:23.624 INFO:tasks.workunit.client.0.smithi082.stdout:4/155: creat d9/d15/d16/f2f x:0 0 0 2024-09-17T01:41:23.624 INFO:tasks.workunit.client.0.smithi082.stdout:6/207: write d1/d3/f1b [1580300,30902] 0 2024-09-17T01:41:23.624 INFO:tasks.workunit.client.0.smithi082.stdout:1/138: write d2/df/f17 [946073,93013] 0 2024-09-17T01:41:23.625 INFO:tasks.workunit.client.0.smithi082.stdout:1/139: stat d2/f10 0 2024-09-17T01:41:23.625 INFO:tasks.workunit.client.0.smithi082.stdout:6/208: write d1/d7/d10/f33 [203934,50219] 0 2024-09-17T01:41:23.626 INFO:tasks.workunit.client.0.smithi082.stdout:1/140: chown d2/da/l12 3 1 2024-09-17T01:41:23.627 INFO:tasks.workunit.client.0.smithi082.stdout:1/141: write d2/df/f1d [2471290,4997] 0 2024-09-17T01:41:23.641 INFO:tasks.workunit.client.0.smithi082.stdout:2/168: write d1/fd [785806,54407] 0 2024-09-17T01:41:23.642 INFO:tasks.workunit.client.0.smithi082.stdout:2/169: stat d1/ca 0 2024-09-17T01:41:23.642 INFO:tasks.workunit.client.0.smithi082.stdout:6/209: dwrite d1/d7/f46 [0,4194304] 0 2024-09-17T01:41:23.643 INFO:tasks.workunit.client.0.smithi082.stdout:6/210: fdatasync d1/d7/d10/f11 0 2024-09-17T01:41:23.646 INFO:tasks.workunit.client.1.smithi167.stdout:6/396: rename d7/d11 to d7/d54/d90 0 2024-09-17T01:41:23.647 INFO:tasks.workunit.client.1.smithi167.stdout:5/249: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:23.649 INFO:tasks.workunit.client.0.smithi082.stdout:4/156: symlink d9/d15/l30 0 2024-09-17T01:41:23.652 INFO:tasks.workunit.client.0.smithi082.stdout:6/211: dwrite d1/d3/f41 [0,4194304] 0 2024-09-17T01:41:23.653 INFO:tasks.workunit.client.1.smithi167.stdout:8/446: dread dc/d56/f70 [0,4194304] 0 2024-09-17T01:41:23.653 INFO:tasks.workunit.client.1.smithi167.stdout:6/397: dwrite d7/d54/d90/d13/d2f/d64/d6b/f82 [0,4194304] 0 2024-09-17T01:41:23.654 INFO:tasks.workunit.client.1.smithi167.stdout:6/398: chown d7/l2c 26680499 1 2024-09-17T01:41:23.658 INFO:tasks.workunit.client.0.smithi082.stdout:0/140: rmdir da/df/d26 0 2024-09-17T01:41:23.664 INFO:tasks.workunit.client.1.smithi167.stdout:0/304: creat d5/d8/d9/d2f/f61 x:0 0 0 2024-09-17T01:41:23.670 INFO:tasks.workunit.client.0.smithi082.stdout:2/170: creat d1/d1a/f30 x:0 0 0 2024-09-17T01:41:23.671 INFO:tasks.workunit.client.0.smithi082.stdout:2/171: write d1/d17/f18 [148420,69877] 0 2024-09-17T01:41:23.673 INFO:tasks.workunit.client.1.smithi167.stdout:9/345: rename d4/d9/c57 to d4/d9/d21/d43/c64 0 2024-09-17T01:41:23.674 INFO:tasks.workunit.client.1.smithi167.stdout:9/346: fsync d4/d9/d21/d2d/d33/d3a/f3f 0 2024-09-17T01:41:23.675 INFO:tasks.workunit.client.1.smithi167.stdout:9/347: dread - d4/d9/d21/d2d/d33/d3a/f3f zero size 2024-09-17T01:41:23.676 INFO:tasks.workunit.client.0.smithi082.stdout:6/212: mknod d1/d7/d8/c4d 0 2024-09-17T01:41:23.677 INFO:tasks.workunit.client.1.smithi167.stdout:6/399: dread d7/d12/f62 [0,4194304] 0 2024-09-17T01:41:23.680 INFO:tasks.workunit.client.0.smithi082.stdout:0/141: symlink da/d1b/d23/l2d 0 2024-09-17T01:41:23.680 INFO:tasks.workunit.client.0.smithi082.stdout:1/142: getdents d2/da 0 2024-09-17T01:41:23.680 INFO:tasks.workunit.client.1.smithi167.stdout:6/400: truncate d7/d12/f2b 956072 0 2024-09-17T01:41:23.681 INFO:tasks.workunit.client.0.smithi082.stdout:1/143: write d2/f18 [3112912,85727] 0 2024-09-17T01:41:23.681 INFO:tasks.workunit.client.0.smithi082.stdout:6/213: write d1/d7/d10/f38 [338653,113837] 0 2024-09-17T01:41:23.682 INFO:tasks.workunit.client.1.smithi167.stdout:4/363: dwrite d0/d4/d7/f23 [0,4194304] 0 2024-09-17T01:41:23.682 INFO:tasks.workunit.client.0.smithi082.stdout:1/144: write d2/dd/d24/f23 [82894,101202] 0 2024-09-17T01:41:23.683 INFO:tasks.workunit.client.1.smithi167.stdout:6/401: write d7/d42/f71 [46667,90357] 0 2024-09-17T01:41:23.684 INFO:tasks.workunit.client.0.smithi082.stdout:1/145: chown d2/dd/c22 24107800 1 2024-09-17T01:41:23.689 INFO:tasks.workunit.client.0.smithi082.stdout:0/142: dread da/fc [0,4194304] 0 2024-09-17T01:41:23.689 INFO:tasks.workunit.client.0.smithi082.stdout:1/146: dread d2/dd/d24/f23 [0,4194304] 0 2024-09-17T01:41:23.692 INFO:tasks.workunit.client.0.smithi082.stdout:6/214: dwrite d1/d3/f3b [0,4194304] 0 2024-09-17T01:41:23.692 INFO:tasks.workunit.client.1.smithi167.stdout:1/302: dwrite d0/d9/f37 [0,4194304] 0 2024-09-17T01:41:23.693 INFO:tasks.workunit.client.0.smithi082.stdout:6/215: fsync d1/d3/f1b 0 2024-09-17T01:41:23.693 INFO:tasks.workunit.client.0.smithi082.stdout:0/143: creat da/d16/f2e x:0 0 0 2024-09-17T01:41:23.694 INFO:tasks.workunit.client.1.smithi167.stdout:9/348: dwrite d4/d9/d21/d2d/d33/d3a/f4d [4194304,4194304] 0 2024-09-17T01:41:23.695 INFO:tasks.workunit.client.0.smithi082.stdout:6/216: write d1/d1f/f21 [4249890,42805] 0 2024-09-17T01:41:23.695 INFO:tasks.workunit.client.1.smithi167.stdout:3/329: dwrite d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:23.697 INFO:tasks.workunit.client.1.smithi167.stdout:1/303: stat d0/d9/d16/l55 0 2024-09-17T01:41:23.698 INFO:tasks.workunit.client.1.smithi167.stdout:5/250: truncate d0/d24/f38 684694 0 2024-09-17T01:41:23.701 INFO:tasks.workunit.client.1.smithi167.stdout:3/330: write d7/d8/d2a/f3f [3180634,30651] 0 2024-09-17T01:41:23.701 INFO:tasks.workunit.client.1.smithi167.stdout:6/402: dread d7/d54/d90/d13/f49 [0,4194304] 0 2024-09-17T01:41:23.703 INFO:tasks.workunit.client.1.smithi167.stdout:8/447: creat dc/d56/d59/d82/d85/f94 x:0 0 0 2024-09-17T01:41:23.704 INFO:tasks.workunit.client.0.smithi082.stdout:6/217: creat d1/d3/f4e x:0 0 0 2024-09-17T01:41:23.707 INFO:tasks.workunit.client.1.smithi167.stdout:4/364: mknod d0/d4/d7/da/d48/d40/d57/c82 0 2024-09-17T01:41:23.712 INFO:tasks.workunit.client.0.smithi082.stdout:0/144: link da/c1f da/df/d2b/c2f 0 2024-09-17T01:41:23.713 INFO:tasks.workunit.client.1.smithi167.stdout:2/357: getdents d5/d10/d1a/d2e/d49 0 2024-09-17T01:41:23.714 INFO:tasks.workunit.client.1.smithi167.stdout:9/349: mknod d4/d9/d21/d43/c65 0 2024-09-17T01:41:23.714 INFO:tasks.workunit.client.0.smithi082.stdout:0/145: mknod da/df/c30 0 2024-09-17T01:41:23.715 INFO:tasks.workunit.client.1.smithi167.stdout:5/251: symlink d0/d24/d2b/l45 0 2024-09-17T01:41:23.716 INFO:tasks.workunit.client.1.smithi167.stdout:6/403: mkdir d7/d54/d91 0 2024-09-17T01:41:23.717 INFO:tasks.workunit.client.1.smithi167.stdout:4/365: creat d0/d4/d7/d6/f83 x:0 0 0 2024-09-17T01:41:23.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/305: creat d5/d8/d9/f62 x:0 0 0 2024-09-17T01:41:23.719 INFO:tasks.workunit.client.1.smithi167.stdout:7/335: rename d0/d2/d14/d19/f2f to d0/d2/d14/f6b 0 2024-09-17T01:41:23.720 INFO:tasks.workunit.client.1.smithi167.stdout:7/336: chown d0/d2/d14/d19/d32 7068318 1 2024-09-17T01:41:23.721 INFO:tasks.workunit.client.0.smithi082.stdout:0/146: creat da/f31 x:0 0 0 2024-09-17T01:41:23.722 INFO:tasks.workunit.client.1.smithi167.stdout:7/337: write d0/d2/d14/d19/d32/f4d [229727,48494] 0 2024-09-17T01:41:23.722 INFO:tasks.workunit.client.1.smithi167.stdout:9/350: unlink d4/f5b 0 2024-09-17T01:41:23.724 INFO:tasks.workunit.client.0.smithi082.stdout:0/147: dread da/df/f15 [0,4194304] 0 2024-09-17T01:41:23.724 INFO:tasks.workunit.client.1.smithi167.stdout:6/404: rmdir d7/d54/d90/d13/d2f/d30 39 2024-09-17T01:41:23.724 INFO:tasks.workunit.client.1.smithi167.stdout:9/351: read d4/d9/f3d [650328,117011] 0 2024-09-17T01:41:23.725 INFO:tasks.workunit.client.1.smithi167.stdout:4/366: creat d0/d4/d7/da/d48/d40/d51/f84 x:0 0 0 2024-09-17T01:41:23.726 INFO:tasks.workunit.client.0.smithi082.stdout:0/148: fsync da/d24/f2a 0 2024-09-17T01:41:23.727 INFO:tasks.workunit.client.1.smithi167.stdout:0/306: rmdir d5/d8/d9/d2f 39 2024-09-17T01:41:23.729 INFO:tasks.workunit.client.0.smithi082.stdout:0/149: mknod da/df/d27/c32 0 2024-09-17T01:41:23.731 INFO:tasks.workunit.client.1.smithi167.stdout:5/252: getdents d0/d9/d1c/d25 0 2024-09-17T01:41:23.732 INFO:tasks.workunit.client.1.smithi167.stdout:9/352: dwrite d4/d9/d21/f3b [0,4194304] 0 2024-09-17T01:41:23.736 INFO:tasks.workunit.client.1.smithi167.stdout:7/338: rmdir d0/d2/d14/d19/d22 39 2024-09-17T01:41:23.738 INFO:tasks.workunit.client.0.smithi082.stdout:0/150: dread da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:23.739 INFO:tasks.workunit.client.1.smithi167.stdout:1/304: dread d0/f46 [0,4194304] 0 2024-09-17T01:41:23.739 INFO:tasks.workunit.client.0.smithi082.stdout:0/151: write da/f31 [960940,22879] 0 2024-09-17T01:41:23.740 INFO:tasks.workunit.client.1.smithi167.stdout:5/253: dwrite d0/d24/d2b/d3d/d3b/f3e [0,4194304] 0 2024-09-17T01:41:23.740 INFO:tasks.workunit.client.1.smithi167.stdout:7/339: truncate d0/d2/d14/d19/d32/f6a 53211 0 2024-09-17T01:41:23.743 INFO:tasks.workunit.client.1.smithi167.stdout:6/405: dread d7/d54/d90/d13/f3f [0,4194304] 0 2024-09-17T01:41:23.743 INFO:tasks.workunit.client.1.smithi167.stdout:9/353: rmdir d4 39 2024-09-17T01:41:23.744 INFO:tasks.workunit.client.1.smithi167.stdout:8/448: dread dc/ff [0,4194304] 0 2024-09-17T01:41:23.744 INFO:tasks.workunit.client.0.smithi082.stdout:0/152: truncate f8 500528 0 2024-09-17T01:41:23.746 INFO:tasks.workunit.client.0.smithi082.stdout:1/147: truncate d2/dd/d24/f23 217871 0 2024-09-17T01:41:23.750 INFO:tasks.workunit.client.0.smithi082.stdout:1/148: rename d2/da/fe to d2/da/d2f/f31 0 2024-09-17T01:41:23.751 INFO:tasks.workunit.client.1.smithi167.stdout:1/305: mknod d0/d9/c57 0 2024-09-17T01:41:23.751 INFO:tasks.workunit.client.1.smithi167.stdout:6/406: dwrite d7/d12/d27/d3a/f63 [0,4194304] 0 2024-09-17T01:41:23.752 INFO:tasks.workunit.client.0.smithi082.stdout:6/218: write d1/d7/d8/fb [3017677,112004] 0 2024-09-17T01:41:23.752 INFO:tasks.workunit.client.0.smithi082.stdout:0/153: mknod da/c33 0 2024-09-17T01:41:23.755 INFO:tasks.workunit.client.1.smithi167.stdout:3/331: rename d7/d8/d10/d14/f57 to d7/f65 0 2024-09-17T01:41:23.756 INFO:tasks.workunit.client.0.smithi082.stdout:1/149: mknod d2/dd/d24/c32 0 2024-09-17T01:41:23.759 INFO:tasks.workunit.client.1.smithi167.stdout:7/340: dwrite d0/d2/d14/d23/f58 [0,4194304] 0 2024-09-17T01:41:23.760 INFO:tasks.workunit.client.0.smithi082.stdout:6/219: rename d1/d7/d8 to d1/d7/d10/d4f 0 2024-09-17T01:41:23.762 INFO:tasks.workunit.client.1.smithi167.stdout:9/354: write d4/d4a/f55 [1673668,11697] 0 2024-09-17T01:41:23.764 INFO:tasks.workunit.client.1.smithi167.stdout:8/449: creat dc/d56/d59/d82/f95 x:0 0 0 2024-09-17T01:41:23.764 INFO:tasks.workunit.client.1.smithi167.stdout:9/355: chown d4/d9/d21/d43/f45 0 1 2024-09-17T01:41:23.765 INFO:tasks.workunit.client.0.smithi082.stdout:0/154: rename da/d16/c18 to da/d24/c34 0 2024-09-17T01:41:23.769 INFO:tasks.workunit.client.0.smithi082.stdout:6/220: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f50 x:0 0 0 2024-09-17T01:41:23.769 INFO:tasks.workunit.client.1.smithi167.stdout:6/407: mknod d7/d12/d27/d3a/d61/c92 0 2024-09-17T01:41:23.770 INFO:tasks.workunit.client.1.smithi167.stdout:2/358: dwrite d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:23.772 INFO:tasks.workunit.client.0.smithi082.stdout:0/155: dwrite da/fd [0,4194304] 0 2024-09-17T01:41:23.772 INFO:tasks.workunit.client.1.smithi167.stdout:6/408: read d7/d12/d27/d28/f46 [21174,19965] 0 2024-09-17T01:41:23.772 INFO:tasks.workunit.client.1.smithi167.stdout:8/450: dwrite dc/d21/d6b/d74/f92 [0,4194304] 0 2024-09-17T01:41:23.776 INFO:tasks.workunit.client.0.smithi082.stdout:6/221: unlink d1/d3/f3d 0 2024-09-17T01:41:23.779 INFO:tasks.workunit.client.1.smithi167.stdout:3/332: mkdir d7/d8/d10/d14/d66 0 2024-09-17T01:41:23.781 INFO:tasks.workunit.client.1.smithi167.stdout:4/367: write d0/d4/f47 [223827,127242] 0 2024-09-17T01:41:23.782 INFO:tasks.workunit.client.0.smithi082.stdout:6/222: dread d1/d7/f46 [0,4194304] 0 2024-09-17T01:41:23.784 INFO:tasks.workunit.client.0.smithi082.stdout:6/223: write d1/d7/d10/d4f/dc/f29 [3745105,19468] 0 2024-09-17T01:41:23.787 INFO:tasks.workunit.client.1.smithi167.stdout:3/333: dwrite d7/d8/d10/f64 [0,4194304] 0 2024-09-17T01:41:23.789 INFO:tasks.workunit.client.1.smithi167.stdout:3/334: readlink d7/d8/d10/d14/d25/lb 0 2024-09-17T01:41:23.790 INFO:tasks.workunit.client.1.smithi167.stdout:1/306: link d0/f46 d0/d9/d16/d48/f58 0 2024-09-17T01:41:23.795 INFO:tasks.workunit.client.1.smithi167.stdout:1/307: dread d0/d5/d34/d3c/f2b [0,4194304] 0 2024-09-17T01:41:23.796 INFO:tasks.workunit.client.0.smithi082.stdout:6/224: rename d1/d3/l13 to d1/d7/d10/d4f/dc/d1d/d36/d3e/l51 0 2024-09-17T01:41:23.799 INFO:tasks.workunit.client.1.smithi167.stdout:2/359: write d5/d10/d1a/d45/f68 [43701,81110] 0 2024-09-17T01:41:23.800 INFO:tasks.workunit.client.1.smithi167.stdout:2/360: write d5/d10/d16/f1b [505795,41005] 0 2024-09-17T01:41:23.801 INFO:tasks.workunit.client.1.smithi167.stdout:2/361: write d5/d10/d1a/d2e/d49/f64 [4308997,27140] 0 2024-09-17T01:41:23.807 INFO:tasks.workunit.client.0.smithi082.stdout:6/225: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l52 0 2024-09-17T01:41:23.809 INFO:tasks.workunit.client.0.smithi082.stdout:6/226: stat d1/d7/d10/d4f/dc/d2b/d48/f2a 0 2024-09-17T01:41:23.809 INFO:tasks.workunit.client.1.smithi167.stdout:5/254: rename d0/c5 to d0/d24/d2b/d3d/d3b/c46 0 2024-09-17T01:41:23.810 INFO:tasks.workunit.client.1.smithi167.stdout:7/341: rmdir d0/d2/d14/d19/d22/d40 39 2024-09-17T01:41:23.812 INFO:tasks.workunit.client.0.smithi082.stdout:6/227: creat d1/d7/d10/d4f/dc/d2b/f53 x:0 0 0 2024-09-17T01:41:23.815 INFO:tasks.workunit.client.1.smithi167.stdout:3/335: creat d7/d8/d2a/d4e/f67 x:0 0 0 2024-09-17T01:41:23.816 INFO:tasks.workunit.client.1.smithi167.stdout:3/336: write d7/d8/d2a/d4e/f5f [556550,47017] 0 2024-09-17T01:41:23.816 INFO:tasks.workunit.client.0.smithi082.stdout:6/228: mknod d1/d7/d10/d4f/dc/c54 0 2024-09-17T01:41:23.817 INFO:tasks.workunit.client.0.smithi082.stdout:6/229: fsync d1/d7/d10/f11 0 2024-09-17T01:41:23.818 INFO:tasks.workunit.client.0.smithi082.stdout:6/230: chown d1/d1f/l25 43727 1 2024-09-17T01:41:23.821 INFO:tasks.workunit.client.0.smithi082.stdout:6/231: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55 0 2024-09-17T01:41:23.823 INFO:tasks.workunit.client.1.smithi167.stdout:6/409: mknod d7/d54/d90/d13/d2f/d30/c93 0 2024-09-17T01:41:23.824 INFO:tasks.workunit.client.0.smithi082.stdout:1/150: write d2/da/d2f/f31 [406612,68770] 0 2024-09-17T01:41:23.824 INFO:tasks.workunit.client.1.smithi167.stdout:2/362: mknod d5/d10/d1a/d39/c7f 0 2024-09-17T01:41:23.828 INFO:tasks.workunit.client.0.smithi082.stdout:1/151: dread d2/f4 [0,4194304] 0 2024-09-17T01:41:23.828 INFO:tasks.workunit.client.1.smithi167.stdout:8/451: truncate fb 441026 0 2024-09-17T01:41:23.829 INFO:tasks.workunit.client.0.smithi082.stdout:1/152: write d2/f20 [463765,121079] 0 2024-09-17T01:41:23.829 INFO:tasks.workunit.client.0.smithi082.stdout:6/232: mkdir d1/d7/d10/d4f/dc/d1d/d36/d56 0 2024-09-17T01:41:23.834 INFO:tasks.workunit.client.0.smithi082.stdout:6/233: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l57 0 2024-09-17T01:41:23.835 INFO:tasks.workunit.client.0.smithi082.stdout:6/234: write d1/d1f/f26 [447363,98459] 0 2024-09-17T01:41:23.835 INFO:tasks.workunit.client.1.smithi167.stdout:4/368: creat d0/d4/d7/da/d48/d40/d57/d6a/d81/f85 x:0 0 0 2024-09-17T01:41:23.836 INFO:tasks.workunit.client.1.smithi167.stdout:7/342: creat d0/d2/d14/d19/d26/d34/f6c x:0 0 0 2024-09-17T01:41:23.836 INFO:tasks.workunit.client.0.smithi082.stdout:6/235: truncate d1/d7/d10/f11 5090355 0 2024-09-17T01:41:23.837 INFO:tasks.workunit.client.0.smithi082.stdout:6/236: readlink d1/d7/l14 0 2024-09-17T01:41:23.838 INFO:tasks.workunit.client.1.smithi167.stdout:3/337: chown d7/d8/d10/d29 45111019 1 2024-09-17T01:41:23.839 INFO:tasks.workunit.client.1.smithi167.stdout:1/308: creat d0/d9/d16/d48/d54/f59 x:0 0 0 2024-09-17T01:41:23.841 INFO:tasks.workunit.client.0.smithi082.stdout:6/237: rename d1/d3/f4e to d1/d7/d10/d4f/dc/d1d/d36/d3e/f58 0 2024-09-17T01:41:23.845 INFO:tasks.workunit.client.1.smithi167.stdout:5/255: write d0/f22 [1780852,5516] 0 2024-09-17T01:41:23.845 INFO:tasks.workunit.client.0.smithi082.stdout:6/238: symlink d1/d7/d10/d4f/dc/d2b/d48/l59 0 2024-09-17T01:41:23.847 INFO:tasks.workunit.client.1.smithi167.stdout:7/343: symlink d0/d2/d14/d19/d32/d62/l6d 0 2024-09-17T01:41:23.849 INFO:tasks.workunit.client.1.smithi167.stdout:7/344: read d0/d2/d14/d19/f3e [438413,50508] 0 2024-09-17T01:41:23.849 INFO:tasks.workunit.client.0.smithi082.stdout:6/239: dread d1/d1f/f26 [0,4194304] 0 2024-09-17T01:41:23.851 INFO:tasks.workunit.client.1.smithi167.stdout:1/309: creat d0/d5/d34/f5a x:0 0 0 2024-09-17T01:41:23.852 INFO:tasks.workunit.client.1.smithi167.stdout:2/363: getdents d5/d6d 0 2024-09-17T01:41:23.853 INFO:tasks.workunit.client.1.smithi167.stdout:4/369: dread d0/d4/d7/d6/f66 [0,4194304] 0 2024-09-17T01:41:23.853 INFO:tasks.workunit.client.0.smithi082.stdout:6/240: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/l5a 0 2024-09-17T01:41:23.855 INFO:tasks.workunit.client.1.smithi167.stdout:8/452: unlink dc/c2a 0 2024-09-17T01:41:23.857 INFO:tasks.workunit.client.0.smithi082.stdout:6/241: creat d1/d3/f5b x:0 0 0 2024-09-17T01:41:23.857 INFO:tasks.workunit.client.1.smithi167.stdout:0/307: sync 2024-09-17T01:41:23.858 INFO:tasks.workunit.client.1.smithi167.stdout:9/356: rename d4/d9/d21/d43/c65 to d4/d9/d21/c66 0 2024-09-17T01:41:23.859 INFO:tasks.workunit.client.1.smithi167.stdout:4/370: dwrite d0/d4/d7/da/f4d [0,4194304] 0 2024-09-17T01:41:23.860 INFO:tasks.workunit.client.1.smithi167.stdout:3/338: creat d7/d8/d10/d14/d66/f68 x:0 0 0 2024-09-17T01:41:23.861 INFO:tasks.workunit.client.1.smithi167.stdout:7/345: mkdir d0/d2/d14/d19/d26/d34/d6e 0 2024-09-17T01:41:23.862 INFO:tasks.workunit.client.1.smithi167.stdout:7/346: fsync d0/d2/d14/f1b 0 2024-09-17T01:41:23.863 INFO:tasks.workunit.client.0.smithi082.stdout:6/242: creat d1/d7/f5c x:0 0 0 2024-09-17T01:41:23.866 INFO:tasks.workunit.client.1.smithi167.stdout:8/453: chown dc/d1a/c1f 37253 1 2024-09-17T01:41:23.868 INFO:tasks.workunit.client.1.smithi167.stdout:1/310: dread d0/d5/d34/f49 [0,4194304] 0 2024-09-17T01:41:23.871 INFO:tasks.workunit.client.1.smithi167.stdout:2/364: dread d5/f44 [0,4194304] 0 2024-09-17T01:41:23.872 INFO:tasks.workunit.client.0.smithi082.stdout:6/243: creat d1/f5d x:0 0 0 2024-09-17T01:41:23.873 INFO:tasks.workunit.client.1.smithi167.stdout:2/365: stat d5/l41 0 2024-09-17T01:41:23.873 INFO:tasks.workunit.client.1.smithi167.stdout:4/371: mknod d0/d4/d7/da/d48/d40/d57/d5a/c86 0 2024-09-17T01:41:23.873 INFO:tasks.workunit.client.1.smithi167.stdout:2/366: chown d5/d10/d16/l50 2163013 1 2024-09-17T01:41:23.873 INFO:tasks.workunit.client.1.smithi167.stdout:4/372: stat d0/c3b 0 2024-09-17T01:41:23.873 INFO:tasks.workunit.client.1.smithi167.stdout:6/410: getdents d7/d54/d90/d34 0 2024-09-17T01:41:23.875 INFO:tasks.workunit.client.1.smithi167.stdout:3/339: dread d7/d8/d10/f40 [0,4194304] 0 2024-09-17T01:41:23.878 INFO:tasks.workunit.client.1.smithi167.stdout:5/256: creat d0/f47 x:0 0 0 2024-09-17T01:41:23.878 INFO:tasks.workunit.client.1.smithi167.stdout:0/308: getdents d5/d8/d5c 0 2024-09-17T01:41:23.880 INFO:tasks.workunit.client.1.smithi167.stdout:9/357: fdatasync d4/d9/f25 0 2024-09-17T01:41:23.884 INFO:tasks.workunit.client.1.smithi167.stdout:2/367: rename d5/d10/d1a/f5c to d5/d33/d48/f80 0 2024-09-17T01:41:23.884 INFO:tasks.workunit.client.1.smithi167.stdout:4/373: dwrite d0/f52 [0,4194304] 0 2024-09-17T01:41:23.885 INFO:tasks.workunit.client.1.smithi167.stdout:6/411: dwrite d7/d12/f2b [0,4194304] 0 2024-09-17T01:41:23.885 INFO:tasks.workunit.client.1.smithi167.stdout:5/257: rmdir d0/d28/d3a 39 2024-09-17T01:41:23.887 INFO:tasks.workunit.client.1.smithi167.stdout:3/340: creat d7/d8/d10/d14/d24/d62/f69 x:0 0 0 2024-09-17T01:41:23.891 INFO:tasks.workunit.client.1.smithi167.stdout:7/347: dread d0/d2/d14/d19/d26/d34/f5d [0,4194304] 0 2024-09-17T01:41:23.892 INFO:tasks.workunit.client.1.smithi167.stdout:8/454: dwrite dc/f15 [0,4194304] 0 2024-09-17T01:41:23.895 INFO:tasks.workunit.client.1.smithi167.stdout:3/341: chown d7/d8/d10/c16 0 1 2024-09-17T01:41:23.896 INFO:tasks.workunit.client.1.smithi167.stdout:6/412: write d7/d54/d90/d13/f2d [80404,48970] 0 2024-09-17T01:41:23.897 INFO:tasks.workunit.client.1.smithi167.stdout:4/374: mknod d0/d4/d7/d6/d2b/d6d/d7e/c87 0 2024-09-17T01:41:23.898 INFO:tasks.workunit.client.1.smithi167.stdout:5/258: dread d0/f20 [0,4194304] 0 2024-09-17T01:41:23.900 INFO:tasks.workunit.client.1.smithi167.stdout:9/358: link d4/d9/d21/d2d/d33/d3a/f40 d4/d9/d21/d2d/d33/d3a/f67 0 2024-09-17T01:41:23.900 INFO:tasks.workunit.client.1.smithi167.stdout:0/309: dwrite d5/d8/d2e/d4d/f22 [0,4194304] 0 2024-09-17T01:41:23.901 INFO:tasks.workunit.client.1.smithi167.stdout:3/342: symlink d7/d8/d10/d14/l6a 0 2024-09-17T01:41:23.901 INFO:tasks.workunit.client.1.smithi167.stdout:4/375: chown d0/d4/d7/da/d48/d40/d51/d2d 2095 1 2024-09-17T01:41:23.902 INFO:tasks.workunit.client.1.smithi167.stdout:7/348: mkdir d0/d2/d14/d6f 0 2024-09-17T01:41:23.907 INFO:tasks.workunit.client.1.smithi167.stdout:4/376: chown d0/d4/d7/da/d48/d40/d51/d2d/d74 246376853 1 2024-09-17T01:41:23.907 INFO:tasks.workunit.client.1.smithi167.stdout:7/349: stat d0/d2/d14/d19/d32/f6a 0 2024-09-17T01:41:23.908 INFO:tasks.workunit.client.1.smithi167.stdout:3/343: rename d7/d8/d1f/f44 to d7/d8/d10/d14/d25/f6b 0 2024-09-17T01:41:23.912 INFO:tasks.workunit.client.1.smithi167.stdout:7/350: write d0/d2/d14/d19/f30 [663194,104901] 0 2024-09-17T01:41:23.912 INFO:tasks.workunit.client.1.smithi167.stdout:6/413: dwrite d7/d12/f62 [0,4194304] 0 2024-09-17T01:41:23.913 INFO:tasks.workunit.client.1.smithi167.stdout:3/344: mkdir d7/d8/d10/d14/d66/d6c 0 2024-09-17T01:41:23.914 INFO:tasks.workunit.client.1.smithi167.stdout:4/377: symlink d0/d4/d7/da/d48/d40/d57/d5a/d6f/l88 0 2024-09-17T01:41:23.915 INFO:tasks.workunit.client.1.smithi167.stdout:9/359: dwrite d4/d9/d21/d2d/d33/d3a/f4d [0,4194304] 0 2024-09-17T01:41:23.915 INFO:tasks.workunit.client.1.smithi167.stdout:6/414: symlink d7/d52/l94 0 2024-09-17T01:41:23.915 INFO:tasks.workunit.client.1.smithi167.stdout:7/351: stat d0/d2/d14/d23/f58 0 2024-09-17T01:41:23.917 INFO:tasks.workunit.client.1.smithi167.stdout:6/415: dread - d7/d12/d27/d3a/d61/f73 zero size 2024-09-17T01:41:23.922 INFO:tasks.workunit.client.1.smithi167.stdout:7/352: unlink d0/d2/c7 0 2024-09-17T01:41:23.923 INFO:tasks.workunit.client.1.smithi167.stdout:9/360: creat d4/d9/d21/d43/d47/f68 x:0 0 0 2024-09-17T01:41:23.923 INFO:tasks.workunit.client.1.smithi167.stdout:4/378: symlink d0/d4/d7/da/d48/l89 0 2024-09-17T01:41:23.923 INFO:tasks.workunit.client.1.smithi167.stdout:6/416: chown d7/d12/d27/d28 3276 1 2024-09-17T01:41:23.924 INFO:tasks.workunit.client.1.smithi167.stdout:7/353: stat d0/d2/d14/d23/c44 0 2024-09-17T01:41:23.925 INFO:tasks.workunit.client.1.smithi167.stdout:5/259: write d0/f19 [3985575,53577] 0 2024-09-17T01:41:23.925 INFO:tasks.workunit.client.1.smithi167.stdout:9/361: chown d4/d9/d21/d43/d47 2752 1 2024-09-17T01:41:23.928 INFO:tasks.workunit.client.1.smithi167.stdout:4/379: write d0/d4/d7/f67 [425807,4764] 0 2024-09-17T01:41:23.928 INFO:tasks.workunit.client.1.smithi167.stdout:7/354: mkdir d0/d55/d70 0 2024-09-17T01:41:23.929 INFO:tasks.workunit.client.1.smithi167.stdout:6/417: mkdir d7/d54/d90/d13/d2f/d64/d6b/d95 0 2024-09-17T01:41:23.931 INFO:tasks.workunit.client.1.smithi167.stdout:5/260: mknod d0/d24/d2b/c48 0 2024-09-17T01:41:23.931 INFO:tasks.workunit.client.1.smithi167.stdout:9/362: rmdir d4/d9/d21 39 2024-09-17T01:41:23.932 INFO:tasks.workunit.client.1.smithi167.stdout:3/345: write f3 [146012,37454] 0 2024-09-17T01:41:23.932 INFO:tasks.workunit.client.1.smithi167.stdout:7/355: rmdir d0/d2/d14 39 2024-09-17T01:41:23.933 INFO:tasks.workunit.client.1.smithi167.stdout:6/418: dread d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:23.934 INFO:tasks.workunit.client.1.smithi167.stdout:3/346: write d7/d8/d10/d14/f5a [1956590,111590] 0 2024-09-17T01:41:23.936 INFO:tasks.workunit.client.1.smithi167.stdout:5/261: mkdir d0/d24/d2b/d49 0 2024-09-17T01:41:23.937 INFO:tasks.workunit.client.1.smithi167.stdout:4/380: link d0/d4/d7/da/d48/d40/d51/d2d/c59 d0/d4/d7/da/d48/d40/d51/c8a 0 2024-09-17T01:41:23.938 INFO:tasks.workunit.client.1.smithi167.stdout:7/356: fdatasync d0/d2/d14/d19/d32/d62/f64 0 2024-09-17T01:41:23.938 INFO:tasks.workunit.client.1.smithi167.stdout:9/363: creat d4/d9/d21/d43/f69 x:0 0 0 2024-09-17T01:41:23.939 INFO:tasks.workunit.client.1.smithi167.stdout:3/347: creat d7/d8/d10/d14/f6d x:0 0 0 2024-09-17T01:41:23.940 INFO:tasks.workunit.client.1.smithi167.stdout:5/262: symlink d0/d9/d1c/l4a 0 2024-09-17T01:41:23.942 INFO:tasks.workunit.client.1.smithi167.stdout:6/419: dread d7/d12/d27/d3a/f63 [0,4194304] 0 2024-09-17T01:41:23.942 INFO:tasks.workunit.client.1.smithi167.stdout:9/364: write d4/d9/d21/d2d/d33/d3a/f4d [7856504,406] 0 2024-09-17T01:41:23.943 INFO:tasks.workunit.client.1.smithi167.stdout:7/357: truncate d0/d55/d5b/f60 3037498 0 2024-09-17T01:41:23.944 INFO:tasks.workunit.client.1.smithi167.stdout:8/455: dread dc/d1a/f49 [0,4194304] 0 2024-09-17T01:41:23.945 INFO:tasks.workunit.client.1.smithi167.stdout:6/420: dread d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:23.945 INFO:tasks.workunit.client.1.smithi167.stdout:3/348: creat d7/d8/d10/d14/d2c/f6e x:0 0 0 2024-09-17T01:41:23.947 INFO:tasks.workunit.client.1.smithi167.stdout:3/349: chown d7/d8/d2a/d4e/f5f 441055749 1 2024-09-17T01:41:23.947 INFO:tasks.workunit.client.1.smithi167.stdout:5/263: rename d0/d9/d1c/d25 to d0/d24/d2b/d49/d4b 0 2024-09-17T01:41:23.955 INFO:tasks.workunit.client.1.smithi167.stdout:7/358: creat d0/d2/d14/d19/d26/d34/d6e/f71 x:0 0 0 2024-09-17T01:41:23.955 INFO:tasks.workunit.client.1.smithi167.stdout:3/350: dwrite d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:23.958 INFO:tasks.workunit.client.1.smithi167.stdout:6/421: mkdir d7/d54/d90/d13/d2f/d96 0 2024-09-17T01:41:23.961 INFO:tasks.workunit.client.1.smithi167.stdout:9/365: dread d4/d9/f1d [0,4194304] 0 2024-09-17T01:41:23.962 INFO:tasks.workunit.client.1.smithi167.stdout:6/422: readlink d7/d12/d27/d28/l36 0 2024-09-17T01:41:23.963 INFO:tasks.workunit.client.1.smithi167.stdout:5/264: creat d0/d28/d3a/d44/f4c x:0 0 0 2024-09-17T01:41:23.964 INFO:tasks.workunit.client.1.smithi167.stdout:3/351: dread d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:23.965 INFO:tasks.workunit.client.1.smithi167.stdout:4/381: dread d0/d4/d7/d6/f60 [0,4194304] 0 2024-09-17T01:41:23.966 INFO:tasks.workunit.client.1.smithi167.stdout:6/423: mkdir d7/d12/d27/d3a/d56/d97 0 2024-09-17T01:41:23.966 INFO:tasks.workunit.client.1.smithi167.stdout:3/352: write d7/f3e [563718,90610] 0 2024-09-17T01:41:23.966 INFO:tasks.workunit.client.1.smithi167.stdout:9/366: truncate d4/d9/d21/f60 35017 0 2024-09-17T01:41:23.968 INFO:tasks.workunit.client.1.smithi167.stdout:3/353: chown d7/d1e/l34 3929151 1 2024-09-17T01:41:23.970 INFO:tasks.workunit.client.1.smithi167.stdout:8/456: truncate dc/d18/f46 4472712 0 2024-09-17T01:41:23.972 INFO:tasks.workunit.client.1.smithi167.stdout:4/382: creat d0/d4/d7/da/d48/d40/d57/d6a/d81/f8b x:0 0 0 2024-09-17T01:41:23.973 INFO:tasks.workunit.client.1.smithi167.stdout:5/265: dwrite d0/d24/d2b/d3d/d3b/f3e [0,4194304] 0 2024-09-17T01:41:23.974 INFO:tasks.workunit.client.1.smithi167.stdout:4/383: read - d0/d4/d7/da/f6e zero size 2024-09-17T01:41:23.977 INFO:tasks.workunit.client.1.smithi167.stdout:9/367: symlink d4/d9/d21/l6a 0 2024-09-17T01:41:23.977 INFO:tasks.workunit.client.1.smithi167.stdout:7/359: truncate d0/d2/f2e 541552 0 2024-09-17T01:41:23.979 INFO:tasks.workunit.client.1.smithi167.stdout:6/424: rename d7/d12 to d7/d54/d90/d13/d2f/d7f/d98 0 2024-09-17T01:41:23.980 INFO:tasks.workunit.client.1.smithi167.stdout:5/266: mkdir d0/d28/d3a/d4d 0 2024-09-17T01:41:23.981 INFO:tasks.workunit.client.1.smithi167.stdout:9/368: chown d4/d9/d21/d43 2148308 1 2024-09-17T01:41:23.983 INFO:tasks.workunit.client.1.smithi167.stdout:4/384: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:23.987 INFO:tasks.workunit.client.1.smithi167.stdout:9/369: mknod d4/d4a/c6b 0 2024-09-17T01:41:23.990 INFO:tasks.workunit.client.1.smithi167.stdout:6/425: creat d7/d54/d90/d13/f99 x:0 0 0 2024-09-17T01:41:23.991 INFO:tasks.workunit.client.1.smithi167.stdout:9/370: mkdir d4/d9/d21/d43/d6c 0 2024-09-17T01:41:23.993 INFO:tasks.workunit.client.1.smithi167.stdout:7/360: write d0/d2/f21 [729513,85633] 0 2024-09-17T01:41:23.994 INFO:tasks.workunit.client.1.smithi167.stdout:6/426: write d7/d54/d90/d13/d2f/d7f/d98/f1c [2840338,107883] 0 2024-09-17T01:41:23.995 INFO:tasks.workunit.client.1.smithi167.stdout:4/385: getdents d0/d4 0 2024-09-17T01:41:23.997 INFO:tasks.workunit.client.1.smithi167.stdout:9/371: creat d4/d9/f6d x:0 0 0 2024-09-17T01:41:23.998 INFO:tasks.workunit.client.1.smithi167.stdout:6/427: creat d7/d54/d90/d13/d2f/d30/d32/f9a x:0 0 0 2024-09-17T01:41:23.999 INFO:tasks.workunit.client.1.smithi167.stdout:9/372: chown d4/d9/d21/d2d/c5e 983 1 2024-09-17T01:41:24.000 INFO:tasks.workunit.client.1.smithi167.stdout:4/386: creat d0/d4/d7/da/d48/d40/d51/d2d/d74/f8c x:0 0 0 2024-09-17T01:41:24.001 INFO:tasks.workunit.client.1.smithi167.stdout:9/373: rmdir d4/d9/d21/d43/d47 39 2024-09-17T01:41:24.002 INFO:tasks.workunit.client.1.smithi167.stdout:9/374: write d4/d9/d21/f2f [1278526,40008] 0 2024-09-17T01:41:24.003 INFO:tasks.workunit.client.1.smithi167.stdout:4/387: mknod d0/d4/d7/d6/c8d 0 2024-09-17T01:41:24.005 INFO:tasks.workunit.client.1.smithi167.stdout:4/388: rmdir d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31 39 2024-09-17T01:41:24.006 INFO:tasks.workunit.client.1.smithi167.stdout:4/389: fsync d0/f64 0 2024-09-17T01:41:24.007 INFO:tasks.workunit.client.1.smithi167.stdout:4/390: mknod d0/d4/d7/d6/d2b/d6d/d7e/c8e 0 2024-09-17T01:41:24.015 INFO:tasks.workunit.client.1.smithi167.stdout:5/267: dread d0/d9/f2d [0,4194304] 0 2024-09-17T01:41:24.015 INFO:tasks.workunit.client.1.smithi167.stdout:7/361: dwrite d0/d2/d14/d19/d26/f35 [4194304,4194304] 0 2024-09-17T01:41:24.015 INFO:tasks.workunit.client.1.smithi167.stdout:5/268: chown d0 6432 1 2024-09-17T01:41:24.016 INFO:tasks.workunit.client.1.smithi167.stdout:4/391: dwrite d0/d4/d69/f6b [0,4194304] 0 2024-09-17T01:41:24.016 INFO:tasks.workunit.client.1.smithi167.stdout:1/311: sync 2024-09-17T01:41:24.017 INFO:tasks.workunit.client.1.smithi167.stdout:1/312: stat d0/d5/d34/c27 0 2024-09-17T01:41:24.021 INFO:tasks.workunit.client.1.smithi167.stdout:1/313: fdatasync d0/d5/d34/d3c/f41 0 2024-09-17T01:41:24.022 INFO:tasks.workunit.client.1.smithi167.stdout:5/269: write d0/f20 [204145,109521] 0 2024-09-17T01:41:24.024 INFO:tasks.workunit.client.1.smithi167.stdout:7/362: dwrite d0/d2/f21 [0,4194304] 0 2024-09-17T01:41:24.025 INFO:tasks.workunit.client.1.smithi167.stdout:5/270: write d0/f22 [1336776,118650] 0 2024-09-17T01:41:24.028 INFO:tasks.workunit.client.1.smithi167.stdout:4/392: rename d0/d4/d7/da/d48/d40/d51/d2d/c59 to d0/d4/d7/da/d48/d40/d51/d2d/d74/c8f 0 2024-09-17T01:41:24.034 INFO:tasks.workunit.client.1.smithi167.stdout:7/363: creat d0/d2/d14/f72 x:0 0 0 2024-09-17T01:41:24.036 INFO:tasks.workunit.client.1.smithi167.stdout:4/393: readlink d0/d4/d7/da/d48/d40/d51/d2d/l7c 0 2024-09-17T01:41:24.038 INFO:tasks.workunit.client.1.smithi167.stdout:1/314: dwrite d0/d5/d34/d3c/f4e [0,4194304] 0 2024-09-17T01:41:24.041 INFO:tasks.workunit.client.1.smithi167.stdout:5/271: dread d0/d24/d2b/d3d/d3b/f3e [0,4194304] 0 2024-09-17T01:41:24.042 INFO:tasks.workunit.client.1.smithi167.stdout:7/364: symlink d0/d2/d14/d19/d22/l73 0 2024-09-17T01:41:24.042 INFO:tasks.workunit.client.1.smithi167.stdout:1/315: creat d0/d5/d34/f5b x:0 0 0 2024-09-17T01:41:24.043 INFO:tasks.workunit.client.1.smithi167.stdout:5/272: chown d0/d28/d3a 886531097 1 2024-09-17T01:41:24.043 INFO:tasks.workunit.client.1.smithi167.stdout:6/428: dread d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:24.044 INFO:tasks.workunit.client.1.smithi167.stdout:4/394: getdents d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d75 0 2024-09-17T01:41:24.045 INFO:tasks.workunit.client.1.smithi167.stdout:4/395: chown d0/d4/d7/da/f4d 609051 1 2024-09-17T01:41:24.046 INFO:tasks.workunit.client.1.smithi167.stdout:1/316: mknod d0/d5/d34/d4c/c5c 0 2024-09-17T01:41:24.046 INFO:tasks.workunit.client.1.smithi167.stdout:5/273: mkdir d0/d24/d2b/d4e 0 2024-09-17T01:41:24.047 INFO:tasks.workunit.client.1.smithi167.stdout:7/365: creat d0/f74 x:0 0 0 2024-09-17T01:41:24.047 INFO:tasks.workunit.client.1.smithi167.stdout:6/429: rmdir d7/d54/d90/d34 39 2024-09-17T01:41:24.048 INFO:tasks.workunit.client.1.smithi167.stdout:4/396: rmdir d0/d4/d7/d6/d2b 39 2024-09-17T01:41:24.051 INFO:tasks.workunit.client.1.smithi167.stdout:5/274: creat d0/d24/d2b/d3d/f4f x:0 0 0 2024-09-17T01:41:24.052 INFO:tasks.workunit.client.1.smithi167.stdout:1/317: link d0/d9/d16/d22/c23 d0/d9/d16/c5d 0 2024-09-17T01:41:24.053 INFO:tasks.workunit.client.1.smithi167.stdout:1/318: truncate d0/d5/d34/f5a 112483 0 2024-09-17T01:41:24.053 INFO:tasks.workunit.client.1.smithi167.stdout:4/397: mknod d0/d4/d7/d6/d2b/d6d/c90 0 2024-09-17T01:41:24.055 INFO:tasks.workunit.client.1.smithi167.stdout:5/275: mknod d0/d24/d2b/d3d/c50 0 2024-09-17T01:41:24.056 INFO:tasks.workunit.client.1.smithi167.stdout:4/398: write d0/d4/d7/da/d48/d40/d57/d5a/d6f/f79 [986733,90939] 0 2024-09-17T01:41:24.057 INFO:tasks.workunit.client.1.smithi167.stdout:1/319: rename d0/d9/l2a to d0/d9/d16/d22/l5e 0 2024-09-17T01:41:24.058 INFO:tasks.workunit.client.1.smithi167.stdout:5/276: chown d0/f14 8167830 1 2024-09-17T01:41:24.064 INFO:tasks.workunit.client.1.smithi167.stdout:5/277: rename d0/d24/d2b/d3d/d3b/c46 to d0/d9/c51 0 2024-09-17T01:41:24.066 INFO:tasks.workunit.client.1.smithi167.stdout:1/320: write d0/d5/d34/d3c/f2b [270245,116363] 0 2024-09-17T01:41:24.071 INFO:tasks.workunit.client.1.smithi167.stdout:1/321: getdents d0/d9/d16/d48 0 2024-09-17T01:41:24.072 INFO:tasks.workunit.client.1.smithi167.stdout:7/366: dread d0/d2/d14/d19/d22/d40/f4a [0,4194304] 0 2024-09-17T01:41:24.072 INFO:tasks.workunit.client.1.smithi167.stdout:6/430: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f87 [0,4194304] 0 2024-09-17T01:41:24.075 INFO:tasks.workunit.client.1.smithi167.stdout:5/278: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:41:24.080 INFO:tasks.workunit.client.1.smithi167.stdout:1/322: dread d0/f46 [0,4194304] 0 2024-09-17T01:41:24.084 INFO:tasks.workunit.client.1.smithi167.stdout:5/279: creat d0/d28/f52 x:0 0 0 2024-09-17T01:41:24.084 INFO:tasks.workunit.client.1.smithi167.stdout:7/367: dwrite d0/d2/d14/d19/d22/f5e [0,4194304] 0 2024-09-17T01:41:24.089 INFO:tasks.workunit.client.1.smithi167.stdout:6/431: dwrite d7/d54/d90/d34/f76 [0,4194304] 0 2024-09-17T01:41:24.089 INFO:tasks.workunit.client.1.smithi167.stdout:1/323: creat d0/d5/d34/f5f x:0 0 0 2024-09-17T01:41:24.089 INFO:tasks.workunit.client.1.smithi167.stdout:6/432: rmdir d7/d52 39 2024-09-17T01:41:24.090 INFO:tasks.workunit.client.1.smithi167.stdout:6/433: symlink d7/d54/d90/d34/l9b 0 2024-09-17T01:41:24.092 INFO:tasks.workunit.client.1.smithi167.stdout:1/324: getdents d0/d9/d16 0 2024-09-17T01:41:24.094 INFO:tasks.workunit.client.1.smithi167.stdout:1/325: dread - d0/d9/d16/d36/f53 zero size 2024-09-17T01:41:24.096 INFO:tasks.workunit.client.1.smithi167.stdout:5/280: dwrite d0/f21 [0,4194304] 0 2024-09-17T01:41:24.096 INFO:tasks.workunit.client.1.smithi167.stdout:1/326: readlink d0/l3a 0 2024-09-17T01:41:24.098 INFO:tasks.workunit.client.1.smithi167.stdout:6/434: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/c9c 0 2024-09-17T01:41:24.103 INFO:tasks.workunit.client.1.smithi167.stdout:6/435: dwrite d7/d54/d90/f5b [0,4194304] 0 2024-09-17T01:41:24.104 INFO:tasks.workunit.client.1.smithi167.stdout:6/436: readlink d7/d54/d90/d13/d2f/d7f/d98/l4f 0 2024-09-17T01:41:24.108 INFO:tasks.workunit.client.1.smithi167.stdout:1/327: truncate d0/d9/f37 3821072 0 2024-09-17T01:41:24.110 INFO:tasks.workunit.client.1.smithi167.stdout:6/437: dwrite d7/d54/d90/d13/f99 [0,4194304] 0 2024-09-17T01:41:24.110 INFO:tasks.workunit.client.1.smithi167.stdout:1/328: write d0/d5/d34/d3c/f4e [674860,60108] 0 2024-09-17T01:41:24.112 INFO:tasks.workunit.client.1.smithi167.stdout:6/438: write d7/d54/d90/d13/d2f/d7f/d98/f1c [627295,77633] 0 2024-09-17T01:41:24.115 INFO:tasks.workunit.client.1.smithi167.stdout:6/439: creat d7/d42/f9d x:0 0 0 2024-09-17T01:41:24.115 INFO:tasks.workunit.client.1.smithi167.stdout:1/329: getdents d0 0 2024-09-17T01:41:24.119 INFO:tasks.workunit.client.1.smithi167.stdout:1/330: creat d0/d9/d16/d48/d54/f60 x:0 0 0 2024-09-17T01:41:24.120 INFO:tasks.workunit.client.1.smithi167.stdout:1/331: fsync d0/d9/d16/d22/f4d 0 2024-09-17T01:41:24.122 INFO:tasks.workunit.client.1.smithi167.stdout:6/440: dwrite d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:24.123 INFO:tasks.workunit.client.1.smithi167.stdout:1/332: truncate d0/d5/d34/f5f 406949 0 2024-09-17T01:41:24.124 INFO:tasks.workunit.client.1.smithi167.stdout:6/441: write d7/d54/d90/d13/d2f/d30/d32/f47 [21300,56286] 0 2024-09-17T01:41:24.127 INFO:tasks.workunit.client.1.smithi167.stdout:6/442: creat d7/d54/d90/d13/d2f/d96/f9e x:0 0 0 2024-09-17T01:41:24.127 INFO:tasks.workunit.client.1.smithi167.stdout:1/333: getdents d0/d5/d34/d4c 0 2024-09-17T01:41:24.129 INFO:tasks.workunit.client.1.smithi167.stdout:1/334: fdatasync d0/d5/d34/d3c/f42 0 2024-09-17T01:41:24.134 INFO:tasks.workunit.client.1.smithi167.stdout:2/368: sync 2024-09-17T01:41:24.134 INFO:tasks.workunit.client.1.smithi167.stdout:0/310: sync 2024-09-17T01:41:24.134 INFO:tasks.workunit.client.1.smithi167.stdout:6/443: rename f6 to d7/d54/d90/d13/d2f/d7f/d98/d27/f9f 0 2024-09-17T01:41:24.137 INFO:tasks.workunit.client.1.smithi167.stdout:2/369: creat d5/d3c/f81 x:0 0 0 2024-09-17T01:41:24.139 INFO:tasks.workunit.client.1.smithi167.stdout:2/370: write d5/d10/d1a/f56 [594647,38573] 0 2024-09-17T01:41:24.139 INFO:tasks.workunit.client.1.smithi167.stdout:1/335: rename d0/d9/d16/d3f to d0/d5/d61 0 2024-09-17T01:41:24.141 INFO:tasks.workunit.client.1.smithi167.stdout:6/444: creat d7/d54/d90/d13/d2f/d64/d6b/fa0 x:0 0 0 2024-09-17T01:41:24.142 INFO:tasks.workunit.client.1.smithi167.stdout:1/336: symlink d0/d5/l62 0 2024-09-17T01:41:24.144 INFO:tasks.workunit.client.1.smithi167.stdout:6/445: mkdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1 0 2024-09-17T01:41:24.145 INFO:tasks.workunit.client.1.smithi167.stdout:1/337: creat d0/d5/d34/f63 x:0 0 0 2024-09-17T01:41:24.146 INFO:tasks.workunit.client.1.smithi167.stdout:0/311: unlink d5/d8/d9/d2f/c47 0 2024-09-17T01:41:24.155 INFO:tasks.workunit.client.1.smithi167.stdout:1/338: link d0/d9/d16/d48/f58 d0/d9/d16/d48/d54/f64 0 2024-09-17T01:41:24.156 INFO:tasks.workunit.client.1.smithi167.stdout:6/446: dwrite d7/d54/d90/f5b [0,4194304] 0 2024-09-17T01:41:24.157 INFO:tasks.workunit.client.1.smithi167.stdout:6/447: dread - d7/f7b zero size 2024-09-17T01:41:24.157 INFO:tasks.workunit.client.1.smithi167.stdout:0/312: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:24.160 INFO:tasks.workunit.client.1.smithi167.stdout:1/339: unlink d0/d9/d16/d36/c51 0 2024-09-17T01:41:24.160 INFO:tasks.workunit.client.1.smithi167.stdout:0/313: creat d5/d8/d2e/d4d/d58/f63 x:0 0 0 2024-09-17T01:41:24.163 INFO:tasks.workunit.client.1.smithi167.stdout:6/448: mkdir d7/d54/d90/d13/d2f/d30/d88/da2 0 2024-09-17T01:41:24.164 INFO:tasks.workunit.client.1.smithi167.stdout:1/340: creat d0/d9/d16/d48/f65 x:0 0 0 2024-09-17T01:41:24.165 INFO:tasks.workunit.client.1.smithi167.stdout:1/341: dread - d0/d9/d16/d22/f4d zero size 2024-09-17T01:41:24.165 INFO:tasks.workunit.client.1.smithi167.stdout:0/314: symlink d5/d8/d2e/d4d/l64 0 2024-09-17T01:41:24.169 INFO:tasks.workunit.client.1.smithi167.stdout:0/315: dread d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:24.169 INFO:tasks.workunit.client.1.smithi167.stdout:1/342: creat d0/d9/d16/d22/f66 x:0 0 0 2024-09-17T01:41:24.172 INFO:tasks.workunit.client.1.smithi167.stdout:6/449: unlink d7/d54/d90/d13/d2f/d7f/d98/d27/f9f 0 2024-09-17T01:41:24.173 INFO:tasks.workunit.client.1.smithi167.stdout:6/450: dread - d7/f7b zero size 2024-09-17T01:41:24.173 INFO:tasks.workunit.client.1.smithi167.stdout:6/451: readlink d7/d54/d90/d13/l8e 0 2024-09-17T01:41:24.175 INFO:tasks.workunit.client.1.smithi167.stdout:6/452: write d7/d54/d90/d13/d2f/d30/f59 [2865584,61440] 0 2024-09-17T01:41:24.175 INFO:tasks.workunit.client.1.smithi167.stdout:0/316: link d5/d8/f44 d5/d8/d2e/d37/f65 0 2024-09-17T01:41:24.177 INFO:tasks.workunit.client.1.smithi167.stdout:6/453: chown d7/d54/d90/d13/d2f/d64/d6b/d95 2271 1 2024-09-17T01:41:24.177 INFO:tasks.workunit.client.1.smithi167.stdout:0/317: write d5/d8/d2e/d4d/f5a [2000774,17154] 0 2024-09-17T01:41:24.181 INFO:tasks.workunit.client.1.smithi167.stdout:0/318: creat d5/d8/d2e/f66 x:0 0 0 2024-09-17T01:41:24.181 INFO:tasks.workunit.client.1.smithi167.stdout:0/319: chown d5/d8/d9 951 1 2024-09-17T01:41:24.182 INFO:tasks.workunit.client.1.smithi167.stdout:6/454: rename d7/d54/d90/d13/c84 to d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1/ca3 0 2024-09-17T01:41:24.185 INFO:tasks.workunit.client.1.smithi167.stdout:6/455: mkdir d7/d52/d79/da4 0 2024-09-17T01:41:24.186 INFO:tasks.workunit.client.1.smithi167.stdout:6/456: fsync d7/f21 0 2024-09-17T01:41:24.189 INFO:tasks.workunit.client.1.smithi167.stdout:6/457: write d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [581415,54045] 0 2024-09-17T01:41:24.190 INFO:tasks.workunit.client.1.smithi167.stdout:6/458: write d7/d54/d90/d13/f55 [3842074,31658] 0 2024-09-17T01:41:24.193 INFO:tasks.workunit.client.1.smithi167.stdout:6/459: creat d7/d54/d90/d13/d2f/d64/d6b/fa5 x:0 0 0 2024-09-17T01:41:24.195 INFO:tasks.workunit.client.1.smithi167.stdout:6/460: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d28/ca6 0 2024-09-17T01:41:24.195 INFO:tasks.workunit.client.1.smithi167.stdout:6/461: chown d7/d54/d90/d13/c19 6814268 1 2024-09-17T01:41:24.196 INFO:tasks.workunit.client.1.smithi167.stdout:1/343: dread d0/f17 [0,4194304] 0 2024-09-17T01:41:24.198 INFO:tasks.workunit.client.1.smithi167.stdout:6/462: creat d7/d54/d90/d13/d2f/d30/fa7 x:0 0 0 2024-09-17T01:41:24.200 INFO:tasks.workunit.client.1.smithi167.stdout:6/463: chown d7/d54/d90/d13/d2f/d30/d32/f58 324379 1 2024-09-17T01:41:24.201 INFO:tasks.workunit.client.1.smithi167.stdout:6/464: mknod d7/d54/ca8 0 2024-09-17T01:41:24.202 INFO:tasks.workunit.client.1.smithi167.stdout:1/344: dwrite d0/d5/d34/f63 [0,4194304] 0 2024-09-17T01:41:24.205 INFO:tasks.workunit.client.1.smithi167.stdout:6/465: symlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/la9 0 2024-09-17T01:41:24.209 INFO:tasks.workunit.client.1.smithi167.stdout:6/466: creat d7/d54/d90/d13/d2f/d7f/d98/faa x:0 0 0 2024-09-17T01:41:24.209 INFO:tasks.workunit.client.1.smithi167.stdout:1/345: dwrite d0/d9/d16/d36/f3e [0,4194304] 0 2024-09-17T01:41:24.212 INFO:tasks.workunit.client.1.smithi167.stdout:6/467: write d7/d54/d90/d13/f65 [4279,66905] 0 2024-09-17T01:41:24.212 INFO:tasks.workunit.client.1.smithi167.stdout:1/346: mknod d0/d9/d16/d48/c67 0 2024-09-17T01:41:24.218 INFO:tasks.workunit.client.1.smithi167.stdout:6/468: rename d7/d54/d90/d13/d2f/d7f/d98/d27/d28 to d7/d54/d90/d13/d2f/d96/dab 0 2024-09-17T01:41:24.220 INFO:tasks.workunit.client.1.smithi167.stdout:6/469: symlink d7/d54/d90/d13/d2f/d7f/d98/lac 0 2024-09-17T01:41:24.223 INFO:tasks.workunit.client.1.smithi167.stdout:6/470: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/cad 0 2024-09-17T01:41:24.225 INFO:tasks.workunit.client.1.smithi167.stdout:1/347: dwrite d0/f46 [0,4194304] 0 2024-09-17T01:41:24.225 INFO:tasks.workunit.client.1.smithi167.stdout:6/471: write d7/d54/d90/d13/f17 [415560,85065] 0 2024-09-17T01:41:24.226 INFO:tasks.workunit.client.1.smithi167.stdout:6/472: fdatasync f0 0 2024-09-17T01:41:24.264 INFO:tasks.workunit.client.1.smithi167.stdout:3/354: sync 2024-09-17T01:41:24.264 INFO:tasks.workunit.client.1.smithi167.stdout:8/457: sync 2024-09-17T01:41:24.278 INFO:tasks.workunit.client.1.smithi167.stdout:3/355: write f6 [4677876,15028] 0 2024-09-17T01:41:24.279 INFO:tasks.workunit.client.1.smithi167.stdout:1/348: dwrite d0/d5/d34/d3c/f2b [8388608,4194304] 0 2024-09-17T01:41:24.281 INFO:tasks.workunit.client.1.smithi167.stdout:1/349: fsync d0/f46 0 2024-09-17T01:41:24.281 INFO:tasks.workunit.client.0.smithi082.stdout:5/98: sync 2024-09-17T01:41:24.282 INFO:tasks.workunit.client.1.smithi167.stdout:6/473: dwrite d7/d54/d90/d13/d2f/d30/f59 [0,4194304] 0 2024-09-17T01:41:24.282 INFO:tasks.workunit.client.1.smithi167.stdout:8/458: truncate dc/d18/f3b 121385 0 2024-09-17T01:41:24.282 INFO:tasks.workunit.client.0.smithi082.stdout:5/99: stat db/d12/l13 0 2024-09-17T01:41:24.283 INFO:tasks.workunit.client.1.smithi167.stdout:1/350: write d0/f46 [5096921,63491] 0 2024-09-17T01:41:24.283 INFO:tasks.workunit.client.1.smithi167.stdout:6/474: chown d7/d54/d90/d13/d2f 0 1 2024-09-17T01:41:24.284 INFO:tasks.workunit.client.0.smithi082.stdout:5/100: read f6 [2054739,75029] 0 2024-09-17T01:41:24.286 INFO:tasks.workunit.client.1.smithi167.stdout:8/459: symlink dc/d21/d61/l96 0 2024-09-17T01:41:24.287 INFO:tasks.workunit.client.1.smithi167.stdout:8/460: fdatasync dc/d1a/f30 0 2024-09-17T01:41:24.288 INFO:tasks.workunit.client.1.smithi167.stdout:1/351: creat d0/d5/d34/f68 x:0 0 0 2024-09-17T01:41:24.291 INFO:tasks.workunit.client.1.smithi167.stdout:8/461: chown dc/f29 27195343 1 2024-09-17T01:41:24.292 INFO:tasks.workunit.client.1.smithi167.stdout:8/462: write dc/d1a/f73 [949596,73438] 0 2024-09-17T01:41:24.292 INFO:tasks.workunit.client.1.smithi167.stdout:6/475: creat d7/fae x:0 0 0 2024-09-17T01:41:24.292 INFO:tasks.workunit.client.1.smithi167.stdout:8/463: stat dc/d56/d59/d65 0 2024-09-17T01:41:24.293 INFO:tasks.workunit.client.0.smithi082.stdout:5/101: dwrite db/d12/f15 [0,4194304] 0 2024-09-17T01:41:24.294 INFO:tasks.workunit.client.1.smithi167.stdout:6/476: chown d7/d54/d90/d13/d2f/d7f/d98/d27 0 1 2024-09-17T01:41:24.294 INFO:tasks.workunit.client.1.smithi167.stdout:8/464: write dc/d21/f31 [8274469,11144] 0 2024-09-17T01:41:24.294 INFO:tasks.workunit.client.1.smithi167.stdout:6/477: chown d7/d42 2839277 1 2024-09-17T01:41:24.294 INFO:tasks.workunit.client.1.smithi167.stdout:1/352: rename d0/d9/d16/c38 to d0/d9/d16/d36/c69 0 2024-09-17T01:41:24.296 INFO:tasks.workunit.client.0.smithi082.stdout:5/102: creat db/d1e/f22 x:0 0 0 2024-09-17T01:41:24.296 INFO:tasks.workunit.client.1.smithi167.stdout:8/465: truncate dc/d1a/f49 948040 0 2024-09-17T01:41:24.298 INFO:tasks.workunit.client.1.smithi167.stdout:6/478: creat d7/d54/d90/d13/d2f/d96/faf x:0 0 0 2024-09-17T01:41:24.299 INFO:tasks.workunit.client.1.smithi167.stdout:1/353: dread d0/d5/d34/d3c/f4e [0,4194304] 0 2024-09-17T01:41:24.299 INFO:tasks.workunit.client.0.smithi082.stdout:5/103: mkdir db/d12/d18/d23 0 2024-09-17T01:41:24.302 INFO:tasks.workunit.client.1.smithi167.stdout:1/354: creat d0/d9/d16/d48/f6a x:0 0 0 2024-09-17T01:41:24.302 INFO:tasks.workunit.client.1.smithi167.stdout:1/355: chown d0/d5/f12 6485178 1 2024-09-17T01:41:24.303 INFO:tasks.workunit.client.1.smithi167.stdout:6/479: mknod d7/d54/d90/cb0 0 2024-09-17T01:41:24.304 INFO:tasks.workunit.client.1.smithi167.stdout:1/356: mknod d0/d5/d61/c6b 0 2024-09-17T01:41:24.305 INFO:tasks.workunit.client.0.smithi082.stdout:5/104: link db/l21 db/d1e/d20/l24 0 2024-09-17T01:41:24.306 INFO:tasks.workunit.client.1.smithi167.stdout:6/480: dread d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:24.319 INFO:tasks.workunit.client.1.smithi167.stdout:8/466: write dc/f29 [2122757,78336] 0 2024-09-17T01:41:24.320 INFO:tasks.workunit.client.1.smithi167.stdout:8/467: dread - dc/d56/d59/d82/f95 zero size 2024-09-17T01:41:24.322 INFO:tasks.workunit.client.0.smithi082.stdout:5/105: truncate db/d12/d18/f1d 3617759 0 2024-09-17T01:41:24.323 INFO:tasks.workunit.client.1.smithi167.stdout:8/468: symlink dc/d56/d57/d5c/l97 0 2024-09-17T01:41:24.323 INFO:tasks.workunit.client.0.smithi082.stdout:5/106: symlink db/d1e/l25 0 2024-09-17T01:41:24.326 INFO:tasks.workunit.client.1.smithi167.stdout:1/357: dwrite d0/d5/d34/d3c/f41 [0,4194304] 0 2024-09-17T01:41:24.326 INFO:tasks.workunit.client.1.smithi167.stdout:8/469: creat dc/d56/d57/d5c/f98 x:0 0 0 2024-09-17T01:41:24.328 INFO:tasks.workunit.client.1.smithi167.stdout:8/470: write dc/d1a/f72 [1018155,120502] 0 2024-09-17T01:41:24.329 INFO:tasks.workunit.client.1.smithi167.stdout:6/481: dwrite d7/d54/d90/d13/d2f/d7f/d98/f40 [0,4194304] 0 2024-09-17T01:41:24.330 INFO:tasks.workunit.client.1.smithi167.stdout:1/358: mknod d0/d9/c6c 0 2024-09-17T01:41:24.331 INFO:tasks.workunit.client.1.smithi167.stdout:6/482: write d7/d54/d90/d13/d2f/d30/d32/f9a [982131,1027] 0 2024-09-17T01:41:24.335 INFO:tasks.workunit.client.1.smithi167.stdout:1/359: rename d0/d5/d34/d4c to d0/d5/d34/d6d 0 2024-09-17T01:41:24.337 INFO:tasks.workunit.client.1.smithi167.stdout:6/483: dread d7/d54/d90/d13/d2f/d7f/f86 [0,4194304] 0 2024-09-17T01:41:24.337 INFO:tasks.workunit.client.1.smithi167.stdout:1/360: mkdir d0/d9/d16/d48/d54/d6e 0 2024-09-17T01:41:24.338 INFO:tasks.workunit.client.1.smithi167.stdout:1/361: fdatasync d0/d5/d34/f14 0 2024-09-17T01:41:24.339 INFO:tasks.workunit.client.1.smithi167.stdout:1/362: chown d0/d5/d34/f68 1213247788 1 2024-09-17T01:41:24.346 INFO:tasks.workunit.client.1.smithi167.stdout:6/484: mkdir d7/d54/d90/d13/d2f/d64/d6b/d95/db1 0 2024-09-17T01:41:24.346 INFO:tasks.workunit.client.1.smithi167.stdout:9/375: sync 2024-09-17T01:41:24.347 INFO:tasks.workunit.client.1.smithi167.stdout:1/363: dwrite d0/d9/d16/d36/f53 [0,4194304] 0 2024-09-17T01:41:24.349 INFO:tasks.workunit.client.1.smithi167.stdout:8/471: dwrite dc/d56/f70 [0,4194304] 0 2024-09-17T01:41:24.351 INFO:tasks.workunit.client.1.smithi167.stdout:1/364: mkdir d0/d9/d16/d48/d54/d6f 0 2024-09-17T01:41:24.353 INFO:tasks.workunit.client.1.smithi167.stdout:6/485: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 [0,4194304] 0 2024-09-17T01:41:24.355 INFO:tasks.workunit.client.1.smithi167.stdout:1/365: rename d0/d5/d34/f68 to d0/d5/d34/f70 0 2024-09-17T01:41:24.359 INFO:tasks.workunit.client.1.smithi167.stdout:1/366: chown d0/d9/d16/d22/c23 164931879 1 2024-09-17T01:41:24.361 INFO:tasks.workunit.client.1.smithi167.stdout:9/376: truncate d4/f38 1033397 0 2024-09-17T01:41:24.364 INFO:tasks.workunit.client.1.smithi167.stdout:6/486: dwrite d7/d54/d90/d13/f49 [0,4194304] 0 2024-09-17T01:41:24.365 INFO:tasks.workunit.client.1.smithi167.stdout:9/377: write d4/d9/d21/f60 [320373,89879] 0 2024-09-17T01:41:24.366 INFO:tasks.workunit.client.1.smithi167.stdout:9/378: read d4/d9/d21/f3c [551709,20208] 0 2024-09-17T01:41:24.367 INFO:tasks.workunit.client.1.smithi167.stdout:6/487: chown d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/la9 450719617 1 2024-09-17T01:41:24.367 INFO:tasks.workunit.client.1.smithi167.stdout:5/281: sync 2024-09-17T01:41:24.368 INFO:tasks.workunit.client.1.smithi167.stdout:7/368: sync 2024-09-17T01:41:24.368 INFO:tasks.workunit.client.1.smithi167.stdout:4/399: sync 2024-09-17T01:41:24.370 INFO:tasks.workunit.client.1.smithi167.stdout:1/367: dread d0/d5/d34/d3c/f2b [0,4194304] 0 2024-09-17T01:41:24.371 INFO:tasks.workunit.client.1.smithi167.stdout:9/379: truncate f1 963690 0 2024-09-17T01:41:24.372 INFO:tasks.workunit.client.1.smithi167.stdout:5/282: symlink d0/d9/d1c/l53 0 2024-09-17T01:41:24.373 INFO:tasks.workunit.client.1.smithi167.stdout:7/369: fdatasync d0/d2/d14/d19/d26/d34/f6c 0 2024-09-17T01:41:24.374 INFO:tasks.workunit.client.1.smithi167.stdout:6/488: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/cb2 0 2024-09-17T01:41:24.375 INFO:tasks.workunit.client.1.smithi167.stdout:5/283: mkdir d0/d54 0 2024-09-17T01:41:24.375 INFO:tasks.workunit.client.1.smithi167.stdout:6/489: dread - d7/d54/d90/d13/d2f/d30/fa7 zero size 2024-09-17T01:41:24.376 INFO:tasks.workunit.client.1.smithi167.stdout:9/380: mknod d4/d9/d21/c6e 0 2024-09-17T01:41:24.377 INFO:tasks.workunit.client.1.smithi167.stdout:5/284: unlink d0/d24/d2b/l45 0 2024-09-17T01:41:24.379 INFO:tasks.workunit.client.1.smithi167.stdout:9/381: mknod d4/d9/d21/d2d/d33/d3a/c6f 0 2024-09-17T01:41:24.380 INFO:tasks.workunit.client.1.smithi167.stdout:6/490: mkdir d7/d54/d90/db3 0 2024-09-17T01:41:24.380 INFO:tasks.workunit.client.1.smithi167.stdout:8/472: dread dc/d56/f62 [0,4194304] 0 2024-09-17T01:41:24.381 INFO:tasks.workunit.client.1.smithi167.stdout:9/382: chown d4/d9/d21/d2d/d33/c61 0 1 2024-09-17T01:41:24.382 INFO:tasks.workunit.client.1.smithi167.stdout:6/491: fdatasync d7/d54/d90/d13/d2f/d64/d6b/fa5 0 2024-09-17T01:41:24.384 INFO:tasks.workunit.client.1.smithi167.stdout:8/473: symlink dc/d21/d6b/d74/d83/l99 0 2024-09-17T01:41:24.384 INFO:tasks.workunit.client.1.smithi167.stdout:9/383: write d4/d9/d21/d43/f69 [651060,96401] 0 2024-09-17T01:41:24.385 INFO:tasks.workunit.client.1.smithi167.stdout:5/285: link d0/f20 d0/d24/d2b/d49/d4b/f55 0 2024-09-17T01:41:24.386 INFO:tasks.workunit.client.1.smithi167.stdout:8/474: chown dc/d56/d59/d82/d85/f94 44011098 1 2024-09-17T01:41:24.387 INFO:tasks.workunit.client.1.smithi167.stdout:6/492: unlink d7/d54/d90/d13/d2f/c4c 0 2024-09-17T01:41:24.390 INFO:tasks.workunit.client.1.smithi167.stdout:8/475: symlink dc/d1a/l9a 0 2024-09-17T01:41:24.392 INFO:tasks.workunit.client.1.smithi167.stdout:5/286: mkdir d0/d54/d56 0 2024-09-17T01:41:24.393 INFO:tasks.workunit.client.1.smithi167.stdout:6/493: creat d7/d52/d79/da4/fb4 x:0 0 0 2024-09-17T01:41:24.394 INFO:tasks.workunit.client.1.smithi167.stdout:8/476: rmdir dc/d56/d59/d65 39 2024-09-17T01:41:24.397 INFO:tasks.workunit.client.1.smithi167.stdout:8/477: write f6 [2158552,52251] 0 2024-09-17T01:41:24.397 INFO:tasks.workunit.client.1.smithi167.stdout:4/400: dread d0/d4/d7/d6/f29 [0,4194304] 0 2024-09-17T01:41:24.397 INFO:tasks.workunit.client.1.smithi167.stdout:6/494: symlink d7/d54/d90/d13/d2f/d7f/lb5 0 2024-09-17T01:41:24.401 INFO:tasks.workunit.client.1.smithi167.stdout:1/368: dwrite d0/f2e [0,4194304] 0 2024-09-17T01:41:24.401 INFO:tasks.workunit.client.1.smithi167.stdout:4/401: dread - d0/d4/d7/d6/d5d/f68 zero size 2024-09-17T01:41:24.402 INFO:tasks.workunit.client.1.smithi167.stdout:8/478: write dc/ff [3989305,12358] 0 2024-09-17T01:41:24.403 INFO:tasks.workunit.client.1.smithi167.stdout:5/287: getdents d0/d28 0 2024-09-17T01:41:24.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/479: creat dc/d56/f9b x:0 0 0 2024-09-17T01:41:24.407 INFO:tasks.workunit.client.1.smithi167.stdout:9/384: dread d4/d9/f3d [0,4194304] 0 2024-09-17T01:41:24.407 INFO:tasks.workunit.client.1.smithi167.stdout:1/369: dread - d0/d9/d16/d48/d54/f59 zero size 2024-09-17T01:41:24.408 INFO:tasks.workunit.client.1.smithi167.stdout:7/370: dwrite d0/d2/d14/d19/d22/f25 [0,4194304] 0 2024-09-17T01:41:24.409 INFO:tasks.workunit.client.1.smithi167.stdout:5/288: creat d0/d28/d3a/f57 x:0 0 0 2024-09-17T01:41:24.410 INFO:tasks.workunit.client.1.smithi167.stdout:4/402: chown d0/d4/d7/da/d48/d40/d57/d6a/d81/f85 755 1 2024-09-17T01:41:24.412 INFO:tasks.workunit.client.1.smithi167.stdout:7/371: chown d0/d2/d14/d19/d26/c5a 1 1 2024-09-17T01:41:24.413 INFO:tasks.workunit.client.1.smithi167.stdout:6/495: dwrite d7/d54/d90/d13/d2f/d7f/d98/f62 [0,4194304] 0 2024-09-17T01:41:24.414 INFO:tasks.workunit.client.1.smithi167.stdout:7/372: fdatasync d0/d2/d14/d19/d32/f6a 0 2024-09-17T01:41:24.414 INFO:tasks.workunit.client.1.smithi167.stdout:2/371: sync 2024-09-17T01:41:24.415 INFO:tasks.workunit.client.1.smithi167.stdout:3/356: sync 2024-09-17T01:41:24.415 INFO:tasks.workunit.client.1.smithi167.stdout:0/320: sync 2024-09-17T01:41:24.415 INFO:tasks.workunit.client.1.smithi167.stdout:5/289: fsync d0/d9/f12 0 2024-09-17T01:41:24.419 INFO:tasks.workunit.client.1.smithi167.stdout:2/372: fdatasync d5/d3c/f40 0 2024-09-17T01:41:24.421 INFO:tasks.workunit.client.1.smithi167.stdout:0/321: readlink d5/d8/d2e/l52 0 2024-09-17T01:41:24.421 INFO:tasks.workunit.client.1.smithi167.stdout:1/370: link d0/d9/d16/d48/f65 d0/d5/d61/f71 0 2024-09-17T01:41:24.423 INFO:tasks.workunit.client.1.smithi167.stdout:8/480: getdents dc/d56/d59 0 2024-09-17T01:41:24.423 INFO:tasks.workunit.client.1.smithi167.stdout:0/322: dread - d5/d8/d9/f3f zero size 2024-09-17T01:41:24.423 INFO:tasks.workunit.client.1.smithi167.stdout:3/357: rmdir d7/d8/d10/d14/d25 39 2024-09-17T01:41:24.425 INFO:tasks.workunit.client.1.smithi167.stdout:0/323: truncate d5/d8/d9/f39 4375531 0 2024-09-17T01:41:24.426 INFO:tasks.workunit.client.1.smithi167.stdout:2/373: unlink d5/d10/d16/f54 0 2024-09-17T01:41:24.427 INFO:tasks.workunit.client.1.smithi167.stdout:2/374: write d5/d10/d1a/d2e/f36 [1260828,101118] 0 2024-09-17T01:41:24.427 INFO:tasks.workunit.client.1.smithi167.stdout:7/373: mkdir d0/d2/d14/d6f/d75 0 2024-09-17T01:41:24.428 INFO:tasks.workunit.client.1.smithi167.stdout:2/375: chown d5/d3c/d4c 46 1 2024-09-17T01:41:24.428 INFO:tasks.workunit.client.1.smithi167.stdout:1/371: creat d0/d5/f72 x:0 0 0 2024-09-17T01:41:24.428 INFO:tasks.workunit.client.1.smithi167.stdout:7/374: chown d0/d2/d14/d19/d22/f25 3883508 1 2024-09-17T01:41:24.429 INFO:tasks.workunit.client.1.smithi167.stdout:8/481: stat dc/fd 0 2024-09-17T01:41:24.431 INFO:tasks.workunit.client.1.smithi167.stdout:3/358: mkdir d7/d8/d10/d14/d2c/d6f 0 2024-09-17T01:41:24.432 INFO:tasks.workunit.client.1.smithi167.stdout:3/359: truncate d7/f54 4302092 0 2024-09-17T01:41:24.432 INFO:tasks.workunit.client.1.smithi167.stdout:0/324: mknod d5/d8/d2e/d4d/d56/c67 0 2024-09-17T01:41:24.433 INFO:tasks.workunit.client.1.smithi167.stdout:2/376: symlink d5/d10/d1a/d39/d5e/l82 0 2024-09-17T01:41:24.435 INFO:tasks.workunit.client.1.smithi167.stdout:5/290: creat d0/d24/d2b/d3d/f58 x:0 0 0 2024-09-17T01:41:24.435 INFO:tasks.workunit.client.1.smithi167.stdout:7/375: symlink d0/d2/d14/d19/d26/l76 0 2024-09-17T01:41:24.436 INFO:tasks.workunit.client.1.smithi167.stdout:8/482: unlink dc/d21/f24 0 2024-09-17T01:41:24.458 INFO:tasks.workunit.client.1.smithi167.stdout:2/377: creat d5/d3c/f83 x:0 0 0 2024-09-17T01:41:24.458 INFO:tasks.workunit.client.1.smithi167.stdout:6/496: link d7/ld d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/lb6 0 2024-09-17T01:41:24.462 INFO:tasks.workunit.client.1.smithi167.stdout:8/483: unlink dc/d56/d57/c81 0 2024-09-17T01:41:24.465 INFO:tasks.workunit.client.1.smithi167.stdout:7/376: creat d0/d2/d14/d19/f77 x:0 0 0 2024-09-17T01:41:24.467 INFO:tasks.workunit.client.1.smithi167.stdout:1/372: dwrite d0/d9/fb [4194304,4194304] 0 2024-09-17T01:41:24.469 INFO:tasks.workunit.client.1.smithi167.stdout:9/385: dwrite d4/d9/d21/d2d/d33/d3a/f40 [4194304,4194304] 0 2024-09-17T01:41:24.469 INFO:tasks.workunit.client.1.smithi167.stdout:2/378: write d5/d10/d16/f18 [2338004,116901] 0 2024-09-17T01:41:24.473 INFO:tasks.workunit.client.1.smithi167.stdout:8/484: symlink dc/d56/l9c 0 2024-09-17T01:41:24.473 INFO:tasks.workunit.client.1.smithi167.stdout:4/403: dwrite d0/d4/d7/f26 [0,4194304] 0 2024-09-17T01:41:24.474 INFO:tasks.workunit.client.1.smithi167.stdout:9/386: chown d4/d4a/c62 6012441 1 2024-09-17T01:41:24.480 INFO:tasks.workunit.client.1.smithi167.stdout:9/387: chown d4/l36 14814973 1 2024-09-17T01:41:24.480 INFO:tasks.workunit.client.1.smithi167.stdout:0/325: dread d5/d8/d2e/d4d/f5a [0,4194304] 0 2024-09-17T01:41:24.481 INFO:tasks.workunit.client.1.smithi167.stdout:4/404: fsync d0/d4/d7/f77 0 2024-09-17T01:41:24.481 INFO:tasks.workunit.client.1.smithi167.stdout:9/388: readlink d4/l1e 0 2024-09-17T01:41:24.481 INFO:tasks.workunit.client.1.smithi167.stdout:5/291: dwrite d0/d28/d3a/d44/f4c [0,4194304] 0 2024-09-17T01:41:24.483 INFO:tasks.workunit.client.1.smithi167.stdout:8/485: chown dc/f17 30 1 2024-09-17T01:41:24.483 INFO:tasks.workunit.client.1.smithi167.stdout:0/326: dread - d5/d8/f44 zero size 2024-09-17T01:41:24.484 INFO:tasks.workunit.client.1.smithi167.stdout:6/497: truncate d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 766244 0 2024-09-17T01:41:24.486 INFO:tasks.workunit.client.1.smithi167.stdout:0/327: readlink d5/d8/d9/l29 0 2024-09-17T01:41:24.486 INFO:tasks.workunit.client.1.smithi167.stdout:5/292: dread d0/f20 [0,4194304] 0 2024-09-17T01:41:24.488 INFO:tasks.workunit.client.1.smithi167.stdout:1/373: link d0/f17 d0/d5/f73 0 2024-09-17T01:41:24.489 INFO:tasks.workunit.client.1.smithi167.stdout:6/498: fdatasync d7/d54/d90/d13/f2d 0 2024-09-17T01:41:24.491 INFO:tasks.workunit.client.1.smithi167.stdout:5/293: write d0/d28/f37 [191845,123751] 0 2024-09-17T01:41:24.492 INFO:tasks.workunit.client.1.smithi167.stdout:8/486: creat dc/d56/d57/d5c/f9d x:0 0 0 2024-09-17T01:41:24.494 INFO:tasks.workunit.client.1.smithi167.stdout:7/377: write d0/d2/d14/d19/f1e [700231,5440] 0 2024-09-17T01:41:24.496 INFO:tasks.workunit.client.1.smithi167.stdout:9/389: rename d4/d9/d21/d43/f45 to d4/d9/d21/d2d/d33/f70 0 2024-09-17T01:41:24.496 INFO:tasks.workunit.client.1.smithi167.stdout:5/294: write d0/f1d [2311888,121298] 0 2024-09-17T01:41:24.496 INFO:tasks.workunit.client.1.smithi167.stdout:0/328: mknod d5/d8/d2e/c68 0 2024-09-17T01:41:24.498 INFO:tasks.workunit.client.1.smithi167.stdout:1/374: mkdir d0/d5/d34/d3c/d74 0 2024-09-17T01:41:24.498 INFO:tasks.workunit.client.1.smithi167.stdout:4/405: dwrite d0/d4/d7/da/d48/d40/d51/d2d/f65 [0,4194304] 0 2024-09-17T01:41:24.498 INFO:tasks.workunit.client.1.smithi167.stdout:8/487: write dc/d56/d57/f8a [41633,50358] 0 2024-09-17T01:41:24.500 INFO:tasks.workunit.client.1.smithi167.stdout:2/379: dwrite d5/d10/d1a/d45/d3f/f7e [0,4194304] 0 2024-09-17T01:41:24.501 INFO:tasks.workunit.client.1.smithi167.stdout:6/499: mkdir d7/d52/db7 0 2024-09-17T01:41:24.508 INFO:tasks.workunit.client.1.smithi167.stdout:2/380: dread - d5/d10/d1a/d45/f79 zero size 2024-09-17T01:41:24.509 INFO:tasks.workunit.client.1.smithi167.stdout:7/378: creat d0/d2/d14/d19/d26/f78 x:0 0 0 2024-09-17T01:41:24.512 INFO:tasks.workunit.client.0.smithi082.stdout:3/82: sync 2024-09-17T01:41:24.512 INFO:tasks.workunit.client.0.smithi082.stdout:7/155: sync 2024-09-17T01:41:24.512 INFO:tasks.workunit.client.0.smithi082.stdout:9/121: sync 2024-09-17T01:41:24.512 INFO:tasks.workunit.client.1.smithi167.stdout:7/379: chown d0/d2/f66 659983 1 2024-09-17T01:41:24.513 INFO:tasks.workunit.client.0.smithi082.stdout:7/156: write d0/d3/db/fe [2280642,12227] 0 2024-09-17T01:41:24.513 INFO:tasks.workunit.client.1.smithi167.stdout:4/406: read d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [3641527,68983] 0 2024-09-17T01:41:24.515 INFO:tasks.workunit.client.1.smithi167.stdout:2/381: write d5/d10/d1a/d2e/f51 [965020,87961] 0 2024-09-17T01:41:24.515 INFO:tasks.workunit.client.0.smithi082.stdout:3/83: chown f0 492 1 2024-09-17T01:41:24.517 INFO:tasks.workunit.client.1.smithi167.stdout:1/375: dread d0/d5/d34/f63 [0,4194304] 0 2024-09-17T01:41:24.522 INFO:tasks.workunit.client.1.smithi167.stdout:8/488: dwrite dc/d56/d59/f77 [0,4194304] 0 2024-09-17T01:41:24.523 INFO:tasks.workunit.client.1.smithi167.stdout:9/390: dwrite d4/d9/d21/d2d/d33/d3a/f67 [4194304,4194304] 0 2024-09-17T01:41:24.527 INFO:tasks.workunit.client.1.smithi167.stdout:0/329: dwrite d5/d8/d2e/d4d/f5a [0,4194304] 0 2024-09-17T01:41:24.529 INFO:tasks.workunit.client.1.smithi167.stdout:4/407: rmdir d0/d4/d7/da/d48/d40/d51/d2d 39 2024-09-17T01:41:24.532 INFO:tasks.workunit.client.1.smithi167.stdout:6/500: dwrite d7/d54/d90/d34/f76 [0,4194304] 0 2024-09-17T01:41:24.532 INFO:tasks.workunit.client.1.smithi167.stdout:5/295: link d0/c4 d0/d24/d2b/d49/d4b/c59 0 2024-09-17T01:41:24.534 INFO:tasks.workunit.client.1.smithi167.stdout:9/391: symlink d4/d4a/l71 0 2024-09-17T01:41:24.538 INFO:tasks.workunit.client.1.smithi167.stdout:9/392: chown d4/d9/d21/d37/l3e 26547638 1 2024-09-17T01:41:24.538 INFO:tasks.workunit.client.1.smithi167.stdout:2/382: mknod d5/d71/c84 0 2024-09-17T01:41:24.539 INFO:tasks.workunit.client.1.smithi167.stdout:8/489: creat dc/d56/d59/d82/d8f/d90/f9e x:0 0 0 2024-09-17T01:41:24.539 INFO:tasks.workunit.client.1.smithi167.stdout:1/376: creat d0/d5/d34/d3c/d74/f75 x:0 0 0 2024-09-17T01:41:24.540 INFO:tasks.workunit.client.0.smithi082.stdout:9/122: write d4/f8 [2248375,85951] 0 2024-09-17T01:41:24.540 INFO:tasks.workunit.client.0.smithi082.stdout:7/157: truncate d0/d3/db/fe 1871762 0 2024-09-17T01:41:24.543 INFO:tasks.workunit.client.1.smithi167.stdout:4/408: fdatasync d0/d4/d7/da/d48/d40/d57/d6a/f7b 0 2024-09-17T01:41:24.543 INFO:tasks.workunit.client.0.smithi082.stdout:3/84: dwrite d9/f1b [0,4194304] 0 2024-09-17T01:41:24.544 INFO:tasks.workunit.client.1.smithi167.stdout:8/490: chown dc/d56/d59/d82/d85 6 1 2024-09-17T01:41:24.544 INFO:tasks.workunit.client.1.smithi167.stdout:5/296: write d0/d24/d2b/d3d/d3b/f3e [4145454,39791] 0 2024-09-17T01:41:24.546 INFO:tasks.workunit.client.1.smithi167.stdout:7/380: getdents d0/d2/d14/d19/d32 0 2024-09-17T01:41:24.548 INFO:tasks.workunit.client.1.smithi167.stdout:5/297: fsync d0/d28/f2a 0 2024-09-17T01:41:24.549 INFO:tasks.workunit.client.1.smithi167.stdout:0/330: dwrite d5/d8/d2e/d4d/f5a [4194304,4194304] 0 2024-09-17T01:41:24.551 INFO:tasks.workunit.client.1.smithi167.stdout:3/360: sync 2024-09-17T01:41:24.551 INFO:tasks.workunit.client.0.smithi082.stdout:7/158: dread d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:24.552 INFO:tasks.workunit.client.0.smithi082.stdout:3/85: dwrite f1 [0,4194304] 0 2024-09-17T01:41:24.554 INFO:tasks.workunit.client.0.smithi082.stdout:3/86: write d9/db/f13 [1284048,29636] 0 2024-09-17T01:41:24.554 INFO:tasks.workunit.client.0.smithi082.stdout:3/87: stat d9/fa 0 2024-09-17T01:41:24.558 INFO:tasks.workunit.client.1.smithi167.stdout:8/491: creat dc/d56/d59/d82/f9f x:0 0 0 2024-09-17T01:41:24.558 INFO:tasks.workunit.client.1.smithi167.stdout:0/331: chown d5/d8/f20 415 1 2024-09-17T01:41:24.559 INFO:tasks.workunit.client.0.smithi082.stdout:3/88: rename d9/c19 to d9/db/c1e 0 2024-09-17T01:41:24.560 INFO:tasks.workunit.client.0.smithi082.stdout:8/145: sync 2024-09-17T01:41:24.560 INFO:tasks.workunit.client.0.smithi082.stdout:4/157: sync 2024-09-17T01:41:24.563 INFO:tasks.workunit.client.1.smithi167.stdout:5/298: mknod d0/d54/c5a 0 2024-09-17T01:41:24.565 INFO:tasks.workunit.client.1.smithi167.stdout:0/332: chown d5/d8/d2e/d4d/d58/f63 553787734 1 2024-09-17T01:41:24.566 INFO:tasks.workunit.client.0.smithi082.stdout:7/159: dwrite d0/dd/f1f [4194304,4194304] 0 2024-09-17T01:41:24.567 INFO:tasks.workunit.client.1.smithi167.stdout:8/492: readlink dc/d1a/l26 0 2024-09-17T01:41:24.569 INFO:tasks.workunit.client.1.smithi167.stdout:6/501: dwrite d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:24.571 INFO:tasks.workunit.client.1.smithi167.stdout:1/377: dwrite d0/d5/d34/f5b [0,4194304] 0 2024-09-17T01:41:24.572 INFO:tasks.workunit.client.0.smithi082.stdout:4/158: dwrite d9/d15/f2e [0,4194304] 0 2024-09-17T01:41:24.573 INFO:tasks.workunit.client.1.smithi167.stdout:2/383: dwrite d5/d10/d16/f73 [0,4194304] 0 2024-09-17T01:41:24.575 INFO:tasks.workunit.client.0.smithi082.stdout:7/160: mkdir d0/dd/d2c 0 2024-09-17T01:41:24.576 INFO:tasks.workunit.client.0.smithi082.stdout:9/123: write d4/f10 [3949532,35765] 0 2024-09-17T01:41:24.577 INFO:tasks.workunit.client.1.smithi167.stdout:0/333: write d5/d8/d9/f2c [4815529,84578] 0 2024-09-17T01:41:24.583 INFO:tasks.workunit.client.1.smithi167.stdout:4/409: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:24.584 INFO:tasks.workunit.client.0.smithi082.stdout:4/159: dwrite d9/d15/f2e [0,4194304] 0 2024-09-17T01:41:24.586 INFO:tasks.workunit.client.1.smithi167.stdout:1/378: dread - d0/d9/d16/d48/f6a zero size 2024-09-17T01:41:24.588 INFO:tasks.workunit.client.0.smithi082.stdout:3/89: write f0 [1220562,19132] 0 2024-09-17T01:41:24.589 INFO:tasks.workunit.client.0.smithi082.stdout:8/146: write d3/f25 [113123,56758] 0 2024-09-17T01:41:24.590 INFO:tasks.workunit.client.0.smithi082.stdout:8/147: fsync d3/f10 0 2024-09-17T01:41:24.591 INFO:tasks.workunit.client.0.smithi082.stdout:8/148: stat d3/dd/d18/c21 0 2024-09-17T01:41:24.591 INFO:tasks.workunit.client.0.smithi082.stdout:7/161: symlink d0/dd/l2d 0 2024-09-17T01:41:24.591 INFO:tasks.workunit.client.1.smithi167.stdout:9/393: dwrite d4/f38 [0,4194304] 0 2024-09-17T01:41:24.592 INFO:tasks.workunit.client.0.smithi082.stdout:8/149: fdatasync d3/dd/d18/f1e 0 2024-09-17T01:41:24.592 INFO:tasks.workunit.client.1.smithi167.stdout:9/394: chown d4/d9/d21/f2f 785560696 1 2024-09-17T01:41:24.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/395: chown d4/d4a/f55 9880722 1 2024-09-17T01:41:24.597 INFO:tasks.workunit.client.1.smithi167.stdout:6/502: symlink d7/d54/d90/d13/d2f/d7f/d98/lb8 0 2024-09-17T01:41:24.601 INFO:tasks.workunit.client.1.smithi167.stdout:0/334: creat d5/d8/d2e/d37/f69 x:0 0 0 2024-09-17T01:41:24.602 INFO:tasks.workunit.client.1.smithi167.stdout:0/335: dread - d5/d8/d2e/d37/f69 zero size 2024-09-17T01:41:24.602 INFO:tasks.workunit.client.1.smithi167.stdout:4/410: dread - d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 zero size 2024-09-17T01:41:24.604 INFO:tasks.workunit.client.0.smithi082.stdout:8/150: mkdir d3/dd/d18/d2d 0 2024-09-17T01:41:24.605 INFO:tasks.workunit.client.0.smithi082.stdout:7/162: rename d0/d3/db/d10/f19 to d0/d3/db/f2e 0 2024-09-17T01:41:24.607 INFO:tasks.workunit.client.0.smithi082.stdout:4/160: mkdir d9/d31 0 2024-09-17T01:41:24.607 INFO:tasks.workunit.client.0.smithi082.stdout:4/161: chown c5 5734 1 2024-09-17T01:41:24.608 INFO:tasks.workunit.client.0.smithi082.stdout:4/162: fsync d9/d15/f1e 0 2024-09-17T01:41:24.608 INFO:tasks.workunit.client.1.smithi167.stdout:6/503: stat d7/d54/d90/d13/d2f/d7f/d98/d27/c1f 0 2024-09-17T01:41:24.610 INFO:tasks.workunit.client.1.smithi167.stdout:4/411: chown d0/d4/cb 2 1 2024-09-17T01:41:24.612 INFO:tasks.workunit.client.1.smithi167.stdout:4/412: readlink d0/d4/d7/d6/l3e 0 2024-09-17T01:41:24.613 INFO:tasks.workunit.client.1.smithi167.stdout:9/396: symlink d4/d9/d21/d43/d6c/l72 0 2024-09-17T01:41:24.614 INFO:tasks.workunit.client.1.smithi167.stdout:3/361: link d7/d8/d10/d14/l6a d7/d8/d10/l70 0 2024-09-17T01:41:24.614 INFO:tasks.workunit.client.1.smithi167.stdout:9/397: fdatasync d4/f16 0 2024-09-17T01:41:24.616 INFO:tasks.workunit.client.0.smithi082.stdout:4/163: dwrite d9/f14 [4194304,4194304] 0 2024-09-17T01:41:24.617 INFO:tasks.workunit.client.1.smithi167.stdout:7/381: dread d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:24.618 INFO:tasks.workunit.client.1.smithi167.stdout:6/504: dwrite d7/f7b [0,4194304] 0 2024-09-17T01:41:24.619 INFO:tasks.workunit.client.0.smithi082.stdout:8/151: mkdir d3/dd/d18/d2d/d2e 0 2024-09-17T01:41:24.620 INFO:tasks.workunit.client.0.smithi082.stdout:9/124: getdents d4/da 0 2024-09-17T01:41:24.621 INFO:tasks.workunit.client.1.smithi167.stdout:7/382: dread - d0/d2/f66 zero size 2024-09-17T01:41:24.622 INFO:tasks.workunit.client.0.smithi082.stdout:3/90: link d9/db/c1e d9/c1f 0 2024-09-17T01:41:24.623 INFO:tasks.workunit.client.1.smithi167.stdout:4/413: write d0/d4/d7/da/d48/d40/d51/d2d/f61 [97559,115883] 0 2024-09-17T01:41:24.623 INFO:tasks.workunit.client.1.smithi167.stdout:2/384: fsync d5/d10/d16/f73 0 2024-09-17T01:41:24.624 INFO:tasks.workunit.client.0.smithi082.stdout:4/164: creat d9/d15/d16/d18/f32 x:0 0 0 2024-09-17T01:41:24.624 INFO:tasks.workunit.client.1.smithi167.stdout:3/362: creat d7/d8/d10/d14/d2c/f71 x:0 0 0 2024-09-17T01:41:24.626 INFO:tasks.workunit.client.1.smithi167.stdout:8/493: dwrite dc/d21/f3a [0,4194304] 0 2024-09-17T01:41:24.628 INFO:tasks.workunit.client.1.smithi167.stdout:3/363: fsync d7/d8/f4c 0 2024-09-17T01:41:24.629 INFO:tasks.workunit.client.1.smithi167.stdout:8/494: write dc/d1a/f7d [1010292,15742] 0 2024-09-17T01:41:24.629 INFO:tasks.workunit.client.1.smithi167.stdout:9/398: rename d4/d9/d21/l6a to d4/d9/d2b/l73 0 2024-09-17T01:41:24.630 INFO:tasks.workunit.client.1.smithi167.stdout:4/414: truncate d0/d4/d7/da/f80 926322 0 2024-09-17T01:41:24.631 INFO:tasks.workunit.client.1.smithi167.stdout:9/399: chown d4/d9/f25 26447 1 2024-09-17T01:41:24.632 INFO:tasks.workunit.client.1.smithi167.stdout:4/415: stat d0/d4/d7/da/c49 0 2024-09-17T01:41:24.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/163: rename d0/d3/f15 to d0/f2f 0 2024-09-17T01:41:24.634 INFO:tasks.workunit.client.0.smithi082.stdout:8/152: dwrite d3/f25 [0,4194304] 0 2024-09-17T01:41:24.636 INFO:tasks.workunit.client.0.smithi082.stdout:2/172: sync 2024-09-17T01:41:24.636 INFO:tasks.workunit.client.0.smithi082.stdout:0/156: sync 2024-09-17T01:41:24.636 INFO:tasks.workunit.client.0.smithi082.stdout:1/153: sync 2024-09-17T01:41:24.636 INFO:tasks.workunit.client.0.smithi082.stdout:6/244: sync 2024-09-17T01:41:24.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/107: sync 2024-09-17T01:41:24.637 INFO:tasks.workunit.client.1.smithi167.stdout:2/385: rmdir d5/d10/d1a/d2e/d49 39 2024-09-17T01:41:24.637 INFO:tasks.workunit.client.0.smithi082.stdout:4/165: dwrite f7 [0,4194304] 0 2024-09-17T01:41:24.641 INFO:tasks.workunit.client.1.smithi167.stdout:5/299: truncate d0/f19 5083046 0 2024-09-17T01:41:24.642 INFO:tasks.workunit.client.1.smithi167.stdout:5/300: readlink d0/l1a 0 2024-09-17T01:41:24.643 INFO:tasks.workunit.client.1.smithi167.stdout:2/386: read d5/f2a [1973124,124457] 0 2024-09-17T01:41:24.646 INFO:tasks.workunit.client.1.smithi167.stdout:3/364: readlink d7/d8/d10/d14/d25/l1b 0 2024-09-17T01:41:24.646 INFO:tasks.workunit.client.1.smithi167.stdout:5/301: read d0/d9/f34 [3911898,5667] 0 2024-09-17T01:41:24.650 INFO:tasks.workunit.client.0.smithi082.stdout:6/245: dwrite d1/d7/d10/f11 [0,4194304] 0 2024-09-17T01:41:24.651 INFO:tasks.workunit.client.0.smithi082.stdout:0/157: creat da/d1b/f35 x:0 0 0 2024-09-17T01:41:24.652 INFO:tasks.workunit.client.1.smithi167.stdout:6/505: rename d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/c92 to d7/d52/d79/da4/cb9 0 2024-09-17T01:41:24.655 INFO:tasks.workunit.client.1.smithi167.stdout:0/336: write d5/d8/d2e/f54 [211024,112478] 0 2024-09-17T01:41:24.657 INFO:tasks.workunit.client.1.smithi167.stdout:9/400: mkdir d4/d9/d21/d2d/d33/d3a/d74 0 2024-09-17T01:41:24.658 INFO:tasks.workunit.client.0.smithi082.stdout:2/173: dread d1/d1a/f24 [0,4194304] 0 2024-09-17T01:41:24.659 INFO:tasks.workunit.client.0.smithi082.stdout:5/108: mknod db/d12/c26 0 2024-09-17T01:41:24.659 INFO:tasks.workunit.client.0.smithi082.stdout:2/174: dread - d1/d1a/f30 zero size 2024-09-17T01:41:24.659 INFO:tasks.workunit.client.1.smithi167.stdout:0/337: truncate d5/d8/d9/d2f/f61 905401 0 2024-09-17T01:41:24.661 INFO:tasks.workunit.client.1.smithi167.stdout:7/383: dread d0/d2/d14/f1b [0,4194304] 0 2024-09-17T01:41:24.663 INFO:tasks.workunit.client.1.smithi167.stdout:7/384: truncate d0/d2/d14/d19/d32/f4d 555613 0 2024-09-17T01:41:24.663 INFO:tasks.workunit.client.1.smithi167.stdout:7/385: fsync d0/d2/d14/d19/d26/d34/f6c 0 2024-09-17T01:41:24.664 INFO:tasks.workunit.client.1.smithi167.stdout:7/386: dread - d0/d2/d14/d19/f77 zero size 2024-09-17T01:41:24.664 INFO:tasks.workunit.client.1.smithi167.stdout:2/387: mknod d5/d10/c85 0 2024-09-17T01:41:24.665 INFO:tasks.workunit.client.0.smithi082.stdout:7/164: fdatasync d0/d3/db/fe 0 2024-09-17T01:41:24.666 INFO:tasks.workunit.client.0.smithi082.stdout:7/165: chown d0/d3/db/cc 236 1 2024-09-17T01:41:24.668 INFO:tasks.workunit.client.1.smithi167.stdout:3/365: unlink d7/d8/d10/d14/d24/l3d 0 2024-09-17T01:41:24.669 INFO:tasks.workunit.client.0.smithi082.stdout:0/158: read da/df/f15 [347117,35656] 0 2024-09-17T01:41:24.670 INFO:tasks.workunit.client.1.smithi167.stdout:8/495: unlink dc/f2f 0 2024-09-17T01:41:24.671 INFO:tasks.workunit.client.1.smithi167.stdout:2/388: dwrite d5/d10/d1a/f56 [0,4194304] 0 2024-09-17T01:41:24.672 INFO:tasks.workunit.client.1.smithi167.stdout:2/389: chown d5/d10/d1a/d39/d5e/c62 13632487 1 2024-09-17T01:41:24.673 INFO:tasks.workunit.client.1.smithi167.stdout:2/390: stat d5/d3c/f69 0 2024-09-17T01:41:24.676 INFO:tasks.workunit.client.1.smithi167.stdout:9/401: mknod d4/d9/d2b/c75 0 2024-09-17T01:41:24.677 INFO:tasks.workunit.client.1.smithi167.stdout:9/402: fsync d4/f18 0 2024-09-17T01:41:24.678 INFO:tasks.workunit.client.1.smithi167.stdout:4/416: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [4194304,4194304] 0 2024-09-17T01:41:24.679 INFO:tasks.workunit.client.1.smithi167.stdout:4/417: fsync d0/d4/d7/f23 0 2024-09-17T01:41:24.680 INFO:tasks.workunit.client.0.smithi082.stdout:4/166: mknod d9/d15/c33 0 2024-09-17T01:41:24.681 INFO:tasks.workunit.client.1.smithi167.stdout:1/379: sync 2024-09-17T01:41:24.688 INFO:tasks.workunit.client.0.smithi082.stdout:9/125: rename d4/da/d11/d20 to d4/d27 0 2024-09-17T01:41:24.689 INFO:tasks.workunit.client.1.smithi167.stdout:7/387: creat d0/d2/d14/d19/d32/d62/f79 x:0 0 0 2024-09-17T01:41:24.692 INFO:tasks.workunit.client.0.smithi082.stdout:5/109: fsync db/f16 0 2024-09-17T01:41:24.695 INFO:tasks.workunit.client.0.smithi082.stdout:2/175: mknod d1/c31 0 2024-09-17T01:41:24.695 INFO:tasks.workunit.client.0.smithi082.stdout:1/154: truncate d2/f11 2960940 0 2024-09-17T01:41:24.697 INFO:tasks.workunit.client.1.smithi167.stdout:3/366: unlink d7/d8/d10/d14/d25/c17 0 2024-09-17T01:41:24.697 INFO:tasks.workunit.client.1.smithi167.stdout:3/367: chown d7/d8/d2a/d4e 808 1 2024-09-17T01:41:24.697 INFO:tasks.workunit.client.1.smithi167.stdout:3/368: chown d7/d8/d10/d14/f5a 112263826 1 2024-09-17T01:41:24.699 INFO:tasks.workunit.client.0.smithi082.stdout:3/91: rename l2 to d9/db/l20 0 2024-09-17T01:41:24.699 INFO:tasks.workunit.client.0.smithi082.stdout:8/153: rename d3 to d3/dd/d18/d2d/d2e/d2f 22 2024-09-17T01:41:24.700 INFO:tasks.workunit.client.0.smithi082.stdout:3/92: write f1 [2739644,94071] 0 2024-09-17T01:41:24.700 INFO:tasks.workunit.client.0.smithi082.stdout:8/154: readlink d3/dd/d18/l28 0 2024-09-17T01:41:24.700 INFO:tasks.workunit.client.0.smithi082.stdout:9/126: symlink d4/da/l28 0 2024-09-17T01:41:24.704 INFO:tasks.workunit.client.0.smithi082.stdout:5/110: truncate f6 1162312 0 2024-09-17T01:41:24.705 INFO:tasks.workunit.client.1.smithi167.stdout:4/418: fsync d0/fd 0 2024-09-17T01:41:24.705 INFO:tasks.workunit.client.0.smithi082.stdout:5/111: stat db/fc 0 2024-09-17T01:41:24.705 INFO:tasks.workunit.client.0.smithi082.stdout:2/176: mknod d1/d17/d29/c32 0 2024-09-17T01:41:24.707 INFO:tasks.workunit.client.1.smithi167.stdout:1/380: mknod d0/d9/d16/d48/d54/c76 0 2024-09-17T01:41:24.709 INFO:tasks.workunit.client.1.smithi167.stdout:7/388: readlink d0/d2/d14/l68 0 2024-09-17T01:41:24.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:24 smithi082 ceph-mon[28077]: pgmap v15: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 73 MiB/s wr, 172 op/s 2024-09-17T01:41:24.715 INFO:tasks.workunit.client.1.smithi167.stdout:6/506: link d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/l53 d7/d52/db7/lba 0 2024-09-17T01:41:24.716 INFO:tasks.workunit.client.1.smithi167.stdout:6/507: write d7/d54/d90/d13/d2f/d96/faf [696524,94387] 0 2024-09-17T01:41:24.717 INFO:tasks.workunit.client.1.smithi167.stdout:6/508: readlink d7/d54/d90/d13/d2f/d7f/d98/l22 0 2024-09-17T01:41:24.717 INFO:tasks.workunit.client.0.smithi082.stdout:3/93: unlink d9/fa 0 2024-09-17T01:41:24.718 INFO:tasks.workunit.client.0.smithi082.stdout:3/94: chown d9/c1c 0 1 2024-09-17T01:41:24.719 INFO:tasks.workunit.client.1.smithi167.stdout:3/369: unlink d7/d8/d10/d14/d66/f68 0 2024-09-17T01:41:24.719 INFO:tasks.workunit.client.1.smithi167.stdout:6/509: dread d7/d54/d90/d13/d2f/f7a [0,4194304] 0 2024-09-17T01:41:24.720 INFO:tasks.workunit.client.1.smithi167.stdout:2/391: symlink d5/d10/d1a/d45/l86 0 2024-09-17T01:41:24.722 INFO:tasks.workunit.client.1.smithi167.stdout:0/338: creat d5/d8/d9/f6a x:0 0 0 2024-09-17T01:41:24.722 INFO:tasks.workunit.client.0.smithi082.stdout:6/246: getdents d1/d7/d10/d4f/dc/d1d 0 2024-09-17T01:41:24.723 INFO:tasks.workunit.client.0.smithi082.stdout:3/95: dwrite f0 [0,4194304] 0 2024-09-17T01:41:24.727 INFO:tasks.workunit.client.0.smithi082.stdout:2/177: creat d1/d17/d29/f33 x:0 0 0 2024-09-17T01:41:24.727 INFO:tasks.workunit.client.0.smithi082.stdout:2/178: chown d1/d17/d29/l2b 7318 1 2024-09-17T01:41:24.729 INFO:tasks.workunit.client.0.smithi082.stdout:1/155: link f0 d2/da/f33 0 2024-09-17T01:41:24.730 INFO:tasks.workunit.client.1.smithi167.stdout:3/370: dread d7/d8/d2a/f63 [0,4194304] 0 2024-09-17T01:41:24.730 INFO:tasks.workunit.client.0.smithi082.stdout:1/156: stat d2/df/c30 0 2024-09-17T01:41:24.733 INFO:tasks.workunit.client.0.smithi082.stdout:7/166: rename d0/dd/c25 to d0/dd/d2c/c30 0 2024-09-17T01:41:24.733 INFO:tasks.workunit.client.0.smithi082.stdout:7/167: chown d0/d3/c28 195946 1 2024-09-17T01:41:24.736 INFO:tasks.workunit.client.1.smithi167.stdout:5/302: dread d0/f19 [4194304,4194304] 0 2024-09-17T01:41:24.737 INFO:tasks.workunit.client.1.smithi167.stdout:0/339: rename d5/d8/d2e/d4d/d58 to d5/d6b 0 2024-09-17T01:41:24.737 INFO:tasks.workunit.client.0.smithi082.stdout:9/127: mkdir d4/da/d11/d26/d29 0 2024-09-17T01:41:24.737 INFO:tasks.workunit.client.1.smithi167.stdout:5/303: dread - d0/d24/d2b/f39 zero size 2024-09-17T01:41:24.737 INFO:tasks.workunit.client.1.smithi167.stdout:0/340: fsync d5/d8/f20 0 2024-09-17T01:41:24.738 INFO:tasks.workunit.client.1.smithi167.stdout:9/403: creat d4/d9/d21/d43/f76 x:0 0 0 2024-09-17T01:41:24.738 INFO:tasks.workunit.client.1.smithi167.stdout:5/304: chown d0/l1e 6759576 1 2024-09-17T01:41:24.738 INFO:tasks.workunit.client.0.smithi082.stdout:9/128: read d4/f8 [1694152,63900] 0 2024-09-17T01:41:24.741 INFO:tasks.workunit.client.0.smithi082.stdout:8/155: truncate d3/f7 5291118 0 2024-09-17T01:41:24.742 INFO:tasks.workunit.client.0.smithi082.stdout:8/156: truncate d3/dd/f26 281434 0 2024-09-17T01:41:24.743 INFO:tasks.workunit.client.1.smithi167.stdout:5/305: dwrite d0/d28/f37 [0,4194304] 0 2024-09-17T01:41:24.743 INFO:tasks.workunit.client.0.smithi082.stdout:6/247: creat d1/d7/d10/f5e x:0 0 0 2024-09-17T01:41:24.750 INFO:tasks.workunit.client.0.smithi082.stdout:4/167: getdents d9/d15/d16 0 2024-09-17T01:41:24.751 INFO:tasks.workunit.client.1.smithi167.stdout:5/306: dwrite d0/f47 [0,4194304] 0 2024-09-17T01:41:24.752 INFO:tasks.workunit.client.1.smithi167.stdout:6/510: unlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/lb6 0 2024-09-17T01:41:24.753 INFO:tasks.workunit.client.0.smithi082.stdout:1/157: mkdir d2/dd/d34 0 2024-09-17T01:41:24.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:24 smithi167 ceph-mon[35643]: pgmap v15: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 73 MiB/s wr, 172 op/s 2024-09-17T01:41:24.754 INFO:tasks.workunit.client.1.smithi167.stdout:6/511: write d7/fae [422380,94572] 0 2024-09-17T01:41:24.754 INFO:tasks.workunit.client.1.smithi167.stdout:3/371: dwrite d7/d8/d10/f42 [0,4194304] 0 2024-09-17T01:41:24.757 INFO:tasks.workunit.client.0.smithi082.stdout:7/168: symlink d0/d3/l31 0 2024-09-17T01:41:24.759 INFO:tasks.workunit.client.1.smithi167.stdout:0/341: mknod d5/d8/d2e/d37/c6c 0 2024-09-17T01:41:24.763 INFO:tasks.workunit.client.0.smithi082.stdout:9/129: dread d4/f1a [0,4194304] 0 2024-09-17T01:41:24.764 INFO:tasks.workunit.client.1.smithi167.stdout:9/404: truncate d4/d9/f25 2257911 0 2024-09-17T01:41:24.764 INFO:tasks.workunit.client.0.smithi082.stdout:9/130: chown d4/f8 48581 1 2024-09-17T01:41:24.766 INFO:tasks.workunit.client.1.smithi167.stdout:4/419: truncate d0/d4/d7/da/f30 3478019 0 2024-09-17T01:41:24.767 INFO:tasks.workunit.client.1.smithi167.stdout:4/420: truncate d0/f44 407648 0 2024-09-17T01:41:24.768 INFO:tasks.workunit.client.0.smithi082.stdout:9/131: dread d4/f10 [0,4194304] 0 2024-09-17T01:41:24.769 INFO:tasks.workunit.client.0.smithi082.stdout:6/248: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l5f 0 2024-09-17T01:41:24.771 INFO:tasks.workunit.client.0.smithi082.stdout:8/157: dread d3/f7 [0,4194304] 0 2024-09-17T01:41:24.772 INFO:tasks.workunit.client.1.smithi167.stdout:7/389: creat d0/d2/f7a x:0 0 0 2024-09-17T01:41:24.772 INFO:tasks.workunit.client.0.smithi082.stdout:8/158: stat d3/f7 0 2024-09-17T01:41:24.773 INFO:tasks.workunit.client.0.smithi082.stdout:8/159: read d3/dd/f27 [3265388,93053] 0 2024-09-17T01:41:24.773 INFO:tasks.workunit.client.0.smithi082.stdout:3/96: unlink d9/db/c1e 0 2024-09-17T01:41:24.774 INFO:tasks.workunit.client.0.smithi082.stdout:3/97: chown d9/db/f17 16 1 2024-09-17T01:41:24.775 INFO:tasks.workunit.client.0.smithi082.stdout:6/249: dread d1/d7/d10/d4f/dc/f29 [0,4194304] 0 2024-09-17T01:41:24.777 INFO:tasks.workunit.client.0.smithi082.stdout:6/250: write d1/d7/d10/d4f/dc/d2b/d48/f2a [463240,63250] 0 2024-09-17T01:41:24.777 INFO:tasks.workunit.client.1.smithi167.stdout:8/496: sync 2024-09-17T01:41:24.778 INFO:tasks.workunit.client.0.smithi082.stdout:6/251: truncate d1/f5d 123395 0 2024-09-17T01:41:24.780 INFO:tasks.workunit.client.1.smithi167.stdout:5/307: creat d0/d28/f5b x:0 0 0 2024-09-17T01:41:24.781 INFO:tasks.workunit.client.1.smithi167.stdout:5/308: chown d0/d9/ff 1479 1 2024-09-17T01:41:24.781 INFO:tasks.workunit.client.0.smithi082.stdout:1/158: unlink d2/da/l12 0 2024-09-17T01:41:24.783 INFO:tasks.workunit.client.1.smithi167.stdout:0/342: dread d5/d8/d2e/d4d/f38 [0,4194304] 0 2024-09-17T01:41:24.783 INFO:tasks.workunit.client.1.smithi167.stdout:2/392: creat d5/d10/d1a/d2e/f87 x:0 0 0 2024-09-17T01:41:24.785 INFO:tasks.workunit.client.0.smithi082.stdout:7/169: write d0/f2f [187052,7673] 0 2024-09-17T01:41:24.785 INFO:tasks.workunit.client.1.smithi167.stdout:2/393: stat d5/d3c/f83 0 2024-09-17T01:41:24.785 INFO:tasks.workunit.client.1.smithi167.stdout:0/343: chown d5/d8/d2e/l5f 1885650 1 2024-09-17T01:41:24.793 INFO:tasks.workunit.client.0.smithi082.stdout:5/112: dwrite f6 [0,4194304] 0 2024-09-17T01:41:24.793 INFO:tasks.workunit.client.1.smithi167.stdout:1/381: getdents d0 0 2024-09-17T01:41:24.794 INFO:tasks.workunit.client.1.smithi167.stdout:7/390: rmdir d0/d2/d14/d19/d32 39 2024-09-17T01:41:24.794 INFO:tasks.workunit.client.0.smithi082.stdout:5/113: dread db/f19 [0,4194304] 0 2024-09-17T01:41:24.800 INFO:tasks.workunit.client.0.smithi082.stdout:8/160: rename d3/dd/f11 to d3/dd/f30 0 2024-09-17T01:41:24.801 INFO:tasks.workunit.client.1.smithi167.stdout:6/512: mknod d7/d54/d91/cbb 0 2024-09-17T01:41:24.802 INFO:tasks.workunit.client.0.smithi082.stdout:8/161: dread d3/f9 [4194304,4194304] 0 2024-09-17T01:41:24.802 INFO:tasks.workunit.client.1.smithi167.stdout:2/394: mknod d5/d1f/c88 0 2024-09-17T01:41:24.803 INFO:tasks.workunit.client.0.smithi082.stdout:4/168: mknod d9/d31/c34 0 2024-09-17T01:41:24.803 INFO:tasks.workunit.client.1.smithi167.stdout:0/344: rmdir d5 39 2024-09-17T01:41:24.804 INFO:tasks.workunit.client.0.smithi082.stdout:4/169: write d9/d15/f1e [97882,78145] 0 2024-09-17T01:41:24.804 INFO:tasks.workunit.client.0.smithi082.stdout:4/170: readlink d9/l23 0 2024-09-17T01:41:24.805 INFO:tasks.workunit.client.0.smithi082.stdout:1/159: creat d2/da/f35 x:0 0 0 2024-09-17T01:41:24.806 INFO:tasks.workunit.client.1.smithi167.stdout:6/513: dwrite d7/d54/d90/d13/f17 [0,4194304] 0 2024-09-17T01:41:24.808 INFO:tasks.workunit.client.0.smithi082.stdout:9/132: mknod d4/d27/d21/c2a 0 2024-09-17T01:41:24.809 INFO:tasks.workunit.client.1.smithi167.stdout:1/382: mknod d0/c77 0 2024-09-17T01:41:24.811 INFO:tasks.workunit.client.1.smithi167.stdout:5/309: link d0/d9/f2d d0/d24/d2b/d3d/d3b/f5c 0 2024-09-17T01:41:24.812 INFO:tasks.workunit.client.1.smithi167.stdout:5/310: write d0/d24/d2b/d3d/f58 [108869,4845] 0 2024-09-17T01:41:24.817 INFO:tasks.workunit.client.0.smithi082.stdout:3/98: rename d9/f1b to d9/f21 0 2024-09-17T01:41:24.819 INFO:tasks.workunit.client.0.smithi082.stdout:5/114: symlink db/l27 0 2024-09-17T01:41:24.820 INFO:tasks.workunit.client.1.smithi167.stdout:2/395: creat d5/d33/f89 x:0 0 0 2024-09-17T01:41:24.823 INFO:tasks.workunit.client.1.smithi167.stdout:3/372: creat d7/f72 x:0 0 0 2024-09-17T01:41:24.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/162: write d3/dd/f27 [5188986,60671] 0 2024-09-17T01:41:24.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/163: stat d3/dd/d18/f1e 0 2024-09-17T01:41:24.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/405: rename d4/d9/d21/d2d/d33/d3a/f4d to d4/d9/d21/d43/f77 0 2024-09-17T01:41:24.825 INFO:tasks.workunit.client.0.smithi082.stdout:8/164: chown d3/f9 124 1 2024-09-17T01:41:24.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/406: stat d4/lc 0 2024-09-17T01:41:24.830 INFO:tasks.workunit.client.1.smithi167.stdout:1/383: dwrite d0/d5/d34/f49 [0,4194304] 0 2024-09-17T01:41:24.831 INFO:tasks.workunit.client.1.smithi167.stdout:1/384: readlink d0/d5/d34/d6d/l4f 0 2024-09-17T01:41:24.835 INFO:tasks.workunit.client.0.smithi082.stdout:5/115: mknod db/d12/d18/c28 0 2024-09-17T01:41:24.835 INFO:tasks.workunit.client.1.smithi167.stdout:0/345: chown d5/d8/d9/d2f/c5e 45958641 1 2024-09-17T01:41:24.837 INFO:tasks.workunit.client.0.smithi082.stdout:4/171: mknod d9/d15/c35 0 2024-09-17T01:41:24.839 INFO:tasks.workunit.client.0.smithi082.stdout:4/172: write d9/fc [494275,66636] 0 2024-09-17T01:41:24.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/170: creat d0/f32 x:0 0 0 2024-09-17T01:41:24.841 INFO:tasks.workunit.client.0.smithi082.stdout:7/171: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:24.842 INFO:tasks.workunit.client.1.smithi167.stdout:7/391: truncate d0/d2/d14/d23/f58 1643935 0 2024-09-17T01:41:24.842 INFO:tasks.workunit.client.0.smithi082.stdout:7/172: write d0/d3/db/d10/f27 [329173,36576] 0 2024-09-17T01:41:24.843 INFO:tasks.workunit.client.0.smithi082.stdout:8/165: creat d3/dd/f31 x:0 0 0 2024-09-17T01:41:24.844 INFO:tasks.workunit.client.0.smithi082.stdout:8/166: write d3/f1f [620702,87190] 0 2024-09-17T01:41:24.845 INFO:tasks.workunit.client.0.smithi082.stdout:8/167: dread - d3/dd/f1b zero size 2024-09-17T01:41:24.847 INFO:tasks.workunit.client.1.smithi167.stdout:4/421: rename d0/f2 to d0/d4/d7/da/d48/d40/d57/d5a/f91 0 2024-09-17T01:41:24.851 INFO:tasks.workunit.client.1.smithi167.stdout:5/311: dread - d0/d28/d3a/f57 zero size 2024-09-17T01:41:24.853 INFO:tasks.workunit.client.1.smithi167.stdout:1/385: mkdir d0/d9/d16/d48/d54/d78 0 2024-09-17T01:41:24.853 INFO:tasks.workunit.client.1.smithi167.stdout:1/386: chown d0/d5/d34/d6d/c5c 414 1 2024-09-17T01:41:24.854 INFO:tasks.workunit.client.1.smithi167.stdout:1/387: fsync d0/d9/d16/d36/f53 0 2024-09-17T01:41:24.856 INFO:tasks.workunit.client.0.smithi082.stdout:4/173: dread d9/fd [0,4194304] 0 2024-09-17T01:41:24.857 INFO:tasks.workunit.client.1.smithi167.stdout:7/392: creat d0/d2/d14/d23/f7b x:0 0 0 2024-09-17T01:41:24.858 INFO:tasks.workunit.client.1.smithi167.stdout:6/514: truncate d7/d54/d90/d13/d2f/d96/faf 191439 0 2024-09-17T01:41:24.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/173: rmdir d0 39 2024-09-17T01:41:24.860 INFO:tasks.workunit.client.1.smithi167.stdout:7/393: dread d0/d2/d14/d19/d22/f25 [0,4194304] 0 2024-09-17T01:41:24.862 INFO:tasks.workunit.client.0.smithi082.stdout:3/99: truncate f7 3104536 0 2024-09-17T01:41:24.863 INFO:tasks.workunit.client.0.smithi082.stdout:3/100: fsync f1 0 2024-09-17T01:41:24.863 INFO:tasks.workunit.client.0.smithi082.stdout:1/160: link d2/dd/d24/c32 d2/dd/c36 0 2024-09-17T01:41:24.863 INFO:tasks.workunit.client.0.smithi082.stdout:3/101: fsync f0 0 2024-09-17T01:41:24.864 INFO:tasks.workunit.client.0.smithi082.stdout:1/161: chown d2/da/f35 1039042618 1 2024-09-17T01:41:24.864 INFO:tasks.workunit.client.0.smithi082.stdout:8/168: mknod d3/dd/d18/d2a/c32 0 2024-09-17T01:41:24.866 INFO:tasks.workunit.client.1.smithi167.stdout:2/396: creat d5/d10/d1a/d2e/f8a x:0 0 0 2024-09-17T01:41:24.866 INFO:tasks.workunit.client.0.smithi082.stdout:9/133: link d4/lf d4/da/l2b 0 2024-09-17T01:41:24.867 INFO:tasks.workunit.client.1.smithi167.stdout:1/388: symlink d0/d5/d61/l79 0 2024-09-17T01:41:24.868 INFO:tasks.workunit.client.0.smithi082.stdout:9/134: dread - d4/da/f16 zero size 2024-09-17T01:41:24.869 INFO:tasks.workunit.client.0.smithi082.stdout:5/116: dwrite db/f16 [0,4194304] 0 2024-09-17T01:41:24.870 INFO:tasks.workunit.client.0.smithi082.stdout:1/162: dread f0 [0,4194304] 0 2024-09-17T01:41:24.871 INFO:tasks.workunit.client.0.smithi082.stdout:1/163: write d2/f18 [2503454,13946] 0 2024-09-17T01:41:24.872 INFO:tasks.workunit.client.0.smithi082.stdout:1/164: write d2/da/f35 [638092,82091] 0 2024-09-17T01:41:24.877 INFO:tasks.workunit.client.1.smithi167.stdout:6/515: unlink d7/d54/d90/l5f 0 2024-09-17T01:41:24.878 INFO:tasks.workunit.client.1.smithi167.stdout:3/373: rename d7/d8/d10/l70 to d7/d8/d10/d37/l73 0 2024-09-17T01:41:24.885 INFO:tasks.workunit.client.1.smithi167.stdout:3/374: dwrite d7/d8/d10/d14/d2c/f2d [4194304,4194304] 0 2024-09-17T01:41:24.885 INFO:tasks.workunit.client.1.smithi167.stdout:9/407: creat d4/d9/d21/d43/f78 x:0 0 0 2024-09-17T01:41:24.886 INFO:tasks.workunit.client.0.smithi082.stdout:7/174: dread d0/d3/db/fe [0,4194304] 0 2024-09-17T01:41:24.886 INFO:tasks.workunit.client.1.smithi167.stdout:3/375: read - d7/d8/d10/d14/f53 zero size 2024-09-17T01:41:24.887 INFO:tasks.workunit.client.1.smithi167.stdout:5/312: symlink d0/d54/d56/l5d 0 2024-09-17T01:41:24.889 INFO:tasks.workunit.client.1.smithi167.stdout:5/313: read d0/f19 [2784943,87915] 0 2024-09-17T01:41:24.890 INFO:tasks.workunit.client.0.smithi082.stdout:5/117: readlink db/d12/l1a 0 2024-09-17T01:41:24.896 INFO:tasks.workunit.client.0.smithi082.stdout:1/165: creat d2/da/f37 x:0 0 0 2024-09-17T01:41:24.897 INFO:tasks.workunit.client.0.smithi082.stdout:1/166: fsync d2/da/d16/f1c 0 2024-09-17T01:41:24.897 INFO:tasks.workunit.client.1.smithi167.stdout:6/516: mkdir d7/d54/d90/d13/d2f/d64/d6b/dbc 0 2024-09-17T01:41:24.900 INFO:tasks.workunit.client.1.smithi167.stdout:4/422: rename d0/d4/d7/da/d48/d40/d57 to d0/d4/d7/d6/d2b/d6d/d7e/d92 0 2024-09-17T01:41:24.901 INFO:tasks.workunit.client.0.smithi082.stdout:1/167: dread d2/f20 [0,4194304] 0 2024-09-17T01:41:24.901 INFO:tasks.workunit.client.0.smithi082.stdout:3/102: truncate f1 2409068 0 2024-09-17T01:41:24.902 INFO:tasks.workunit.client.1.smithi167.stdout:8/497: sync 2024-09-17T01:41:24.905 INFO:tasks.workunit.client.0.smithi082.stdout:8/169: dwrite d3/f20 [0,4194304] 0 2024-09-17T01:41:24.908 INFO:tasks.workunit.client.1.smithi167.stdout:9/408: symlink d4/d9/d21/d37/l79 0 2024-09-17T01:41:24.908 INFO:tasks.workunit.client.1.smithi167.stdout:4/423: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [4194304,4194304] 0 2024-09-17T01:41:24.909 INFO:tasks.workunit.client.0.smithi082.stdout:5/118: unlink db/f10 0 2024-09-17T01:41:24.909 INFO:tasks.workunit.client.1.smithi167.stdout:9/409: write d4/d9/d21/f2f [3397110,119382] 0 2024-09-17T01:41:24.910 INFO:tasks.workunit.client.1.smithi167.stdout:3/376: unlink l5 0 2024-09-17T01:41:24.912 INFO:tasks.workunit.client.0.smithi082.stdout:9/135: creat d4/da/d11/d26/d29/f2c x:0 0 0 2024-09-17T01:41:24.913 INFO:tasks.workunit.client.1.smithi167.stdout:4/424: truncate d0/d4/d7/da/f80 1721327 0 2024-09-17T01:41:24.914 INFO:tasks.workunit.client.1.smithi167.stdout:7/394: dwrite d0/f5f [0,4194304] 0 2024-09-17T01:41:24.917 INFO:tasks.workunit.client.0.smithi082.stdout:5/119: dwrite f6 [4194304,4194304] 0 2024-09-17T01:41:24.918 INFO:tasks.workunit.client.1.smithi167.stdout:0/346: sync 2024-09-17T01:41:24.919 INFO:tasks.workunit.client.1.smithi167.stdout:1/389: unlink d0/d9/d16/d36/c56 0 2024-09-17T01:41:24.919 INFO:tasks.workunit.client.1.smithi167.stdout:4/425: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f/f79 88100 1 2024-09-17T01:41:24.920 INFO:tasks.workunit.client.1.smithi167.stdout:0/347: dread - d5/d8/f44 zero size 2024-09-17T01:41:24.920 INFO:tasks.workunit.client.1.smithi167.stdout:6/517: readlink d7/d54/d90/d34/l50 0 2024-09-17T01:41:24.923 INFO:tasks.workunit.client.0.smithi082.stdout:1/168: mknod d2/dd/c38 0 2024-09-17T01:41:24.923 INFO:tasks.workunit.client.0.smithi082.stdout:7/175: dwrite d0/d3/db/d10/f1e [0,4194304] 0 2024-09-17T01:41:24.926 INFO:tasks.workunit.client.0.smithi082.stdout:1/169: dread - d2/da/d2d/f2e zero size 2024-09-17T01:41:24.928 INFO:tasks.workunit.client.0.smithi082.stdout:1/170: readlink d2/dd/d24/l25 0 2024-09-17T01:41:24.928 INFO:tasks.workunit.client.1.smithi167.stdout:3/377: dwrite d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:24.929 INFO:tasks.workunit.client.1.smithi167.stdout:4/426: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f7b 1477116974 1 2024-09-17T01:41:24.929 INFO:tasks.workunit.client.0.smithi082.stdout:1/171: chown d2/da/d16/f1c 1072010759 1 2024-09-17T01:41:24.930 INFO:tasks.workunit.client.1.smithi167.stdout:9/410: creat d4/d9/d2b/f7a x:0 0 0 2024-09-17T01:41:24.934 INFO:tasks.workunit.client.0.smithi082.stdout:9/136: truncate d4/f1a 827759 0 2024-09-17T01:41:24.934 INFO:tasks.workunit.client.1.smithi167.stdout:2/397: link d5/d10/d1a/d2e/l55 d5/d1f/l8b 0 2024-09-17T01:41:24.935 INFO:tasks.workunit.client.1.smithi167.stdout:2/398: stat d5/d33/f57 0 2024-09-17T01:41:24.938 INFO:tasks.workunit.client.1.smithi167.stdout:1/390: read d0/d5/d34/f14 [4337184,12850] 0 2024-09-17T01:41:24.939 INFO:tasks.workunit.client.1.smithi167.stdout:7/395: write d0/d2/d14/d19/d32/d62/f64 [282407,115904] 0 2024-09-17T01:41:24.941 INFO:tasks.workunit.client.1.smithi167.stdout:4/427: dwrite d0/d4/d7/da/f4d [0,4194304] 0 2024-09-17T01:41:24.945 INFO:tasks.workunit.client.0.smithi082.stdout:7/176: creat d0/d3/db/f33 x:0 0 0 2024-09-17T01:41:24.947 INFO:tasks.workunit.client.0.smithi082.stdout:7/177: write d0/fa [3271761,127619] 0 2024-09-17T01:41:24.948 INFO:tasks.workunit.client.0.smithi082.stdout:7/178: read - d0/d3/db/f33 zero size 2024-09-17T01:41:24.949 INFO:tasks.workunit.client.0.smithi082.stdout:3/103: dread d9/db/f13 [0,4194304] 0 2024-09-17T01:41:24.949 INFO:tasks.workunit.client.0.smithi082.stdout:7/179: fdatasync d0/dd/f17 0 2024-09-17T01:41:24.951 INFO:tasks.workunit.client.0.smithi082.stdout:9/137: mkdir d4/d27/d2d 0 2024-09-17T01:41:24.955 INFO:tasks.workunit.client.1.smithi167.stdout:8/498: truncate dc/d56/f5e 3686029 0 2024-09-17T01:41:24.956 INFO:tasks.workunit.client.1.smithi167.stdout:6/518: symlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/lbd 0 2024-09-17T01:41:24.956 INFO:tasks.workunit.client.0.smithi082.stdout:8/170: creat d3/f33 x:0 0 0 2024-09-17T01:41:24.957 INFO:tasks.workunit.client.1.smithi167.stdout:6/519: write d7/d54/d90/d13/d2f/d30/f59 [3818182,52916] 0 2024-09-17T01:41:24.957 INFO:tasks.workunit.client.0.smithi082.stdout:5/120: write db/fc [1072913,61898] 0 2024-09-17T01:41:24.958 INFO:tasks.workunit.client.0.smithi082.stdout:3/104: creat d9/db/f22 x:0 0 0 2024-09-17T01:41:24.959 INFO:tasks.workunit.client.1.smithi167.stdout:3/378: mkdir d7/d8/d10/d14/d2c/d74 0 2024-09-17T01:41:24.960 INFO:tasks.workunit.client.1.smithi167.stdout:3/379: truncate d7/f65 489893 0 2024-09-17T01:41:24.960 INFO:tasks.workunit.client.0.smithi082.stdout:7/180: mkdir d0/dd/d34 0 2024-09-17T01:41:24.963 INFO:tasks.workunit.client.0.smithi082.stdout:9/138: rename d4/da to d4/d27/d21/d2e 0 2024-09-17T01:41:24.963 INFO:tasks.workunit.client.1.smithi167.stdout:3/380: dread d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:24.967 INFO:tasks.workunit.client.1.smithi167.stdout:7/396: chown d0/c2b 7 1 2024-09-17T01:41:24.969 INFO:tasks.workunit.client.1.smithi167.stdout:1/391: symlink d0/d9/d16/d36/l7a 0 2024-09-17T01:41:24.970 INFO:tasks.workunit.client.1.smithi167.stdout:3/381: dwrite d7/f72 [0,4194304] 0 2024-09-17T01:41:24.972 INFO:tasks.workunit.client.1.smithi167.stdout:4/428: write d0/d4/f47 [4311084,30431] 0 2024-09-17T01:41:24.972 INFO:tasks.workunit.client.0.smithi082.stdout:8/171: rename d3/dd/d18/d2a to d3/dd/d18/d34 0 2024-09-17T01:41:24.974 INFO:tasks.workunit.client.0.smithi082.stdout:7/181: creat d0/d3/f35 x:0 0 0 2024-09-17T01:41:24.977 INFO:tasks.workunit.client.1.smithi167.stdout:8/499: mkdir dc/d56/d57/da0 0 2024-09-17T01:41:24.978 INFO:tasks.workunit.client.0.smithi082.stdout:9/139: truncate d4/f10 3763158 0 2024-09-17T01:41:24.979 INFO:tasks.workunit.client.0.smithi082.stdout:9/140: stat d4/d27/d21/d2e/fb 0 2024-09-17T01:41:24.980 INFO:tasks.workunit.client.1.smithi167.stdout:5/314: getdents d0/d24/d2b 0 2024-09-17T01:41:24.981 INFO:tasks.workunit.client.1.smithi167.stdout:5/315: readlink d0/d9/d1c/l4a 0 2024-09-17T01:41:24.983 INFO:tasks.workunit.client.1.smithi167.stdout:6/520: unlink d7/d54/d90/f5b 0 2024-09-17T01:41:24.984 INFO:tasks.workunit.client.0.smithi082.stdout:8/172: mknod d3/dd/d18/d2d/c35 0 2024-09-17T01:41:24.985 INFO:tasks.workunit.client.1.smithi167.stdout:2/399: write d5/d1f/f20 [1031000,114861] 0 2024-09-17T01:41:24.986 INFO:tasks.workunit.client.0.smithi082.stdout:7/182: mkdir d0/d3/d36 0 2024-09-17T01:41:24.987 INFO:tasks.workunit.client.1.smithi167.stdout:9/411: creat d4/d9/d21/d2d/d33/d3a/d74/f7b x:0 0 0 2024-09-17T01:41:24.991 INFO:tasks.workunit.client.0.smithi082.stdout:5/121: dwrite f9 [4194304,4194304] 0 2024-09-17T01:41:24.992 INFO:tasks.workunit.client.1.smithi167.stdout:9/412: dwrite d4/f4e [0,4194304] 0 2024-09-17T01:41:24.993 INFO:tasks.workunit.client.1.smithi167.stdout:7/397: rmdir d0 39 2024-09-17T01:41:24.993 INFO:tasks.workunit.client.1.smithi167.stdout:9/413: chown d4/d9/d21/d43 472718317 1 2024-09-17T01:41:24.996 INFO:tasks.workunit.client.0.smithi082.stdout:5/122: dread db/d12/f15 [0,4194304] 0 2024-09-17T01:41:24.997 INFO:tasks.workunit.client.0.smithi082.stdout:5/123: fsync db/d12/f15 0 2024-09-17T01:41:24.997 INFO:tasks.workunit.client.1.smithi167.stdout:1/392: unlink d0/d9/d16/d48/f6a 0 2024-09-17T01:41:24.998 INFO:tasks.workunit.client.0.smithi082.stdout:3/105: write f7 [3577914,34828] 0 2024-09-17T01:41:25.000 INFO:tasks.workunit.client.1.smithi167.stdout:3/382: mkdir d7/d8/d10/d29/d75 0 2024-09-17T01:41:25.001 INFO:tasks.workunit.client.1.smithi167.stdout:9/414: dwrite d4/d9/d21/f60 [0,4194304] 0 2024-09-17T01:41:25.002 INFO:tasks.workunit.client.1.smithi167.stdout:3/383: dread - d7/d8/d10/d14/f53 zero size 2024-09-17T01:41:25.008 INFO:tasks.workunit.client.1.smithi167.stdout:6/521: creat d7/d54/d90/d13/d2f/d64/fbe x:0 0 0 2024-09-17T01:41:25.017 INFO:tasks.workunit.client.1.smithi167.stdout:0/348: getdents d5/d8/d9 0 2024-09-17T01:41:25.018 INFO:tasks.workunit.client.1.smithi167.stdout:5/316: dwrite d0/d9/d1c/f23 [0,4194304] 0 2024-09-17T01:41:25.019 INFO:tasks.workunit.client.1.smithi167.stdout:3/384: write d7/f41 [4138602,90054] 0 2024-09-17T01:41:25.021 INFO:tasks.workunit.client.1.smithi167.stdout:4/429: truncate d0/d4/d7/d6/f29 223616 0 2024-09-17T01:41:25.023 INFO:tasks.workunit.client.1.smithi167.stdout:1/393: creat d0/d9/d16/d48/d54/d6e/f7b x:0 0 0 2024-09-17T01:41:25.023 INFO:tasks.workunit.client.1.smithi167.stdout:8/500: truncate dc/d21/f31 4941285 0 2024-09-17T01:41:25.025 INFO:tasks.workunit.client.1.smithi167.stdout:5/317: unlink d0/d9/c2f 0 2024-09-17T01:41:25.025 INFO:tasks.workunit.client.1.smithi167.stdout:4/430: chown d0/d4/d7/d6/l2f 63 1 2024-09-17T01:41:25.027 INFO:tasks.workunit.client.1.smithi167.stdout:2/400: creat d5/d10/d1a/d2e/f8c x:0 0 0 2024-09-17T01:41:25.027 INFO:tasks.workunit.client.1.smithi167.stdout:8/501: chown dc/d56/d59/d82/d8f 37325 1 2024-09-17T01:41:25.028 INFO:tasks.workunit.client.1.smithi167.stdout:0/349: dwrite d5/d8/d2e/d4d/d56/f59 [0,4194304] 0 2024-09-17T01:41:25.029 INFO:tasks.workunit.client.1.smithi167.stdout:5/318: chown d0/d54/d56/l5d 3697 1 2024-09-17T01:41:25.029 INFO:tasks.workunit.client.1.smithi167.stdout:8/502: chown dc/d56 187 1 2024-09-17T01:41:25.029 INFO:tasks.workunit.client.1.smithi167.stdout:9/415: getdents d4/d9/d2b 0 2024-09-17T01:41:25.030 INFO:tasks.workunit.client.1.smithi167.stdout:1/394: rename d0/d9/d16/d48/c67 to d0/c7c 0 2024-09-17T01:41:25.035 INFO:tasks.workunit.client.1.smithi167.stdout:3/385: link d7/d8/d2a/c5d d7/d8/d1f/c76 0 2024-09-17T01:41:25.035 INFO:tasks.workunit.client.1.smithi167.stdout:5/319: write d0/d24/d2b/f39 [401880,92019] 0 2024-09-17T01:41:25.035 INFO:tasks.workunit.client.1.smithi167.stdout:0/350: write d5/d6b/f5d [556534,130064] 0 2024-09-17T01:41:25.036 INFO:tasks.workunit.client.1.smithi167.stdout:1/395: read - d0/d5/d34/f70 zero size 2024-09-17T01:41:25.037 INFO:tasks.workunit.client.1.smithi167.stdout:4/431: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 2776 1 2024-09-17T01:41:25.040 INFO:tasks.workunit.client.1.smithi167.stdout:4/432: chown d0/d4/d7/d10/d70 32553625 1 2024-09-17T01:41:25.040 INFO:tasks.workunit.client.1.smithi167.stdout:0/351: mkdir d5/d8/d2e/d6d 0 2024-09-17T01:41:25.040 INFO:tasks.workunit.client.1.smithi167.stdout:5/320: creat d0/d28/d3a/d44/f5e x:0 0 0 2024-09-17T01:41:25.041 INFO:tasks.workunit.client.1.smithi167.stdout:3/386: creat d7/d8/d10/d14/d24/d62/f77 x:0 0 0 2024-09-17T01:41:25.043 INFO:tasks.workunit.client.1.smithi167.stdout:1/396: unlink d0/d9/d16/d36/c3b 0 2024-09-17T01:41:25.045 INFO:tasks.workunit.client.1.smithi167.stdout:1/397: write d0/d5/d34/d3c/d74/f75 [117532,111370] 0 2024-09-17T01:41:25.047 INFO:tasks.workunit.client.1.smithi167.stdout:6/522: dread d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:25.048 INFO:tasks.workunit.client.1.smithi167.stdout:3/387: creat d7/d8/f78 x:0 0 0 2024-09-17T01:41:25.049 INFO:tasks.workunit.client.1.smithi167.stdout:2/401: getdents d5/d1f 0 2024-09-17T01:41:25.051 INFO:tasks.workunit.client.1.smithi167.stdout:7/398: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:25.052 INFO:tasks.workunit.client.1.smithi167.stdout:0/352: unlink d5/d8/l1e 0 2024-09-17T01:41:25.052 INFO:tasks.workunit.client.1.smithi167.stdout:5/321: fdatasync d0/d9/f2d 0 2024-09-17T01:41:25.053 INFO:tasks.workunit.client.1.smithi167.stdout:9/416: link d4/d4a/l5f d4/l7c 0 2024-09-17T01:41:25.056 INFO:tasks.workunit.client.1.smithi167.stdout:1/398: dwrite d0/d9/d16/d48/d54/f64 [4194304,4194304] 0 2024-09-17T01:41:25.056 INFO:tasks.workunit.client.1.smithi167.stdout:9/417: write d4/f4e [2825883,80849] 0 2024-09-17T01:41:25.059 INFO:tasks.workunit.client.1.smithi167.stdout:0/353: readlink d5/d8/d9/d2f/l51 0 2024-09-17T01:41:25.060 INFO:tasks.workunit.client.1.smithi167.stdout:5/322: mkdir d0/d24/d2b/d3d/d3b/d5f 0 2024-09-17T01:41:25.061 INFO:tasks.workunit.client.1.smithi167.stdout:0/354: chown d5/d8/d2e/d6d 893952686 1 2024-09-17T01:41:25.062 INFO:tasks.workunit.client.1.smithi167.stdout:7/399: unlink d0/d2/d14/d19/c27 0 2024-09-17T01:41:25.064 INFO:tasks.workunit.client.1.smithi167.stdout:2/402: dwrite d5/d10/d1a/d45/f68 [0,4194304] 0 2024-09-17T01:41:25.066 INFO:tasks.workunit.client.1.smithi167.stdout:6/523: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f87 [0,4194304] 0 2024-09-17T01:41:25.066 INFO:tasks.workunit.client.1.smithi167.stdout:4/433: write d0/d4/d7/da/f30 [1066776,50870] 0 2024-09-17T01:41:25.067 INFO:tasks.workunit.client.1.smithi167.stdout:5/323: creat d0/d9/d1c/f60 x:0 0 0 2024-09-17T01:41:25.070 INFO:tasks.workunit.client.1.smithi167.stdout:0/355: mknod d5/d8/d2e/d4d/c6e 0 2024-09-17T01:41:25.071 INFO:tasks.workunit.client.1.smithi167.stdout:9/418: creat d4/d9/d21/d43/f7d x:0 0 0 2024-09-17T01:41:25.073 INFO:tasks.workunit.client.1.smithi167.stdout:1/399: dwrite d0/d5/d34/f14 [4194304,4194304] 0 2024-09-17T01:41:25.073 INFO:tasks.workunit.client.1.smithi167.stdout:0/356: chown d5/d8/d9/f35 537158 1 2024-09-17T01:41:25.074 INFO:tasks.workunit.client.1.smithi167.stdout:9/419: write d4/f38 [2574282,127053] 0 2024-09-17T01:41:25.075 INFO:tasks.workunit.client.1.smithi167.stdout:2/403: write d5/d10/d1a/d2e/d49/f64 [2993907,72467] 0 2024-09-17T01:41:25.077 INFO:tasks.workunit.client.1.smithi167.stdout:3/388: symlink d7/d8/d1f/l79 0 2024-09-17T01:41:25.078 INFO:tasks.workunit.client.1.smithi167.stdout:4/434: fdatasync d0/d4/d7/d6/f43 0 2024-09-17T01:41:25.080 INFO:tasks.workunit.client.1.smithi167.stdout:9/420: write d4/f18 [392065,96887] 0 2024-09-17T01:41:25.080 INFO:tasks.workunit.client.1.smithi167.stdout:7/400: link d0/f4f d0/d2/d14/d19/d26/d34/f7c 0 2024-09-17T01:41:25.082 INFO:tasks.workunit.client.1.smithi167.stdout:1/400: rename d0/d9/d16/d48/d54/f59 to d0/d5/d34/f7d 0 2024-09-17T01:41:25.082 INFO:tasks.workunit.client.1.smithi167.stdout:3/389: chown d7/d8/d1f/c28 3 1 2024-09-17T01:41:25.083 INFO:tasks.workunit.client.1.smithi167.stdout:9/421: chown d4/f18 44340836 1 2024-09-17T01:41:25.083 INFO:tasks.workunit.client.1.smithi167.stdout:4/435: chown d0/d4/d7/d6/d2b/d6d 234277 1 2024-09-17T01:41:25.085 INFO:tasks.workunit.client.1.smithi167.stdout:7/401: fsync d0/d2/d14/d19/d22/f5e 0 2024-09-17T01:41:25.086 INFO:tasks.workunit.client.1.smithi167.stdout:3/390: fdatasync d7/f65 0 2024-09-17T01:41:25.088 INFO:tasks.workunit.client.1.smithi167.stdout:9/422: unlink d4/d9/d21/d2d/f5a 0 2024-09-17T01:41:25.089 INFO:tasks.workunit.client.1.smithi167.stdout:3/391: fdatasync d7/f54 0 2024-09-17T01:41:25.089 INFO:tasks.workunit.client.1.smithi167.stdout:0/357: dread d5/d8/d2e/f54 [0,4194304] 0 2024-09-17T01:41:25.089 INFO:tasks.workunit.client.1.smithi167.stdout:6/524: dwrite d7/d54/d90/d13/d2f/d64/d6b/fa5 [0,4194304] 0 2024-09-17T01:41:25.090 INFO:tasks.workunit.client.1.smithi167.stdout:2/404: link d5/d10/d1a/d45/d3f/l5d d5/d71/l8d 0 2024-09-17T01:41:25.092 INFO:tasks.workunit.client.1.smithi167.stdout:7/402: symlink d0/d2/l7d 0 2024-09-17T01:41:25.096 INFO:tasks.workunit.client.1.smithi167.stdout:3/392: chown d7/d8/d2a/d4e/f67 0 1 2024-09-17T01:41:25.097 INFO:tasks.workunit.client.1.smithi167.stdout:9/423: mknod d4/d9/d21/d43/c7e 0 2024-09-17T01:41:25.098 INFO:tasks.workunit.client.1.smithi167.stdout:2/405: read d5/d1f/f26 [3929950,96445] 0 2024-09-17T01:41:25.099 INFO:tasks.workunit.client.1.smithi167.stdout:5/324: write d0/f19 [5354176,20759] 0 2024-09-17T01:41:25.100 INFO:tasks.workunit.client.1.smithi167.stdout:7/403: creat d0/d55/d70/f7e x:0 0 0 2024-09-17T01:41:25.101 INFO:tasks.workunit.client.1.smithi167.stdout:6/525: mknod d7/d54/d90/d13/d2f/d64/d6b/dbc/cbf 0 2024-09-17T01:41:25.103 INFO:tasks.workunit.client.1.smithi167.stdout:9/424: rename d4/l1e to d4/l7f 0 2024-09-17T01:41:25.104 INFO:tasks.workunit.client.1.smithi167.stdout:3/393: chown d7/d8/d10/d29/c33 655 1 2024-09-17T01:41:25.104 INFO:tasks.workunit.client.1.smithi167.stdout:4/436: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d74/f8c [0,4194304] 0 2024-09-17T01:41:25.105 INFO:tasks.workunit.client.1.smithi167.stdout:5/325: chown d0/d24/d2b/d3d/l40 482796751 1 2024-09-17T01:41:25.108 INFO:tasks.workunit.client.1.smithi167.stdout:3/394: chown d7/d1e/f3c 0 1 2024-09-17T01:41:25.108 INFO:tasks.workunit.client.1.smithi167.stdout:7/404: mkdir d0/d2/d14/d19/d7f 0 2024-09-17T01:41:25.109 INFO:tasks.workunit.client.1.smithi167.stdout:6/526: mknod d7/d52/d79/da4/cc0 0 2024-09-17T01:41:25.109 INFO:tasks.workunit.client.1.smithi167.stdout:0/358: dwrite d5/d8/d9/f39 [0,4194304] 0 2024-09-17T01:41:25.112 INFO:tasks.workunit.client.1.smithi167.stdout:7/405: chown d0/d2/d14/d19/d26/l76 481599 1 2024-09-17T01:41:25.113 INFO:tasks.workunit.client.1.smithi167.stdout:4/437: write d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 [937471,68774] 0 2024-09-17T01:41:25.115 INFO:tasks.workunit.client.0.smithi082.stdout:7/183: mkdir d0/d3/d36/d37 0 2024-09-17T01:41:25.116 INFO:tasks.workunit.client.0.smithi082.stdout:3/106: dread - d9/db/f17 zero size 2024-09-17T01:41:25.117 INFO:tasks.workunit.client.1.smithi167.stdout:4/438: fdatasync d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f85 0 2024-09-17T01:41:25.118 INFO:tasks.workunit.client.0.smithi082.stdout:9/141: write d4/d27/d21/d2e/fb [959906,73508] 0 2024-09-17T01:41:25.118 INFO:tasks.workunit.client.1.smithi167.stdout:5/326: truncate d0/d24/f38 951238 0 2024-09-17T01:41:25.118 INFO:tasks.workunit.client.1.smithi167.stdout:1/401: dread d0/d9/f37 [0,4194304] 0 2024-09-17T01:41:25.119 INFO:tasks.workunit.client.0.smithi082.stdout:5/124: dread fa [0,4194304] 0 2024-09-17T01:41:25.119 INFO:tasks.workunit.client.1.smithi167.stdout:4/439: read d0/d4/d7/f77 [819967,111436] 0 2024-09-17T01:41:25.120 INFO:tasks.workunit.client.1.smithi167.stdout:5/327: fsync d0/d28/d3a/d44/f5e 0 2024-09-17T01:41:25.120 INFO:tasks.workunit.client.1.smithi167.stdout:7/406: unlink d0/f5f 0 2024-09-17T01:41:25.122 INFO:tasks.workunit.client.1.smithi167.stdout:5/328: write d0/f47 [3344084,56076] 0 2024-09-17T01:41:25.122 INFO:tasks.workunit.client.1.smithi167.stdout:4/440: fsync d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f7b 0 2024-09-17T01:41:25.123 INFO:tasks.workunit.client.0.smithi082.stdout:7/184: mknod d0/d3/d36/c38 0 2024-09-17T01:41:25.124 INFO:tasks.workunit.client.1.smithi167.stdout:5/329: chown d0/f1d 803453 1 2024-09-17T01:41:25.124 INFO:tasks.workunit.client.1.smithi167.stdout:4/441: readlink d0/d4/d7/da/d48/l54 0 2024-09-17T01:41:25.127 INFO:tasks.workunit.client.0.smithi082.stdout:7/185: dread d0/f23 [4194304,4194304] 0 2024-09-17T01:41:25.128 INFO:tasks.workunit.client.1.smithi167.stdout:2/406: dwrite d5/d10/d1a/d2e/f3b [4194304,4194304] 0 2024-09-17T01:41:25.128 INFO:tasks.workunit.client.0.smithi082.stdout:5/125: mkdir db/d12/d29 0 2024-09-17T01:41:25.129 INFO:tasks.workunit.client.1.smithi167.stdout:2/407: write d5/d10/d16/f1b [3220154,109203] 0 2024-09-17T01:41:25.132 INFO:tasks.workunit.client.1.smithi167.stdout:2/408: write d5/d10/d16/f73 [2010420,93894] 0 2024-09-17T01:41:25.133 INFO:tasks.workunit.client.1.smithi167.stdout:3/395: write d7/d1e/f4f [159974,106089] 0 2024-09-17T01:41:25.133 INFO:tasks.workunit.client.1.smithi167.stdout:2/409: readlink d5/d10/d16/l7a 0 2024-09-17T01:41:25.135 INFO:tasks.workunit.client.1.smithi167.stdout:7/407: mkdir d0/d2/d14/d19/d32/d80 0 2024-09-17T01:41:25.137 INFO:tasks.workunit.client.1.smithi167.stdout:2/410: dread d5/d10/f22 [0,4194304] 0 2024-09-17T01:41:25.140 INFO:tasks.workunit.client.1.smithi167.stdout:0/359: dwrite d5/d8/d2e/d4d/f38 [0,4194304] 0 2024-09-17T01:41:25.140 INFO:tasks.workunit.client.1.smithi167.stdout:9/425: truncate d4/d9/d21/d43/f77 5324597 0 2024-09-17T01:41:25.141 INFO:tasks.workunit.client.1.smithi167.stdout:3/396: dread d7/d1e/f4f [0,4194304] 0 2024-09-17T01:41:25.144 INFO:tasks.workunit.client.0.smithi082.stdout:5/126: unlink f7 0 2024-09-17T01:41:25.145 INFO:tasks.workunit.client.1.smithi167.stdout:8/503: sync 2024-09-17T01:41:25.147 INFO:tasks.workunit.client.1.smithi167.stdout:8/504: write dc/d21/f44 [2782033,43342] 0 2024-09-17T01:41:25.147 INFO:tasks.workunit.client.1.smithi167.stdout:4/442: unlink d0/f44 0 2024-09-17T01:41:25.148 INFO:tasks.workunit.client.1.smithi167.stdout:1/402: write d0/d5/d61/f71 [492220,92296] 0 2024-09-17T01:41:25.148 INFO:tasks.workunit.client.1.smithi167.stdout:3/397: dwrite d7/d8/d2a/f3f [0,4194304] 0 2024-09-17T01:41:25.150 INFO:tasks.workunit.client.1.smithi167.stdout:8/505: fsync dc/d56/d59/d82/f9f 0 2024-09-17T01:41:25.151 INFO:tasks.workunit.client.1.smithi167.stdout:4/443: write d0/d4/d7/d10/f3f [376515,75607] 0 2024-09-17T01:41:25.151 INFO:tasks.workunit.client.1.smithi167.stdout:3/398: chown d7/d1e/l5b 8405 1 2024-09-17T01:41:25.152 INFO:tasks.workunit.client.0.smithi082.stdout:7/186: mknod d0/c39 0 2024-09-17T01:41:25.154 INFO:tasks.workunit.client.0.smithi082.stdout:7/187: write d0/d3/db/f33 [328273,49591] 0 2024-09-17T01:41:25.156 INFO:tasks.workunit.client.1.smithi167.stdout:6/527: truncate d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f8f 3551038 0 2024-09-17T01:41:25.157 INFO:tasks.workunit.client.0.smithi082.stdout:9/142: dwrite d4/f1a [0,4194304] 0 2024-09-17T01:41:25.158 INFO:tasks.workunit.client.0.smithi082.stdout:5/127: readlink db/l21 0 2024-09-17T01:41:25.158 INFO:tasks.workunit.client.1.smithi167.stdout:6/528: write d7/f8a [874827,103271] 0 2024-09-17T01:41:25.158 INFO:tasks.workunit.client.1.smithi167.stdout:3/399: read d7/d8/d2a/d4e/f59 [573609,52120] 0 2024-09-17T01:41:25.160 INFO:tasks.workunit.client.1.smithi167.stdout:7/408: creat d0/d2/d14/d19/d26/f81 x:0 0 0 2024-09-17T01:41:25.161 INFO:tasks.workunit.client.0.smithi082.stdout:3/107: getdents d9 0 2024-09-17T01:41:25.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/143: dread d4/d27/d21/d2e/f18 [0,4194304] 0 2024-09-17T01:41:25.166 INFO:tasks.workunit.client.1.smithi167.stdout:6/529: dread d7/d54/d90/d34/f76 [0,4194304] 0 2024-09-17T01:41:25.171 INFO:tasks.workunit.client.1.smithi167.stdout:6/530: dread - d7/d54/d90/d13/d2f/d30/fa7 zero size 2024-09-17T01:41:25.171 INFO:tasks.workunit.client.1.smithi167.stdout:7/409: dwrite d0/d2/f41 [0,4194304] 0 2024-09-17T01:41:25.172 INFO:tasks.workunit.client.1.smithi167.stdout:0/360: write d5/d8/d2e/f54 [1302096,79121] 0 2024-09-17T01:41:25.172 INFO:tasks.workunit.client.1.smithi167.stdout:2/411: dread d5/d10/d1a/d2e/f59 [0,4194304] 0 2024-09-17T01:41:25.174 INFO:tasks.workunit.client.1.smithi167.stdout:9/426: write d4/d9/d21/d43/d47/f68 [235514,89710] 0 2024-09-17T01:41:25.175 INFO:tasks.workunit.client.0.smithi082.stdout:3/108: creat d9/f23 x:0 0 0 2024-09-17T01:41:25.176 INFO:tasks.workunit.client.1.smithi167.stdout:0/361: write d5/d6b/f5d [1512055,52733] 0 2024-09-17T01:41:25.177 INFO:tasks.workunit.client.1.smithi167.stdout:7/410: chown d0/d2/d14/d19/d26/f35 31046829 1 2024-09-17T01:41:25.179 INFO:tasks.workunit.client.1.smithi167.stdout:9/427: dread - d4/d9/d21/d2d/d33/d3a/d74/f7b zero size 2024-09-17T01:41:25.181 INFO:tasks.workunit.client.1.smithi167.stdout:9/428: chown d4/f18 60906 1 2024-09-17T01:41:25.185 INFO:tasks.workunit.client.1.smithi167.stdout:0/362: dwrite d5/d8/d9/f62 [0,4194304] 0 2024-09-17T01:41:25.321 INFO:tasks.workunit.client.1.smithi167.stdout:1/403: mkdir d0/d9/d16/d48/d54/d6e/d7e 0 2024-09-17T01:41:25.322 INFO:tasks.workunit.client.1.smithi167.stdout:4/444: mknod d0/d4/d7/d6/d2b/d6d/d7e/c93 0 2024-09-17T01:41:25.324 INFO:tasks.workunit.client.0.smithi082.stdout:5/128: link db/d1e/l25 db/d12/d18/d23/l2a 0 2024-09-17T01:41:25.325 INFO:tasks.workunit.client.0.smithi082.stdout:7/188: write d0/d3/db/fe [1756940,51549] 0 2024-09-17T01:41:25.326 INFO:tasks.workunit.client.0.smithi082.stdout:7/189: chown d0/f23 1948 1 2024-09-17T01:41:25.327 INFO:tasks.workunit.client.0.smithi082.stdout:9/144: rename d4/d27/c25 to d4/d27/d21/d2e/d11/c2f 0 2024-09-17T01:41:25.328 INFO:tasks.workunit.client.0.smithi082.stdout:5/129: fdatasync db/d12/f1c 0 2024-09-17T01:41:25.329 INFO:tasks.workunit.client.1.smithi167.stdout:3/400: mkdir d7/d8/d2a/d7a 0 2024-09-17T01:41:25.330 INFO:tasks.workunit.client.0.smithi082.stdout:7/190: creat d0/d3/d36/f3a x:0 0 0 2024-09-17T01:41:25.331 INFO:tasks.workunit.client.0.smithi082.stdout:7/191: stat d0/d3/db/d10 0 2024-09-17T01:41:25.333 INFO:tasks.workunit.client.1.smithi167.stdout:5/330: rename d0/d9/d1c/l4a to d0/l61 0 2024-09-17T01:41:25.334 INFO:tasks.workunit.client.1.smithi167.stdout:5/331: write d0/d9/f2d [2521506,105387] 0 2024-09-17T01:41:25.335 INFO:tasks.workunit.client.1.smithi167.stdout:5/332: write d0/d9/d1c/f23 [2779397,89642] 0 2024-09-17T01:41:25.335 INFO:tasks.workunit.client.1.smithi167.stdout:5/333: stat d0/l1a 0 2024-09-17T01:41:25.337 INFO:tasks.workunit.client.0.smithi082.stdout:5/130: dread db/d12/d18/f1d [0,4194304] 0 2024-09-17T01:41:25.338 INFO:tasks.workunit.client.0.smithi082.stdout:7/192: mknod d0/d3/d36/c3b 0 2024-09-17T01:41:25.338 INFO:tasks.workunit.client.0.smithi082.stdout:5/131: truncate db/d1e/f22 912777 0 2024-09-17T01:41:25.340 INFO:tasks.workunit.client.1.smithi167.stdout:6/531: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/cc1 0 2024-09-17T01:41:25.341 INFO:tasks.workunit.client.1.smithi167.stdout:5/334: dwrite d0/d28/d3a/f57 [0,4194304] 0 2024-09-17T01:41:25.341 INFO:tasks.workunit.client.1.smithi167.stdout:5/335: chown d0/d54 743452 1 2024-09-17T01:41:25.342 INFO:tasks.workunit.client.1.smithi167.stdout:5/336: readlink d0/d24/l2e 0 2024-09-17T01:41:25.343 INFO:tasks.workunit.client.0.smithi082.stdout:5/132: mkdir db/d2b 0 2024-09-17T01:41:25.343 INFO:tasks.workunit.client.0.smithi082.stdout:5/133: chown db/d12/l13 3591 1 2024-09-17T01:41:25.346 INFO:tasks.workunit.client.0.smithi082.stdout:7/193: symlink d0/d3/d36/l3c 0 2024-09-17T01:41:25.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/145: creat d4/f30 x:0 0 0 2024-09-17T01:41:25.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/146: chown d4/d27/d21 0 1 2024-09-17T01:41:25.350 INFO:tasks.workunit.client.1.smithi167.stdout:0/363: mknod d5/d8/d9/d2f/c6f 0 2024-09-17T01:41:25.351 INFO:tasks.workunit.client.0.smithi082.stdout:3/109: creat d9/f24 x:0 0 0 2024-09-17T01:41:25.351 INFO:tasks.workunit.client.1.smithi167.stdout:8/506: mknod dc/d18/ca1 0 2024-09-17T01:41:25.353 INFO:tasks.workunit.client.1.smithi167.stdout:1/404: unlink d0/d5/d34/d3c/l33 0 2024-09-17T01:41:25.354 INFO:tasks.workunit.client.0.smithi082.stdout:7/194: creat d0/dd/f3d x:0 0 0 2024-09-17T01:41:25.355 INFO:tasks.workunit.client.1.smithi167.stdout:4/445: creat d0/d4/d7/d6/d2b/d6d/d7e/f94 x:0 0 0 2024-09-17T01:41:25.356 INFO:tasks.workunit.client.0.smithi082.stdout:9/147: mkdir d4/d27/d21/d2e/d11/d26/d31 0 2024-09-17T01:41:25.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/110: chown d9/db/c1d 118356 1 2024-09-17T01:41:25.358 INFO:tasks.workunit.client.0.smithi082.stdout:5/134: creat db/d12/d29/f2c x:0 0 0 2024-09-17T01:41:25.359 INFO:tasks.workunit.client.0.smithi082.stdout:5/135: dread - db/d12/d29/f2c zero size 2024-09-17T01:41:25.359 INFO:tasks.workunit.client.0.smithi082.stdout:7/195: unlink d0/d3/db/cc 0 2024-09-17T01:41:25.361 INFO:tasks.workunit.client.0.smithi082.stdout:3/111: rmdir d9 39 2024-09-17T01:41:25.362 INFO:tasks.workunit.client.0.smithi082.stdout:5/136: creat db/f2d x:0 0 0 2024-09-17T01:41:25.362 INFO:tasks.workunit.client.0.smithi082.stdout:9/148: dwrite d4/f17 [0,4194304] 0 2024-09-17T01:41:25.362 INFO:tasks.workunit.client.0.smithi082.stdout:9/149: dread - d4/f30 zero size 2024-09-17T01:41:25.366 INFO:tasks.workunit.client.1.smithi167.stdout:5/337: unlink d0/f22 0 2024-09-17T01:41:25.366 INFO:tasks.workunit.client.1.smithi167.stdout:5/338: fdatasync d0/d28/f5b 0 2024-09-17T01:41:25.368 INFO:tasks.workunit.client.0.smithi082.stdout:5/137: dread f6 [0,4194304] 0 2024-09-17T01:41:25.372 INFO:tasks.workunit.client.0.smithi082.stdout:3/112: symlink d9/db/l25 0 2024-09-17T01:41:25.376 INFO:tasks.workunit.client.1.smithi167.stdout:0/364: creat d5/d6b/f70 x:0 0 0 2024-09-17T01:41:25.380 INFO:tasks.workunit.client.1.smithi167.stdout:1/405: rmdir d0/d9/d16/d48/d54/d6e 39 2024-09-17T01:41:25.383 INFO:tasks.workunit.client.0.smithi082.stdout:3/113: mkdir d9/db/d26 0 2024-09-17T01:41:25.386 INFO:tasks.workunit.client.1.smithi167.stdout:7/411: creat d0/d2/d14/d19/f82 x:0 0 0 2024-09-17T01:41:25.387 INFO:tasks.workunit.client.0.smithi082.stdout:9/150: dread d4/f17 [4194304,4194304] 0 2024-09-17T01:41:25.387 INFO:tasks.workunit.client.0.smithi082.stdout:9/151: readlink l3 0 2024-09-17T01:41:25.388 INFO:tasks.workunit.client.0.smithi082.stdout:7/196: link d0/l8 d0/l3e 0 2024-09-17T01:41:25.388 INFO:tasks.workunit.client.0.smithi082.stdout:9/152: chown d4/d27/d21/d2e/fb 4 1 2024-09-17T01:41:25.388 INFO:tasks.workunit.client.1.smithi167.stdout:9/429: truncate d4/d9/d21/f3b 3585120 0 2024-09-17T01:41:25.388 INFO:tasks.workunit.client.1.smithi167.stdout:9/430: chown d4/d9/ld 1 1 2024-09-17T01:41:25.388 INFO:tasks.workunit.client.1.smithi167.stdout:9/431: chown d4/d9/d21/d43/d47 10821 1 2024-09-17T01:41:25.389 INFO:tasks.workunit.client.0.smithi082.stdout:9/153: fdatasync d4/d27/d21/d2e/d11/d26/d29/f2c 0 2024-09-17T01:41:25.391 INFO:tasks.workunit.client.0.smithi082.stdout:5/138: write db/d12/d18/f1d [3809390,66520] 0 2024-09-17T01:41:25.392 INFO:tasks.workunit.client.1.smithi167.stdout:9/432: dwrite d4/d9/f4c [0,4194304] 0 2024-09-17T01:41:25.393 INFO:tasks.workunit.client.0.smithi082.stdout:7/197: mkdir d0/d3/db/d10/d3f 0 2024-09-17T01:41:25.394 INFO:tasks.workunit.client.1.smithi167.stdout:0/365: symlink d5/d8/d2e/l71 0 2024-09-17T01:41:25.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/114: creat d9/db/d26/f27 x:0 0 0 2024-09-17T01:41:25.399 INFO:tasks.workunit.client.0.smithi082.stdout:7/198: dwrite d0/dd/f16 [0,4194304] 0 2024-09-17T01:41:25.401 INFO:tasks.workunit.client.1.smithi167.stdout:1/406: creat d0/d5/d61/f7f x:0 0 0 2024-09-17T01:41:25.402 INFO:tasks.workunit.client.1.smithi167.stdout:9/433: dwrite d4/d9/d21/d43/f78 [0,4194304] 0 2024-09-17T01:41:25.403 INFO:tasks.workunit.client.1.smithi167.stdout:1/407: chown d0/d5/d34/l21 3117367 1 2024-09-17T01:41:25.404 INFO:tasks.workunit.client.1.smithi167.stdout:0/366: dwrite d5/d8/d2e/d4d/f22 [0,4194304] 0 2024-09-17T01:41:25.405 INFO:tasks.workunit.client.1.smithi167.stdout:2/412: rename d5/d10/d1a/d2e/d49 to d5/d10/d1a/d45/d8e 0 2024-09-17T01:41:25.406 INFO:tasks.workunit.client.0.smithi082.stdout:9/154: symlink d4/d27/d21/d2e/d11/l32 0 2024-09-17T01:41:25.406 INFO:tasks.workunit.client.1.smithi167.stdout:7/412: mkdir d0/d2/d14/d19/d26/d83 0 2024-09-17T01:41:25.408 INFO:tasks.workunit.client.1.smithi167.stdout:0/367: fsync d5/d8/d2e/d4d/d56/f59 0 2024-09-17T01:41:25.408 INFO:tasks.workunit.client.0.smithi082.stdout:3/115: mkdir d9/db/d26/d28 0 2024-09-17T01:41:25.409 INFO:tasks.workunit.client.0.smithi082.stdout:3/116: truncate f6 2257028 0 2024-09-17T01:41:25.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/199: creat d0/dd/d2c/f40 x:0 0 0 2024-09-17T01:41:25.416 INFO:tasks.workunit.client.1.smithi167.stdout:0/368: dwrite d5/d8/d2e/d37/d45/f4b [0,4194304] 0 2024-09-17T01:41:25.417 INFO:tasks.workunit.client.0.smithi082.stdout:3/117: dread f0 [0,4194304] 0 2024-09-17T01:41:25.418 INFO:tasks.workunit.client.0.smithi082.stdout:5/139: dwrite f6 [0,4194304] 0 2024-09-17T01:41:25.420 INFO:tasks.workunit.client.0.smithi082.stdout:9/155: rename d4/d27/d21/d2e/cc to d4/d27/d21/d2e/c33 0 2024-09-17T01:41:25.421 INFO:tasks.workunit.client.0.smithi082.stdout:7/200: fsync d0/dd/f1d 0 2024-09-17T01:41:25.421 INFO:tasks.workunit.client.1.smithi167.stdout:5/339: fsync d0/f21 0 2024-09-17T01:41:25.421 INFO:tasks.workunit.client.0.smithi082.stdout:5/140: chown db/d12/l1a 1018698505 1 2024-09-17T01:41:25.422 INFO:tasks.workunit.client.0.smithi082.stdout:5/141: fdatasync db/fc 0 2024-09-17T01:41:25.423 INFO:tasks.workunit.client.0.smithi082.stdout:5/142: readlink db/l1b 0 2024-09-17T01:41:25.423 INFO:tasks.workunit.client.1.smithi167.stdout:3/401: getdents d7/d8/d2a/d4e 0 2024-09-17T01:41:25.425 INFO:tasks.workunit.client.1.smithi167.stdout:9/434: write d4/d9/f1d [2412494,10404] 0 2024-09-17T01:41:25.426 INFO:tasks.workunit.client.1.smithi167.stdout:1/408: mkdir d0/d9/d16/d48/d80 0 2024-09-17T01:41:25.428 INFO:tasks.workunit.client.1.smithi167.stdout:4/446: rename d0/d4/cb to d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d4f/c95 0 2024-09-17T01:41:25.429 INFO:tasks.workunit.client.1.smithi167.stdout:9/435: write d4/d9/d21/d2d/d33/d3a/d74/f7b [341305,32862] 0 2024-09-17T01:41:25.431 INFO:tasks.workunit.client.1.smithi167.stdout:3/402: dwrite f3 [0,4194304] 0 2024-09-17T01:41:25.433 INFO:tasks.workunit.client.0.smithi082.stdout:5/143: creat db/f2e x:0 0 0 2024-09-17T01:41:25.433 INFO:tasks.workunit.client.0.smithi082.stdout:5/144: stat db/d12 0 2024-09-17T01:41:25.434 INFO:tasks.workunit.client.1.smithi167.stdout:6/532: link d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/c9c d7/d54/d90/d13/d2f/cc2 0 2024-09-17T01:41:25.434 INFO:tasks.workunit.client.0.smithi082.stdout:5/145: dread - db/f2e zero size 2024-09-17T01:41:25.435 INFO:tasks.workunit.client.1.smithi167.stdout:0/369: chown d5/d8/l23 64607886 1 2024-09-17T01:41:25.437 INFO:tasks.workunit.client.1.smithi167.stdout:5/340: creat d0/d24/f62 x:0 0 0 2024-09-17T01:41:25.438 INFO:tasks.workunit.client.1.smithi167.stdout:5/341: write d0/d9/f2d [6576501,125637] 0 2024-09-17T01:41:25.439 INFO:tasks.workunit.client.1.smithi167.stdout:2/413: creat d5/d6d/f8f x:0 0 0 2024-09-17T01:41:25.439 INFO:tasks.workunit.client.0.smithi082.stdout:5/146: dread db/f17 [0,4194304] 0 2024-09-17T01:41:25.442 INFO:tasks.workunit.client.1.smithi167.stdout:1/409: rename d0/d5/d34/c27 to d0/d9/d16/d48/d80/c81 0 2024-09-17T01:41:25.444 INFO:tasks.workunit.client.1.smithi167.stdout:9/436: mkdir d4/d9/d21/d2d/d33/d80 0 2024-09-17T01:41:25.445 INFO:tasks.workunit.client.1.smithi167.stdout:6/533: creat d7/d54/d90/d13/d2f/d64/d6b/dbc/fc3 x:0 0 0 2024-09-17T01:41:25.445 INFO:tasks.workunit.client.1.smithi167.stdout:5/342: dwrite d0/d24/d2b/f39 [0,4194304] 0 2024-09-17T01:41:25.446 INFO:tasks.workunit.client.1.smithi167.stdout:9/437: fsync d4/d9/f6d 0 2024-09-17T01:41:25.449 INFO:tasks.workunit.client.1.smithi167.stdout:0/370: dread d5/d8/d2e/f54 [0,4194304] 0 2024-09-17T01:41:25.450 INFO:tasks.workunit.client.1.smithi167.stdout:3/403: rename d7/d8/d10/c16 to d7/d8/d10/d14/d24/d62/c7b 0 2024-09-17T01:41:25.451 INFO:tasks.workunit.client.1.smithi167.stdout:1/410: symlink d0/d9/d16/d48/l82 0 2024-09-17T01:41:25.452 INFO:tasks.workunit.client.1.smithi167.stdout:1/411: write d0/d9/f31 [2108770,131062] 0 2024-09-17T01:41:25.453 INFO:tasks.workunit.client.1.smithi167.stdout:1/412: write d0/d9/d16/d48/d54/f60 [237576,74444] 0 2024-09-17T01:41:25.454 INFO:tasks.workunit.client.1.smithi167.stdout:5/343: stat d0/d28/f2a 0 2024-09-17T01:41:25.454 INFO:tasks.workunit.client.1.smithi167.stdout:1/413: fdatasync d0/d5/d61/f7f 0 2024-09-17T01:41:25.455 INFO:tasks.workunit.client.1.smithi167.stdout:0/371: creat d5/d8/d9/d2f/f72 x:0 0 0 2024-09-17T01:41:25.456 INFO:tasks.workunit.client.1.smithi167.stdout:3/404: truncate d7/d1e/f4f 1729406 0 2024-09-17T01:41:25.457 INFO:tasks.workunit.client.1.smithi167.stdout:5/344: write d0/d24/d2b/d3d/d3b/f3e [316172,88299] 0 2024-09-17T01:41:25.457 INFO:tasks.workunit.client.1.smithi167.stdout:0/372: readlink d5/d8/d2e/d4d/l12 0 2024-09-17T01:41:25.458 INFO:tasks.workunit.client.0.smithi082.stdout:7/201: dread d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:25.459 INFO:tasks.workunit.client.1.smithi167.stdout:1/414: write d0/d5/d61/f71 [1555339,117268] 0 2024-09-17T01:41:25.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/202: readlink d0/d3/l31 0 2024-09-17T01:41:25.459 INFO:tasks.workunit.client.1.smithi167.stdout:6/534: getdents d7/d54/d90/d13/d2f/d64/d6b/d95 0 2024-09-17T01:41:25.461 INFO:tasks.workunit.client.0.smithi082.stdout:7/203: symlink d0/l41 0 2024-09-17T01:41:25.462 INFO:tasks.workunit.client.1.smithi167.stdout:1/415: rmdir d0/d5/d34 39 2024-09-17T01:41:25.462 INFO:tasks.workunit.client.1.smithi167.stdout:6/535: rmdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61 39 2024-09-17T01:41:25.464 INFO:tasks.workunit.client.0.smithi082.stdout:7/204: mkdir d0/dd/d2c/d42 0 2024-09-17T01:41:25.465 INFO:tasks.workunit.client.0.smithi082.stdout:7/205: rmdir d0/d3/d36 39 2024-09-17T01:41:25.466 INFO:tasks.workunit.client.0.smithi082.stdout:7/206: dread - d0/d3/f2b zero size 2024-09-17T01:41:25.467 INFO:tasks.workunit.client.0.smithi082.stdout:7/207: write d0/d3/db/d10/f1e [3759465,6554] 0 2024-09-17T01:41:25.467 INFO:tasks.workunit.client.1.smithi167.stdout:6/536: link d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/cad d7/cc4 0 2024-09-17T01:41:25.468 INFO:tasks.workunit.client.1.smithi167.stdout:6/537: chown d7/d54/d90/d13/d2f/d64/d6b/fa0 238244020 1 2024-09-17T01:41:25.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/208: truncate d0/dd/d2c/f40 671927 0 2024-09-17T01:41:25.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/209: chown d0/dd 87 1 2024-09-17T01:41:25.469 INFO:tasks.workunit.client.1.smithi167.stdout:6/538: fsync d7/d54/d90/d13/d2f/d7f/d98/d27/f26 0 2024-09-17T01:41:25.471 INFO:tasks.workunit.client.0.smithi082.stdout:7/210: mknod d0/d3/db/c43 0 2024-09-17T01:41:25.473 INFO:tasks.workunit.client.1.smithi167.stdout:6/539: write d7/d54/d90/d13/d2f/d7f/f86 [3978147,47235] 0 2024-09-17T01:41:25.474 INFO:tasks.workunit.client.1.smithi167.stdout:4/447: dread d0/d4/d69/f6b [0,4194304] 0 2024-09-17T01:41:25.477 INFO:tasks.workunit.client.1.smithi167.stdout:6/540: creat d7/d54/d90/d13/d2f/d7f/fc5 x:0 0 0 2024-09-17T01:41:25.478 INFO:tasks.workunit.client.0.smithi082.stdout:7/211: link d0/d3/db/f29 d0/d3/d36/d37/f44 0 2024-09-17T01:41:25.479 INFO:tasks.workunit.client.1.smithi167.stdout:6/541: rmdir d7/d54/d90/d13/d2f/d96/dab 39 2024-09-17T01:41:25.480 INFO:tasks.workunit.client.1.smithi167.stdout:6/542: write d7/d42/f71 [750462,85559] 0 2024-09-17T01:41:25.484 INFO:tasks.workunit.client.1.smithi167.stdout:8/507: truncate dc/f3c 1949070 0 2024-09-17T01:41:25.485 INFO:tasks.workunit.client.1.smithi167.stdout:6/543: fdatasync d7/d54/d90/d13/d2f/d96/dab/f46 0 2024-09-17T01:41:25.487 INFO:tasks.workunit.client.0.smithi082.stdout:7/212: dwrite d0/d3/db/f29 [0,4194304] 0 2024-09-17T01:41:25.490 INFO:tasks.workunit.client.0.smithi082.stdout:9/156: unlink d4/d27/d21/d2e/c33 0 2024-09-17T01:41:25.492 INFO:tasks.workunit.client.1.smithi167.stdout:6/544: rename d7/f7b to d7/d54/d90/d13/d2f/d64/d6b/d95/db1/fc6 0 2024-09-17T01:41:25.493 INFO:tasks.workunit.client.1.smithi167.stdout:3/405: dread d7/f54 [0,4194304] 0 2024-09-17T01:41:25.495 INFO:tasks.workunit.client.0.smithi082.stdout:9/157: fdatasync d4/f1d 0 2024-09-17T01:41:25.497 INFO:tasks.workunit.client.0.smithi082.stdout:7/213: dread d0/d3/f21 [4194304,4194304] 0 2024-09-17T01:41:25.498 INFO:tasks.workunit.client.0.smithi082.stdout:7/214: fdatasync d0/d3/d36/f3a 0 2024-09-17T01:41:25.501 INFO:tasks.workunit.client.1.smithi167.stdout:6/545: mknod d7/d54/d91/cc7 0 2024-09-17T01:41:25.502 INFO:tasks.workunit.client.0.smithi082.stdout:9/158: creat d4/d27/d21/d2e/f34 x:0 0 0 2024-09-17T01:41:25.503 INFO:tasks.workunit.client.0.smithi082.stdout:3/118: dwrite f1 [0,4194304] 0 2024-09-17T01:41:25.504 INFO:tasks.workunit.client.0.smithi082.stdout:3/119: chown d9/db/f22 5223311 1 2024-09-17T01:41:25.504 INFO:tasks.workunit.client.0.smithi082.stdout:7/215: symlink d0/d3/d36/l45 0 2024-09-17T01:41:25.505 INFO:tasks.workunit.client.0.smithi082.stdout:3/120: stat d9/db/d26/d28 0 2024-09-17T01:41:25.507 INFO:tasks.workunit.client.0.smithi082.stdout:9/159: mkdir d4/d27/d21/d2e/d11/d26/d29/d35 0 2024-09-17T01:41:25.509 INFO:tasks.workunit.client.1.smithi167.stdout:8/508: getdents dc/d1a 0 2024-09-17T01:41:25.511 INFO:tasks.workunit.client.0.smithi082.stdout:7/216: dwrite d0/d3/f2b [0,4194304] 0 2024-09-17T01:41:25.511 INFO:tasks.workunit.client.1.smithi167.stdout:3/406: mkdir d7/d8/d10/d14/d66/d6c/d7c 0 2024-09-17T01:41:25.514 INFO:tasks.workunit.client.0.smithi082.stdout:9/160: mkdir d4/d27/d36 0 2024-09-17T01:41:25.516 INFO:tasks.workunit.client.1.smithi167.stdout:6/546: mkdir d7/d54/d90/d34/dc8 0 2024-09-17T01:41:25.517 INFO:tasks.workunit.client.1.smithi167.stdout:6/547: fdatasync d7/d54/d90/d13/d2f/d7f/f86 0 2024-09-17T01:41:25.518 INFO:tasks.workunit.client.1.smithi167.stdout:8/509: readlink dc/d18/l20 0 2024-09-17T01:41:25.519 INFO:tasks.workunit.client.1.smithi167.stdout:8/510: write dc/d21/f47 [5293826,53342] 0 2024-09-17T01:41:25.519 INFO:tasks.workunit.client.0.smithi082.stdout:5/147: truncate f6 7786378 0 2024-09-17T01:41:25.520 INFO:tasks.workunit.client.0.smithi082.stdout:5/148: fsync db/f2d 0 2024-09-17T01:41:25.524 INFO:tasks.workunit.client.1.smithi167.stdout:3/407: creat d7/d8/d10/d14/d24/f7d x:0 0 0 2024-09-17T01:41:25.524 INFO:tasks.workunit.client.1.smithi167.stdout:3/408: dread - d7/d8/d2a/d4e/f67 zero size 2024-09-17T01:41:25.524 INFO:tasks.workunit.client.0.smithi082.stdout:7/217: rename d0/d3/d36/f3a to d0/d3/d36/f46 0 2024-09-17T01:41:25.525 INFO:tasks.workunit.client.1.smithi167.stdout:0/373: getdents d5/d8/d9/d2f 0 2024-09-17T01:41:25.527 INFO:tasks.workunit.client.1.smithi167.stdout:6/548: creat d7/d54/d90/d13/d2f/d30/fc9 x:0 0 0 2024-09-17T01:41:25.528 INFO:tasks.workunit.client.0.smithi082.stdout:3/121: creat d9/f29 x:0 0 0 2024-09-17T01:41:25.529 INFO:tasks.workunit.client.0.smithi082.stdout:3/122: rename d9/db to d9/db/d26/d28/d2a 22 2024-09-17T01:41:25.529 INFO:tasks.workunit.client.1.smithi167.stdout:9/438: write d4/d9/d21/d43/f77 [6064875,94736] 0 2024-09-17T01:41:25.530 INFO:tasks.workunit.client.1.smithi167.stdout:8/511: symlink dc/d21/d6b/d74/d83/la2 0 2024-09-17T01:41:25.530 INFO:tasks.workunit.client.1.smithi167.stdout:9/439: write d4/d4a/f55 [3386988,14296] 0 2024-09-17T01:41:25.533 INFO:tasks.workunit.client.0.smithi082.stdout:7/218: mkdir d0/d3/db/d10/d47 0 2024-09-17T01:41:25.535 INFO:tasks.workunit.client.1.smithi167.stdout:0/374: unlink d5/d8/d9/c21 0 2024-09-17T01:41:25.536 INFO:tasks.workunit.client.1.smithi167.stdout:0/375: chown d5/d8/d2e/c4e 0 1 2024-09-17T01:41:25.537 INFO:tasks.workunit.client.0.smithi082.stdout:7/219: dread d0/d3/f21 [4194304,4194304] 0 2024-09-17T01:41:25.537 INFO:tasks.workunit.client.1.smithi167.stdout:0/376: write d5/d8/d9/f62 [11287,121886] 0 2024-09-17T01:41:25.537 INFO:tasks.workunit.client.0.smithi082.stdout:9/161: fsync d4/f10 0 2024-09-17T01:41:25.543 INFO:tasks.workunit.client.1.smithi167.stdout:6/549: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f8f [0,4194304] 0 2024-09-17T01:41:25.546 INFO:tasks.workunit.client.0.smithi082.stdout:0/159: sync 2024-09-17T01:41:25.548 INFO:tasks.workunit.client.1.smithi167.stdout:3/409: mknod d7/d8/d2a/d7a/c7e 0 2024-09-17T01:41:25.549 INFO:tasks.workunit.client.1.smithi167.stdout:9/440: rmdir d4/d9/d2b 39 2024-09-17T01:41:25.550 INFO:tasks.workunit.client.1.smithi167.stdout:9/441: truncate d4/d9/f6d 372925 0 2024-09-17T01:41:25.557 INFO:tasks.workunit.client.0.smithi082.stdout:9/162: mkdir d4/d27/d21/d2e/d11/d37 0 2024-09-17T01:41:25.558 INFO:tasks.workunit.client.0.smithi082.stdout:9/163: dread - d4/f30 zero size 2024-09-17T01:41:25.559 INFO:tasks.workunit.client.1.smithi167.stdout:8/512: symlink dc/d18/la3 0 2024-09-17T01:41:25.560 INFO:tasks.workunit.client.0.smithi082.stdout:3/123: creat d9/f2b x:0 0 0 2024-09-17T01:41:25.561 INFO:tasks.workunit.client.1.smithi167.stdout:3/410: mkdir d7/d8/d10/d14/d2c/d7f 0 2024-09-17T01:41:25.562 INFO:tasks.workunit.client.0.smithi082.stdout:0/160: rename da/c1f to da/d1b/c36 0 2024-09-17T01:41:25.563 INFO:tasks.workunit.client.1.smithi167.stdout:9/442: rmdir d4/d9/d21/d2d 39 2024-09-17T01:41:25.564 INFO:tasks.workunit.client.0.smithi082.stdout:0/161: read da/fb [1025609,112498] 0 2024-09-17T01:41:25.566 INFO:tasks.workunit.client.0.smithi082.stdout:0/162: read da/d16/f25 [110998,93134] 0 2024-09-17T01:41:25.567 INFO:tasks.workunit.client.0.smithi082.stdout:3/124: chown d9/c1f 463285 1 2024-09-17T01:41:25.567 INFO:tasks.workunit.client.0.smithi082.stdout:3/125: chown f1 334803 1 2024-09-17T01:41:25.569 INFO:tasks.workunit.client.1.smithi167.stdout:9/443: dwrite d4/f18 [4194304,4194304] 0 2024-09-17T01:41:25.569 INFO:tasks.workunit.client.0.smithi082.stdout:9/164: creat d4/d27/d21/d2e/d11/d37/f38 x:0 0 0 2024-09-17T01:41:25.574 INFO:tasks.workunit.client.0.smithi082.stdout:3/126: dwrite f6 [0,4194304] 0 2024-09-17T01:41:25.577 INFO:tasks.workunit.client.0.smithi082.stdout:0/163: symlink da/d1e/l37 0 2024-09-17T01:41:25.578 INFO:tasks.workunit.client.1.smithi167.stdout:7/413: sync 2024-09-17T01:41:25.579 INFO:tasks.workunit.client.1.smithi167.stdout:7/414: readlink d0/d2/l48 0 2024-09-17T01:41:25.581 INFO:tasks.workunit.client.1.smithi167.stdout:6/550: creat d7/d54/d90/d13/d2f/fca x:0 0 0 2024-09-17T01:41:25.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/220: truncate d0/d3/f2b 105897 0 2024-09-17T01:41:25.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/221: readlink d0/l1 0 2024-09-17T01:41:25.587 INFO:tasks.workunit.client.1.smithi167.stdout:3/411: link d7/d8/d10/d14/f5a d7/d1e/f80 0 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:1/172: sync 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:6/252: sync 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:4/174: sync 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:2/179: sync 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:8/173: sync 2024-09-17T01:41:25.589 INFO:tasks.workunit.client.0.smithi082.stdout:3/127: symlink d9/db/d26/l2c 0 2024-09-17T01:41:25.590 INFO:tasks.workunit.client.1.smithi167.stdout:0/377: getdents d5/d8 0 2024-09-17T01:41:25.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/180: readlink d1/d10/l2c 0 2024-09-17T01:41:25.592 INFO:tasks.workunit.client.1.smithi167.stdout:6/551: mknod d7/d54/d90/d13/d2f/d64/ccb 0 2024-09-17T01:41:25.598 INFO:tasks.workunit.client.0.smithi082.stdout:6/253: rmdir d1/d1f 39 2024-09-17T01:41:25.598 INFO:tasks.workunit.client.0.smithi082.stdout:8/174: dread d3/f1f [0,4194304] 0 2024-09-17T01:41:25.600 INFO:tasks.workunit.client.1.smithi167.stdout:3/412: rmdir d7/d8/d2a 39 2024-09-17T01:41:25.602 INFO:tasks.workunit.client.0.smithi082.stdout:6/254: fsync d1/d7/d10/f16 0 2024-09-17T01:41:25.602 INFO:tasks.workunit.client.0.smithi082.stdout:2/181: dwrite d1/d17/f18 [0,4194304] 0 2024-09-17T01:41:25.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/378: unlink d5/d8/d2e/d4d/d56/c67 0 2024-09-17T01:41:25.603 INFO:tasks.workunit.client.0.smithi082.stdout:3/128: chown d9/fe 3 1 2024-09-17T01:41:25.603 INFO:tasks.workunit.client.0.smithi082.stdout:0/164: dread da/f14 [0,4194304] 0 2024-09-17T01:41:25.603 INFO:tasks.workunit.client.0.smithi082.stdout:2/182: chown d1/l22 121025 1 2024-09-17T01:41:25.603 INFO:tasks.workunit.client.0.smithi082.stdout:1/173: symlink d2/da/d16/l39 0 2024-09-17T01:41:25.604 INFO:tasks.workunit.client.0.smithi082.stdout:6/255: chown d1/d7/d10/d4f/f30 61614 1 2024-09-17T01:41:25.604 INFO:tasks.workunit.client.0.smithi082.stdout:5/149: truncate f6 4395694 0 2024-09-17T01:41:25.605 INFO:tasks.workunit.client.1.smithi167.stdout:3/413: dwrite f3 [4194304,4194304] 0 2024-09-17T01:41:25.606 INFO:tasks.workunit.client.0.smithi082.stdout:5/150: chown db/d12/d18/c28 1 1 2024-09-17T01:41:25.607 INFO:tasks.workunit.client.0.smithi082.stdout:9/165: rename d4/d27/d21/d2e/d11/d26 to d4/d27/d21/d2e/d11/d39 0 2024-09-17T01:41:25.607 INFO:tasks.workunit.client.1.smithi167.stdout:7/415: creat d0/d2/d14/d6f/d75/f84 x:0 0 0 2024-09-17T01:41:25.608 INFO:tasks.workunit.client.1.smithi167.stdout:6/552: creat d7/d52/fcc x:0 0 0 2024-09-17T01:41:25.608 INFO:tasks.workunit.client.0.smithi082.stdout:9/166: dread - d4/f1d zero size 2024-09-17T01:41:25.609 INFO:tasks.workunit.client.0.smithi082.stdout:4/175: creat d9/d15/d16/f36 x:0 0 0 2024-09-17T01:41:25.610 INFO:tasks.workunit.client.1.smithi167.stdout:9/444: rename d4/d9/d21/d37 to d4/d9/d21/d81 0 2024-09-17T01:41:25.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/176: stat d9/d15/d16/f36 0 2024-09-17T01:41:25.611 INFO:tasks.workunit.client.1.smithi167.stdout:6/553: write d7/d54/d90/d13/d2f/d7f/fc5 [5002,53322] 0 2024-09-17T01:41:25.611 INFO:tasks.workunit.client.0.smithi082.stdout:2/183: dwrite d1/d10/f19 [0,4194304] 0 2024-09-17T01:41:25.612 INFO:tasks.workunit.client.1.smithi167.stdout:8/513: link dc/c80 dc/d56/d59/d82/ca4 0 2024-09-17T01:41:25.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/379: mknod d5/d8/d2e/c73 0 2024-09-17T01:41:25.615 INFO:tasks.workunit.client.0.smithi082.stdout:6/256: dread d1/d7/f46 [0,4194304] 0 2024-09-17T01:41:25.616 INFO:tasks.workunit.client.0.smithi082.stdout:4/177: truncate d9/d15/f22 667640 0 2024-09-17T01:41:25.618 INFO:tasks.workunit.client.1.smithi167.stdout:7/416: creat d0/d2/d14/d19/d26/f85 x:0 0 0 2024-09-17T01:41:25.619 INFO:tasks.workunit.client.1.smithi167.stdout:9/445: dread - d4/d9/d2b/f7a zero size 2024-09-17T01:41:25.620 INFO:tasks.workunit.client.0.smithi082.stdout:0/165: mknod da/df/c38 0 2024-09-17T01:41:25.620 INFO:tasks.workunit.client.1.smithi167.stdout:9/446: write d4/f38 [3789109,54992] 0 2024-09-17T01:41:25.621 INFO:tasks.workunit.client.0.smithi082.stdout:1/174: unlink d2/dd/d24/c32 0 2024-09-17T01:41:25.622 INFO:tasks.workunit.client.1.smithi167.stdout:6/554: mkdir d7/d54/d90/d13/d2f/d96/dab/dcd 0 2024-09-17T01:41:25.625 INFO:tasks.workunit.client.1.smithi167.stdout:9/447: dread d4/d9/d21/f60 [0,4194304] 0 2024-09-17T01:41:25.626 INFO:tasks.workunit.client.0.smithi082.stdout:2/184: creat d1/d17/f34 x:0 0 0 2024-09-17T01:41:25.626 INFO:tasks.workunit.client.1.smithi167.stdout:9/448: write d4/d9/d21/f2f [307768,47770] 0 2024-09-17T01:41:25.627 INFO:tasks.workunit.client.0.smithi082.stdout:2/185: stat d1/d10/f19 0 2024-09-17T01:41:25.628 INFO:tasks.workunit.client.0.smithi082.stdout:7/222: creat d0/f48 x:0 0 0 2024-09-17T01:41:25.629 INFO:tasks.workunit.client.0.smithi082.stdout:7/223: chown d0/d3/db/d10/f1e 28085555 1 2024-09-17T01:41:25.629 INFO:tasks.workunit.client.0.smithi082.stdout:7/224: readlink d0/l24 0 2024-09-17T01:41:25.631 INFO:tasks.workunit.client.1.smithi167.stdout:0/380: rename d5/ce to d5/d8/d2e/d6d/c74 0 2024-09-17T01:41:25.631 INFO:tasks.workunit.client.1.smithi167.stdout:0/381: read - d5/d8/d2e/f66 zero size 2024-09-17T01:41:25.634 INFO:tasks.workunit.client.0.smithi082.stdout:1/175: write d2/dd/f13 [521936,58830] 0 2024-09-17T01:41:25.635 INFO:tasks.workunit.client.1.smithi167.stdout:8/514: creat dc/d18/fa5 x:0 0 0 2024-09-17T01:41:25.636 INFO:tasks.workunit.client.0.smithi082.stdout:5/151: truncate f9 6258979 0 2024-09-17T01:41:25.637 INFO:tasks.workunit.client.1.smithi167.stdout:9/449: creat d4/d9/d21/d43/d47/f82 x:0 0 0 2024-09-17T01:41:25.638 INFO:tasks.workunit.client.1.smithi167.stdout:0/382: dwrite d5/d8/d9/f6a [0,4194304] 0 2024-09-17T01:41:25.643 INFO:tasks.workunit.client.1.smithi167.stdout:0/383: dread d5/d8/d2e/d4d/f5a [0,4194304] 0 2024-09-17T01:41:25.644 INFO:tasks.workunit.client.1.smithi167.stdout:0/384: chown d5/d8/d2e/d4d/f2b 1012 1 2024-09-17T01:41:25.645 INFO:tasks.workunit.client.1.smithi167.stdout:0/385: truncate d5/d6b/f70 283473 0 2024-09-17T01:41:25.645 INFO:tasks.workunit.client.0.smithi082.stdout:7/225: mknod d0/d3/db/d10/c49 0 2024-09-17T01:41:25.646 INFO:tasks.workunit.client.0.smithi082.stdout:7/226: readlink d0/dd/l2d 0 2024-09-17T01:41:25.647 INFO:tasks.workunit.client.1.smithi167.stdout:3/414: link d7/d1e/f80 d7/d8/d10/d14/d2c/f81 0 2024-09-17T01:41:25.651 INFO:tasks.workunit.client.0.smithi082.stdout:4/178: mkdir d9/d15/d37 0 2024-09-17T01:41:25.652 INFO:tasks.workunit.client.0.smithi082.stdout:4/179: write d9/d15/d16/f2c [925804,19989] 0 2024-09-17T01:41:25.654 INFO:tasks.workunit.client.0.smithi082.stdout:4/180: write d9/f14 [2695357,36699] 0 2024-09-17T01:41:25.655 INFO:tasks.workunit.client.1.smithi167.stdout:8/515: mknod dc/d21/ca6 0 2024-09-17T01:41:25.663 INFO:tasks.workunit.client.0.smithi082.stdout:9/167: link d4/d27/d21/d2e/d11/c12 d4/d27/d21/c3a 0 2024-09-17T01:41:25.664 INFO:tasks.workunit.client.1.smithi167.stdout:0/386: symlink d5/d8/l75 0 2024-09-17T01:41:25.667 INFO:tasks.workunit.client.1.smithi167.stdout:3/415: fdatasync d7/d8/d10/d14/d25/f48 0 2024-09-17T01:41:25.668 INFO:tasks.workunit.client.1.smithi167.stdout:3/416: chown d7/d8/d10/d14/d25 0 1 2024-09-17T01:41:25.668 INFO:tasks.workunit.client.1.smithi167.stdout:2/414: sync 2024-09-17T01:41:25.670 INFO:tasks.workunit.client.0.smithi082.stdout:8/175: getdents d3/dd/d18 0 2024-09-17T01:41:25.671 INFO:tasks.workunit.client.0.smithi082.stdout:8/176: read d3/f7 [5136666,84628] 0 2024-09-17T01:41:25.674 INFO:tasks.workunit.client.1.smithi167.stdout:8/516: dread dc/f29 [0,4194304] 0 2024-09-17T01:41:25.675 INFO:tasks.workunit.client.1.smithi167.stdout:6/555: getdents d7/d54/d90/d13/d2f/d96/dab 0 2024-09-17T01:41:25.676 INFO:tasks.workunit.client.1.smithi167.stdout:6/556: dread - d7/d54/d90/d13/f75 zero size 2024-09-17T01:41:25.676 INFO:tasks.workunit.client.1.smithi167.stdout:9/450: write d4/d9/d21/f60 [5168104,86979] 0 2024-09-17T01:41:25.677 INFO:tasks.workunit.client.1.smithi167.stdout:0/387: mknod d5/c76 0 2024-09-17T01:41:25.677 INFO:tasks.workunit.client.0.smithi082.stdout:6/257: write d1/d7/d10/d4f/dc/f29 [1196349,696] 0 2024-09-17T01:41:25.678 INFO:tasks.workunit.client.0.smithi082.stdout:0/166: link da/fe da/df/d2b/f39 0 2024-09-17T01:41:25.679 INFO:tasks.workunit.client.0.smithi082.stdout:6/258: stat d1/d7/d10/d4f/dc/d1d/d2c/c31 0 2024-09-17T01:41:25.681 INFO:tasks.workunit.client.1.smithi167.stdout:9/451: dread d4/d9/d21/d43/d47/f68 [0,4194304] 0 2024-09-17T01:41:25.681 INFO:tasks.workunit.client.0.smithi082.stdout:5/152: rename c1 to db/d2b/c2f 0 2024-09-17T01:41:25.683 INFO:tasks.workunit.client.1.smithi167.stdout:2/415: rmdir d5/d3c/d4c/d4d 39 2024-09-17T01:41:25.686 INFO:tasks.workunit.client.1.smithi167.stdout:6/557: dwrite d7/d54/d90/d13/f17 [0,4194304] 0 2024-09-17T01:41:25.689 INFO:tasks.workunit.client.0.smithi082.stdout:4/181: dread d9/d15/d16/d18/f21 [0,4194304] 0 2024-09-17T01:41:25.690 INFO:tasks.workunit.client.1.smithi167.stdout:7/417: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:25.690 INFO:tasks.workunit.client.1.smithi167.stdout:0/388: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:41:25.694 INFO:tasks.workunit.client.1.smithi167.stdout:9/452: dwrite d4/f16 [0,4194304] 0 2024-09-17T01:41:25.695 INFO:tasks.workunit.client.1.smithi167.stdout:4/448: sync 2024-09-17T01:41:25.695 INFO:tasks.workunit.client.1.smithi167.stdout:5/345: sync 2024-09-17T01:41:25.695 INFO:tasks.workunit.client.1.smithi167.stdout:1/416: sync 2024-09-17T01:41:25.699 INFO:tasks.workunit.client.1.smithi167.stdout:5/346: read d0/f21 [3870710,23176] 0 2024-09-17T01:41:25.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/177: symlink d3/dd/d18/l36 0 2024-09-17T01:41:25.705 INFO:tasks.workunit.client.1.smithi167.stdout:1/417: dwrite d0/d9/d16/d22/f4d [0,4194304] 0 2024-09-17T01:41:25.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/178: chown d3/dd/d18/d2d 0 1 2024-09-17T01:41:25.706 INFO:tasks.workunit.client.0.smithi082.stdout:8/179: chown d3/dd/f27 3 1 2024-09-17T01:41:25.710 INFO:tasks.workunit.client.0.smithi082.stdout:3/129: link d9/db/l20 d9/l2d 0 2024-09-17T01:41:25.710 INFO:tasks.workunit.client.1.smithi167.stdout:3/417: creat d7/d8/d10/d14/d2c/d7f/f82 x:0 0 0 2024-09-17T01:41:25.712 INFO:tasks.workunit.client.1.smithi167.stdout:2/416: write d5/d10/d1a/d45/d6b/f6f [496473,7221] 0 2024-09-17T01:41:25.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:25 smithi082 ceph-mon[28077]: pgmap v16: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 73 MiB/s wr, 172 op/s 2024-09-17T01:41:25.717 INFO:tasks.workunit.client.0.smithi082.stdout:3/130: dwrite d9/f29 [0,4194304] 0 2024-09-17T01:41:25.718 INFO:tasks.workunit.client.0.smithi082.stdout:4/182: creat d9/d15/d16/d18/f38 x:0 0 0 2024-09-17T01:41:25.719 INFO:tasks.workunit.client.1.smithi167.stdout:7/418: rename d0/d2/d14/d19/d26/d34/c51 to d0/d2/d14/d6f/c86 0 2024-09-17T01:41:25.720 INFO:tasks.workunit.client.0.smithi082.stdout:2/186: write d1/f1b [717846,49637] 0 2024-09-17T01:41:25.720 INFO:tasks.workunit.client.0.smithi082.stdout:3/131: write f0 [2951599,113655] 0 2024-09-17T01:41:25.721 INFO:tasks.workunit.client.0.smithi082.stdout:7/227: write d0/d3/f21 [733941,33907] 0 2024-09-17T01:41:25.725 INFO:tasks.workunit.client.0.smithi082.stdout:1/176: dwrite f0 [0,4194304] 0 2024-09-17T01:41:25.726 INFO:tasks.workunit.client.0.smithi082.stdout:9/168: chown d4/d27/d21/c3a 193793759 1 2024-09-17T01:41:25.728 INFO:tasks.workunit.client.0.smithi082.stdout:8/180: symlink d3/dd/d18/d34/l37 0 2024-09-17T01:41:25.729 INFO:tasks.workunit.client.0.smithi082.stdout:5/153: dwrite f3 [0,4194304] 0 2024-09-17T01:41:25.733 INFO:tasks.workunit.client.0.smithi082.stdout:7/228: write d0/d3/db/d10/f27 [838964,46709] 0 2024-09-17T01:41:25.734 INFO:tasks.workunit.client.0.smithi082.stdout:5/154: chown db/d1e/d20/l24 1917010433 1 2024-09-17T01:41:25.738 INFO:tasks.workunit.client.0.smithi082.stdout:2/187: dwrite d1/fd [0,4194304] 0 2024-09-17T01:41:25.738 INFO:tasks.workunit.client.0.smithi082.stdout:5/155: write db/d1e/f22 [1130770,40371] 0 2024-09-17T01:41:25.740 INFO:tasks.workunit.client.0.smithi082.stdout:3/132: dread f1 [0,4194304] 0 2024-09-17T01:41:25.741 INFO:tasks.workunit.client.0.smithi082.stdout:5/156: write db/f2d [25492,14726] 0 2024-09-17T01:41:25.743 INFO:tasks.workunit.client.0.smithi082.stdout:5/157: chown db/d12/d18 42433 1 2024-09-17T01:41:25.743 INFO:tasks.workunit.client.0.smithi082.stdout:3/133: write d9/f2b [997761,39282] 0 2024-09-17T01:41:25.744 INFO:tasks.workunit.client.1.smithi167.stdout:7/419: mkdir d0/d2/d14/d6f/d87 0 2024-09-17T01:41:25.745 INFO:tasks.workunit.client.0.smithi082.stdout:3/134: write f6 [1483134,122695] 0 2024-09-17T01:41:25.746 INFO:tasks.workunit.client.0.smithi082.stdout:5/158: write db/d12/d29/f2c [664209,44587] 0 2024-09-17T01:41:25.747 INFO:tasks.workunit.client.0.smithi082.stdout:4/183: symlink d9/d15/l39 0 2024-09-17T01:41:25.748 INFO:tasks.workunit.client.0.smithi082.stdout:7/229: dread d0/d3/d36/d37/f44 [0,4194304] 0 2024-09-17T01:41:25.749 INFO:tasks.workunit.client.0.smithi082.stdout:2/188: dread d1/d1a/f24 [0,4194304] 0 2024-09-17T01:41:25.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/230: fsync d0/dd/f17 0 2024-09-17T01:41:25.750 INFO:tasks.workunit.client.1.smithi167.stdout:5/347: mkdir d0/d24/d2b/d4e/d63 0 2024-09-17T01:41:25.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:25 smithi167 ceph-mon[35643]: pgmap v16: 65 pgs: 65 active+clean; 700 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 73 MiB/s wr, 172 op/s 2024-09-17T01:41:25.756 INFO:tasks.workunit.client.1.smithi167.stdout:1/418: truncate d0/d9/d16/d36/f53 863637 0 2024-09-17T01:41:25.757 INFO:tasks.workunit.client.0.smithi082.stdout:9/169: mkdir d4/d27/d36/d3b 0 2024-09-17T01:41:25.757 INFO:tasks.workunit.client.0.smithi082.stdout:2/189: dread d1/fd [0,4194304] 0 2024-09-17T01:41:25.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/184: dwrite d9/d15/d16/d18/f38 [0,4194304] 0 2024-09-17T01:41:25.758 INFO:tasks.workunit.client.0.smithi082.stdout:7/231: dread d0/dd/f16 [0,4194304] 0 2024-09-17T01:41:25.760 INFO:tasks.workunit.client.1.smithi167.stdout:8/517: write dc/d21/f31 [1509589,27959] 0 2024-09-17T01:41:25.761 INFO:tasks.workunit.client.0.smithi082.stdout:6/259: truncate d1/d3/f3b 1804915 0 2024-09-17T01:41:25.761 INFO:tasks.workunit.client.0.smithi082.stdout:7/232: stat d0/d3/db/d10/d3f 0 2024-09-17T01:41:25.762 INFO:tasks.workunit.client.1.smithi167.stdout:6/558: link d7/d54/d90/d34/f76 d7/d52/d79/da4/fce 0 2024-09-17T01:41:25.763 INFO:tasks.workunit.client.1.smithi167.stdout:9/453: dwrite d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:7/233: fdatasync d0/dd/f1f 0 2024-09-17T01:41:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:7/234: stat d0/c1c 0 2024-09-17T01:41:25.763 INFO:tasks.workunit.client.0.smithi082.stdout:7/235: chown d0/dd/f16 10837 1 2024-09-17T01:41:25.764 INFO:tasks.workunit.client.0.smithi082.stdout:3/135: rename d9/c1f to d9/db/d26/c2e 0 2024-09-17T01:41:25.765 INFO:tasks.workunit.client.0.smithi082.stdout:7/236: read d0/d3/db/fe [1852592,4102] 0 2024-09-17T01:41:25.766 INFO:tasks.workunit.client.0.smithi082.stdout:7/237: write d0/dd/d2c/f40 [138928,97433] 0 2024-09-17T01:41:25.767 INFO:tasks.workunit.client.0.smithi082.stdout:5/159: truncate db/f17 2250070 0 2024-09-17T01:41:25.768 INFO:tasks.workunit.client.1.smithi167.stdout:6/559: dread d7/d54/d90/d13/f2d [0,4194304] 0 2024-09-17T01:41:25.772 INFO:tasks.workunit.client.1.smithi167.stdout:3/418: link d7/d8/d10/d14/d2c/f6e d7/d8/d2a/d4e/f83 0 2024-09-17T01:41:25.773 INFO:tasks.workunit.client.1.smithi167.stdout:2/417: creat d5/d3c/d4c/f90 x:0 0 0 2024-09-17T01:41:25.774 INFO:tasks.workunit.client.0.smithi082.stdout:1/177: dwrite d2/dd/f19 [0,4194304] 0 2024-09-17T01:41:25.774 INFO:tasks.workunit.client.1.smithi167.stdout:2/418: chown d5/d10/d16/f2d 51 1 2024-09-17T01:41:25.776 INFO:tasks.workunit.client.1.smithi167.stdout:9/454: creat d4/f83 x:0 0 0 2024-09-17T01:41:25.777 INFO:tasks.workunit.client.0.smithi082.stdout:1/178: write d2/da/f37 [734821,122967] 0 2024-09-17T01:41:25.777 INFO:tasks.workunit.client.1.smithi167.stdout:9/455: write d4/d9/d21/d43/f76 [40119,57651] 0 2024-09-17T01:41:25.778 INFO:tasks.workunit.client.1.smithi167.stdout:9/456: write d4/f16 [3478628,56514] 0 2024-09-17T01:41:25.779 INFO:tasks.workunit.client.0.smithi082.stdout:4/185: creat d9/d15/d16/d18/f3a x:0 0 0 2024-09-17T01:41:25.780 INFO:tasks.workunit.client.1.smithi167.stdout:4/449: rename d0/d4/d7/da/d48/d40/d51/d2d/d2e/c4b to d0/d4/d7/c96 0 2024-09-17T01:41:25.783 INFO:tasks.workunit.client.1.smithi167.stdout:7/420: dread d0/d2/d14/d19/f30 [0,4194304] 0 2024-09-17T01:41:25.784 INFO:tasks.workunit.client.1.smithi167.stdout:5/348: truncate d0/d9/fb 2629854 0 2024-09-17T01:41:25.784 INFO:tasks.workunit.client.1.smithi167.stdout:4/450: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 [926201,22572] 0 2024-09-17T01:41:25.785 INFO:tasks.workunit.client.0.smithi082.stdout:1/179: dwrite f0 [0,4194304] 0 2024-09-17T01:41:25.786 INFO:tasks.workunit.client.1.smithi167.stdout:5/349: stat d0/d28/d3a/d44/f5e 0 2024-09-17T01:41:25.788 INFO:tasks.workunit.client.1.smithi167.stdout:6/560: creat d7/d54/d90/d13/d2f/d30/d32/fcf x:0 0 0 2024-09-17T01:41:25.788 INFO:tasks.workunit.client.1.smithi167.stdout:2/419: dread d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:25.788 INFO:tasks.workunit.client.0.smithi082.stdout:1/180: read d2/da/f35 [451211,91338] 0 2024-09-17T01:41:25.790 INFO:tasks.workunit.client.1.smithi167.stdout:2/420: read d5/f44 [537215,87557] 0 2024-09-17T01:41:25.790 INFO:tasks.workunit.client.1.smithi167.stdout:5/350: dread d0/d28/d3a/f57 [0,4194304] 0 2024-09-17T01:41:25.791 INFO:tasks.workunit.client.1.smithi167.stdout:1/419: mkdir d0/d5/d34/d83 0 2024-09-17T01:41:25.792 INFO:tasks.workunit.client.0.smithi082.stdout:4/186: dread d9/fc [0,4194304] 0 2024-09-17T01:41:25.792 INFO:tasks.workunit.client.1.smithi167.stdout:7/421: dread d0/d2/d14/d19/d32/d62/f64 [0,4194304] 0 2024-09-17T01:41:25.793 INFO:tasks.workunit.client.0.smithi082.stdout:6/260: rename d1/d3/f41 to d1/d7/d10/d4f/dc/d1d/d2c/f60 0 2024-09-17T01:41:25.797 INFO:tasks.workunit.client.0.smithi082.stdout:5/160: unlink db/cd 0 2024-09-17T01:41:25.799 INFO:tasks.workunit.client.0.smithi082.stdout:4/187: dwrite d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:25.802 INFO:tasks.workunit.client.0.smithi082.stdout:5/161: dread db/d12/f15 [0,4194304] 0 2024-09-17T01:41:25.810 INFO:tasks.workunit.client.0.smithi082.stdout:8/181: truncate d3/dd/ff 276225 0 2024-09-17T01:41:25.811 INFO:tasks.workunit.client.1.smithi167.stdout:5/351: chown d0/d28/d3a/f3f 1692 1 2024-09-17T01:41:25.811 INFO:tasks.workunit.client.1.smithi167.stdout:3/419: symlink d7/d8/d2a/l84 0 2024-09-17T01:41:25.811 INFO:tasks.workunit.client.1.smithi167.stdout:8/518: mkdir dc/d56/d57/da0/da7 0 2024-09-17T01:41:25.812 INFO:tasks.workunit.client.1.smithi167.stdout:0/389: rename d5/d8/d2e to d5/d6b/d77 0 2024-09-17T01:41:25.816 INFO:tasks.workunit.client.1.smithi167.stdout:6/561: stat d7/d52/d79/da4/fce 0 2024-09-17T01:41:25.817 INFO:tasks.workunit.client.1.smithi167.stdout:3/420: dwrite d7/f72 [0,4194304] 0 2024-09-17T01:41:25.825 INFO:tasks.workunit.client.1.smithi167.stdout:8/519: read - dc/f48 zero size 2024-09-17T01:41:25.829 INFO:tasks.workunit.client.0.smithi082.stdout:6/261: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l61 0 2024-09-17T01:41:25.829 INFO:tasks.workunit.client.1.smithi167.stdout:8/520: dwrite f6 [0,4194304] 0 2024-09-17T01:41:25.831 INFO:tasks.workunit.client.1.smithi167.stdout:8/521: truncate dc/d56/d57/d5c/f98 19430 0 2024-09-17T01:41:25.833 INFO:tasks.workunit.client.1.smithi167.stdout:9/457: rename d4/d9/d21/d81/c42 to d4/d9/d21/d2d/c84 0 2024-09-17T01:41:25.834 INFO:tasks.workunit.client.0.smithi082.stdout:4/188: fsync d9/fd 0 2024-09-17T01:41:25.836 INFO:tasks.workunit.client.0.smithi082.stdout:5/162: rmdir db/d2b 39 2024-09-17T01:41:25.836 INFO:tasks.workunit.client.0.smithi082.stdout:5/163: readlink db/d12/l1a 0 2024-09-17T01:41:25.838 INFO:tasks.workunit.client.1.smithi167.stdout:9/458: dwrite d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:25.839 INFO:tasks.workunit.client.1.smithi167.stdout:0/390: symlink d5/d6b/d77/d4d/d56/l78 0 2024-09-17T01:41:25.840 INFO:tasks.workunit.client.1.smithi167.stdout:9/459: dread - d4/d9/d21/d2d/d33/d3a/f3f zero size 2024-09-17T01:41:25.840 INFO:tasks.workunit.client.1.smithi167.stdout:0/391: dread - d5/d6b/d77/f66 zero size 2024-09-17T01:41:25.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/238: symlink d0/d3/d36/d37/l4a 0 2024-09-17T01:41:25.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/239: fdatasync d0/dd/d2c/f40 0 2024-09-17T01:41:25.841 INFO:tasks.workunit.client.1.smithi167.stdout:6/562: creat d7/d54/d90/d13/d2f/d96/dab/fd0 x:0 0 0 2024-09-17T01:41:25.843 INFO:tasks.workunit.client.1.smithi167.stdout:6/563: write d7/d54/d90/d13/d2f/d30/d32/f9a [533630,15418] 0 2024-09-17T01:41:25.845 INFO:tasks.workunit.client.1.smithi167.stdout:6/564: stat d7/d54/d90/d13/d2f/d7f/d98/l4f 0 2024-09-17T01:41:25.846 INFO:tasks.workunit.client.0.smithi082.stdout:2/190: truncate d1/f16 747395 0 2024-09-17T01:41:25.847 INFO:tasks.workunit.client.0.smithi082.stdout:2/191: write d1/d10/f19 [2349902,36867] 0 2024-09-17T01:41:25.848 INFO:tasks.workunit.client.0.smithi082.stdout:9/170: link d4/f1d d4/d27/d21/d2e/d11/d37/f3c 0 2024-09-17T01:41:25.849 INFO:tasks.workunit.client.0.smithi082.stdout:9/171: read d4/f8 [1435856,108348] 0 2024-09-17T01:41:25.853 INFO:tasks.workunit.client.1.smithi167.stdout:1/420: link d0/d5/d61/f7f d0/d9/d16/d22/f84 0 2024-09-17T01:41:25.854 INFO:tasks.workunit.client.1.smithi167.stdout:1/421: chown d0/d9/c1d 17 1 2024-09-17T01:41:25.854 INFO:tasks.workunit.client.1.smithi167.stdout:2/421: dwrite d5/d10/f22 [0,4194304] 0 2024-09-17T01:41:25.855 INFO:tasks.workunit.client.1.smithi167.stdout:8/522: creat dc/d56/d57/d7e/fa8 x:0 0 0 2024-09-17T01:41:25.856 INFO:tasks.workunit.client.1.smithi167.stdout:8/523: write dc/d21/d6b/d74/f92 [3346113,10235] 0 2024-09-17T01:41:25.857 INFO:tasks.workunit.client.0.smithi082.stdout:6/262: rmdir d1/d7/d10/d4f 39 2024-09-17T01:41:25.857 INFO:tasks.workunit.client.1.smithi167.stdout:8/524: fdatasync dc/d21/f25 0 2024-09-17T01:41:25.858 INFO:tasks.workunit.client.0.smithi082.stdout:6/263: chown d1/d3 672 1 2024-09-17T01:41:25.859 INFO:tasks.workunit.client.0.smithi082.stdout:6/264: write d1/d7/d10/f38 [268236,49300] 0 2024-09-17T01:41:25.861 INFO:tasks.workunit.client.1.smithi167.stdout:9/460: mknod d4/d9/d21/d2d/c85 0 2024-09-17T01:41:25.863 INFO:tasks.workunit.client.0.smithi082.stdout:4/189: symlink d9/d15/d16/l3b 0 2024-09-17T01:41:25.865 INFO:tasks.workunit.client.0.smithi082.stdout:4/190: chown d9/d15/d16/d18/f38 15528190 1 2024-09-17T01:41:25.866 INFO:tasks.workunit.client.0.smithi082.stdout:4/191: fdatasync d9/f14 0 2024-09-17T01:41:25.868 INFO:tasks.workunit.client.0.smithi082.stdout:6/265: dwrite d1/d7/d10/f4a [0,4194304] 0 2024-09-17T01:41:25.875 INFO:tasks.workunit.client.0.smithi082.stdout:4/192: dwrite d9/d15/f27 [0,4194304] 0 2024-09-17T01:41:25.876 INFO:tasks.workunit.client.0.smithi082.stdout:3/136: truncate d9/f21 1421955 0 2024-09-17T01:41:25.877 INFO:tasks.workunit.client.0.smithi082.stdout:4/193: write f7 [3627628,105756] 0 2024-09-17T01:41:25.878 INFO:tasks.workunit.client.1.smithi167.stdout:1/422: mkdir d0/d5/d34/d3c/d85 0 2024-09-17T01:41:25.883 INFO:tasks.workunit.client.0.smithi082.stdout:1/181: truncate d2/df/f1d 1967197 0 2024-09-17T01:41:25.886 INFO:tasks.workunit.client.0.smithi082.stdout:9/172: dread - d4/f1d zero size 2024-09-17T01:41:25.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/173: stat d4/d27/d21/d2e/d11/d39/d29/d35 0 2024-09-17T01:41:25.890 INFO:tasks.workunit.client.1.smithi167.stdout:9/461: creat d4/d9/d21/d43/d6c/f86 x:0 0 0 2024-09-17T01:41:25.890 INFO:tasks.workunit.client.1.smithi167.stdout:3/421: fsync d7/d8/d10/d14/d25/f6b 0 2024-09-17T01:41:25.892 INFO:tasks.workunit.client.1.smithi167.stdout:6/565: rename d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/cad to d7/d52/d79/da4/cd1 0 2024-09-17T01:41:25.892 INFO:tasks.workunit.client.0.smithi082.stdout:5/164: mkdir db/d1e/d20/d30 0 2024-09-17T01:41:25.894 INFO:tasks.workunit.client.1.smithi167.stdout:2/422: mkdir d5/d3c/d4c/d4d/d91 0 2024-09-17T01:41:25.894 INFO:tasks.workunit.client.1.smithi167.stdout:2/423: chown d5/l41 630890 1 2024-09-17T01:41:25.897 INFO:tasks.workunit.client.1.smithi167.stdout:4/451: sync 2024-09-17T01:41:25.898 INFO:tasks.workunit.client.1.smithi167.stdout:8/525: link dc/d56/d59/d82/f95 dc/d56/d59/d65/fa9 0 2024-09-17T01:41:25.903 INFO:tasks.workunit.client.1.smithi167.stdout:3/422: fsync d7/d8/d10/d14/f5a 0 2024-09-17T01:41:25.903 INFO:tasks.workunit.client.1.smithi167.stdout:3/423: chown f6 2360 1 2024-09-17T01:41:25.904 INFO:tasks.workunit.client.0.smithi082.stdout:3/137: truncate d9/fe 1174222 0 2024-09-17T01:41:25.904 INFO:tasks.workunit.client.0.smithi082.stdout:3/138: dread - d9/db/f17 zero size 2024-09-17T01:41:25.904 INFO:tasks.workunit.client.0.smithi082.stdout:3/139: chown d9 360 1 2024-09-17T01:41:25.906 INFO:tasks.workunit.client.0.smithi082.stdout:4/194: rename d9/d15/l26 to d9/d31/l3c 0 2024-09-17T01:41:25.908 INFO:tasks.workunit.client.1.smithi167.stdout:1/423: symlink d0/d9/d16/d48/d54/d6e/l86 0 2024-09-17T01:41:25.910 INFO:tasks.workunit.client.0.smithi082.stdout:3/140: dwrite f0 [0,4194304] 0 2024-09-17T01:41:25.911 INFO:tasks.workunit.client.0.smithi082.stdout:7/240: truncate d0/dd/d2c/f40 587202 0 2024-09-17T01:41:25.915 INFO:tasks.workunit.client.1.smithi167.stdout:4/452: creat d0/d4/d7/d6/d2b/d6d/f97 x:0 0 0 2024-09-17T01:41:25.916 INFO:tasks.workunit.client.0.smithi082.stdout:1/182: symlink d2/da/l3a 0 2024-09-17T01:41:25.917 INFO:tasks.workunit.client.1.smithi167.stdout:4/453: truncate d0/d4/d7/da/d48/d40/d51/d2d/d74/f8c 4672551 0 2024-09-17T01:41:25.918 INFO:tasks.workunit.client.1.smithi167.stdout:8/526: creat dc/d56/faa x:0 0 0 2024-09-17T01:41:25.918 INFO:tasks.workunit.client.1.smithi167.stdout:8/527: fdatasync dc/d1a/f72 0 2024-09-17T01:41:25.918 INFO:tasks.workunit.client.1.smithi167.stdout:4/454: chown d0/d4/d7/da/d48/d40/d51/d2d/d74 443428632 1 2024-09-17T01:41:25.919 INFO:tasks.workunit.client.0.smithi082.stdout:9/174: unlink d4/f10 0 2024-09-17T01:41:25.920 INFO:tasks.workunit.client.1.smithi167.stdout:9/462: truncate d4/d9/d21/f3b 2827654 0 2024-09-17T01:41:25.921 INFO:tasks.workunit.client.1.smithi167.stdout:9/463: write d4/f83 [581066,37025] 0 2024-09-17T01:41:25.921 INFO:tasks.workunit.client.0.smithi082.stdout:5/165: creat db/d1e/f31 x:0 0 0 2024-09-17T01:41:25.922 INFO:tasks.workunit.client.0.smithi082.stdout:5/166: write db/d1e/f31 [866487,81634] 0 2024-09-17T01:41:25.923 INFO:tasks.workunit.client.0.smithi082.stdout:5/167: readlink db/d12/l1a 0 2024-09-17T01:41:25.924 INFO:tasks.workunit.client.0.smithi082.stdout:5/168: write db/fc [4001110,92880] 0 2024-09-17T01:41:25.925 INFO:tasks.workunit.client.1.smithi167.stdout:6/566: mknod d7/d54/d90/d13/d2f/d96/cd2 0 2024-09-17T01:41:25.928 INFO:tasks.workunit.client.0.smithi082.stdout:8/182: link d3/dd/d18/l28 d3/l38 0 2024-09-17T01:41:25.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/183: chown d3/dd/c1d 0 1 2024-09-17T01:41:25.932 INFO:tasks.workunit.client.1.smithi167.stdout:9/464: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:41:25.932 INFO:tasks.workunit.client.1.smithi167.stdout:1/424: symlink d0/l87 0 2024-09-17T01:41:25.932 INFO:tasks.workunit.client.1.smithi167.stdout:2/424: mknod d5/d3c/d4c/c92 0 2024-09-17T01:41:25.932 INFO:tasks.workunit.client.1.smithi167.stdout:6/567: chown d7/d54/d90/d13/d2f/d30/l44 0 1 2024-09-17T01:41:25.932 INFO:tasks.workunit.client.1.smithi167.stdout:0/392: truncate d5/d8/d9/f35 2723274 0 2024-09-17T01:41:25.933 INFO:tasks.workunit.client.1.smithi167.stdout:9/465: chown d4/d4a/c62 0 1 2024-09-17T01:41:25.937 INFO:tasks.workunit.client.1.smithi167.stdout:0/393: read d5/d8/d9/d2f/f3b [3182280,48514] 0 2024-09-17T01:41:25.937 INFO:tasks.workunit.client.0.smithi082.stdout:7/241: symlink d0/d3/d36/l4b 0 2024-09-17T01:41:25.938 INFO:tasks.workunit.client.0.smithi082.stdout:7/242: readlink d0/d3/d36/d37/l4a 0 2024-09-17T01:41:25.938 INFO:tasks.workunit.client.1.smithi167.stdout:0/394: dread d5/d6b/f70 [0,4194304] 0 2024-09-17T01:41:25.940 INFO:tasks.workunit.client.0.smithi082.stdout:2/192: rename d1/d1a to d1/d35 0 2024-09-17T01:41:25.941 INFO:tasks.workunit.client.0.smithi082.stdout:6/266: truncate d1/d7/f46 3519124 0 2024-09-17T01:41:25.952 INFO:tasks.workunit.client.1.smithi167.stdout:2/425: symlink d5/l93 0 2024-09-17T01:41:25.953 INFO:tasks.workunit.client.0.smithi082.stdout:4/195: symlink d9/d15/d37/l3d 0 2024-09-17T01:41:25.953 INFO:tasks.workunit.client.1.smithi167.stdout:2/426: write d5/d10/d16/f1b [5071120,102633] 0 2024-09-17T01:41:25.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/141: unlink d9/l16 0 2024-09-17T01:41:25.957 INFO:tasks.workunit.client.1.smithi167.stdout:8/528: creat dc/d56/d57/da0/da7/fab x:0 0 0 2024-09-17T01:41:25.958 INFO:tasks.workunit.client.1.smithi167.stdout:8/529: fdatasync dc/d56/f70 0 2024-09-17T01:41:25.958 INFO:tasks.workunit.client.0.smithi082.stdout:7/243: fdatasync d0/d3/db/fe 0 2024-09-17T01:41:25.961 INFO:tasks.workunit.client.1.smithi167.stdout:4/455: link d0/d4/d7/da/d48/d40/d51/d2d/d2e/f34 d0/d4/d7/d6/d2b/d6d/d7e/d92/f98 0 2024-09-17T01:41:25.963 INFO:tasks.workunit.client.0.smithi082.stdout:9/175: mkdir d4/d27/d2d/d3d 0 2024-09-17T01:41:25.964 INFO:tasks.workunit.client.0.smithi082.stdout:7/244: dwrite d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:25.966 INFO:tasks.workunit.client.0.smithi082.stdout:5/169: link db/d1e/f22 db/d12/d29/f32 0 2024-09-17T01:41:25.966 INFO:tasks.workunit.client.0.smithi082.stdout:5/170: fdatasync db/f16 0 2024-09-17T01:41:25.967 INFO:tasks.workunit.client.1.smithi167.stdout:3/424: link d7/d8/d10/d14/c45 d7/d8/d2a/d4e/c85 0 2024-09-17T01:41:25.967 INFO:tasks.workunit.client.1.smithi167.stdout:3/425: chown d7/f72 3784 1 2024-09-17T01:41:25.968 INFO:tasks.workunit.client.1.smithi167.stdout:3/426: dread - d7/d8/d2a/d4e/f67 zero size 2024-09-17T01:41:25.969 INFO:tasks.workunit.client.1.smithi167.stdout:3/427: chown d7/d8/d10/d14/d2c/f2f 6 1 2024-09-17T01:41:25.969 INFO:tasks.workunit.client.1.smithi167.stdout:3/428: chown d7/d8/d10/c55 152 1 2024-09-17T01:41:25.970 INFO:tasks.workunit.client.1.smithi167.stdout:3/429: fsync f6 0 2024-09-17T01:41:25.970 INFO:tasks.workunit.client.1.smithi167.stdout:3/430: fdatasync f3 0 2024-09-17T01:41:25.970 INFO:tasks.workunit.client.0.smithi082.stdout:4/196: mkdir d9/d15/d16/d3e 0 2024-09-17T01:41:25.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/142: creat d9/db/f2f x:0 0 0 2024-09-17T01:41:25.973 INFO:tasks.workunit.client.0.smithi082.stdout:3/143: chown d9/f2b 1661564 1 2024-09-17T01:41:25.974 INFO:tasks.workunit.client.0.smithi082.stdout:3/144: write d9/f29 [4601164,122440] 0 2024-09-17T01:41:25.975 INFO:tasks.workunit.client.0.smithi082.stdout:3/145: write d9/db/f18 [793234,109874] 0 2024-09-17T01:41:25.977 INFO:tasks.workunit.client.0.smithi082.stdout:6/267: creat d1/d7/d10/d4f/dc/d1d/d2c/f62 x:0 0 0 2024-09-17T01:41:25.978 INFO:tasks.workunit.client.0.smithi082.stdout:1/183: link c1 d2/da/d2d/c3b 0 2024-09-17T01:41:25.979 INFO:tasks.workunit.client.1.smithi167.stdout:4/456: chown d0/d4/d7/c96 64 1 2024-09-17T01:41:25.979 INFO:tasks.workunit.client.0.smithi082.stdout:7/245: symlink d0/d3/db/d10/l4c 0 2024-09-17T01:41:25.981 INFO:tasks.workunit.client.1.smithi167.stdout:4/457: truncate d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f85 599852 0 2024-09-17T01:41:25.982 INFO:tasks.workunit.client.0.smithi082.stdout:8/184: rename d3/dd/f1b to d3/f39 0 2024-09-17T01:41:25.983 INFO:tasks.workunit.client.0.smithi082.stdout:8/185: chown d3/dd/d18/d34 13815 1 2024-09-17T01:41:25.987 INFO:tasks.workunit.client.1.smithi167.stdout:2/427: mkdir d5/d33/d48/d72/d94 0 2024-09-17T01:41:25.987 INFO:tasks.workunit.client.1.smithi167.stdout:4/458: dwrite d0/d4/d7/da/d48/d40/d51/f84 [0,4194304] 0 2024-09-17T01:41:25.988 INFO:tasks.workunit.client.1.smithi167.stdout:2/428: chown d5/d10 4054138 1 2024-09-17T01:41:25.989 INFO:tasks.workunit.client.1.smithi167.stdout:4/459: read d0/d4/d7/da/d48/d40/d51/f84 [4107354,120128] 0 2024-09-17T01:41:25.992 INFO:tasks.workunit.client.1.smithi167.stdout:9/466: link d4/d9/l41 d4/d9/d21/d2d/d33/d80/l87 0 2024-09-17T01:41:25.994 INFO:tasks.workunit.client.1.smithi167.stdout:7/422: sync 2024-09-17T01:41:25.994 INFO:tasks.workunit.client.1.smithi167.stdout:5/352: sync 2024-09-17T01:41:25.994 INFO:tasks.workunit.client.1.smithi167.stdout:0/395: creat d5/d8/f79 x:0 0 0 2024-09-17T01:41:25.995 INFO:tasks.workunit.client.1.smithi167.stdout:4/460: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 [0,4194304] 0 2024-09-17T01:41:25.996 INFO:tasks.workunit.client.1.smithi167.stdout:0/396: dread - d5/d6b/f63 zero size 2024-09-17T01:41:25.996 INFO:tasks.workunit.client.1.smithi167.stdout:7/423: chown d0/d2/d14/d19/d32/d62/f79 1027363950 1 2024-09-17T01:41:25.996 INFO:tasks.workunit.client.1.smithi167.stdout:4/461: write d0/d4/d7/d6/d2b/f7d [347355,57411] 0 2024-09-17T01:41:26.001 INFO:tasks.workunit.client.1.smithi167.stdout:2/429: unlink d5/d3c/d4c/d4d/c5a 0 2024-09-17T01:41:26.001 INFO:tasks.workunit.client.1.smithi167.stdout:2/430: chown d5/d10/d1a/d2e/f4b 146219822 1 2024-09-17T01:41:26.005 INFO:tasks.workunit.client.0.smithi082.stdout:3/146: mknod d9/db/d26/d28/c30 0 2024-09-17T01:41:26.006 INFO:tasks.workunit.client.1.smithi167.stdout:9/467: symlink d4/l88 0 2024-09-17T01:41:26.008 INFO:tasks.workunit.client.0.smithi082.stdout:4/197: write d9/d15/d16/d18/f21 [403561,75416] 0 2024-09-17T01:41:26.009 INFO:tasks.workunit.client.0.smithi082.stdout:7/246: symlink d0/d3/l4d 0 2024-09-17T01:41:26.011 INFO:tasks.workunit.client.0.smithi082.stdout:9/176: link d4/d27/d21/d2e/c1f d4/d27/d21/d2e/d11/d37/c3e 0 2024-09-17T01:41:26.011 INFO:tasks.workunit.client.1.smithi167.stdout:9/468: dwrite d4/d9/d21/d43/f77 [0,4194304] 0 2024-09-17T01:41:26.013 INFO:tasks.workunit.client.0.smithi082.stdout:7/247: dread d0/d3/db/f14 [4194304,4194304] 0 2024-09-17T01:41:26.013 INFO:tasks.workunit.client.1.smithi167.stdout:4/462: rename d0/d4/l39 to d0/d4/d69/l99 0 2024-09-17T01:41:26.014 INFO:tasks.workunit.client.0.smithi082.stdout:7/248: write d0/dd/f1f [5669631,106582] 0 2024-09-17T01:41:26.014 INFO:tasks.workunit.client.0.smithi082.stdout:2/193: rename d1/d17/d29/c2a to d1/d17/c36 0 2024-09-17T01:41:26.015 INFO:tasks.workunit.client.1.smithi167.stdout:3/431: dwrite d7/d8/d2a/f22 [4194304,4194304] 0 2024-09-17T01:41:26.018 INFO:tasks.workunit.client.1.smithi167.stdout:6/568: truncate d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 420634 0 2024-09-17T01:41:26.021 INFO:tasks.workunit.client.0.smithi082.stdout:3/147: creat d9/db/d26/f31 x:0 0 0 2024-09-17T01:41:26.023 INFO:tasks.workunit.client.0.smithi082.stdout:6/268: creat d1/f63 x:0 0 0 2024-09-17T01:41:26.024 INFO:tasks.workunit.client.1.smithi167.stdout:5/353: mkdir d0/d9/d64 0 2024-09-17T01:41:26.027 INFO:tasks.workunit.client.1.smithi167.stdout:0/397: symlink d5/d8/l7a 0 2024-09-17T01:41:26.028 INFO:tasks.workunit.client.1.smithi167.stdout:5/354: dwrite d0/f47 [0,4194304] 0 2024-09-17T01:41:26.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/148: dwrite d9/db/f22 [0,4194304] 0 2024-09-17T01:41:26.029 INFO:tasks.workunit.client.1.smithi167.stdout:5/355: chown d0/d9/d1c/l53 0 1 2024-09-17T01:41:26.035 INFO:tasks.workunit.client.0.smithi082.stdout:8/186: truncate d3/dd/d18/f24 1255589 0 2024-09-17T01:41:26.036 INFO:tasks.workunit.client.0.smithi082.stdout:9/177: mknod d4/d27/d2d/c3f 0 2024-09-17T01:41:26.038 INFO:tasks.workunit.client.1.smithi167.stdout:4/463: rename d0/d4/d7/d6/l37 to d0/d4/d7/da/d48/l9a 0 2024-09-17T01:41:26.039 INFO:tasks.workunit.client.0.smithi082.stdout:5/171: rename db/f2e to db/d1e/d20/d30/f33 0 2024-09-17T01:41:26.040 INFO:tasks.workunit.client.0.smithi082.stdout:2/194: rmdir d1/d17 39 2024-09-17T01:41:26.042 INFO:tasks.workunit.client.1.smithi167.stdout:9/469: rename d4/d9/d21/d2d/d33/d3a/d74/f7b to d4/d9/d21/d2d/d33/d3a/d74/f89 0 2024-09-17T01:41:26.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/184: getdents d2/df 0 2024-09-17T01:41:26.043 INFO:tasks.workunit.client.1.smithi167.stdout:9/470: read - d4/d9/d21/d2d/d33/d3a/f3f zero size 2024-09-17T01:41:26.045 INFO:tasks.workunit.client.1.smithi167.stdout:0/398: mkdir d5/d6b/d77/d4d/d56/d7b 0 2024-09-17T01:41:26.045 INFO:tasks.workunit.client.1.smithi167.stdout:0/399: stat d5 0 2024-09-17T01:41:26.046 INFO:tasks.workunit.client.1.smithi167.stdout:0/400: readlink d5/d6b/d77/d4d/l12 0 2024-09-17T01:41:26.046 INFO:tasks.workunit.client.0.smithi082.stdout:4/198: creat d9/d15/d16/d3e/f3f x:0 0 0 2024-09-17T01:41:26.047 INFO:tasks.workunit.client.0.smithi082.stdout:5/172: dwrite db/d1e/f31 [0,4194304] 0 2024-09-17T01:41:26.047 INFO:tasks.workunit.client.0.smithi082.stdout:3/149: creat d9/db/d26/d28/f32 x:0 0 0 2024-09-17T01:41:26.048 INFO:tasks.workunit.client.1.smithi167.stdout:1/425: sync 2024-09-17T01:41:26.048 INFO:tasks.workunit.client.1.smithi167.stdout:3/432: getdents d7/d8/d10/d29/d75 0 2024-09-17T01:41:26.048 INFO:tasks.workunit.client.1.smithi167.stdout:3/433: stat d7/f72 0 2024-09-17T01:41:26.055 INFO:tasks.workunit.client.1.smithi167.stdout:7/424: write d0/d2/f2e [1500877,13762] 0 2024-09-17T01:41:26.056 INFO:tasks.workunit.client.0.smithi082.stdout:4/199: dwrite d9/d15/d16/f2f [0,4194304] 0 2024-09-17T01:41:26.056 INFO:tasks.workunit.client.0.smithi082.stdout:4/200: readlink l4 0 2024-09-17T01:41:26.057 INFO:tasks.workunit.client.1.smithi167.stdout:4/464: read d0/d4/d7/d6/f29 [122530,46890] 0 2024-09-17T01:41:26.059 INFO:tasks.workunit.client.0.smithi082.stdout:7/249: rename d0/d3/l4d to d0/d3/db/l4e 0 2024-09-17T01:41:26.063 INFO:tasks.workunit.client.1.smithi167.stdout:4/465: dwrite d0/d4/d7/f26 [0,4194304] 0 2024-09-17T01:41:26.065 INFO:tasks.workunit.client.0.smithi082.stdout:2/195: creat d1/d35/f37 x:0 0 0 2024-09-17T01:41:26.066 INFO:tasks.workunit.client.1.smithi167.stdout:1/426: symlink d0/d9/d16/d22/l88 0 2024-09-17T01:41:26.067 INFO:tasks.workunit.client.1.smithi167.stdout:1/427: chown d0/d9/d16/l19 415231 1 2024-09-17T01:41:26.068 INFO:tasks.workunit.client.1.smithi167.stdout:1/428: stat d0/l3a 0 2024-09-17T01:41:26.073 INFO:tasks.workunit.client.1.smithi167.stdout:6/569: creat d7/d54/d90/d13/fd3 x:0 0 0 2024-09-17T01:41:26.073 INFO:tasks.workunit.client.1.smithi167.stdout:6/570: fsync d7/fae 0 2024-09-17T01:41:26.074 INFO:tasks.workunit.client.0.smithi082.stdout:5/173: symlink db/d12/l34 0 2024-09-17T01:41:26.079 INFO:tasks.workunit.client.0.smithi082.stdout:9/178: rename d4/d27/d21/d2e/d11/d39/d29/f2c to d4/d27/d21/d2e/d11/d39/d31/f40 0 2024-09-17T01:41:26.079 INFO:tasks.workunit.client.0.smithi082.stdout:9/179: dread - d4/d27/d21/d2e/f34 zero size 2024-09-17T01:41:26.080 INFO:tasks.workunit.client.1.smithi167.stdout:4/466: symlink d0/d4/d7/da/d48/d40/d51/d2d/d74/l9b 0 2024-09-17T01:41:26.082 INFO:tasks.workunit.client.0.smithi082.stdout:7/250: creat d0/d3/db/f4f x:0 0 0 2024-09-17T01:41:26.082 INFO:tasks.workunit.client.1.smithi167.stdout:3/434: creat d7/d8/d10/d29/d75/f86 x:0 0 0 2024-09-17T01:41:26.083 INFO:tasks.workunit.client.0.smithi082.stdout:7/251: stat d0/dd/c20 0 2024-09-17T01:41:26.084 INFO:tasks.workunit.client.0.smithi082.stdout:7/252: stat d0/d3/db/d10/f22 0 2024-09-17T01:41:26.085 INFO:tasks.workunit.client.1.smithi167.stdout:1/429: creat d0/d5/d34/d3c/f89 x:0 0 0 2024-09-17T01:41:26.086 INFO:tasks.workunit.client.0.smithi082.stdout:6/269: link d1/d7/d10/f38 d1/d1f/f64 0 2024-09-17T01:41:26.087 INFO:tasks.workunit.client.0.smithi082.stdout:9/180: dwrite d4/d27/d21/d2e/d11/d37/f38 [0,4194304] 0 2024-09-17T01:41:26.088 INFO:tasks.workunit.client.1.smithi167.stdout:3/435: dwrite d7/d8/d10/d14/d24/d62/f77 [0,4194304] 0 2024-09-17T01:41:26.089 INFO:tasks.workunit.client.1.smithi167.stdout:5/356: rename d0/d28/d3a/f57 to d0/d24/d2b/d3d/f65 0 2024-09-17T01:41:26.090 INFO:tasks.workunit.client.1.smithi167.stdout:3/436: chown d7/d8/d10/d14/d24/d62/f77 832 1 2024-09-17T01:41:26.090 INFO:tasks.workunit.client.0.smithi082.stdout:1/185: dwrite d2/da/f35 [0,4194304] 0 2024-09-17T01:41:26.091 INFO:tasks.workunit.client.1.smithi167.stdout:3/437: fdatasync d7/d8/d10/d14/f5a 0 2024-09-17T01:41:26.094 INFO:tasks.workunit.client.1.smithi167.stdout:2/431: link d5/d10/d1a/d2e/l55 d5/d10/d1a/d2e/l95 0 2024-09-17T01:41:26.095 INFO:tasks.workunit.client.1.smithi167.stdout:8/530: sync 2024-09-17T01:41:26.096 INFO:tasks.workunit.client.1.smithi167.stdout:9/471: link d4/d9/d21/c6e d4/d9/d21/d2d/d33/d80/c8a 0 2024-09-17T01:41:26.099 INFO:tasks.workunit.client.1.smithi167.stdout:4/467: unlink d0/d4/d7/da/d48/d40/d51/d2d/d74/l9b 0 2024-09-17T01:41:26.101 INFO:tasks.workunit.client.1.smithi167.stdout:1/430: mkdir d0/d5/d34/d8a 0 2024-09-17T01:41:26.104 INFO:tasks.workunit.client.1.smithi167.stdout:0/401: rename d5/d6b/d77/d37/l3e to d5/d6b/d77/d37/d45/l7c 0 2024-09-17T01:41:26.105 INFO:tasks.workunit.client.1.smithi167.stdout:9/472: dwrite d4/d9/d21/d43/d47/f82 [0,4194304] 0 2024-09-17T01:41:26.105 INFO:tasks.workunit.client.1.smithi167.stdout:5/357: mkdir d0/d24/d2b/d49/d66 0 2024-09-17T01:41:26.107 INFO:tasks.workunit.client.1.smithi167.stdout:3/438: write d7/d8/f4c [171503,87338] 0 2024-09-17T01:41:26.116 INFO:tasks.workunit.client.1.smithi167.stdout:6/571: creat d7/fd4 x:0 0 0 2024-09-17T01:41:26.117 INFO:tasks.workunit.client.1.smithi167.stdout:5/358: symlink d0/d24/l67 0 2024-09-17T01:41:26.119 INFO:tasks.workunit.client.1.smithi167.stdout:8/531: symlink dc/lac 0 2024-09-17T01:41:26.120 INFO:tasks.workunit.client.1.smithi167.stdout:3/439: creat d7/d8/d10/d29/f87 x:0 0 0 2024-09-17T01:41:26.124 INFO:tasks.workunit.client.1.smithi167.stdout:6/572: unlink d7/d54/d90/d13/d2f/d30/f59 0 2024-09-17T01:41:26.125 INFO:tasks.workunit.client.1.smithi167.stdout:5/359: symlink d0/d9/d1c/l68 0 2024-09-17T01:41:26.126 INFO:tasks.workunit.client.1.smithi167.stdout:8/532: rmdir dc/d56/d57/da0 39 2024-09-17T01:41:26.128 INFO:tasks.workunit.client.1.smithi167.stdout:3/440: creat d7/d8/d2a/d7a/f88 x:0 0 0 2024-09-17T01:41:26.129 INFO:tasks.workunit.client.1.smithi167.stdout:9/473: link d4/d9/d21/d43/d47/f82 d4/d9/d21/d43/d6c/f8b 0 2024-09-17T01:41:26.131 INFO:tasks.workunit.client.1.smithi167.stdout:7/425: rename d0/d2/d14/d19/d26/d34 to d0/d2/d88 0 2024-09-17T01:41:26.134 INFO:tasks.workunit.client.1.smithi167.stdout:8/533: dwrite dc/d21/d6b/d74/f92 [0,4194304] 0 2024-09-17T01:41:26.135 INFO:tasks.workunit.client.1.smithi167.stdout:9/474: dread d4/f16 [0,4194304] 0 2024-09-17T01:41:26.137 INFO:tasks.workunit.client.1.smithi167.stdout:9/475: chown d4/d9/d2b/c75 29513 1 2024-09-17T01:41:26.137 INFO:tasks.workunit.client.1.smithi167.stdout:5/360: unlink d0/d28/d3a/f3f 0 2024-09-17T01:41:26.137 INFO:tasks.workunit.client.1.smithi167.stdout:5/361: readlink d0/d9/l1f 0 2024-09-17T01:41:26.137 INFO:tasks.workunit.client.1.smithi167.stdout:9/476: read d4/f16 [888145,3961] 0 2024-09-17T01:41:26.139 INFO:tasks.workunit.client.1.smithi167.stdout:3/441: creat d7/d8/d10/d14/d2c/f89 x:0 0 0 2024-09-17T01:41:26.139 INFO:tasks.workunit.client.1.smithi167.stdout:1/431: write d0/d5/d61/f7f [269203,42907] 0 2024-09-17T01:41:26.171 INFO:tasks.workunit.client.0.smithi082.stdout:3/150: mknod d9/c33 0 2024-09-17T01:41:26.172 INFO:tasks.workunit.client.0.smithi082.stdout:5/174: creat db/d12/f35 x:0 0 0 2024-09-17T01:41:26.172 INFO:tasks.workunit.client.0.smithi082.stdout:2/196: mkdir d1/d17/d38 0 2024-09-17T01:41:26.172 INFO:tasks.workunit.client.0.smithi082.stdout:6/270: rename d1/d7/l14 to d1/d7/d10/d4f/dc/d2b/d48/l65 0 2024-09-17T01:41:26.173 INFO:tasks.workunit.client.0.smithi082.stdout:3/151: chown d9/db/cd 1874 1 2024-09-17T01:41:26.173 INFO:tasks.workunit.client.1.smithi167.stdout:2/432: rename c3 to d5/c96 0 2024-09-17T01:41:26.174 INFO:tasks.workunit.client.0.smithi082.stdout:4/201: truncate f7 593727 0 2024-09-17T01:41:26.174 INFO:tasks.workunit.client.0.smithi082.stdout:3/152: stat d9/db/d26 0 2024-09-17T01:41:26.174 INFO:tasks.workunit.client.1.smithi167.stdout:0/402: getdents d5/d6b/d77/d37 0 2024-09-17T01:41:26.174 INFO:tasks.workunit.client.1.smithi167.stdout:7/426: mkdir d0/d2/d14/d6f/d89 0 2024-09-17T01:41:26.175 INFO:tasks.workunit.client.1.smithi167.stdout:9/477: mknod d4/d9/d21/d2d/d33/c8c 0 2024-09-17T01:41:26.176 INFO:tasks.workunit.client.0.smithi082.stdout:9/181: write d4/d27/d21/d2e/d11/d37/f3c [55897,9832] 0 2024-09-17T01:41:26.176 INFO:tasks.workunit.client.1.smithi167.stdout:5/362: dwrite d0/d9/f12 [0,4194304] 0 2024-09-17T01:41:26.177 INFO:tasks.workunit.client.1.smithi167.stdout:6/573: write f0 [2009200,60061] 0 2024-09-17T01:41:26.179 INFO:tasks.workunit.client.1.smithi167.stdout:2/433: mknod d5/d6d/c97 0 2024-09-17T01:41:26.179 INFO:tasks.workunit.client.1.smithi167.stdout:7/427: rmdir d0/d2/d14 39 2024-09-17T01:41:26.179 INFO:tasks.workunit.client.0.smithi082.stdout:8/187: getdents d3/dd/d18/d2d 0 2024-09-17T01:41:26.181 INFO:tasks.workunit.client.1.smithi167.stdout:3/442: symlink d7/l8a 0 2024-09-17T01:41:26.181 INFO:tasks.workunit.client.0.smithi082.stdout:3/153: symlink d9/db/d26/l34 0 2024-09-17T01:41:26.182 INFO:tasks.workunit.client.1.smithi167.stdout:3/443: dread - d7/d8/d10/d14/d2c/f89 zero size 2024-09-17T01:41:26.182 INFO:tasks.workunit.client.0.smithi082.stdout:4/202: readlink d9/d31/l3c 0 2024-09-17T01:41:26.182 INFO:tasks.workunit.client.0.smithi082.stdout:1/186: symlink d2/l3c 0 2024-09-17T01:41:26.183 INFO:tasks.workunit.client.1.smithi167.stdout:1/432: write d0/d5/f12 [3334621,102786] 0 2024-09-17T01:41:26.184 INFO:tasks.workunit.client.1.smithi167.stdout:0/403: dread d5/d6b/d77/d4d/f40 [0,4194304] 0 2024-09-17T01:41:26.185 INFO:tasks.workunit.client.0.smithi082.stdout:5/175: creat db/d2b/f36 x:0 0 0 2024-09-17T01:41:26.187 INFO:tasks.workunit.client.0.smithi082.stdout:1/187: stat d2/da/d16/f1c 0 2024-09-17T01:41:26.188 INFO:tasks.workunit.client.0.smithi082.stdout:9/182: creat d4/d27/d21/d2e/d11/d39/f41 x:0 0 0 2024-09-17T01:41:26.189 INFO:tasks.workunit.client.0.smithi082.stdout:2/197: dwrite d1/d17/d29/f33 [0,4194304] 0 2024-09-17T01:41:26.191 INFO:tasks.workunit.client.0.smithi082.stdout:8/188: mkdir d3/dd/d18/d3a 0 2024-09-17T01:41:26.193 INFO:tasks.workunit.client.0.smithi082.stdout:6/271: dwrite d1/d7/d10/d4f/f20 [0,4194304] 0 2024-09-17T01:41:26.194 INFO:tasks.workunit.client.0.smithi082.stdout:3/154: write f1 [4881380,116211] 0 2024-09-17T01:41:26.194 INFO:tasks.workunit.client.0.smithi082.stdout:1/188: chown d2/da/d2f/f31 0 1 2024-09-17T01:41:26.197 INFO:tasks.workunit.client.1.smithi167.stdout:1/433: mknod d0/d9/d16/d48/d54/d6e/c8b 0 2024-09-17T01:41:26.198 INFO:tasks.workunit.client.1.smithi167.stdout:1/434: chown d0/d5/d34/f7d 513 1 2024-09-17T01:41:26.199 INFO:tasks.workunit.client.1.smithi167.stdout:5/363: truncate d0/f13 1980078 0 2024-09-17T01:41:26.200 INFO:tasks.workunit.client.0.smithi082.stdout:6/272: truncate d1/d7/d10/f4a 4907514 0 2024-09-17T01:41:26.206 INFO:tasks.workunit.client.1.smithi167.stdout:4/468: sync 2024-09-17T01:41:26.207 INFO:tasks.workunit.client.1.smithi167.stdout:4/469: chown d0/d4/d7/da/d48/d40 220869 1 2024-09-17T01:41:26.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/203: dread d9/d15/f2e [0,4194304] 0 2024-09-17T01:41:26.225 INFO:tasks.workunit.client.1.smithi167.stdout:9/478: rename d4/d9/d21/d43/c64 to d4/d9/d21/d81/c8d 0 2024-09-17T01:41:26.226 INFO:tasks.workunit.client.0.smithi082.stdout:5/176: dwrite db/d12/f1c [0,4194304] 0 2024-09-17T01:41:26.226 INFO:tasks.workunit.client.0.smithi082.stdout:6/273: write d1/d7/d10/d4f/fb [888002,50428] 0 2024-09-17T01:41:26.227 INFO:tasks.workunit.client.0.smithi082.stdout:3/155: readlink d9/l2d 0 2024-09-17T01:41:26.227 INFO:tasks.workunit.client.1.smithi167.stdout:6/574: mkdir d7/d54/d90/dd5 0 2024-09-17T01:41:26.228 INFO:tasks.workunit.client.0.smithi082.stdout:4/204: readlink d9/d15/d16/l28 0 2024-09-17T01:41:26.230 INFO:tasks.workunit.client.1.smithi167.stdout:2/434: unlink d5/d10/l1e 0 2024-09-17T01:41:26.232 INFO:tasks.workunit.client.0.smithi082.stdout:6/274: fdatasync d1/d7/d10/f4a 0 2024-09-17T01:41:26.234 INFO:tasks.workunit.client.1.smithi167.stdout:0/404: symlink d5/d8/l7d 0 2024-09-17T01:41:26.234 INFO:tasks.workunit.client.0.smithi082.stdout:4/205: write d9/fa [219244,24644] 0 2024-09-17T01:41:26.237 INFO:tasks.workunit.client.0.smithi082.stdout:2/198: getdents d1/d17/d38 0 2024-09-17T01:41:26.237 INFO:tasks.workunit.client.0.smithi082.stdout:9/183: dwrite d4/d27/d21/d2e/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:26.237 INFO:tasks.workunit.client.0.smithi082.stdout:5/177: symlink db/d12/d29/l37 0 2024-09-17T01:41:26.239 INFO:tasks.workunit.client.1.smithi167.stdout:8/534: sync 2024-09-17T01:41:26.239 INFO:tasks.workunit.client.0.smithi082.stdout:8/189: dwrite d3/f10 [4194304,4194304] 0 2024-09-17T01:41:26.241 INFO:tasks.workunit.client.0.smithi082.stdout:2/199: write d1/f9 [1793481,46678] 0 2024-09-17T01:41:26.241 INFO:tasks.workunit.client.0.smithi082.stdout:4/206: dread - d9/d15/d16/d18/f3a zero size 2024-09-17T01:41:26.242 INFO:tasks.workunit.client.1.smithi167.stdout:9/479: chown d4/lc 11362 1 2024-09-17T01:41:26.243 INFO:tasks.workunit.client.0.smithi082.stdout:8/190: truncate d3/dd/f23 849751 0 2024-09-17T01:41:26.249 INFO:tasks.workunit.client.1.smithi167.stdout:2/435: mkdir d5/d10/d1a/d45/d8e/d98 0 2024-09-17T01:41:26.249 INFO:tasks.workunit.client.1.smithi167.stdout:9/480: dwrite d4/f4e [0,4194304] 0 2024-09-17T01:41:26.251 INFO:tasks.workunit.client.0.smithi082.stdout:6/275: creat d1/d1f/f66 x:0 0 0 2024-09-17T01:41:26.252 INFO:tasks.workunit.client.0.smithi082.stdout:6/276: dread - d1/d7/f5c zero size 2024-09-17T01:41:26.253 INFO:tasks.workunit.client.0.smithi082.stdout:6/277: dread - d1/d7/f5c zero size 2024-09-17T01:41:26.254 INFO:tasks.workunit.client.1.smithi167.stdout:3/444: creat d7/f8b x:0 0 0 2024-09-17T01:41:26.256 INFO:tasks.workunit.client.1.smithi167.stdout:0/405: stat d5/d8/c2a 0 2024-09-17T01:41:26.261 INFO:tasks.workunit.client.0.smithi082.stdout:9/184: creat d4/d27/d21/f42 x:0 0 0 2024-09-17T01:41:26.261 INFO:tasks.workunit.client.0.smithi082.stdout:8/191: fsync d3/dd/f30 0 2024-09-17T01:41:26.262 INFO:tasks.workunit.client.0.smithi082.stdout:9/185: chown d4/d27/d21/d2e/d11/l32 22 1 2024-09-17T01:41:26.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/186: truncate d4/d27/d21/d2e/d11/d39/d31/f40 635602 0 2024-09-17T01:41:26.266 INFO:tasks.workunit.client.0.smithi082.stdout:4/207: mknod d9/d15/c40 0 2024-09-17T01:41:26.267 INFO:tasks.workunit.client.0.smithi082.stdout:4/208: fsync d9/d15/f22 0 2024-09-17T01:41:26.268 INFO:tasks.workunit.client.0.smithi082.stdout:4/209: write d9/d15/f22 [1241068,106563] 0 2024-09-17T01:41:26.269 INFO:tasks.workunit.client.1.smithi167.stdout:7/428: truncate d0/d2/d14/d19/d22/f2a 1890647 0 2024-09-17T01:41:26.270 INFO:tasks.workunit.client.0.smithi082.stdout:5/178: creat db/f38 x:0 0 0 2024-09-17T01:41:26.272 INFO:tasks.workunit.client.1.smithi167.stdout:9/481: rmdir d4/d9/d21/d81 39 2024-09-17T01:41:26.273 INFO:tasks.workunit.client.0.smithi082.stdout:3/156: truncate d9/f2b 42352 0 2024-09-17T01:41:26.274 INFO:tasks.workunit.client.1.smithi167.stdout:1/435: truncate d0/d9/d16/d22/f4d 2445486 0 2024-09-17T01:41:26.276 INFO:tasks.workunit.client.1.smithi167.stdout:4/470: truncate d0/d4/d7/da/d48/d40/d51/d2d/f65 4094272 0 2024-09-17T01:41:26.278 INFO:tasks.workunit.client.1.smithi167.stdout:5/364: dwrite d0/d28/f37 [4194304,4194304] 0 2024-09-17T01:41:26.278 INFO:tasks.workunit.client.0.smithi082.stdout:8/192: fdatasync d3/dd/ff 0 2024-09-17T01:41:26.278 INFO:tasks.workunit.client.1.smithi167.stdout:4/471: write d0/d4/d7/d6/d5d/f68 [186327,79575] 0 2024-09-17T01:41:26.280 INFO:tasks.workunit.client.1.smithi167.stdout:8/535: truncate dc/d56/f5e 2218002 0 2024-09-17T01:41:26.281 INFO:tasks.workunit.client.0.smithi082.stdout:8/193: dread d3/dd/f26 [0,4194304] 0 2024-09-17T01:41:26.281 INFO:tasks.workunit.client.1.smithi167.stdout:6/575: rmdir d7/d54/d90/d13/d2f/d96/dab/dcd 0 2024-09-17T01:41:26.282 INFO:tasks.workunit.client.0.smithi082.stdout:4/210: rmdir d9/d15/d37 39 2024-09-17T01:41:26.282 INFO:tasks.workunit.client.0.smithi082.stdout:8/194: dread - d3/f14 zero size 2024-09-17T01:41:26.284 INFO:tasks.workunit.client.0.smithi082.stdout:1/189: dwrite d2/dd/d24/f23 [0,4194304] 0 2024-09-17T01:41:26.285 INFO:tasks.workunit.client.0.smithi082.stdout:6/278: creat d1/d7/d10/d4f/dc/d1d/d36/f67 x:0 0 0 2024-09-17T01:41:26.285 INFO:tasks.workunit.client.1.smithi167.stdout:2/436: symlink d5/d10/d1a/d2e/l99 0 2024-09-17T01:41:26.288 INFO:tasks.workunit.client.0.smithi082.stdout:3/157: rmdir d9/db/d26 39 2024-09-17T01:41:26.290 INFO:tasks.workunit.client.1.smithi167.stdout:1/436: mknod d0/d9/d16/d48/c8c 0 2024-09-17T01:41:26.292 INFO:tasks.workunit.client.0.smithi082.stdout:9/187: symlink d4/d27/d2d/d3d/l43 0 2024-09-17T01:41:26.293 INFO:tasks.workunit.client.0.smithi082.stdout:4/211: dread d9/d15/d16/f2c [0,4194304] 0 2024-09-17T01:41:26.296 INFO:tasks.workunit.client.0.smithi082.stdout:1/190: dwrite d2/da/d2f/f31 [0,4194304] 0 2024-09-17T01:41:26.298 INFO:tasks.workunit.client.0.smithi082.stdout:1/191: write d2/f10 [551898,42724] 0 2024-09-17T01:41:26.299 INFO:tasks.workunit.client.0.smithi082.stdout:1/192: chown d2/da/d16/f29 19128029 1 2024-09-17T01:41:26.308 INFO:tasks.workunit.client.0.smithi082.stdout:5/179: rename l5 to db/d1e/d20/l39 0 2024-09-17T01:41:26.310 INFO:tasks.workunit.client.0.smithi082.stdout:5/180: truncate db/d12/f35 551455 0 2024-09-17T01:41:26.311 INFO:tasks.workunit.client.0.smithi082.stdout:6/279: dread d1/d7/d10/d4f/f30 [0,4194304] 0 2024-09-17T01:41:26.316 INFO:tasks.workunit.client.1.smithi167.stdout:8/536: mkdir dc/d56/d57/d7e/dad 0 2024-09-17T01:41:26.319 INFO:tasks.workunit.client.0.smithi082.stdout:5/181: dwrite db/d12/d18/f1d [4194304,4194304] 0 2024-09-17T01:41:26.320 INFO:tasks.workunit.client.1.smithi167.stdout:1/437: dread d0/d9/d16/d36/f3e [0,4194304] 0 2024-09-17T01:41:26.322 INFO:tasks.workunit.client.1.smithi167.stdout:6/576: rename d7/d54/d90/d13/d2f/d30/l44 to d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1/ld6 0 2024-09-17T01:41:26.324 INFO:tasks.workunit.client.1.smithi167.stdout:3/445: truncate d7/d8/d2a/f22 4948684 0 2024-09-17T01:41:26.326 INFO:tasks.workunit.client.0.smithi082.stdout:4/212: chown d9/c12 1294 1 2024-09-17T01:41:26.326 INFO:tasks.workunit.client.1.smithi167.stdout:3/446: chown d7/d8/d2a/f3f 17590413 1 2024-09-17T01:41:26.326 INFO:tasks.workunit.client.0.smithi082.stdout:4/213: readlink d9/d15/l30 0 2024-09-17T01:41:26.327 INFO:tasks.workunit.client.0.smithi082.stdout:9/188: mkdir d4/d27/d21/d2e/d11/d39/d44 0 2024-09-17T01:41:26.329 INFO:tasks.workunit.client.1.smithi167.stdout:3/447: write d7/d8/d10/d14/d2c/f2f [120767,119573] 0 2024-09-17T01:41:26.329 INFO:tasks.workunit.client.1.smithi167.stdout:0/406: write d5/d8/f44 [1009924,70499] 0 2024-09-17T01:41:26.330 INFO:tasks.workunit.client.1.smithi167.stdout:6/577: dwrite d7/d54/d90/d13/f2d [0,4194304] 0 2024-09-17T01:41:26.330 INFO:tasks.workunit.client.0.smithi082.stdout:1/193: unlink d2/da/d16/f29 0 2024-09-17T01:41:26.332 INFO:tasks.workunit.client.1.smithi167.stdout:6/578: dread - d7/d54/d90/d13/d2f/d7f/d98/faa zero size 2024-09-17T01:41:26.338 INFO:tasks.workunit.client.1.smithi167.stdout:0/407: read d5/d8/f44 [658063,109601] 0 2024-09-17T01:41:26.340 INFO:tasks.workunit.client.1.smithi167.stdout:7/429: creat d0/d2/d14/f8a x:0 0 0 2024-09-17T01:41:26.344 INFO:tasks.workunit.client.1.smithi167.stdout:2/437: dread d5/d10/d1a/d45/f9 [0,4194304] 0 2024-09-17T01:41:26.346 INFO:tasks.workunit.client.0.smithi082.stdout:5/182: rename db/l21 to db/d1e/d20/l3a 0 2024-09-17T01:41:26.346 INFO:tasks.workunit.client.1.smithi167.stdout:9/482: sync 2024-09-17T01:41:26.348 INFO:tasks.workunit.client.0.smithi082.stdout:3/158: mkdir d9/d35 0 2024-09-17T01:41:26.349 INFO:tasks.workunit.client.0.smithi082.stdout:3/159: chown d9/f23 17 1 2024-09-17T01:41:26.350 INFO:tasks.workunit.client.0.smithi082.stdout:3/160: write d9/f23 [734273,31963] 0 2024-09-17T01:41:26.350 INFO:tasks.workunit.client.1.smithi167.stdout:5/365: truncate d0/d24/d2b/d3d/d3b/f5c 7986633 0 2024-09-17T01:41:26.351 INFO:tasks.workunit.client.0.smithi082.stdout:3/161: write d9/db/f17 [830045,93271] 0 2024-09-17T01:41:26.351 INFO:tasks.workunit.client.0.smithi082.stdout:4/214: write d9/d15/d16/f2c [73176,74643] 0 2024-09-17T01:41:26.355 INFO:tasks.workunit.client.0.smithi082.stdout:9/189: symlink d4/d27/d2d/l45 0 2024-09-17T01:41:26.357 INFO:tasks.workunit.client.1.smithi167.stdout:4/472: creat d0/d4/d7/da/d48/d40/d51/d2d/d2e/f9c x:0 0 0 2024-09-17T01:41:26.357 INFO:tasks.workunit.client.1.smithi167.stdout:4/473: chown d0/l15 48815633 1 2024-09-17T01:41:26.359 INFO:tasks.workunit.client.0.smithi082.stdout:1/194: symlink d2/dd/d24/l3d 0 2024-09-17T01:41:26.360 INFO:tasks.workunit.client.0.smithi082.stdout:3/162: dwrite d9/f23 [0,4194304] 0 2024-09-17T01:41:26.360 INFO:tasks.workunit.client.0.smithi082.stdout:8/195: dwrite d3/dd/f27 [0,4194304] 0 2024-09-17T01:41:26.361 INFO:tasks.workunit.client.0.smithi082.stdout:6/280: symlink d1/d7/d10/d4f/dc/d1d/d36/l68 0 2024-09-17T01:41:26.363 INFO:tasks.workunit.client.1.smithi167.stdout:6/579: mknod d7/d54/d90/d13/d2f/d64/d6b/cd7 0 2024-09-17T01:41:26.368 INFO:tasks.workunit.client.0.smithi082.stdout:5/183: rename db/d1e/f22 to db/d1e/d20/d30/f3b 0 2024-09-17T01:41:26.369 INFO:tasks.workunit.client.1.smithi167.stdout:8/537: mkdir dc/dae 0 2024-09-17T01:41:26.371 INFO:tasks.workunit.client.1.smithi167.stdout:0/408: mkdir d5/d6b/d7e 0 2024-09-17T01:41:26.372 INFO:tasks.workunit.client.1.smithi167.stdout:0/409: write d5/d8/f79 [992690,55868] 0 2024-09-17T01:41:26.373 INFO:tasks.workunit.client.1.smithi167.stdout:7/430: write d0/d2/d14/d19/f3e [1721218,7434] 0 2024-09-17T01:41:26.374 INFO:tasks.workunit.client.0.smithi082.stdout:9/190: unlink l3 0 2024-09-17T01:41:26.374 INFO:tasks.workunit.client.0.smithi082.stdout:6/281: dwrite d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:26.375 INFO:tasks.workunit.client.1.smithi167.stdout:7/431: chown d0/d2/d14/d19/d26/f35 6866 1 2024-09-17T01:41:26.376 INFO:tasks.workunit.client.1.smithi167.stdout:2/438: symlink d5/d3c/d4c/d4d/l9a 0 2024-09-17T01:41:26.377 INFO:tasks.workunit.client.1.smithi167.stdout:9/483: mknod d4/d9/d2b/c8e 0 2024-09-17T01:41:26.378 INFO:tasks.workunit.client.1.smithi167.stdout:9/484: dread d4/d9/f6d [0,4194304] 0 2024-09-17T01:41:26.379 INFO:tasks.workunit.client.0.smithi082.stdout:8/196: mkdir d3/dd/d18/d2d/d3b 0 2024-09-17T01:41:26.379 INFO:tasks.workunit.client.1.smithi167.stdout:9/485: chown d4/l51 30935 1 2024-09-17T01:41:26.380 INFO:tasks.workunit.client.1.smithi167.stdout:5/366: mkdir d0/d28/d3a/d44/d69 0 2024-09-17T01:41:26.383 INFO:tasks.workunit.client.1.smithi167.stdout:5/367: fsync d0/d24/d2b/d3d/f58 0 2024-09-17T01:41:26.383 INFO:tasks.workunit.client.0.smithi082.stdout:6/282: dwrite d1/d7/d10/f33 [0,4194304] 0 2024-09-17T01:41:26.384 INFO:tasks.workunit.client.1.smithi167.stdout:5/368: read - d0/d24/d2b/d3d/f4f zero size 2024-09-17T01:41:26.385 INFO:tasks.workunit.client.1.smithi167.stdout:9/486: dwrite d4/f18 [0,4194304] 0 2024-09-17T01:41:26.394 INFO:tasks.workunit.client.0.smithi082.stdout:9/191: fdatasync d4/d27/d21/d2e/d11/d39/d31/f40 0 2024-09-17T01:41:26.396 INFO:tasks.workunit.client.0.smithi082.stdout:3/163: symlink d9/db/l36 0 2024-09-17T01:41:26.398 INFO:tasks.workunit.client.1.smithi167.stdout:0/410: unlink d5/c76 0 2024-09-17T01:41:26.399 INFO:tasks.workunit.client.1.smithi167.stdout:6/580: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [0,4194304] 0 2024-09-17T01:41:26.399 INFO:tasks.workunit.client.1.smithi167.stdout:8/538: dread dc/d21/f34 [0,4194304] 0 2024-09-17T01:41:26.400 INFO:tasks.workunit.client.1.smithi167.stdout:1/438: creat d0/d5/f8d x:0 0 0 2024-09-17T01:41:26.400 INFO:tasks.workunit.client.0.smithi082.stdout:9/192: dwrite d4/f1a [0,4194304] 0 2024-09-17T01:41:26.402 INFO:tasks.workunit.client.1.smithi167.stdout:8/539: write dc/d1a/f73 [1097298,113949] 0 2024-09-17T01:41:26.402 INFO:tasks.workunit.client.0.smithi082.stdout:1/195: rename d2/dd/f14 to d2/da/d2d/f3e 0 2024-09-17T01:41:26.403 INFO:tasks.workunit.client.1.smithi167.stdout:7/432: mkdir d0/d2/d14/d6f/d8b 0 2024-09-17T01:41:26.404 INFO:tasks.workunit.client.0.smithi082.stdout:6/283: stat d1/d7/f46 0 2024-09-17T01:41:26.406 INFO:tasks.workunit.client.0.smithi082.stdout:6/284: chown d1/d7/f24 586578350 1 2024-09-17T01:41:26.407 INFO:tasks.workunit.client.0.smithi082.stdout:5/184: link db/d2b/f36 db/d12/d29/f3c 0 2024-09-17T01:41:26.408 INFO:tasks.workunit.client.0.smithi082.stdout:9/193: dwrite d4/d27/d21/d2e/d11/d39/d31/f40 [0,4194304] 0 2024-09-17T01:41:26.411 INFO:tasks.workunit.client.1.smithi167.stdout:6/581: dwrite d7/d54/d90/d13/f49 [0,4194304] 0 2024-09-17T01:41:26.412 INFO:tasks.workunit.client.1.smithi167.stdout:9/487: stat d4/d9/d21/f27 0 2024-09-17T01:41:26.414 INFO:tasks.workunit.client.1.smithi167.stdout:3/448: link d7/c5e d7/d8/d10/d14/d2c/d74/c8c 0 2024-09-17T01:41:26.415 INFO:tasks.workunit.client.1.smithi167.stdout:2/439: dwrite d5/d10/d1a/d2e/f59 [0,4194304] 0 2024-09-17T01:41:26.416 INFO:tasks.workunit.client.0.smithi082.stdout:9/194: dwrite d4/d27/d21/d2e/d11/d37/f38 [0,4194304] 0 2024-09-17T01:41:26.418 INFO:tasks.workunit.client.0.smithi082.stdout:4/215: getdents d9/d15 0 2024-09-17T01:41:26.419 INFO:tasks.workunit.client.0.smithi082.stdout:5/185: symlink db/d12/l3d 0 2024-09-17T01:41:26.419 INFO:tasks.workunit.client.0.smithi082.stdout:5/186: stat db/fc 0 2024-09-17T01:41:26.420 INFO:tasks.workunit.client.1.smithi167.stdout:0/411: creat d5/d8/d9/f7f x:0 0 0 2024-09-17T01:41:26.421 INFO:tasks.workunit.client.0.smithi082.stdout:6/285: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/f69 x:0 0 0 2024-09-17T01:41:26.429 INFO:tasks.workunit.client.1.smithi167.stdout:1/439: symlink d0/d9/d16/d48/d80/l8e 0 2024-09-17T01:41:26.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/286: dwrite d1/d1f/f21 [0,4194304] 0 2024-09-17T01:41:26.432 INFO:tasks.workunit.client.0.smithi082.stdout:4/216: mknod d9/d31/c41 0 2024-09-17T01:41:26.433 INFO:tasks.workunit.client.0.smithi082.stdout:6/287: chown d1/d1f/l3c 3 1 2024-09-17T01:41:26.434 INFO:tasks.workunit.client.1.smithi167.stdout:8/540: creat dc/d21/d61/faf x:0 0 0 2024-09-17T01:41:26.434 INFO:tasks.workunit.client.1.smithi167.stdout:8/541: chown dc/d56/d57/l8e 11 1 2024-09-17T01:41:26.435 INFO:tasks.workunit.client.0.smithi082.stdout:5/187: rmdir db/d12 39 2024-09-17T01:41:26.440 INFO:tasks.workunit.client.0.smithi082.stdout:9/195: mknod d4/d27/d21/d2e/d11/d37/c46 0 2024-09-17T01:41:26.443 INFO:tasks.workunit.client.0.smithi082.stdout:3/164: link d9/db/f11 d9/db/f37 0 2024-09-17T01:41:26.444 INFO:tasks.workunit.client.1.smithi167.stdout:5/369: symlink d0/d28/l6a 0 2024-09-17T01:41:26.446 INFO:tasks.workunit.client.0.smithi082.stdout:8/197: link d3/dd/d18/d34/l37 d3/l3c 0 2024-09-17T01:41:26.446 INFO:tasks.workunit.client.0.smithi082.stdout:9/196: dwrite d4/d27/d21/f42 [0,4194304] 0 2024-09-17T01:41:26.447 INFO:tasks.workunit.client.0.smithi082.stdout:8/198: dread - d3/dd/f2b zero size 2024-09-17T01:41:26.447 INFO:tasks.workunit.client.0.smithi082.stdout:9/197: chown d4/d27/d36/d3b 12422734 1 2024-09-17T01:41:26.448 INFO:tasks.workunit.client.1.smithi167.stdout:9/488: creat d4/d9/d21/d43/d6c/f8f x:0 0 0 2024-09-17T01:41:26.448 INFO:tasks.workunit.client.1.smithi167.stdout:9/489: chown d4/d9/f6d 0 1 2024-09-17T01:41:26.449 INFO:tasks.workunit.client.0.smithi082.stdout:4/217: creat d9/d31/f42 x:0 0 0 2024-09-17T01:41:26.452 INFO:tasks.workunit.client.1.smithi167.stdout:6/582: creat d7/d54/d90/d13/d2f/d64/d6b/d95/fd8 x:0 0 0 2024-09-17T01:41:26.453 INFO:tasks.workunit.client.0.smithi082.stdout:8/199: dread d3/dd/f27 [0,4194304] 0 2024-09-17T01:41:26.453 INFO:tasks.workunit.client.0.smithi082.stdout:6/288: fsync d1/d7/f46 0 2024-09-17T01:41:26.454 INFO:tasks.workunit.client.0.smithi082.stdout:5/188: fsync db/d2b/f36 0 2024-09-17T01:41:26.455 INFO:tasks.workunit.client.1.smithi167.stdout:9/490: dwrite d4/d9/d21/d43/f69 [0,4194304] 0 2024-09-17T01:41:26.455 INFO:tasks.workunit.client.1.smithi167.stdout:2/440: dread d5/d10/d16/f73 [0,4194304] 0 2024-09-17T01:41:26.456 INFO:tasks.workunit.client.0.smithi082.stdout:6/289: write d1/d1f/f21 [2179797,115412] 0 2024-09-17T01:41:26.456 INFO:tasks.workunit.client.0.smithi082.stdout:5/189: fdatasync db/fc 0 2024-09-17T01:41:26.457 INFO:tasks.workunit.client.1.smithi167.stdout:0/412: mkdir d5/d6b/d77/d37/d80 0 2024-09-17T01:41:26.460 INFO:tasks.workunit.client.1.smithi167.stdout:1/440: mkdir d0/d9/d16/d36/d8f 0 2024-09-17T01:41:26.462 INFO:tasks.workunit.client.0.smithi082.stdout:3/165: stat d9/db/d26 0 2024-09-17T01:41:26.463 INFO:tasks.workunit.client.1.smithi167.stdout:8/542: creat dc/d1a/fb0 x:0 0 0 2024-09-17T01:41:26.465 INFO:tasks.workunit.client.1.smithi167.stdout:7/433: truncate d0/d2/d14/d23/f58 1895334 0 2024-09-17T01:41:26.465 INFO:tasks.workunit.client.0.smithi082.stdout:6/290: dwrite d1/d7/d10/f16 [0,4194304] 0 2024-09-17T01:41:26.469 INFO:tasks.workunit.client.1.smithi167.stdout:5/370: rename d0/d28/d3a/d44/f4c to d0/d28/d3a/d44/d69/f6b 0 2024-09-17T01:41:26.469 INFO:tasks.workunit.client.0.smithi082.stdout:9/198: creat d4/d27/d2d/d3d/f47 x:0 0 0 2024-09-17T01:41:26.469 INFO:tasks.workunit.client.1.smithi167.stdout:5/371: read d0/d28/f2a [361682,5689] 0 2024-09-17T01:41:26.470 INFO:tasks.workunit.client.1.smithi167.stdout:5/372: write d0/f47 [899772,89031] 0 2024-09-17T01:41:26.472 INFO:tasks.workunit.client.1.smithi167.stdout:4/474: link d0/d4/d7/da/d48/d40/d51/d2d/d74/c8f d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/c9d 0 2024-09-17T01:41:26.482 INFO:tasks.workunit.client.0.smithi082.stdout:1/196: rmdir d2/dd/d24 39 2024-09-17T01:41:26.482 INFO:tasks.workunit.client.0.smithi082.stdout:1/197: stat d2/f4 0 2024-09-17T01:41:26.484 INFO:tasks.workunit.client.1.smithi167.stdout:2/441: stat d5/d10/d1a/d39/l61 0 2024-09-17T01:41:26.484 INFO:tasks.workunit.client.1.smithi167.stdout:2/442: chown d5/d3c/d4c/d4d/d91 259430017 1 2024-09-17T01:41:26.485 INFO:tasks.workunit.client.0.smithi082.stdout:5/190: chown fa 1573196 1 2024-09-17T01:41:26.485 INFO:tasks.workunit.client.1.smithi167.stdout:0/413: creat d5/d6b/d77/d6d/f81 x:0 0 0 2024-09-17T01:41:26.486 INFO:tasks.workunit.client.1.smithi167.stdout:0/414: read - d5/d6b/d77/d37/f69 zero size 2024-09-17T01:41:26.487 INFO:tasks.workunit.client.1.smithi167.stdout:1/441: write d0/d5/d34/d3c/f2b [1420152,123945] 0 2024-09-17T01:41:26.488 INFO:tasks.workunit.client.1.smithi167.stdout:8/543: write dc/d21/f31 [5730772,49600] 0 2024-09-17T01:41:26.490 INFO:tasks.workunit.client.0.smithi082.stdout:5/191: dwrite f3 [0,4194304] 0 2024-09-17T01:41:26.497 INFO:tasks.workunit.client.0.smithi082.stdout:8/200: creat d3/dd/d18/d2d/d3b/f3d x:0 0 0 2024-09-17T01:41:26.498 INFO:tasks.workunit.client.1.smithi167.stdout:6/583: write d7/f5c [906516,52076] 0 2024-09-17T01:41:26.499 INFO:tasks.workunit.client.1.smithi167.stdout:6/584: write d7/fd4 [801365,115761] 0 2024-09-17T01:41:26.500 INFO:tasks.workunit.client.1.smithi167.stdout:6/585: fsync d7/d54/d90/d13/d2f/d7f/d98/faa 0 2024-09-17T01:41:26.500 INFO:tasks.workunit.client.1.smithi167.stdout:5/373: symlink d0/d24/l6c 0 2024-09-17T01:41:26.501 INFO:tasks.workunit.client.0.smithi082.stdout:8/201: dread d3/f10 [4194304,4194304] 0 2024-09-17T01:41:26.501 INFO:tasks.workunit.client.1.smithi167.stdout:5/374: readlink d0/l1e 0 2024-09-17T01:41:26.501 INFO:tasks.workunit.client.1.smithi167.stdout:6/586: dread - d7/d42/f9d zero size 2024-09-17T01:41:26.502 INFO:tasks.workunit.client.0.smithi082.stdout:3/166: mknod d9/db/c38 0 2024-09-17T01:41:26.502 INFO:tasks.workunit.client.0.smithi082.stdout:8/202: dread - d3/dd/f2b zero size 2024-09-17T01:41:26.502 INFO:tasks.workunit.client.0.smithi082.stdout:8/203: stat d3/dd/d18/l28 0 2024-09-17T01:41:26.503 INFO:tasks.workunit.client.1.smithi167.stdout:6/587: chown d7/d54/d90/d13/d2f/d7f/d98/d27 956410171 1 2024-09-17T01:41:26.504 INFO:tasks.workunit.client.0.smithi082.stdout:6/291: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55/l6a 0 2024-09-17T01:41:26.504 INFO:tasks.workunit.client.0.smithi082.stdout:4/218: truncate d9/fa 1736026 0 2024-09-17T01:41:26.506 INFO:tasks.workunit.client.0.smithi082.stdout:5/192: creat db/d1e/d20/f3e x:0 0 0 2024-09-17T01:41:26.507 INFO:tasks.workunit.client.1.smithi167.stdout:3/449: creat d7/d8/d10/d14/f8d x:0 0 0 2024-09-17T01:41:26.508 INFO:tasks.workunit.client.1.smithi167.stdout:3/450: write d7/d8/d10/d14/f8d [256344,54687] 0 2024-09-17T01:41:26.511 INFO:tasks.workunit.client.1.smithi167.stdout:8/544: dread dc/d21/d6b/f6c [0,4194304] 0 2024-09-17T01:41:26.511 INFO:tasks.workunit.client.0.smithi082.stdout:8/204: mkdir d3/dd/d18/d2d/d3e 0 2024-09-17T01:41:26.511 INFO:tasks.workunit.client.0.smithi082.stdout:4/219: dwrite d9/f14 [4194304,4194304] 0 2024-09-17T01:41:26.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/415: unlink d5/d8/l7d 0 2024-09-17T01:41:26.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/220: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:26.516 INFO:tasks.workunit.client.0.smithi082.stdout:6/292: dread d1/d7/f2e [0,4194304] 0 2024-09-17T01:41:26.518 INFO:tasks.workunit.client.0.smithi082.stdout:6/293: write d1/d7/f5c [69673,31316] 0 2024-09-17T01:41:26.518 INFO:tasks.workunit.client.1.smithi167.stdout:7/434: mkdir d0/d2/d14/d19/d7f/d8c 0 2024-09-17T01:41:26.519 INFO:tasks.workunit.client.0.smithi082.stdout:4/221: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:26.519 INFO:tasks.workunit.client.1.smithi167.stdout:7/435: write d0/d2/d14/d19/f77 [270880,55910] 0 2024-09-17T01:41:26.528 INFO:tasks.workunit.client.1.smithi167.stdout:7/436: dwrite d0/d55/d70/f7e [0,4194304] 0 2024-09-17T01:41:26.528 INFO:tasks.workunit.client.1.smithi167.stdout:4/475: unlink d0/d4/d7/f53 0 2024-09-17T01:41:26.528 INFO:tasks.workunit.client.1.smithi167.stdout:7/437: stat d0/d2/f66 0 2024-09-17T01:41:26.528 INFO:tasks.workunit.client.1.smithi167.stdout:9/491: write d4/d9/f25 [3233980,17880] 0 2024-09-17T01:41:26.531 INFO:tasks.workunit.client.0.smithi082.stdout:5/193: write db/d1e/d20/d30/f3b [137048,37433] 0 2024-09-17T01:41:26.531 INFO:tasks.workunit.client.1.smithi167.stdout:8/545: creat dc/d21/d61/fb1 x:0 0 0 2024-09-17T01:41:26.533 INFO:tasks.workunit.client.0.smithi082.stdout:1/198: rename d2/dd to d2/d3f 0 2024-09-17T01:41:26.534 INFO:tasks.workunit.client.1.smithi167.stdout:1/442: mkdir d0/d9/d16/d48/d54/d78/d90 0 2024-09-17T01:41:26.535 INFO:tasks.workunit.client.1.smithi167.stdout:1/443: chown d0/d5/d34/f63 159486 1 2024-09-17T01:41:26.535 INFO:tasks.workunit.client.0.smithi082.stdout:6/294: mknod d1/d7/d10/d4f/dc/d1d/c6b 0 2024-09-17T01:41:26.537 INFO:tasks.workunit.client.0.smithi082.stdout:8/205: dread d3/f20 [0,4194304] 0 2024-09-17T01:41:26.538 INFO:tasks.workunit.client.0.smithi082.stdout:4/222: mknod d9/d15/d37/c43 0 2024-09-17T01:41:26.541 INFO:tasks.workunit.client.1.smithi167.stdout:5/375: mkdir d0/d24/d2b/d3d/d6d 0 2024-09-17T01:41:26.542 INFO:tasks.workunit.client.0.smithi082.stdout:5/194: readlink db/d12/l1a 0 2024-09-17T01:41:26.544 INFO:tasks.workunit.client.0.smithi082.stdout:4/223: dwrite d9/f14 [0,4194304] 0 2024-09-17T01:41:26.545 INFO:tasks.workunit.client.0.smithi082.stdout:4/224: fdatasync d9/d15/d16/d3e/f3f 0 2024-09-17T01:41:26.546 INFO:tasks.workunit.client.0.smithi082.stdout:6/295: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f6c x:0 0 0 2024-09-17T01:41:26.546 INFO:tasks.workunit.client.0.smithi082.stdout:4/225: chown d9/d2b 6705 1 2024-09-17T01:41:26.553 INFO:tasks.workunit.client.1.smithi167.stdout:4/476: dread d0/d4/d7/da/d48/d40/d51/d2d/d74/f8c [0,4194304] 0 2024-09-17T01:41:26.554 INFO:tasks.workunit.client.0.smithi082.stdout:8/206: dwrite d3/f39 [0,4194304] 0 2024-09-17T01:41:26.554 INFO:tasks.workunit.client.1.smithi167.stdout:4/477: write d0/d4/d7/f67 [229964,46874] 0 2024-09-17T01:41:26.557 INFO:tasks.workunit.client.1.smithi167.stdout:3/451: symlink d7/d8/d10/d14/d2c/d74/l8e 0 2024-09-17T01:41:26.559 INFO:tasks.workunit.client.0.smithi082.stdout:1/199: rename d2/d3f/c38 to d2/da/d2d/c40 0 2024-09-17T01:41:26.559 INFO:tasks.workunit.client.1.smithi167.stdout:3/452: write d7/d8/d2a/d4e/f5f [546302,124604] 0 2024-09-17T01:41:26.559 INFO:tasks.workunit.client.0.smithi082.stdout:1/200: chown d2/l2b 10369971 1 2024-09-17T01:41:26.560 INFO:tasks.workunit.client.1.smithi167.stdout:9/492: mkdir d4/d9/d21/d2d/d33/d90 0 2024-09-17T01:41:26.561 INFO:tasks.workunit.client.0.smithi082.stdout:1/201: fsync d2/da/d2f/f31 0 2024-09-17T01:41:26.562 INFO:tasks.workunit.client.0.smithi082.stdout:1/202: write d2/da/f35 [3186374,70386] 0 2024-09-17T01:41:26.563 INFO:tasks.workunit.client.1.smithi167.stdout:8/546: mkdir dc/d56/d59/d82/db2 0 2024-09-17T01:41:26.567 INFO:tasks.workunit.client.1.smithi167.stdout:0/416: creat d5/d6b/d77/d37/d80/f82 x:0 0 0 2024-09-17T01:41:26.569 INFO:tasks.workunit.client.1.smithi167.stdout:3/453: dread d7/d8/d2a/f63 [0,4194304] 0 2024-09-17T01:41:26.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/454: stat d7/d8/d10/d14/d66/d6c 0 2024-09-17T01:41:26.570 INFO:tasks.workunit.client.0.smithi082.stdout:5/195: dwrite db/f19 [0,4194304] 0 2024-09-17T01:41:26.571 INFO:tasks.workunit.client.1.smithi167.stdout:6/588: rename d7/d54/d90/d13/d2f/d7f/d98/d27/l33 to d7/ld9 0 2024-09-17T01:41:26.571 INFO:tasks.workunit.client.1.smithi167.stdout:3/455: write d7/d8/d10/d14/f5a [732843,70269] 0 2024-09-17T01:41:26.572 INFO:tasks.workunit.client.0.smithi082.stdout:5/196: write db/d12/d29/f32 [1038140,119182] 0 2024-09-17T01:41:26.572 INFO:tasks.workunit.client.1.smithi167.stdout:2/443: getdents d5/d3c/d4c 0 2024-09-17T01:41:26.576 INFO:tasks.workunit.client.0.smithi082.stdout:1/203: rename d2/f18 to d2/da/d2d/f41 0 2024-09-17T01:41:26.578 INFO:tasks.workunit.client.1.smithi167.stdout:4/478: creat d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d4f/f9e x:0 0 0 2024-09-17T01:41:26.582 INFO:tasks.workunit.client.1.smithi167.stdout:8/547: symlink dc/d56/d59/d82/d8f/d90/lb3 0 2024-09-17T01:41:26.583 INFO:tasks.workunit.client.0.smithi082.stdout:5/197: unlink db/f38 0 2024-09-17T01:41:26.585 INFO:tasks.workunit.client.1.smithi167.stdout:8/548: dread dc/d21/f34 [4194304,4194304] 0 2024-09-17T01:41:26.586 INFO:tasks.workunit.client.1.smithi167.stdout:1/444: symlink d0/d9/d16/d48/d54/d78/d90/l91 0 2024-09-17T01:41:26.588 INFO:tasks.workunit.client.1.smithi167.stdout:5/376: unlink d0/lc 0 2024-09-17T01:41:26.589 INFO:tasks.workunit.client.0.smithi082.stdout:4/226: getdents d9/d31 0 2024-09-17T01:41:26.590 INFO:tasks.workunit.client.0.smithi082.stdout:6/296: truncate d1/d7/d10/d4f/f12 976422 0 2024-09-17T01:41:26.590 INFO:tasks.workunit.client.0.smithi082.stdout:4/227: write d9/f14 [337113,52632] 0 2024-09-17T01:41:26.591 INFO:tasks.workunit.client.1.smithi167.stdout:8/549: dwrite dc/d1a/f73 [0,4194304] 0 2024-09-17T01:41:26.591 INFO:tasks.workunit.client.1.smithi167.stdout:5/377: truncate d0/d24/d2b/d3d/f4f 570101 0 2024-09-17T01:41:26.592 INFO:tasks.workunit.client.1.smithi167.stdout:0/417: creat d5/f83 x:0 0 0 2024-09-17T01:41:26.593 INFO:tasks.workunit.client.1.smithi167.stdout:8/550: write dc/d21/d61/fb1 [802498,62585] 0 2024-09-17T01:41:26.594 INFO:tasks.workunit.client.0.smithi082.stdout:4/228: dread - d9/d15/d16/d18/f3a zero size 2024-09-17T01:41:26.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/297: fsync d1/d7/d10/d4f/dc/d1d/d36/f67 0 2024-09-17T01:41:26.594 INFO:tasks.workunit.client.1.smithi167.stdout:7/438: creat d0/d2/d14/d19/d22/f8d x:0 0 0 2024-09-17T01:41:26.596 INFO:tasks.workunit.client.1.smithi167.stdout:6/589: chown d7/ld9 141277500 1 2024-09-17T01:41:26.597 INFO:tasks.workunit.client.1.smithi167.stdout:2/444: creat d5/d10/d1a/d45/d8e/f9b x:0 0 0 2024-09-17T01:41:26.598 INFO:tasks.workunit.client.0.smithi082.stdout:5/198: creat db/d1e/d20/f3f x:0 0 0 2024-09-17T01:41:26.600 INFO:tasks.workunit.client.1.smithi167.stdout:4/479: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/f9f x:0 0 0 2024-09-17T01:41:26.601 INFO:tasks.workunit.client.1.smithi167.stdout:8/551: dwrite dc/f7a [0,4194304] 0 2024-09-17T01:41:26.602 INFO:tasks.workunit.client.0.smithi082.stdout:4/229: mkdir d9/d15/d16/d44 0 2024-09-17T01:41:26.603 INFO:tasks.workunit.client.0.smithi082.stdout:6/298: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/l6d 0 2024-09-17T01:41:26.604 INFO:tasks.workunit.client.0.smithi082.stdout:4/230: write d9/d15/d16/f2c [1751270,49254] 0 2024-09-17T01:41:26.605 INFO:tasks.workunit.client.1.smithi167.stdout:1/445: creat d0/d9/d16/d48/d54/d78/f92 x:0 0 0 2024-09-17T01:41:26.605 INFO:tasks.workunit.client.0.smithi082.stdout:5/199: dwrite db/f16 [0,4194304] 0 2024-09-17T01:41:26.605 INFO:tasks.workunit.client.1.smithi167.stdout:6/590: dwrite d7/d52/fcc [0,4194304] 0 2024-09-17T01:41:26.606 INFO:tasks.workunit.client.0.smithi082.stdout:6/299: truncate d1/f63 812177 0 2024-09-17T01:41:26.606 INFO:tasks.workunit.client.0.smithi082.stdout:1/204: rename d2/da/d16/l39 to d2/d3f/d34/l42 0 2024-09-17T01:41:26.607 INFO:tasks.workunit.client.1.smithi167.stdout:6/591: readlink d7/d54/d90/d13/d2f/d7f/d98/l4f 0 2024-09-17T01:41:26.608 INFO:tasks.workunit.client.0.smithi082.stdout:5/200: write db/d12/f1c [1043215,28209] 0 2024-09-17T01:41:26.609 INFO:tasks.workunit.client.1.smithi167.stdout:0/418: creat d5/f84 x:0 0 0 2024-09-17T01:41:26.611 INFO:tasks.workunit.client.1.smithi167.stdout:3/456: mkdir d7/d8f 0 2024-09-17T01:41:26.613 INFO:tasks.workunit.client.0.smithi082.stdout:4/231: dwrite d9/f14 [0,4194304] 0 2024-09-17T01:41:26.614 INFO:tasks.workunit.client.1.smithi167.stdout:7/439: rename d0/d2/d14/d19/d32/f6a to d0/d2/d14/d19/d26/d83/f8e 0 2024-09-17T01:41:26.616 INFO:tasks.workunit.client.0.smithi082.stdout:1/205: unlink d2/c9 0 2024-09-17T01:41:26.617 INFO:tasks.workunit.client.1.smithi167.stdout:2/445: rmdir d5/d10/d1a 39 2024-09-17T01:41:26.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/201: readlink db/d1e/l25 0 2024-09-17T01:41:26.619 INFO:tasks.workunit.client.1.smithi167.stdout:9/493: link d4/d9/d2b/c8e d4/d4a/c91 0 2024-09-17T01:41:26.619 INFO:tasks.workunit.client.1.smithi167.stdout:0/419: dwrite d5/f84 [0,4194304] 0 2024-09-17T01:41:26.619 INFO:tasks.workunit.client.1.smithi167.stdout:7/440: read d0/d2/d14/d19/f77 [108313,31844] 0 2024-09-17T01:41:26.619 INFO:tasks.workunit.client.0.smithi082.stdout:6/300: mknod d1/d7/d10/d4f/dc/d2b/c6e 0 2024-09-17T01:41:26.623 INFO:tasks.workunit.client.1.smithi167.stdout:4/480: unlink d0/d4/d7/c96 0 2024-09-17T01:41:26.627 INFO:tasks.workunit.client.0.smithi082.stdout:5/202: creat db/d12/d18/f40 x:0 0 0 2024-09-17T01:41:26.630 INFO:tasks.workunit.client.1.smithi167.stdout:1/446: mknod d0/d5/d34/d3c/c93 0 2024-09-17T01:41:26.632 INFO:tasks.workunit.client.0.smithi082.stdout:1/206: dwrite d2/d3f/f26 [4194304,4194304] 0 2024-09-17T01:41:26.632 INFO:tasks.workunit.client.0.smithi082.stdout:4/232: dread d9/d15/f22 [0,4194304] 0 2024-09-17T01:41:26.633 INFO:tasks.workunit.client.1.smithi167.stdout:5/378: truncate d0/d24/d2b/d3d/d3b/f5c 8031657 0 2024-09-17T01:41:26.633 INFO:tasks.workunit.client.0.smithi082.stdout:1/207: chown d2/da/d2d/f2e 15469597 1 2024-09-17T01:41:26.634 INFO:tasks.workunit.client.0.smithi082.stdout:1/208: chown d2/da/d2d/f3e 186 1 2024-09-17T01:41:26.636 INFO:tasks.workunit.client.0.smithi082.stdout:4/233: readlink d9/l1b 0 2024-09-17T01:41:26.643 INFO:tasks.workunit.client.0.smithi082.stdout:1/209: dwrite f0 [0,4194304] 0 2024-09-17T01:41:26.652 INFO:tasks.workunit.client.0.smithi082.stdout:1/210: creat d2/d3f/d34/f43 x:0 0 0 2024-09-17T01:41:26.654 INFO:tasks.workunit.client.1.smithi167.stdout:0/420: mknod d5/d8/d9/d2f/c85 0 2024-09-17T01:41:26.656 INFO:tasks.workunit.client.1.smithi167.stdout:4/481: unlink d0/d4/d7/da/d48/d40/d51/d2d/d2e/f9c 0 2024-09-17T01:41:26.657 INFO:tasks.workunit.client.0.smithi082.stdout:4/234: getdents d9/d31 0 2024-09-17T01:41:26.657 INFO:tasks.workunit.client.1.smithi167.stdout:4/482: chown d0/d4/d7/da 29 1 2024-09-17T01:41:26.658 INFO:tasks.workunit.client.0.smithi082.stdout:1/211: creat d2/da/d2f/f44 x:0 0 0 2024-09-17T01:41:26.659 INFO:tasks.workunit.client.1.smithi167.stdout:5/379: creat d0/d24/d2b/f6e x:0 0 0 2024-09-17T01:41:26.660 INFO:tasks.workunit.client.0.smithi082.stdout:4/235: mkdir d9/d15/d37/d45 0 2024-09-17T01:41:26.660 INFO:tasks.workunit.client.1.smithi167.stdout:5/380: write d0/d24/d2b/f6e [633641,26713] 0 2024-09-17T01:41:26.660 INFO:tasks.workunit.client.1.smithi167.stdout:5/381: stat d0/d24/d2b/d3d 0 2024-09-17T01:41:26.664 INFO:tasks.workunit.client.1.smithi167.stdout:8/552: rename dc/f1b to dc/d56/d59/d65/fb4 0 2024-09-17T01:41:26.671 INFO:tasks.workunit.client.1.smithi167.stdout:4/483: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/ca0 0 2024-09-17T01:41:26.671 INFO:tasks.workunit.client.1.smithi167.stdout:4/484: readlink d0/d4/lc 0 2024-09-17T01:41:26.672 INFO:tasks.workunit.client.1.smithi167.stdout:5/382: creat d0/d24/d2b/d49/d4b/f6f x:0 0 0 2024-09-17T01:41:26.674 INFO:tasks.workunit.client.1.smithi167.stdout:6/592: rename d7/d54/d90/d13/f55 to d7/d54/d90/d13/d2f/d96/dab/fda 0 2024-09-17T01:41:26.674 INFO:tasks.workunit.client.1.smithi167.stdout:3/457: write d7/d8/d2a/f2e [746628,53264] 0 2024-09-17T01:41:26.675 INFO:tasks.workunit.client.1.smithi167.stdout:2/446: creat d5/d10/f9c x:0 0 0 2024-09-17T01:41:26.677 INFO:tasks.workunit.client.1.smithi167.stdout:7/441: rmdir d0/d2/d14/d19/d7f/d8c 0 2024-09-17T01:41:26.678 INFO:tasks.workunit.client.1.smithi167.stdout:0/421: creat d5/d6b/d7e/f86 x:0 0 0 2024-09-17T01:41:26.679 INFO:tasks.workunit.client.1.smithi167.stdout:2/447: write d5/d3c/d4c/d4d/f75 [1010541,85420] 0 2024-09-17T01:41:26.680 INFO:tasks.workunit.client.1.smithi167.stdout:4/485: creat d0/d4/d7/da/d48/d40/d51/d2d/fa1 x:0 0 0 2024-09-17T01:41:26.682 INFO:tasks.workunit.client.1.smithi167.stdout:5/383: creat d0/d24/d2b/d4e/f70 x:0 0 0 2024-09-17T01:41:26.683 INFO:tasks.workunit.client.1.smithi167.stdout:8/553: dread dc/d21/f47 [0,4194304] 0 2024-09-17T01:41:26.684 INFO:tasks.workunit.client.1.smithi167.stdout:9/494: rename d4/d9/d21/d2d/d33/d80/l87 to d4/d9/d21/d2d/d33/d3a/d74/l92 0 2024-09-17T01:41:26.685 INFO:tasks.workunit.client.1.smithi167.stdout:6/593: dwrite d7/f8a [0,4194304] 0 2024-09-17T01:41:26.687 INFO:tasks.workunit.client.1.smithi167.stdout:3/458: dwrite d7/d8/d10/d14/f5a [0,4194304] 0 2024-09-17T01:41:26.691 INFO:tasks.workunit.client.1.smithi167.stdout:3/459: fdatasync d7/d8/d10/d14/d25/f6b 0 2024-09-17T01:41:26.691 INFO:tasks.workunit.client.1.smithi167.stdout:4/486: mkdir d0/d4/d7/d6/d5d/da2 0 2024-09-17T01:41:26.692 INFO:tasks.workunit.client.1.smithi167.stdout:0/422: truncate d5/d6b/d77/d37/f65 1797418 0 2024-09-17T01:41:26.694 INFO:tasks.workunit.client.1.smithi167.stdout:9/495: symlink d4/l93 0 2024-09-17T01:41:26.694 INFO:tasks.workunit.client.1.smithi167.stdout:5/384: chown d0/d24/d2b/d3d/f65 12869 1 2024-09-17T01:41:26.694 INFO:tasks.workunit.client.1.smithi167.stdout:8/554: truncate dc/f48 843156 0 2024-09-17T01:41:26.695 INFO:tasks.workunit.client.1.smithi167.stdout:3/460: stat d7/d8/d10/d14/f53 0 2024-09-17T01:41:26.697 INFO:tasks.workunit.client.1.smithi167.stdout:4/487: mknod d0/d4/d7/d6/d2b/ca3 0 2024-09-17T01:41:26.697 INFO:tasks.workunit.client.1.smithi167.stdout:0/423: chown d5/d6b/d77/d4d/c42 1102727 1 2024-09-17T01:41:26.699 INFO:tasks.workunit.client.1.smithi167.stdout:1/447: dwrite d0/d9/d16/d36/f53 [0,4194304] 0 2024-09-17T01:41:26.703 INFO:tasks.workunit.client.1.smithi167.stdout:6/594: truncate d7/d54/d90/d13/d2f/d7f/f86 6411126 0 2024-09-17T01:41:26.708 INFO:tasks.workunit.client.1.smithi167.stdout:0/424: fdatasync d5/d8/f44 0 2024-09-17T01:41:26.711 INFO:tasks.workunit.client.1.smithi167.stdout:9/496: dwrite d4/d9/d21/d43/d6c/f86 [0,4194304] 0 2024-09-17T01:41:26.711 INFO:tasks.workunit.client.1.smithi167.stdout:6/595: fdatasync d7/d54/d90/d13/d2f/d96/dab/fda 0 2024-09-17T01:41:26.713 INFO:tasks.workunit.client.1.smithi167.stdout:3/461: dwrite d7/d8/d10/d14/d24/d62/f77 [0,4194304] 0 2024-09-17T01:41:26.716 INFO:tasks.workunit.client.1.smithi167.stdout:9/497: unlink d4/d9/d21/c6e 0 2024-09-17T01:41:26.718 INFO:tasks.workunit.client.1.smithi167.stdout:1/448: dread d0/d5/d61/f71 [0,4194304] 0 2024-09-17T01:41:26.720 INFO:tasks.workunit.client.1.smithi167.stdout:0/425: rename d5/d6b/d77/d4d/l12 to d5/d6b/d77/d4d/d56/l87 0 2024-09-17T01:41:26.721 INFO:tasks.workunit.client.1.smithi167.stdout:0/426: chown d5/d6b/d77/d4d/f40 3657 1 2024-09-17T01:41:26.721 INFO:tasks.workunit.client.1.smithi167.stdout:3/462: chown d7/d8/d1f/l79 893 1 2024-09-17T01:41:26.722 INFO:tasks.workunit.client.1.smithi167.stdout:0/427: readlink d5/d8/d9/l24 0 2024-09-17T01:41:26.724 INFO:tasks.workunit.client.1.smithi167.stdout:1/449: creat d0/d9/d16/d48/d54/d6e/f94 x:0 0 0 2024-09-17T01:41:26.725 INFO:tasks.workunit.client.1.smithi167.stdout:5/385: dread d0/f14 [0,4194304] 0 2024-09-17T01:41:26.726 INFO:tasks.workunit.client.1.smithi167.stdout:5/386: dread - d0/d9/f33 zero size 2024-09-17T01:41:26.726 INFO:tasks.workunit.client.1.smithi167.stdout:3/463: creat d7/d8/d10/d14/d24/d62/f90 x:0 0 0 2024-09-17T01:41:26.727 INFO:tasks.workunit.client.1.smithi167.stdout:0/428: mknod d5/d6b/d77/d4d/c88 0 2024-09-17T01:41:26.727 INFO:tasks.workunit.client.1.smithi167.stdout:5/387: fsync d0/d28/f5b 0 2024-09-17T01:41:26.729 INFO:tasks.workunit.client.0.smithi082.stdout:4/236: stat d9/d15/d16/d18/f20 0 2024-09-17T01:41:26.731 INFO:tasks.workunit.client.1.smithi167.stdout:6/596: dread d7/d54/d90/d13/f3f [0,4194304] 0 2024-09-17T01:41:26.731 INFO:tasks.workunit.client.0.smithi082.stdout:1/212: chown d2/d3f/f13 2100 1 2024-09-17T01:41:26.731 INFO:tasks.workunit.client.0.smithi082.stdout:5/203: truncate db/f19 3684336 0 2024-09-17T01:41:26.732 INFO:tasks.workunit.client.1.smithi167.stdout:1/450: fsync d0/d5/d61/f71 0 2024-09-17T01:41:26.732 INFO:tasks.workunit.client.0.smithi082.stdout:5/204: write db/d12/d29/f32 [1817451,5417] 0 2024-09-17T01:41:26.735 INFO:tasks.workunit.client.1.smithi167.stdout:0/429: readlink d5/d6b/d77/d4d/l28 0 2024-09-17T01:41:26.736 INFO:tasks.workunit.client.0.smithi082.stdout:1/213: unlink d2/df/f17 0 2024-09-17T01:41:26.737 INFO:tasks.workunit.client.1.smithi167.stdout:5/388: mknod d0/c71 0 2024-09-17T01:41:26.741 INFO:tasks.workunit.client.1.smithi167.stdout:0/430: dwrite d5/f84 [0,4194304] 0 2024-09-17T01:41:26.743 INFO:tasks.workunit.client.1.smithi167.stdout:3/464: mknod d7/d8/d10/c91 0 2024-09-17T01:41:26.744 INFO:tasks.workunit.client.1.smithi167.stdout:3/465: chown d7/d8/d1f/l79 84910 1 2024-09-17T01:41:26.748 INFO:tasks.workunit.client.0.smithi082.stdout:5/205: truncate db/d2b/f36 869895 0 2024-09-17T01:41:26.751 INFO:tasks.workunit.client.1.smithi167.stdout:7/442: dread d0/f3f [0,4194304] 0 2024-09-17T01:41:26.752 INFO:tasks.workunit.client.1.smithi167.stdout:3/466: dread d7/d1e/f3c [0,4194304] 0 2024-09-17T01:41:26.752 INFO:tasks.workunit.client.1.smithi167.stdout:1/451: mknod d0/d5/d34/d83/c95 0 2024-09-17T01:41:26.754 INFO:tasks.workunit.client.0.smithi082.stdout:1/214: creat d2/da/d2d/f45 x:0 0 0 2024-09-17T01:41:26.756 INFO:tasks.workunit.client.0.smithi082.stdout:4/237: creat d9/f46 x:0 0 0 2024-09-17T01:41:26.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/238: write d9/f14 [2685182,62295] 0 2024-09-17T01:41:26.758 INFO:tasks.workunit.client.0.smithi082.stdout:4/239: stat d9/d15/d16/l3b 0 2024-09-17T01:41:26.759 INFO:tasks.workunit.client.0.smithi082.stdout:5/206: mknod db/d12/d18/c41 0 2024-09-17T01:41:26.759 INFO:tasks.workunit.client.0.smithi082.stdout:5/207: chown db/f16 83980 1 2024-09-17T01:41:26.761 INFO:tasks.workunit.client.0.smithi082.stdout:1/215: write d2/da/d2d/f3e [185147,103293] 0 2024-09-17T01:41:26.762 INFO:tasks.workunit.client.1.smithi167.stdout:7/443: rmdir d0/d2/d14/d19/d22/d40 39 2024-09-17T01:41:26.764 INFO:tasks.workunit.client.1.smithi167.stdout:8/555: write dc/d1a/f49 [1951335,67170] 0 2024-09-17T01:41:26.764 INFO:tasks.workunit.client.1.smithi167.stdout:1/452: symlink d0/d9/d16/l96 0 2024-09-17T01:41:26.765 INFO:tasks.workunit.client.1.smithi167.stdout:7/444: write d0/d2/d14/d19/d26/f59 [607513,46139] 0 2024-09-17T01:41:26.766 INFO:tasks.workunit.client.1.smithi167.stdout:2/448: dwrite d5/d10/d1a/f37 [0,4194304] 0 2024-09-17T01:41:26.767 INFO:tasks.workunit.client.1.smithi167.stdout:3/467: mkdir d7/d8/d10/d14/d24/d62/d92 0 2024-09-17T01:41:26.769 INFO:tasks.workunit.client.0.smithi082.stdout:5/208: rename db/l1b to db/d2b/l42 0 2024-09-17T01:41:26.769 INFO:tasks.workunit.client.1.smithi167.stdout:4/488: write d0/d4/d7/d6/f29 [611617,83956] 0 2024-09-17T01:41:26.771 INFO:tasks.workunit.client.0.smithi082.stdout:1/216: truncate d2/d3f/f19 4675254 0 2024-09-17T01:41:26.772 INFO:tasks.workunit.client.0.smithi082.stdout:4/240: truncate f7 447089 0 2024-09-17T01:41:26.776 INFO:tasks.workunit.client.0.smithi082.stdout:5/209: mknod db/d2b/c43 0 2024-09-17T01:41:26.778 INFO:tasks.workunit.client.0.smithi082.stdout:5/210: dread db/d12/f35 [0,4194304] 0 2024-09-17T01:41:26.783 INFO:tasks.workunit.client.1.smithi167.stdout:9/498: dwrite d4/d9/f3d [4194304,4194304] 0 2024-09-17T01:41:26.784 INFO:tasks.workunit.client.1.smithi167.stdout:4/489: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [8388608,4194304] 0 2024-09-17T01:41:26.784 INFO:tasks.workunit.client.1.smithi167.stdout:9/499: fdatasync d4/d9/d21/d2d/d33/d3a/f67 0 2024-09-17T01:41:26.786 INFO:tasks.workunit.client.1.smithi167.stdout:8/556: write dc/d56/d57/da0/da7/fab [748328,25200] 0 2024-09-17T01:41:26.788 INFO:tasks.workunit.client.1.smithi167.stdout:8/557: truncate dc/f15 4301313 0 2024-09-17T01:41:26.788 INFO:tasks.workunit.client.1.smithi167.stdout:4/490: read d0/d4/d7/f23 [3240921,24449] 0 2024-09-17T01:41:26.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/241: mkdir d9/d47 0 2024-09-17T01:41:26.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/242: fsync d9/d15/f1e 0 2024-09-17T01:41:26.790 INFO:tasks.workunit.client.1.smithi167.stdout:4/491: dread - d0/d4/d7/d6/f83 zero size 2024-09-17T01:41:26.793 INFO:tasks.workunit.client.0.smithi082.stdout:1/217: dread d2/da/d2d/f41 [0,4194304] 0 2024-09-17T01:41:26.793 INFO:tasks.workunit.client.0.smithi082.stdout:6/301: truncate d1/d7/d10/d4f/f12 801259 0 2024-09-17T01:41:26.795 INFO:tasks.workunit.client.0.smithi082.stdout:1/218: read d2/da/f35 [3236303,54824] 0 2024-09-17T01:41:26.797 INFO:tasks.workunit.client.0.smithi082.stdout:4/243: dwrite d9/f14 [4194304,4194304] 0 2024-09-17T01:41:26.799 INFO:tasks.workunit.client.1.smithi167.stdout:5/389: write d0/d9/fb [2340543,90027] 0 2024-09-17T01:41:26.807 INFO:tasks.workunit.client.1.smithi167.stdout:9/500: mknod d4/d9/d21/d2d/d33/d3a/c94 0 2024-09-17T01:41:26.811 INFO:tasks.workunit.client.1.smithi167.stdout:8/558: rename dc/d56/d57/l8e to dc/d56/d59/d82/d8f/d90/lb5 0 2024-09-17T01:41:26.813 INFO:tasks.workunit.client.0.smithi082.stdout:4/244: mkdir d9/d31/d48 0 2024-09-17T01:41:26.814 INFO:tasks.workunit.client.1.smithi167.stdout:1/453: symlink d0/d9/d16/d36/d8f/l97 0 2024-09-17T01:41:26.822 INFO:tasks.workunit.client.1.smithi167.stdout:0/431: getdents d5/d6b/d77/d6d 0 2024-09-17T01:41:26.823 INFO:tasks.workunit.client.1.smithi167.stdout:9/501: rmdir d4/d9/d2b 39 2024-09-17T01:41:26.823 INFO:tasks.workunit.client.1.smithi167.stdout:5/390: dread d0/f21 [0,4194304] 0 2024-09-17T01:41:26.825 INFO:tasks.workunit.client.0.smithi082.stdout:6/302: creat d1/d7/d10/f6f x:0 0 0 2024-09-17T01:41:26.826 INFO:tasks.workunit.client.1.smithi167.stdout:4/492: rename d0/d4/d7/d6/d2b/d6d/d7e/c8e to d0/d4/d7/da/d48/ca4 0 2024-09-17T01:41:26.827 INFO:tasks.workunit.client.0.smithi082.stdout:5/211: dwrite db/d12/d29/f3c [0,4194304] 0 2024-09-17T01:41:26.827 INFO:tasks.workunit.client.1.smithi167.stdout:4/493: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f85 105076 1 2024-09-17T01:41:26.828 INFO:tasks.workunit.client.1.smithi167.stdout:8/559: creat dc/d21/d6b/d74/d83/fb6 x:0 0 0 2024-09-17T01:41:26.828 INFO:tasks.workunit.client.0.smithi082.stdout:6/303: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f6c 77593 1 2024-09-17T01:41:26.828 INFO:tasks.workunit.client.0.smithi082.stdout:5/212: write db/d1e/d20/f3e [93473,129163] 0 2024-09-17T01:41:26.829 INFO:tasks.workunit.client.0.smithi082.stdout:5/213: chown db/d1e/d20 713382060 1 2024-09-17T01:41:26.829 INFO:tasks.workunit.client.1.smithi167.stdout:8/560: write dc/d21/f3a [5113475,46727] 0 2024-09-17T01:41:26.829 INFO:tasks.workunit.client.1.smithi167.stdout:4/494: stat d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 0 2024-09-17T01:41:26.830 INFO:tasks.workunit.client.1.smithi167.stdout:8/561: chown dc/ff 46197017 1 2024-09-17T01:41:26.834 INFO:tasks.workunit.client.1.smithi167.stdout:1/454: mknod d0/d9/d16/d48/d54/d78/d90/c98 0 2024-09-17T01:41:26.837 INFO:tasks.workunit.client.0.smithi082.stdout:1/219: truncate f0 1096313 0 2024-09-17T01:41:26.843 INFO:tasks.workunit.client.0.smithi082.stdout:1/220: mkdir d2/df/d46 0 2024-09-17T01:41:26.844 INFO:tasks.workunit.client.1.smithi167.stdout:9/502: symlink d4/d9/d21/d2d/d33/d3a/l95 0 2024-09-17T01:41:26.844 INFO:tasks.workunit.client.1.smithi167.stdout:9/503: readlink d4/d4a/l71 0 2024-09-17T01:41:26.846 INFO:tasks.workunit.client.1.smithi167.stdout:5/391: symlink d0/d9/d1c/l72 0 2024-09-17T01:41:26.846 INFO:tasks.workunit.client.1.smithi167.stdout:9/504: write d4/d9/d21/d2d/d33/d3a/f40 [2668637,4985] 0 2024-09-17T01:41:26.847 INFO:tasks.workunit.client.0.smithi082.stdout:1/221: mkdir d2/da/d2f/d47 0 2024-09-17T01:41:26.848 INFO:tasks.workunit.client.0.smithi082.stdout:1/222: write d2/d3f/d34/f43 [379775,2290] 0 2024-09-17T01:41:26.850 INFO:tasks.workunit.client.1.smithi167.stdout:4/495: read d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 [141751,1093] 0 2024-09-17T01:41:26.852 INFO:tasks.workunit.client.1.smithi167.stdout:7/445: link d0/d2/l7d d0/d2/l8f 0 2024-09-17T01:41:26.853 INFO:tasks.workunit.client.1.smithi167.stdout:8/562: dread dc/d56/f70 [0,4194304] 0 2024-09-17T01:41:26.853 INFO:tasks.workunit.client.0.smithi082.stdout:1/223: truncate d2/da/f35 4601436 0 2024-09-17T01:41:26.854 INFO:tasks.workunit.client.1.smithi167.stdout:8/563: stat dc/d18/la3 0 2024-09-17T01:41:26.854 INFO:tasks.workunit.client.0.smithi082.stdout:5/214: dwrite f6 [0,4194304] 0 2024-09-17T01:41:26.855 INFO:tasks.workunit.client.1.smithi167.stdout:3/468: getdents d7/d8/d2a 0 2024-09-17T01:41:26.855 INFO:tasks.workunit.client.1.smithi167.stdout:3/469: dread - d7/d8/f78 zero size 2024-09-17T01:41:26.856 INFO:tasks.workunit.client.1.smithi167.stdout:0/432: creat d5/d6b/d77/d4d/d56/d7b/f89 x:0 0 0 2024-09-17T01:41:26.857 INFO:tasks.workunit.client.1.smithi167.stdout:5/392: write d0/d28/f52 [235991,22186] 0 2024-09-17T01:41:26.857 INFO:tasks.workunit.client.1.smithi167.stdout:9/505: mknod d4/d9/d21/d43/d6c/c96 0 2024-09-17T01:41:26.858 INFO:tasks.workunit.client.1.smithi167.stdout:1/455: dread d0/d9/d16/d48/f58 [4194304,4194304] 0 2024-09-17T01:41:26.859 INFO:tasks.workunit.client.1.smithi167.stdout:9/506: write d4/f83 [890388,56408] 0 2024-09-17T01:41:26.859 INFO:tasks.workunit.client.0.smithi082.stdout:5/215: mknod db/d1e/d20/c44 0 2024-09-17T01:41:26.860 INFO:tasks.workunit.client.1.smithi167.stdout:1/456: read - d0/d9/d16/d48/d54/d6e/f7b zero size 2024-09-17T01:41:26.861 INFO:tasks.workunit.client.0.smithi082.stdout:1/224: symlink d2/d3f/l48 0 2024-09-17T01:41:26.862 INFO:tasks.workunit.client.1.smithi167.stdout:2/449: getdents d5/d10/d1a/d46 0 2024-09-17T01:41:26.863 INFO:tasks.workunit.client.0.smithi082.stdout:5/216: dread db/d12/d29/f2c [0,4194304] 0 2024-09-17T01:41:26.865 INFO:tasks.workunit.client.1.smithi167.stdout:4/496: creat d0/d4/fa5 x:0 0 0 2024-09-17T01:41:26.865 INFO:tasks.workunit.client.1.smithi167.stdout:6/597: sync 2024-09-17T01:41:26.866 INFO:tasks.workunit.client.0.smithi082.stdout:5/217: mknod db/d1e/d20/d30/c45 0 2024-09-17T01:41:26.867 INFO:tasks.workunit.client.0.smithi082.stdout:5/218: chown db/f2d 0 1 2024-09-17T01:41:26.867 INFO:tasks.workunit.client.1.smithi167.stdout:9/507: dwrite d4/f83 [0,4194304] 0 2024-09-17T01:41:26.867 INFO:tasks.workunit.client.1.smithi167.stdout:6/598: fdatasync d7/d42/f71 0 2024-09-17T01:41:26.868 INFO:tasks.workunit.client.1.smithi167.stdout:8/564: creat dc/d21/d6b/d74/d83/fb7 x:0 0 0 2024-09-17T01:41:26.869 INFO:tasks.workunit.client.1.smithi167.stdout:3/470: mkdir d7/d8/d10/d14/d2c/d93 0 2024-09-17T01:41:26.869 INFO:tasks.workunit.client.1.smithi167.stdout:1/457: dread d0/d9/d16/d36/f53 [0,4194304] 0 2024-09-17T01:41:26.869 INFO:tasks.workunit.client.0.smithi082.stdout:1/225: creat d2/df/d46/f49 x:0 0 0 2024-09-17T01:41:26.869 INFO:tasks.workunit.client.1.smithi167.stdout:4/497: write d0/d4/d7/f67 [1460194,75293] 0 2024-09-17T01:41:26.870 INFO:tasks.workunit.client.0.smithi082.stdout:5/219: mknod db/d1e/d20/d30/c46 0 2024-09-17T01:41:26.871 INFO:tasks.workunit.client.1.smithi167.stdout:3/471: stat d7/d8/d10/d14/d66/d6c 0 2024-09-17T01:41:26.871 INFO:tasks.workunit.client.0.smithi082.stdout:1/226: symlink d2/da/d2f/l4a 0 2024-09-17T01:41:26.872 INFO:tasks.workunit.client.1.smithi167.stdout:5/393: mknod d0/d28/d3a/d44/d69/c73 0 2024-09-17T01:41:26.872 INFO:tasks.workunit.client.1.smithi167.stdout:3/472: write d7/d8/d2a/d7a/f88 [593041,37894] 0 2024-09-17T01:41:26.873 INFO:tasks.workunit.client.1.smithi167.stdout:5/394: fsync d0/d24/f35 0 2024-09-17T01:41:26.874 INFO:tasks.workunit.client.1.smithi167.stdout:9/508: dread d4/d9/f3d [4194304,4194304] 0 2024-09-17T01:41:26.876 INFO:tasks.workunit.client.1.smithi167.stdout:9/509: dread - d4/d9/d21/d43/d6c/f8f zero size 2024-09-17T01:41:26.877 INFO:tasks.workunit.client.1.smithi167.stdout:2/450: rename d5/d3c/d4c/d4d/c66 to d5/d10/d1a/d45/d8e/c9d 0 2024-09-17T01:41:26.880 INFO:tasks.workunit.client.0.smithi082.stdout:1/227: rename d2/d3f/c36 to d2/da/d2f/c4b 0 2024-09-17T01:41:26.880 INFO:tasks.workunit.client.1.smithi167.stdout:3/473: dwrite d7/d8/f4c [0,4194304] 0 2024-09-17T01:41:26.882 INFO:tasks.workunit.client.0.smithi082.stdout:1/228: rmdir d2/da/d2f 39 2024-09-17T01:41:26.884 INFO:tasks.workunit.client.1.smithi167.stdout:0/433: symlink d5/d8/d5c/l8a 0 2024-09-17T01:41:26.890 INFO:tasks.workunit.client.0.smithi082.stdout:1/229: creat d2/da/d2f/f4c x:0 0 0 2024-09-17T01:41:26.892 INFO:tasks.workunit.client.0.smithi082.stdout:1/230: readlink d2/l5 0 2024-09-17T01:41:26.895 INFO:tasks.workunit.client.1.smithi167.stdout:7/446: rmdir d0/d2/d14/d6f/d89 0 2024-09-17T01:41:26.897 INFO:tasks.workunit.client.0.smithi082.stdout:1/231: rename d2/d3f/d34/f43 to d2/da/d2f/d47/f4d 0 2024-09-17T01:41:26.900 INFO:tasks.workunit.client.1.smithi167.stdout:2/451: symlink d5/d6d/l9e 0 2024-09-17T01:41:26.902 INFO:tasks.workunit.client.1.smithi167.stdout:3/474: creat d7/d8/d2a/d4e/f94 x:0 0 0 2024-09-17T01:41:26.902 INFO:tasks.workunit.client.0.smithi082.stdout:1/232: dread d2/da/f33 [0,4194304] 0 2024-09-17T01:41:26.902 INFO:tasks.workunit.client.1.smithi167.stdout:3/475: readlink d7/d8/d2a/l27 0 2024-09-17T01:41:26.903 INFO:tasks.workunit.client.1.smithi167.stdout:0/434: symlink d5/l8b 0 2024-09-17T01:41:26.904 INFO:tasks.workunit.client.1.smithi167.stdout:6/599: symlink d7/d54/d90/ldb 0 2024-09-17T01:41:26.905 INFO:tasks.workunit.client.1.smithi167.stdout:8/565: dwrite dc/fd [4194304,4194304] 0 2024-09-17T01:41:26.905 INFO:tasks.workunit.client.1.smithi167.stdout:1/458: mknod d0/d5/d34/d8a/c99 0 2024-09-17T01:41:26.906 INFO:tasks.workunit.client.1.smithi167.stdout:1/459: dread - d0/d9/d16/d48/d54/d78/f92 zero size 2024-09-17T01:41:26.907 INFO:tasks.workunit.client.0.smithi082.stdout:1/233: mknod d2/d3f/c4e 0 2024-09-17T01:41:26.907 INFO:tasks.workunit.client.1.smithi167.stdout:7/447: rmdir d0/d2/d14/d19/d26/d83 39 2024-09-17T01:41:26.909 INFO:tasks.workunit.client.1.smithi167.stdout:5/395: truncate d0/d24/d2b/d3d/f58 92428 0 2024-09-17T01:41:26.911 INFO:tasks.workunit.client.1.smithi167.stdout:9/510: mkdir d4/d9/d97 0 2024-09-17T01:41:26.912 INFO:tasks.workunit.client.1.smithi167.stdout:2/452: mknod d5/d1f/c9f 0 2024-09-17T01:41:26.913 INFO:tasks.workunit.client.1.smithi167.stdout:2/453: stat d5/d10/d1a/d2e/f4b 0 2024-09-17T01:41:26.915 INFO:tasks.workunit.client.1.smithi167.stdout:3/476: creat d7/d8/d2a/f95 x:0 0 0 2024-09-17T01:41:26.916 INFO:tasks.workunit.client.1.smithi167.stdout:3/477: stat d7/d8/d10/d14/d2c/f6e 0 2024-09-17T01:41:26.916 INFO:tasks.workunit.client.1.smithi167.stdout:3/478: chown d7/d8/d2a/c4a 59931 1 2024-09-17T01:41:26.917 INFO:tasks.workunit.client.1.smithi167.stdout:8/566: stat dc/f36 0 2024-09-17T01:41:26.918 INFO:tasks.workunit.client.1.smithi167.stdout:8/567: chown dc/fd 1762231 1 2024-09-17T01:41:26.919 INFO:tasks.workunit.client.1.smithi167.stdout:8/568: dread - dc/d1a/f86 zero size 2024-09-17T01:41:26.919 INFO:tasks.workunit.client.0.smithi082.stdout:1/234: getdents d2/da/d2f 0 2024-09-17T01:41:26.919 INFO:tasks.workunit.client.1.smithi167.stdout:0/435: dread d5/d6b/d77/d37/f65 [0,4194304] 0 2024-09-17T01:41:26.924 INFO:tasks.workunit.client.1.smithi167.stdout:8/569: dread dc/d56/d57/f8a [0,4194304] 0 2024-09-17T01:41:26.924 INFO:tasks.workunit.client.1.smithi167.stdout:9/511: creat d4/d9/d21/d2d/d33/d3a/f98 x:0 0 0 2024-09-17T01:41:26.925 INFO:tasks.workunit.client.1.smithi167.stdout:9/512: read - d4/d9/d21/d2d/d33/d3a/f3f zero size 2024-09-17T01:41:26.926 INFO:tasks.workunit.client.1.smithi167.stdout:9/513: write d4/f4e [3396922,9909] 0 2024-09-17T01:41:26.927 INFO:tasks.workunit.client.0.smithi082.stdout:1/235: link d2/da/d2f/d47/f4d d2/d3f/d24/f4f 0 2024-09-17T01:41:26.927 INFO:tasks.workunit.client.1.smithi167.stdout:9/514: write d4/d9/d21/f2f [4879397,90266] 0 2024-09-17T01:41:26.927 INFO:tasks.workunit.client.1.smithi167.stdout:4/498: link d0/d4/d7/da/d48/d40/d51/c8a d0/d4/d7/d6/d5d/da2/ca6 0 2024-09-17T01:41:26.927 INFO:tasks.workunit.client.1.smithi167.stdout:9/515: readlink d4/l51 0 2024-09-17T01:41:26.928 INFO:tasks.workunit.client.0.smithi082.stdout:1/236: rmdir d2/df 39 2024-09-17T01:41:26.929 INFO:tasks.workunit.client.1.smithi167.stdout:9/516: fdatasync d4/d9/d21/d2d/d33/d3a/f3f 0 2024-09-17T01:41:26.929 INFO:tasks.workunit.client.1.smithi167.stdout:0/436: creat d5/d6b/d77/d37/d45/f8c x:0 0 0 2024-09-17T01:41:26.930 INFO:tasks.workunit.client.1.smithi167.stdout:9/517: write d4/d9/d21/f60 [4284421,3031] 0 2024-09-17T01:41:26.930 INFO:tasks.workunit.client.0.smithi082.stdout:1/237: creat d2/da/d2f/d47/f50 x:0 0 0 2024-09-17T01:41:26.934 INFO:tasks.workunit.client.0.smithi082.stdout:1/238: fsync d2/da/f35 0 2024-09-17T01:41:26.935 INFO:tasks.workunit.client.1.smithi167.stdout:7/448: creat d0/d2/d14/d19/d22/d40/f90 x:0 0 0 2024-09-17T01:41:26.935 INFO:tasks.workunit.client.1.smithi167.stdout:1/460: creat d0/d9/d16/d48/d54/d6e/d7e/f9a x:0 0 0 2024-09-17T01:41:26.936 INFO:tasks.workunit.client.1.smithi167.stdout:2/454: truncate d5/d1f/f26 3124175 0 2024-09-17T01:41:26.936 INFO:tasks.workunit.client.1.smithi167.stdout:9/518: chown d4/d4a/c52 0 1 2024-09-17T01:41:26.938 INFO:tasks.workunit.client.0.smithi082.stdout:1/239: creat d2/da/d2f/d47/f51 x:0 0 0 2024-09-17T01:41:26.938 INFO:tasks.workunit.client.1.smithi167.stdout:1/461: truncate d0/d9/d16/d48/d54/d6e/d7e/f9a 953298 0 2024-09-17T01:41:26.939 INFO:tasks.workunit.client.0.smithi082.stdout:1/240: read d2/da/f33 [321392,18169] 0 2024-09-17T01:41:26.939 INFO:tasks.workunit.client.1.smithi167.stdout:3/479: symlink d7/d8/d10/d14/l96 0 2024-09-17T01:41:26.940 INFO:tasks.workunit.client.1.smithi167.stdout:4/499: symlink d0/d4/d7/d10/d70/la7 0 2024-09-17T01:41:26.941 INFO:tasks.workunit.client.1.smithi167.stdout:4/500: write d0/d4/d7/da/f6e [829895,80145] 0 2024-09-17T01:41:26.947 INFO:tasks.workunit.client.0.smithi082.stdout:1/241: link d2/da/f35 d2/df/d46/f52 0 2024-09-17T01:41:26.949 INFO:tasks.workunit.client.1.smithi167.stdout:4/501: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:26.950 INFO:tasks.workunit.client.0.smithi082.stdout:1/242: creat d2/da/d2f/d47/f53 x:0 0 0 2024-09-17T01:41:26.952 INFO:tasks.workunit.client.1.smithi167.stdout:5/396: creat d0/d24/d2b/d3d/f74 x:0 0 0 2024-09-17T01:41:26.952 INFO:tasks.workunit.client.1.smithi167.stdout:5/397: chown d0/d24/d2b 13 1 2024-09-17T01:41:26.953 INFO:tasks.workunit.client.0.smithi082.stdout:1/243: mkdir d2/d3f/d24/d54 0 2024-09-17T01:41:26.954 INFO:tasks.workunit.client.1.smithi167.stdout:8/570: link dc/d21/d6b/f78 dc/dae/fb8 0 2024-09-17T01:41:26.956 INFO:tasks.workunit.client.1.smithi167.stdout:9/519: creat d4/d9/d21/d43/d6c/f99 x:0 0 0 2024-09-17T01:41:26.958 INFO:tasks.workunit.client.1.smithi167.stdout:2/455: rename d5/d3c/f69 to d5/d10/d1a/d45/d8e/fa0 0 2024-09-17T01:41:26.958 INFO:tasks.workunit.client.0.smithi082.stdout:1/244: dwrite d2/da/d2f/f31 [0,4194304] 0 2024-09-17T01:41:26.959 INFO:tasks.workunit.client.1.smithi167.stdout:1/462: symlink d0/d5/d34/d6d/l9b 0 2024-09-17T01:41:26.959 INFO:tasks.workunit.client.1.smithi167.stdout:3/480: rmdir d7/d8/d10/d14/d25 39 2024-09-17T01:41:26.961 INFO:tasks.workunit.client.1.smithi167.stdout:6/600: getdents d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56 0 2024-09-17T01:41:26.965 INFO:tasks.workunit.client.1.smithi167.stdout:7/449: symlink d0/d2/l91 0 2024-09-17T01:41:26.968 INFO:tasks.workunit.client.0.smithi082.stdout:1/245: truncate d2/df/d46/f52 1727194 0 2024-09-17T01:41:26.969 INFO:tasks.workunit.client.1.smithi167.stdout:3/481: dwrite d7/d8/d10/d29/f87 [0,4194304] 0 2024-09-17T01:41:26.970 INFO:tasks.workunit.client.1.smithi167.stdout:4/502: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 [0,4194304] 0 2024-09-17T01:41:26.970 INFO:tasks.workunit.client.1.smithi167.stdout:1/463: symlink d0/d5/d34/d6d/l9c 0 2024-09-17T01:41:26.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/246: rename d2/c28 to d2/df/d46/c55 0 2024-09-17T01:41:26.974 INFO:tasks.workunit.client.1.smithi167.stdout:1/464: dread d0/d9/d16/d48/d54/f64 [4194304,4194304] 0 2024-09-17T01:41:26.978 INFO:tasks.workunit.client.1.smithi167.stdout:1/465: dread d0/d9/d16/d48/f58 [4194304,4194304] 0 2024-09-17T01:41:26.979 INFO:tasks.workunit.client.1.smithi167.stdout:1/466: read d0/d9/d16/d48/f58 [4439670,101343] 0 2024-09-17T01:41:26.980 INFO:tasks.workunit.client.1.smithi167.stdout:6/601: mknod d7/d54/d90/d13/d2f/d64/d6b/cdc 0 2024-09-17T01:41:26.985 INFO:tasks.workunit.client.1.smithi167.stdout:7/450: creat d0/d2/d14/d19/d32/f92 x:0 0 0 2024-09-17T01:41:26.986 INFO:tasks.workunit.client.1.smithi167.stdout:2/456: symlink d5/d10/d1a/d2e/la1 0 2024-09-17T01:41:26.987 INFO:tasks.workunit.client.1.smithi167.stdout:5/398: rename d0/d24/d2b/d3d/f58 to d0/d54/f75 0 2024-09-17T01:41:26.990 INFO:tasks.workunit.client.1.smithi167.stdout:1/467: mknod d0/d9/d16/d36/c9d 0 2024-09-17T01:41:26.990 INFO:tasks.workunit.client.1.smithi167.stdout:0/437: getdents d5/d8/d9 0 2024-09-17T01:41:26.992 INFO:tasks.workunit.client.1.smithi167.stdout:1/468: fdatasync d0/d9/d16/d22/f84 0 2024-09-17T01:41:26.993 INFO:tasks.workunit.client.1.smithi167.stdout:3/482: rename d7/d1e/f3c to d7/d8/d10/d14/d24/f97 0 2024-09-17T01:41:26.994 INFO:tasks.workunit.client.1.smithi167.stdout:4/503: dread d0/d4/d7/da/f2c [0,4194304] 0 2024-09-17T01:41:26.995 INFO:tasks.workunit.client.1.smithi167.stdout:5/399: creat d0/d54/f76 x:0 0 0 2024-09-17T01:41:26.996 INFO:tasks.workunit.client.1.smithi167.stdout:7/451: dwrite d0/d2/d88/d6e/f71 [0,4194304] 0 2024-09-17T01:41:26.996 INFO:tasks.workunit.client.1.smithi167.stdout:0/438: rmdir d5/d8/d5c 39 2024-09-17T01:41:26.996 INFO:tasks.workunit.client.1.smithi167.stdout:3/483: chown d7/d8/d10/c55 2708716 1 2024-09-17T01:41:26.996 INFO:tasks.workunit.client.1.smithi167.stdout:1/469: dread - d0/d9/d16/d48/d54/d6e/f7b zero size 2024-09-17T01:41:27.000 INFO:tasks.workunit.client.1.smithi167.stdout:0/439: symlink d5/d8/d9/d2f/l8d 0 2024-09-17T01:41:27.001 INFO:tasks.workunit.client.1.smithi167.stdout:5/400: read d0/d24/f38 [178810,95494] 0 2024-09-17T01:41:27.001 INFO:tasks.workunit.client.1.smithi167.stdout:4/504: dread d0/d4/d7/da/d48/d40/d51/d2d/f61 [0,4194304] 0 2024-09-17T01:41:27.002 INFO:tasks.workunit.client.1.smithi167.stdout:3/484: creat d7/d8/d10/d29/f98 x:0 0 0 2024-09-17T01:41:27.008 INFO:tasks.workunit.client.1.smithi167.stdout:0/440: creat d5/d6b/d77/d6d/f8e x:0 0 0 2024-09-17T01:41:27.008 INFO:tasks.workunit.client.1.smithi167.stdout:5/401: truncate d0/d24/d2b/d4e/f70 235753 0 2024-09-17T01:41:27.009 INFO:tasks.workunit.client.1.smithi167.stdout:8/571: dwrite dc/d21/d61/f6f [0,4194304] 0 2024-09-17T01:41:27.009 INFO:tasks.workunit.client.1.smithi167.stdout:4/505: readlink d0/d4/d7/da/d48/l9a 0 2024-09-17T01:41:27.012 INFO:tasks.workunit.client.1.smithi167.stdout:3/485: mknod d7/d8/d2a/c99 0 2024-09-17T01:41:27.013 INFO:tasks.workunit.client.0.smithi082.stdout:1/247: dwrite d2/da/f33 [0,4194304] 0 2024-09-17T01:41:27.014 INFO:tasks.workunit.client.1.smithi167.stdout:9/520: dwrite d4/d9/f3d [0,4194304] 0 2024-09-17T01:41:27.016 INFO:tasks.workunit.client.0.smithi082.stdout:1/248: rmdir d2/d3f/d34 39 2024-09-17T01:41:27.021 INFO:tasks.workunit.client.1.smithi167.stdout:0/441: read d5/d8/d9/f35 [43524,130897] 0 2024-09-17T01:41:27.022 INFO:tasks.workunit.client.1.smithi167.stdout:4/506: mkdir d0/d4/d7/d6/d2b/d6d/d7e/da8 0 2024-09-17T01:41:27.024 INFO:tasks.workunit.client.0.smithi082.stdout:1/249: dwrite d2/da/d2d/f45 [0,4194304] 0 2024-09-17T01:41:27.025 INFO:tasks.workunit.client.1.smithi167.stdout:7/452: link d0/d2/d14/d19/f77 d0/d2/d14/d6f/d87/f93 0 2024-09-17T01:41:27.025 INFO:tasks.workunit.client.1.smithi167.stdout:8/572: dwrite f8 [4194304,4194304] 0 2024-09-17T01:41:27.026 INFO:tasks.workunit.client.0.smithi082.stdout:1/250: unlink d2/da/d2d/f2e 0 2024-09-17T01:41:27.027 INFO:tasks.workunit.client.0.smithi082.stdout:1/251: fsync d2/da/d2f/f4c 0 2024-09-17T01:41:27.027 INFO:tasks.workunit.client.1.smithi167.stdout:6/602: dread d7/d54/d90/d13/d2f/d7f/f86 [0,4194304] 0 2024-09-17T01:41:27.029 INFO:tasks.workunit.client.0.smithi082.stdout:0/167: sync 2024-09-17T01:41:27.030 INFO:tasks.workunit.client.0.smithi082.stdout:1/252: creat d2/da/f56 x:0 0 0 2024-09-17T01:41:27.030 INFO:tasks.workunit.client.1.smithi167.stdout:8/573: fdatasync dc/f17 0 2024-09-17T01:41:27.030 INFO:tasks.workunit.client.0.smithi082.stdout:1/253: chown d2/l21 0 1 2024-09-17T01:41:27.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/168: rmdir da/d1b 39 2024-09-17T01:41:27.031 INFO:tasks.workunit.client.1.smithi167.stdout:0/442: chown d5/d8/d9/d2f/f72 0 1 2024-09-17T01:41:27.033 INFO:tasks.workunit.client.0.smithi082.stdout:0/169: mknod da/d1e/c3a 0 2024-09-17T01:41:27.035 INFO:tasks.workunit.client.0.smithi082.stdout:1/254: creat d2/da/d16/f57 x:0 0 0 2024-09-17T01:41:27.035 INFO:tasks.workunit.client.1.smithi167.stdout:7/453: write d0/d2/d14/d19/d26/f78 [1033770,54196] 0 2024-09-17T01:41:27.036 INFO:tasks.workunit.client.1.smithi167.stdout:6/603: chown d7/d54/d90/d13/d2f/d30/fa7 3450835 1 2024-09-17T01:41:27.036 INFO:tasks.workunit.client.0.smithi082.stdout:1/255: write d2/da/f37 [582228,13862] 0 2024-09-17T01:41:27.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/256: truncate d2/d3f/d24/f4f 976779 0 2024-09-17T01:41:27.039 INFO:tasks.workunit.client.1.smithi167.stdout:0/443: write d5/d6b/f5d [114005,108920] 0 2024-09-17T01:41:27.039 INFO:tasks.workunit.client.1.smithi167.stdout:5/402: dwrite d0/f14 [0,4194304] 0 2024-09-17T01:41:27.040 INFO:tasks.workunit.client.1.smithi167.stdout:5/403: readlink d0/d24/d2b/d3d/l40 0 2024-09-17T01:41:27.042 INFO:tasks.workunit.client.1.smithi167.stdout:9/521: creat d4/d9/f9a x:0 0 0 2024-09-17T01:41:27.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/257: dread d2/da/d2f/f31 [0,4194304] 0 2024-09-17T01:41:27.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/258: readlink d2/l21 0 2024-09-17T01:41:27.044 INFO:tasks.workunit.client.1.smithi167.stdout:9/522: chown d4/d9/d21/d2d/d33/d3a/f67 11 1 2024-09-17T01:41:27.047 INFO:tasks.workunit.client.1.smithi167.stdout:5/404: unlink d0/d9/f33 0 2024-09-17T01:41:27.049 INFO:tasks.workunit.client.1.smithi167.stdout:8/574: dread fb [0,4194304] 0 2024-09-17T01:41:27.051 INFO:tasks.workunit.client.1.smithi167.stdout:5/405: symlink d0/d24/d2b/d49/d4b/l77 0 2024-09-17T01:41:27.052 INFO:tasks.workunit.client.0.smithi082.stdout:1/259: creat d2/da/f58 x:0 0 0 2024-09-17T01:41:27.053 INFO:tasks.workunit.client.1.smithi167.stdout:4/507: rename d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/c9d to d0/ca9 0 2024-09-17T01:41:27.054 INFO:tasks.workunit.client.1.smithi167.stdout:9/523: symlink d4/d9/d2b/l9b 0 2024-09-17T01:41:27.055 INFO:tasks.workunit.client.1.smithi167.stdout:9/524: fdatasync d4/f4e 0 2024-09-17T01:41:27.056 INFO:tasks.workunit.client.1.smithi167.stdout:5/406: creat d0/d28/d3a/f78 x:0 0 0 2024-09-17T01:41:27.058 INFO:tasks.workunit.client.1.smithi167.stdout:7/454: rename d0/d2/d14/c45 to d0/d2/d14/d6f/d87/c94 0 2024-09-17T01:41:27.059 INFO:tasks.workunit.client.0.smithi082.stdout:1/260: rename d2/da/f1f to d2/d3f/d34/f59 0 2024-09-17T01:41:27.061 INFO:tasks.workunit.client.1.smithi167.stdout:9/525: mkdir d4/d9/d21/d2d/d33/d3a/d9c 0 2024-09-17T01:41:27.062 INFO:tasks.workunit.client.1.smithi167.stdout:9/526: fsync d4/d9/d21/d43/f69 0 2024-09-17T01:41:27.064 INFO:tasks.workunit.client.1.smithi167.stdout:5/407: rename d0/l29 to d0/d24/d2b/d49/d66/l79 0 2024-09-17T01:41:27.064 INFO:tasks.workunit.client.1.smithi167.stdout:7/455: fdatasync d0/d2/d14/d19/d22/d40/f4a 0 2024-09-17T01:41:27.065 INFO:tasks.workunit.client.0.smithi082.stdout:1/261: creat d2/d3f/f5a x:0 0 0 2024-09-17T01:41:27.066 INFO:tasks.workunit.client.0.smithi082.stdout:1/262: readlink d2/l2b 0 2024-09-17T01:41:27.066 INFO:tasks.workunit.client.0.smithi082.stdout:1/263: fdatasync d2/f10 0 2024-09-17T01:41:27.067 INFO:tasks.workunit.client.0.smithi082.stdout:1/264: fsync d2/f10 0 2024-09-17T01:41:27.068 INFO:tasks.workunit.client.0.smithi082.stdout:1/265: readlink d2/da/l3a 0 2024-09-17T01:41:27.068 INFO:tasks.workunit.client.1.smithi167.stdout:9/527: creat d4/d9/d21/d43/d6c/f9d x:0 0 0 2024-09-17T01:41:27.069 INFO:tasks.workunit.client.1.smithi167.stdout:5/408: chown d0/d28/l3c 435799892 1 2024-09-17T01:41:27.069 INFO:tasks.workunit.client.0.smithi082.stdout:1/266: stat d2/da/d2f/d47/f50 0 2024-09-17T01:41:27.069 INFO:tasks.workunit.client.0.smithi082.stdout:1/267: chown f0 401 1 2024-09-17T01:41:27.069 INFO:tasks.workunit.client.1.smithi167.stdout:7/456: mknod d0/d55/d70/c95 0 2024-09-17T01:41:27.071 INFO:tasks.workunit.client.1.smithi167.stdout:4/508: creat d0/d4/d7/da/d48/d40/d51/d2d/d2e/faa x:0 0 0 2024-09-17T01:41:27.072 INFO:tasks.workunit.client.1.smithi167.stdout:9/528: mkdir d4/d9/d21/d43/d6c/d9e 0 2024-09-17T01:41:27.073 INFO:tasks.workunit.client.0.smithi082.stdout:1/268: symlink d2/d3f/d24/l5b 0 2024-09-17T01:41:27.076 INFO:tasks.workunit.client.1.smithi167.stdout:7/457: rename d0/f3f to d0/d2/d88/f96 0 2024-09-17T01:41:27.076 INFO:tasks.workunit.client.1.smithi167.stdout:4/509: rename d0/d4 to d0/d4/d7/d6/d5d/da2/dab 22 2024-09-17T01:41:27.076 INFO:tasks.workunit.client.1.smithi167.stdout:9/529: rmdir d4/d9/d21/d43 39 2024-09-17T01:41:27.084 INFO:tasks.workunit.client.1.smithi167.stdout:7/458: symlink d0/d2/d14/d19/d26/d83/l97 0 2024-09-17T01:41:27.085 INFO:tasks.workunit.client.1.smithi167.stdout:6/604: truncate d7/d54/d90/d13/d2f/d64/d6b/fa5 3590101 0 2024-09-17T01:41:27.086 INFO:tasks.workunit.client.1.smithi167.stdout:5/409: getdents d0/d54 0 2024-09-17T01:41:27.087 INFO:tasks.workunit.client.1.smithi167.stdout:5/410: write d0/d24/f35 [1004553,114076] 0 2024-09-17T01:41:27.088 INFO:tasks.workunit.client.1.smithi167.stdout:7/459: mknod d0/d2/d88/c98 0 2024-09-17T01:41:27.089 INFO:tasks.workunit.client.1.smithi167.stdout:7/460: truncate d0/d2/d14/d19/d32/f92 486392 0 2024-09-17T01:41:27.090 INFO:tasks.workunit.client.1.smithi167.stdout:6/605: fdatasync d7/d54/d90/d13/d2f/d7f/f86 0 2024-09-17T01:41:27.090 INFO:tasks.workunit.client.1.smithi167.stdout:7/461: dread - d0/d2/d14/d19/d22/d40/f90 zero size 2024-09-17T01:41:27.092 INFO:tasks.workunit.client.1.smithi167.stdout:4/510: getdents d0/d4/d7 0 2024-09-17T01:41:27.093 INFO:tasks.workunit.client.1.smithi167.stdout:4/511: dread - d0/d4/d7/da/d48/d40/d51/d2d/d2e/faa zero size 2024-09-17T01:41:27.094 INFO:tasks.workunit.client.1.smithi167.stdout:9/530: creat d4/d9/d21/d2d/d33/d80/f9f x:0 0 0 2024-09-17T01:41:27.097 INFO:tasks.workunit.client.1.smithi167.stdout:7/462: mknod d0/d2/d14/d19/d22/d40/c99 0 2024-09-17T01:41:27.100 INFO:tasks.workunit.client.1.smithi167.stdout:4/512: mkdir d0/d4/d7/da/d48/d40/d51/d2d/dac 0 2024-09-17T01:41:27.100 INFO:tasks.workunit.client.1.smithi167.stdout:4/513: chown d0/d4/d7/d6/d2b/d6d/d7e/f94 1556 1 2024-09-17T01:41:27.101 INFO:tasks.workunit.client.1.smithi167.stdout:9/531: creat d4/d9/d21/d2d/d33/d3a/fa0 x:0 0 0 2024-09-17T01:41:27.102 INFO:tasks.workunit.client.1.smithi167.stdout:6/606: unlink d7/d54/d90/d13/d2f/d96/faf 0 2024-09-17T01:41:27.103 INFO:tasks.workunit.client.1.smithi167.stdout:6/607: fsync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f87 0 2024-09-17T01:41:27.103 INFO:tasks.workunit.client.1.smithi167.stdout:5/411: creat d0/d9/f7a x:0 0 0 2024-09-17T01:41:27.105 INFO:tasks.workunit.client.1.smithi167.stdout:7/463: symlink d0/d2/d88/d6e/l9a 0 2024-09-17T01:41:27.105 INFO:tasks.workunit.client.1.smithi167.stdout:5/412: truncate d0/d24/d2b/d3d/f4f 621869 0 2024-09-17T01:41:27.106 INFO:tasks.workunit.client.1.smithi167.stdout:5/413: truncate d0/d54/f76 764332 0 2024-09-17T01:41:27.107 INFO:tasks.workunit.client.1.smithi167.stdout:5/414: dread - d0/d24/f62 zero size 2024-09-17T01:41:27.107 INFO:tasks.workunit.client.1.smithi167.stdout:4/514: mkdir d0/d4/d7/da/d48/d40/dad 0 2024-09-17T01:41:27.108 INFO:tasks.workunit.client.0.smithi082.stdout:1/269: write d2/df/d46/f52 [2002712,17221] 0 2024-09-17T01:41:27.111 INFO:tasks.workunit.client.1.smithi167.stdout:7/464: rename d0/d2/d14/d19/d22/d40/f4a to d0/d2/d14/d4c/f9b 0 2024-09-17T01:41:27.112 INFO:tasks.workunit.client.0.smithi082.stdout:1/270: symlink d2/d3f/d24/l5c 0 2024-09-17T01:41:27.113 INFO:tasks.workunit.client.1.smithi167.stdout:7/465: chown d0/d2/d88/f6c 20 1 2024-09-17T01:41:27.113 INFO:tasks.workunit.client.1.smithi167.stdout:4/515: dwrite d0/d4/d7/f23 [0,4194304] 0 2024-09-17T01:41:27.113 INFO:tasks.workunit.client.1.smithi167.stdout:9/532: truncate d4/d9/d21/d43/d47/f68 1206602 0 2024-09-17T01:41:27.115 INFO:tasks.workunit.client.1.smithi167.stdout:4/516: write d0/d4/d7/d6/d2b/f7d [272460,78595] 0 2024-09-17T01:41:27.115 INFO:tasks.workunit.client.1.smithi167.stdout:6/608: creat d7/d54/d90/dd5/fdd x:0 0 0 2024-09-17T01:41:27.118 INFO:tasks.workunit.client.1.smithi167.stdout:5/415: symlink d0/d9/d64/l7b 0 2024-09-17T01:41:27.119 INFO:tasks.workunit.client.1.smithi167.stdout:6/609: write d7/fae [391280,77771] 0 2024-09-17T01:41:27.122 INFO:tasks.workunit.client.1.smithi167.stdout:5/416: write d0/d28/f5b [720917,36329] 0 2024-09-17T01:41:27.124 INFO:tasks.workunit.client.1.smithi167.stdout:4/517: creat d0/d4/d7/da/d48/d40/dad/fae x:0 0 0 2024-09-17T01:41:27.124 INFO:tasks.workunit.client.1.smithi167.stdout:9/533: dwrite d4/d9/d21/d43/d6c/f8f [0,4194304] 0 2024-09-17T01:41:27.129 INFO:tasks.workunit.client.1.smithi167.stdout:9/534: mkdir d4/d9/d21/d43/d6c/d9e/da1 0 2024-09-17T01:41:27.130 INFO:tasks.workunit.client.1.smithi167.stdout:9/535: write d4/d9/d21/d43/d6c/f8f [1793416,4713] 0 2024-09-17T01:41:27.131 INFO:tasks.workunit.client.1.smithi167.stdout:9/536: chown d4/f38 896 1 2024-09-17T01:41:27.132 INFO:tasks.workunit.client.1.smithi167.stdout:9/537: write d4/f18 [6869078,17214] 0 2024-09-17T01:41:27.133 INFO:tasks.workunit.client.1.smithi167.stdout:9/538: chown d4/d9/l35 101141 1 2024-09-17T01:41:27.138 INFO:tasks.workunit.client.1.smithi167.stdout:9/539: read d4/d9/d21/d43/d47/f82 [2355101,69462] 0 2024-09-17T01:41:27.139 INFO:tasks.workunit.client.1.smithi167.stdout:4/518: write d0/d4/d7/da/d48/d40/d51/d2d/d2e/f34 [2785596,10063] 0 2024-09-17T01:41:27.142 INFO:tasks.workunit.client.1.smithi167.stdout:2/457: sync 2024-09-17T01:41:27.143 INFO:tasks.workunit.client.1.smithi167.stdout:9/540: creat d4/d9/d21/d43/d6c/fa2 x:0 0 0 2024-09-17T01:41:27.143 INFO:tasks.workunit.client.1.smithi167.stdout:7/466: dwrite d0/d2/d14/d19/f77 [0,4194304] 0 2024-09-17T01:41:27.143 INFO:tasks.workunit.client.1.smithi167.stdout:6/610: dwrite d7/d52/d79/da4/fce [4194304,4194304] 0 2024-09-17T01:41:27.144 INFO:tasks.workunit.client.1.smithi167.stdout:2/458: fsync d5/d3c/f81 0 2024-09-17T01:41:27.145 INFO:tasks.workunit.client.1.smithi167.stdout:9/541: chown d4/d9/d2b/f7a 127 1 2024-09-17T01:41:27.146 INFO:tasks.workunit.client.1.smithi167.stdout:9/542: stat d4/d9/d21/f60 0 2024-09-17T01:41:27.146 INFO:tasks.workunit.client.1.smithi167.stdout:9/543: readlink d4/d9/d2b/l73 0 2024-09-17T01:41:27.147 INFO:tasks.workunit.client.1.smithi167.stdout:6/611: write d7/d54/d90/d13/d2f/d30/fc9 [408935,29015] 0 2024-09-17T01:41:27.152 INFO:tasks.workunit.client.1.smithi167.stdout:6/612: readlink d7/ld 0 2024-09-17T01:41:27.152 INFO:tasks.workunit.client.1.smithi167.stdout:9/544: mkdir d4/d9/d2b/da3 0 2024-09-17T01:41:27.153 INFO:tasks.workunit.client.1.smithi167.stdout:6/613: chown d7/d54/d90/d13/d2f/d7f/d98/d27/c3d 1043738784 1 2024-09-17T01:41:27.154 INFO:tasks.workunit.client.1.smithi167.stdout:7/467: getdents d0/d2 0 2024-09-17T01:41:27.155 INFO:tasks.workunit.client.1.smithi167.stdout:9/545: truncate d4/f16 3431983 0 2024-09-17T01:41:27.160 INFO:tasks.workunit.client.1.smithi167.stdout:9/546: fdatasync d4/d9/d21/d2d/d33/d3a/fa0 0 2024-09-17T01:41:27.160 INFO:tasks.workunit.client.1.smithi167.stdout:7/468: rmdir d0/d2/d14/d19/d32/d62 39 2024-09-17T01:41:27.218 INFO:tasks.workunit.client.1.smithi167.stdout:7/469: mkdir d0/d2/d14/d19/d32/d9c 0 2024-09-17T01:41:27.219 INFO:tasks.workunit.client.1.smithi167.stdout:9/547: truncate d4/d9/d21/d43/d6c/fa2 561535 0 2024-09-17T01:41:27.220 INFO:tasks.workunit.client.1.smithi167.stdout:6/614: dwrite d7/d54/d90/d13/d2f/d7f/d98/f62 [0,4194304] 0 2024-09-17T01:41:27.220 INFO:tasks.workunit.client.1.smithi167.stdout:7/470: dread - d0/d2/d14/f8a zero size 2024-09-17T01:41:27.221 INFO:tasks.workunit.client.1.smithi167.stdout:9/548: mkdir d4/da4 0 2024-09-17T01:41:27.221 INFO:tasks.workunit.client.1.smithi167.stdout:7/471: creat d0/d2/f9d x:0 0 0 2024-09-17T01:41:27.222 INFO:tasks.workunit.client.1.smithi167.stdout:6/615: stat d7/d54/d90/d13/d2f/d7f/d98/d27/c37 0 2024-09-17T01:41:27.222 INFO:tasks.workunit.client.1.smithi167.stdout:9/549: chown d4/d9/d21/d43/c59 2 1 2024-09-17T01:41:27.223 INFO:tasks.workunit.client.1.smithi167.stdout:9/550: chown d4/d9/d2b/c2c 23 1 2024-09-17T01:41:27.225 INFO:tasks.workunit.client.1.smithi167.stdout:4/519: dread d0/f64 [0,4194304] 0 2024-09-17T01:41:27.226 INFO:tasks.workunit.client.1.smithi167.stdout:9/551: mkdir d4/d9/d21/d43/d6c/da5 0 2024-09-17T01:41:27.226 INFO:tasks.workunit.client.1.smithi167.stdout:9/552: chown d4/d9 6132340 1 2024-09-17T01:41:27.229 INFO:tasks.workunit.client.1.smithi167.stdout:4/520: truncate d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f85 1414533 0 2024-09-17T01:41:27.230 INFO:tasks.workunit.client.1.smithi167.stdout:6/616: rename d7/d54/d90/d13/d2f/d7f/f86 to d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fde 0 2024-09-17T01:41:27.231 INFO:tasks.workunit.client.1.smithi167.stdout:6/617: read d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 [682292,123262] 0 2024-09-17T01:41:27.232 INFO:tasks.workunit.client.1.smithi167.stdout:6/618: write d7/d54/d90/d13/f2d [2325201,50553] 0 2024-09-17T01:41:27.234 INFO:tasks.workunit.client.1.smithi167.stdout:6/619: write d7/d54/d90/d13/d2f/d7f/fc5 [851548,105957] 0 2024-09-17T01:41:27.236 INFO:tasks.workunit.client.1.smithi167.stdout:6/620: chown d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1 14093 1 2024-09-17T01:41:27.240 INFO:tasks.workunit.client.1.smithi167.stdout:9/553: truncate d4/d9/d21/d2d/d33/d3a/f67 2903579 0 2024-09-17T01:41:27.243 INFO:tasks.workunit.client.1.smithi167.stdout:6/621: link d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/lbd d7/d54/d90/d13/d2f/d64/d6b/d95/db1/ldf 0 2024-09-17T01:41:27.245 INFO:tasks.workunit.client.1.smithi167.stdout:4/521: truncate d0/d4/d7/da/f4d 3799620 0 2024-09-17T01:41:27.245 INFO:tasks.workunit.client.1.smithi167.stdout:7/472: dwrite d0/d2/f7a [0,4194304] 0 2024-09-17T01:41:27.247 INFO:tasks.workunit.client.1.smithi167.stdout:6/622: chown d7/d54/d90/d13/d2f/d64/fbe 3709893 1 2024-09-17T01:41:27.247 INFO:tasks.workunit.client.1.smithi167.stdout:7/473: dread - d0/f67 zero size 2024-09-17T01:41:27.251 INFO:tasks.workunit.client.1.smithi167.stdout:9/554: dwrite d4/d9/d21/d43/f69 [4194304,4194304] 0 2024-09-17T01:41:27.253 INFO:tasks.workunit.client.1.smithi167.stdout:6/623: creat d7/d52/db7/fe0 x:0 0 0 2024-09-17T01:41:27.256 INFO:tasks.workunit.client.1.smithi167.stdout:1/470: sync 2024-09-17T01:41:27.256 INFO:tasks.workunit.client.1.smithi167.stdout:3/486: sync 2024-09-17T01:41:27.256 INFO:tasks.workunit.client.1.smithi167.stdout:9/555: rmdir d4/d9/d21/d2d/d33/d3a/d74 39 2024-09-17T01:41:27.257 INFO:tasks.workunit.client.1.smithi167.stdout:4/522: dread d0/d4/d7/da/f6e [0,4194304] 0 2024-09-17T01:41:27.257 INFO:tasks.workunit.client.1.smithi167.stdout:7/474: fsync d0/d2/d14/f18 0 2024-09-17T01:41:27.259 INFO:tasks.workunit.client.1.smithi167.stdout:7/475: stat d0/d2/f9d 0 2024-09-17T01:41:27.259 INFO:tasks.workunit.client.1.smithi167.stdout:1/471: unlink d0/d5/d34/d83/c95 0 2024-09-17T01:41:27.260 INFO:tasks.workunit.client.1.smithi167.stdout:6/624: symlink d7/d54/d90/d13/d2f/d7f/d98/le1 0 2024-09-17T01:41:27.264 INFO:tasks.workunit.client.1.smithi167.stdout:3/487: dwrite d7/d8/d2a/d4e/f94 [0,4194304] 0 2024-09-17T01:41:27.265 INFO:tasks.workunit.client.1.smithi167.stdout:9/556: creat d4/d9/d21/d43/d6c/d9e/da1/fa6 x:0 0 0 2024-09-17T01:41:27.269 INFO:tasks.workunit.client.1.smithi167.stdout:3/488: mknod d7/d8/d10/d14/d2c/d7f/c9a 0 2024-09-17T01:41:27.272 INFO:tasks.workunit.client.1.smithi167.stdout:9/557: symlink d4/d9/d21/d43/d6c/la7 0 2024-09-17T01:41:27.275 INFO:tasks.workunit.client.1.smithi167.stdout:7/476: link d0/d2/d14/d4c/c50 d0/d2/d14/d6f/d87/c9e 0 2024-09-17T01:41:27.277 INFO:tasks.workunit.client.1.smithi167.stdout:9/558: symlink d4/d4a/la8 0 2024-09-17T01:41:27.278 INFO:tasks.workunit.client.1.smithi167.stdout:3/489: mkdir d7/d8f/d9b 0 2024-09-17T01:41:27.282 INFO:tasks.workunit.client.1.smithi167.stdout:9/559: rename d4/d9/d21/d81/l79 to d4/la9 0 2024-09-17T01:41:27.283 INFO:tasks.workunit.client.1.smithi167.stdout:7/477: dwrite d0/d2/d14/f18 [0,4194304] 0 2024-09-17T01:41:27.284 INFO:tasks.workunit.client.1.smithi167.stdout:4/523: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:27.286 INFO:tasks.workunit.client.1.smithi167.stdout:9/560: fdatasync d4/d9/d21/d43/f7d 0 2024-09-17T01:41:27.287 INFO:tasks.workunit.client.1.smithi167.stdout:3/490: rename d7/d8/d10/d14/d2c/d93 to d7/d8/d10/d14/d24/d9c 0 2024-09-17T01:41:27.287 INFO:tasks.workunit.client.1.smithi167.stdout:1/472: dread d0/d9/fb [4194304,4194304] 0 2024-09-17T01:41:27.290 INFO:tasks.workunit.client.1.smithi167.stdout:0/444: sync 2024-09-17T01:41:27.290 INFO:tasks.workunit.client.1.smithi167.stdout:7/478: creat d0/d55/d5b/f9f x:0 0 0 2024-09-17T01:41:27.291 INFO:tasks.workunit.client.1.smithi167.stdout:1/473: chown d0/d9/d16/d36/c9d 484138515 1 2024-09-17T01:41:27.292 INFO:tasks.workunit.client.1.smithi167.stdout:0/445: dread - d5/d8/d9/d2f/f72 zero size 2024-09-17T01:41:27.294 INFO:tasks.workunit.client.1.smithi167.stdout:6/625: dwrite d7/d54/d90/d13/d2f/d30/d32/f58 [0,4194304] 0 2024-09-17T01:41:27.296 INFO:tasks.workunit.client.1.smithi167.stdout:9/561: getdents d4/d9/d2b/da3 0 2024-09-17T01:41:27.297 INFO:tasks.workunit.client.1.smithi167.stdout:1/474: creat d0/d5/d34/d3c/f9e x:0 0 0 2024-09-17T01:41:27.300 INFO:tasks.workunit.client.1.smithi167.stdout:4/524: getdents d0/d4/d7/d6/d2b/d6d/d7e 0 2024-09-17T01:41:27.302 INFO:tasks.workunit.client.1.smithi167.stdout:3/491: dread d7/d8/d10/d14/d24/d62/f77 [0,4194304] 0 2024-09-17T01:41:27.305 INFO:tasks.workunit.client.1.smithi167.stdout:7/479: dwrite d0/d2/d14/d19/d26/f85 [0,4194304] 0 2024-09-17T01:41:27.305 INFO:tasks.workunit.client.1.smithi167.stdout:9/562: creat d4/d9/d21/d2d/d33/d3a/d9c/faa x:0 0 0 2024-09-17T01:41:27.306 INFO:tasks.workunit.client.1.smithi167.stdout:4/525: readlink d0/d4/d7/da/d48/d40/d51/d2d/l7c 0 2024-09-17T01:41:27.307 INFO:tasks.workunit.client.1.smithi167.stdout:3/492: chown d7/d8/d10/c50 292 1 2024-09-17T01:41:27.307 INFO:tasks.workunit.client.1.smithi167.stdout:6/626: creat d7/d54/d90/d13/d2f/d7f/d98/d27/fe2 x:0 0 0 2024-09-17T01:41:27.310 INFO:tasks.workunit.client.1.smithi167.stdout:9/563: write d4/d9/f4c [3751731,67843] 0 2024-09-17T01:41:27.312 INFO:tasks.workunit.client.1.smithi167.stdout:3/493: stat d7/d8/d10/c91 0 2024-09-17T01:41:27.312 INFO:tasks.workunit.client.1.smithi167.stdout:0/446: dwrite d5/d6b/d77/f54 [0,4194304] 0 2024-09-17T01:41:27.315 INFO:tasks.workunit.client.1.smithi167.stdout:0/447: chown d5/d6b/d77/d37/d80 214 1 2024-09-17T01:41:27.316 INFO:tasks.workunit.client.1.smithi167.stdout:6/627: mkdir d7/d54/d90/d13/d2f/d96/dab/de3 0 2024-09-17T01:41:27.316 INFO:tasks.workunit.client.1.smithi167.stdout:4/526: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/laf 0 2024-09-17T01:41:27.319 INFO:tasks.workunit.client.1.smithi167.stdout:7/480: rename d0/d2/d14/d19/d22/d40/f90 to d0/d2/d14/d6f/fa0 0 2024-09-17T01:41:27.320 INFO:tasks.workunit.client.1.smithi167.stdout:9/564: rmdir d4/d9/d21/d2d/d33/d3a/d9c 39 2024-09-17T01:41:27.321 INFO:tasks.workunit.client.1.smithi167.stdout:4/527: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 21664142 1 2024-09-17T01:41:27.324 INFO:tasks.workunit.client.1.smithi167.stdout:0/448: dwrite d5/d6b/d77/f54 [0,4194304] 0 2024-09-17T01:41:27.324 INFO:tasks.workunit.client.1.smithi167.stdout:1/475: truncate d0/d9/d16/d48/d54/f60 127465 0 2024-09-17T01:41:27.328 INFO:tasks.workunit.client.1.smithi167.stdout:7/481: symlink d0/d2/d14/d19/la1 0 2024-09-17T01:41:27.328 INFO:tasks.workunit.client.1.smithi167.stdout:6/628: dwrite d7/d54/d90/d13/d2f/d30/d32/f58 [0,4194304] 0 2024-09-17T01:41:27.330 INFO:tasks.workunit.client.1.smithi167.stdout:0/449: unlink d5/d6b/d77/d4d/l28 0 2024-09-17T01:41:27.332 INFO:tasks.workunit.client.1.smithi167.stdout:6/629: write d7/d54/d90/d13/d2f/d7f/fc5 [1773448,33249] 0 2024-09-17T01:41:27.334 INFO:tasks.workunit.client.1.smithi167.stdout:7/482: fdatasync d0/d2/f41 0 2024-09-17T01:41:27.335 INFO:tasks.workunit.client.1.smithi167.stdout:8/575: sync 2024-09-17T01:41:27.335 INFO:tasks.workunit.client.1.smithi167.stdout:2/459: sync 2024-09-17T01:41:27.337 INFO:tasks.workunit.client.1.smithi167.stdout:5/417: sync 2024-09-17T01:41:27.338 INFO:tasks.workunit.client.1.smithi167.stdout:4/528: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [12582912,4194304] 0 2024-09-17T01:41:27.341 INFO:tasks.workunit.client.1.smithi167.stdout:8/576: chown dc/d1a/f52 0 1 2024-09-17T01:41:27.342 INFO:tasks.workunit.client.1.smithi167.stdout:7/483: write d0/d2/d14/f18 [3759354,127322] 0 2024-09-17T01:41:27.342 INFO:tasks.workunit.client.1.smithi167.stdout:6/630: unlink d7/d54/d90/d13/d2f/d96/dab/l36 0 2024-09-17T01:41:27.346 INFO:tasks.workunit.client.1.smithi167.stdout:2/460: symlink d5/d10/d1a/d2e/la2 0 2024-09-17T01:41:27.349 INFO:tasks.workunit.client.1.smithi167.stdout:1/476: dread d0/d5/d34/d3c/d74/f75 [0,4194304] 0 2024-09-17T01:41:27.353 INFO:tasks.workunit.client.0.smithi082.stdout:4/245: sync 2024-09-17T01:41:27.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/304: sync 2024-09-17T01:41:27.353 INFO:tasks.workunit.client.0.smithi082.stdout:3/167: sync 2024-09-17T01:41:27.353 INFO:tasks.workunit.client.0.smithi082.stdout:0/170: sync 2024-09-17T01:41:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:5/220: sync 2024-09-17T01:41:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:8/207: sync 2024-09-17T01:41:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:7/253: sync 2024-09-17T01:41:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:9/199: sync 2024-09-17T01:41:27.354 INFO:tasks.workunit.client.0.smithi082.stdout:1/271: sync 2024-09-17T01:41:27.355 INFO:tasks.workunit.client.0.smithi082.stdout:2/200: sync 2024-09-17T01:41:27.356 INFO:tasks.workunit.client.1.smithi167.stdout:3/494: dwrite d7/d1e/f4f [0,4194304] 0 2024-09-17T01:41:27.357 INFO:tasks.workunit.client.0.smithi082.stdout:0/171: rmdir da 39 2024-09-17T01:41:27.357 INFO:tasks.workunit.client.0.smithi082.stdout:4/246: stat d9/d15/d16/c2a 0 2024-09-17T01:41:27.358 INFO:tasks.workunit.client.1.smithi167.stdout:9/565: dwrite d4/f83 [4194304,4194304] 0 2024-09-17T01:41:27.358 INFO:tasks.workunit.client.1.smithi167.stdout:6/631: fsync d7/d54/d90/d13/d2f/d64/d6b/fa5 0 2024-09-17T01:41:27.359 INFO:tasks.workunit.client.1.smithi167.stdout:4/529: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 [4194304,4194304] 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.1.smithi167.stdout:5/418: dwrite d0/f47 [4194304,4194304] 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:7/254: write d0/d3/db/d10/f27 [1274884,3019] 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:9/200: write d4/d27/d2d/d3d/f47 [956073,59753] 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/221: fdatasync db/d12/d18/f40 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:2/201: symlink d1/d17/l39 0 2024-09-17T01:41:27.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/222: readlink db/d12/l13 0 2024-09-17T01:41:27.366 INFO:tasks.workunit.client.0.smithi082.stdout:9/201: fdatasync d4/d27/d21/d2e/f16 0 2024-09-17T01:41:27.366 INFO:tasks.workunit.client.0.smithi082.stdout:8/208: mknod d3/dd/d18/d2d/d3b/c3f 0 2024-09-17T01:41:27.367 INFO:tasks.workunit.client.0.smithi082.stdout:8/209: dread - d3/dd/f2b zero size 2024-09-17T01:41:27.372 INFO:tasks.workunit.client.1.smithi167.stdout:7/484: dwrite d0/d2/d14/d19/d22/f8d [0,4194304] 0 2024-09-17T01:41:27.372 INFO:tasks.workunit.client.0.smithi082.stdout:4/247: read - d9/d15/d16/d3e/f3f zero size 2024-09-17T01:41:27.373 INFO:tasks.workunit.client.1.smithi167.stdout:2/461: write d5/f44 [41588,128302] 0 2024-09-17T01:41:27.373 INFO:tasks.workunit.client.0.smithi082.stdout:3/168: dwrite f0 [0,4194304] 0 2024-09-17T01:41:27.373 INFO:tasks.workunit.client.0.smithi082.stdout:5/223: mkdir db/d1e/d20/d30/d47 0 2024-09-17T01:41:27.375 INFO:tasks.workunit.client.1.smithi167.stdout:9/566: mknod d4/d9/d21/d2d/d33/d90/cab 0 2024-09-17T01:41:27.377 INFO:tasks.workunit.client.0.smithi082.stdout:2/202: symlink d1/l3a 0 2024-09-17T01:41:27.378 INFO:tasks.workunit.client.1.smithi167.stdout:6/632: creat d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fe4 x:0 0 0 2024-09-17T01:41:27.378 INFO:tasks.workunit.client.1.smithi167.stdout:1/477: dwrite d0/d9/d16/d48/d54/d6e/f94 [0,4194304] 0 2024-09-17T01:41:27.384 INFO:tasks.workunit.client.1.smithi167.stdout:3/495: dwrite d7/d8/d2a/f2e [0,4194304] 0 2024-09-17T01:41:27.385 INFO:tasks.workunit.client.0.smithi082.stdout:0/172: creat da/d24/f3b x:0 0 0 2024-09-17T01:41:27.387 INFO:tasks.workunit.client.1.smithi167.stdout:8/577: dwrite dc/d21/d6b/f78 [0,4194304] 0 2024-09-17T01:41:27.387 INFO:tasks.workunit.client.1.smithi167.stdout:7/485: unlink d0/d2/d14/d19/f30 0 2024-09-17T01:41:27.390 INFO:tasks.workunit.client.0.smithi082.stdout:6/305: rename d1/d7/d10/d4f/dc/d2b/f35 to d1/d7/d10/d4f/dc/d1d/d36/d56/f70 0 2024-09-17T01:41:27.390 INFO:tasks.workunit.client.0.smithi082.stdout:6/306: fdatasync d1/d3/f1b 0 2024-09-17T01:41:27.391 INFO:tasks.workunit.client.1.smithi167.stdout:4/530: rename d0/d4/d7/d6/f60 to d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/fb0 0 2024-09-17T01:41:27.393 INFO:tasks.workunit.client.1.smithi167.stdout:2/462: dwrite d5/d10/d16/f65 [0,4194304] 0 2024-09-17T01:41:27.393 INFO:tasks.workunit.client.1.smithi167.stdout:3/496: truncate d7/d8/d10/d14/d24/f7d 981025 0 2024-09-17T01:41:27.394 INFO:tasks.workunit.client.0.smithi082.stdout:5/224: creat db/d2b/f48 x:0 0 0 2024-09-17T01:41:27.395 INFO:tasks.workunit.client.1.smithi167.stdout:8/578: truncate dc/d56/d59/d65/fa9 213539 0 2024-09-17T01:41:27.395 INFO:tasks.workunit.client.1.smithi167.stdout:9/567: rmdir d4/d9/d21/d43 39 2024-09-17T01:41:27.397 INFO:tasks.workunit.client.1.smithi167.stdout:4/531: fsync d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d4f/f9e 0 2024-09-17T01:41:27.398 INFO:tasks.workunit.client.0.smithi082.stdout:7/255: dwrite d0/d3/db/f18 [0,4194304] 0 2024-09-17T01:41:27.399 INFO:tasks.workunit.client.0.smithi082.stdout:9/202: mknod d4/d27/d21/d2e/d11/d39/c48 0 2024-09-17T01:41:27.399 INFO:tasks.workunit.client.0.smithi082.stdout:7/256: fsync d0/f32 0 2024-09-17T01:41:27.401 INFO:tasks.workunit.client.0.smithi082.stdout:2/203: creat d1/d17/f3b x:0 0 0 2024-09-17T01:41:27.402 INFO:tasks.workunit.client.0.smithi082.stdout:2/204: chown d1/d17/f21 2 1 2024-09-17T01:41:27.402 INFO:tasks.workunit.client.1.smithi167.stdout:2/463: fsync d5/f44 0 2024-09-17T01:41:27.403 INFO:tasks.workunit.client.1.smithi167.stdout:1/478: creat d0/d9/d16/d48/d54/d78/f9f x:0 0 0 2024-09-17T01:41:27.403 INFO:tasks.workunit.client.1.smithi167.stdout:6/633: rmdir d7/d54/d90/d13/d2f/d64/d6b/d95/db1 39 2024-09-17T01:41:27.403 INFO:tasks.workunit.client.0.smithi082.stdout:0/173: fdatasync da/d16/f25 0 2024-09-17T01:41:27.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/579: dread - dc/d56/d59/d82/d8f/d90/f9e zero size 2024-09-17T01:41:27.407 INFO:tasks.workunit.client.1.smithi167.stdout:4/532: creat d0/d4/fb1 x:0 0 0 2024-09-17T01:41:27.407 INFO:tasks.workunit.client.1.smithi167.stdout:6/634: chown d7/d52/c67 418051 1 2024-09-17T01:41:27.408 INFO:tasks.workunit.client.0.smithi082.stdout:6/307: creat d1/d7/d10/d4f/dc/d1d/d36/d56/f71 x:0 0 0 2024-09-17T01:41:27.412 INFO:tasks.workunit.client.0.smithi082.stdout:5/225: mknod db/d1e/d20/d30/c49 0 2024-09-17T01:41:27.412 INFO:tasks.workunit.client.1.smithi167.stdout:1/479: mknod d0/d5/d61/ca0 0 2024-09-17T01:41:27.413 INFO:tasks.workunit.client.1.smithi167.stdout:3/497: dwrite d7/d8/d2a/f95 [0,4194304] 0 2024-09-17T01:41:27.413 INFO:tasks.workunit.client.1.smithi167.stdout:9/568: fdatasync d4/d9/d21/d2d/d33/d3a/d74/f89 0 2024-09-17T01:41:27.414 INFO:tasks.workunit.client.0.smithi082.stdout:4/248: mkdir d9/d15/d37/d45/d49 0 2024-09-17T01:41:27.415 INFO:tasks.workunit.client.1.smithi167.stdout:7/486: mknod d0/d2/d88/d6e/ca2 0 2024-09-17T01:41:27.417 INFO:tasks.workunit.client.1.smithi167.stdout:2/464: rename d5/d1f to d5/d10/d1a/d39/da3 0 2024-09-17T01:41:27.418 INFO:tasks.workunit.client.0.smithi082.stdout:5/226: dread f6 [0,4194304] 0 2024-09-17T01:41:27.418 INFO:tasks.workunit.client.1.smithi167.stdout:4/533: fsync d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 0 2024-09-17T01:41:27.418 INFO:tasks.workunit.client.1.smithi167.stdout:2/465: fdatasync d5/d10/d1a/d2e/f87 0 2024-09-17T01:41:27.419 INFO:tasks.workunit.client.1.smithi167.stdout:7/487: dread d0/d2/d14/d6f/d87/f93 [0,4194304] 0 2024-09-17T01:41:27.421 INFO:tasks.workunit.client.1.smithi167.stdout:6/635: mknod d7/d52/d79/da4/ce5 0 2024-09-17T01:41:27.421 INFO:tasks.workunit.client.1.smithi167.stdout:9/569: read d4/d9/d21/d2d/d33/f70 [626405,128134] 0 2024-09-17T01:41:27.421 INFO:tasks.workunit.client.0.smithi082.stdout:2/205: creat d1/d35/f3c x:0 0 0 2024-09-17T01:41:27.423 INFO:tasks.workunit.client.0.smithi082.stdout:0/174: creat da/df/d27/f3c x:0 0 0 2024-09-17T01:41:27.424 INFO:tasks.workunit.client.1.smithi167.stdout:1/480: symlink d0/d5/d34/d3c/d74/la1 0 2024-09-17T01:41:27.425 INFO:tasks.workunit.client.1.smithi167.stdout:1/481: truncate d0/d9/d16/d22/f66 923510 0 2024-09-17T01:41:27.426 INFO:tasks.workunit.client.0.smithi082.stdout:1/272: creat d2/da/d16/f5d x:0 0 0 2024-09-17T01:41:27.427 INFO:tasks.workunit.client.0.smithi082.stdout:1/273: chown d2/da/f37 99 1 2024-09-17T01:41:27.427 INFO:tasks.workunit.client.1.smithi167.stdout:3/498: unlink d7/d8/d2a/c4d 0 2024-09-17T01:41:27.428 INFO:tasks.workunit.client.0.smithi082.stdout:1/274: dread - d2/da/d2f/f44 zero size 2024-09-17T01:41:27.428 INFO:tasks.workunit.client.1.smithi167.stdout:1/482: dread d0/d9/fb [4194304,4194304] 0 2024-09-17T01:41:27.430 INFO:tasks.workunit.client.0.smithi082.stdout:8/210: write d3/dd/d18/f24 [2102672,82845] 0 2024-09-17T01:41:27.432 INFO:tasks.workunit.client.0.smithi082.stdout:8/211: truncate d3/dd/f23 1389507 0 2024-09-17T01:41:27.434 INFO:tasks.workunit.client.0.smithi082.stdout:4/249: mkdir d9/d15/d16/d18/d4a 0 2024-09-17T01:41:27.435 INFO:tasks.workunit.client.1.smithi167.stdout:1/483: dwrite d0/d5/d34/f5f [0,4194304] 0 2024-09-17T01:41:27.439 INFO:tasks.workunit.client.0.smithi082.stdout:7/257: mkdir d0/d50 0 2024-09-17T01:41:27.441 INFO:tasks.workunit.client.0.smithi082.stdout:5/227: creat db/d12/d18/f4a x:0 0 0 2024-09-17T01:41:27.442 INFO:tasks.workunit.client.0.smithi082.stdout:5/228: write db/d2b/f48 [809122,29024] 0 2024-09-17T01:41:27.443 INFO:tasks.workunit.client.1.smithi167.stdout:2/466: rename d5/d10/d1a/d45/c47 to d5/d10/d1a/d39/d5e/ca4 0 2024-09-17T01:41:27.443 INFO:tasks.workunit.client.1.smithi167.stdout:5/419: truncate d0/f19 1261089 0 2024-09-17T01:41:27.445 INFO:tasks.workunit.client.1.smithi167.stdout:9/570: rmdir d4/d9/d21/d2d/d33/d3a 39 2024-09-17T01:41:27.446 INFO:tasks.workunit.client.1.smithi167.stdout:9/571: write d4/d9/f9a [543758,106462] 0 2024-09-17T01:41:27.448 INFO:tasks.workunit.client.0.smithi082.stdout:0/175: rename da/l12 to da/df/l3d 0 2024-09-17T01:41:27.449 INFO:tasks.workunit.client.0.smithi082.stdout:0/176: truncate da/d16/f2e 226816 0 2024-09-17T01:41:27.450 INFO:tasks.workunit.client.1.smithi167.stdout:6/636: rmdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61 39 2024-09-17T01:41:27.451 INFO:tasks.workunit.client.1.smithi167.stdout:0/450: sync 2024-09-17T01:41:27.452 INFO:tasks.workunit.client.1.smithi167.stdout:0/451: write d5/d6b/d77/d4d/f2b [892785,15415] 0 2024-09-17T01:41:27.454 INFO:tasks.workunit.client.1.smithi167.stdout:3/499: unlink d7/f8b 0 2024-09-17T01:41:27.455 INFO:tasks.workunit.client.0.smithi082.stdout:0/177: dread da/fb [0,4194304] 0 2024-09-17T01:41:27.457 INFO:tasks.workunit.client.1.smithi167.stdout:6/637: dwrite d7/d54/d90/d13/d2f/d7f/d98/f62 [0,4194304] 0 2024-09-17T01:41:27.459 INFO:tasks.workunit.client.1.smithi167.stdout:3/500: dread d7/d8/d2a/f95 [0,4194304] 0 2024-09-17T01:41:27.460 INFO:tasks.workunit.client.0.smithi082.stdout:9/203: creat d4/f49 x:0 0 0 2024-09-17T01:41:27.460 INFO:tasks.workunit.client.0.smithi082.stdout:0/178: write da/d24/f3b [224132,103753] 0 2024-09-17T01:41:27.460 INFO:tasks.workunit.client.0.smithi082.stdout:3/169: truncate f0 3371296 0 2024-09-17T01:41:27.461 INFO:tasks.workunit.client.0.smithi082.stdout:9/204: truncate d4/f30 1006127 0 2024-09-17T01:41:27.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/212: unlink d3/f39 0 2024-09-17T01:41:27.463 INFO:tasks.workunit.client.0.smithi082.stdout:4/250: creat d9/d15/d16/f4b x:0 0 0 2024-09-17T01:41:27.465 INFO:tasks.workunit.client.0.smithi082.stdout:4/251: chown d9/d15/l39 143086 1 2024-09-17T01:41:27.465 INFO:tasks.workunit.client.0.smithi082.stdout:7/258: mknod d0/d3/db/c51 0 2024-09-17T01:41:27.467 INFO:tasks.workunit.client.1.smithi167.stdout:1/484: mkdir d0/d5/d61/da2 0 2024-09-17T01:41:27.468 INFO:tasks.workunit.client.0.smithi082.stdout:9/205: dwrite d4/d27/d21/d2e/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:27.468 INFO:tasks.workunit.client.1.smithi167.stdout:1/485: write d0/d9/d16/d48/d54/d78/f9f [935074,123474] 0 2024-09-17T01:41:27.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/259: write d0/d3/db/d10/f27 [2266062,24665] 0 2024-09-17T01:41:27.470 INFO:tasks.workunit.client.0.smithi082.stdout:5/229: unlink db/d2b/f48 0 2024-09-17T01:41:27.471 INFO:tasks.workunit.client.0.smithi082.stdout:5/230: chown db/d1e 1353964 1 2024-09-17T01:41:27.471 INFO:tasks.workunit.client.0.smithi082.stdout:7/260: chown d0/l41 0 1 2024-09-17T01:41:27.472 INFO:tasks.workunit.client.0.smithi082.stdout:2/206: truncate d1/d10/f2f 8751 0 2024-09-17T01:41:27.477 INFO:tasks.workunit.client.1.smithi167.stdout:8/580: link dc/d56/d59/f60 dc/d56/d57/d7e/dad/fb9 0 2024-09-17T01:41:27.477 INFO:tasks.workunit.client.1.smithi167.stdout:8/581: fsync dc/ff 0 2024-09-17T01:41:27.478 INFO:tasks.workunit.client.0.smithi082.stdout:9/206: dwrite d4/d27/d2d/d3d/f47 [0,4194304] 0 2024-09-17T01:41:27.479 INFO:tasks.workunit.client.0.smithi082.stdout:3/170: rename d9/c33 to d9/db/d26/d28/c39 0 2024-09-17T01:41:27.479 INFO:tasks.workunit.client.0.smithi082.stdout:9/207: readlink d4/d27/d21/d2e/l28 0 2024-09-17T01:41:27.480 INFO:tasks.workunit.client.0.smithi082.stdout:9/208: readlink d4/d27/d2d/d3d/l43 0 2024-09-17T01:41:27.481 INFO:tasks.workunit.client.0.smithi082.stdout:3/171: truncate d9/db/d26/f31 351090 0 2024-09-17T01:41:27.485 INFO:tasks.workunit.client.1.smithi167.stdout:4/534: dwrite d0/d4/d7/da/d48/d40/d51/d2d/f61 [0,4194304] 0 2024-09-17T01:41:27.489 INFO:tasks.workunit.client.0.smithi082.stdout:9/209: dwrite d4/d27/d21/d2e/f34 [0,4194304] 0 2024-09-17T01:41:27.493 INFO:tasks.workunit.client.1.smithi167.stdout:6/638: fsync d7/d54/d90/d13/d2f/d96/dab/f31 0 2024-09-17T01:41:27.496 INFO:tasks.workunit.client.0.smithi082.stdout:9/210: dread d4/d27/d21/f42 [0,4194304] 0 2024-09-17T01:41:27.497 INFO:tasks.workunit.client.0.smithi082.stdout:1/275: write d2/da/d2f/d47/f4d [680254,60686] 0 2024-09-17T01:41:27.499 INFO:tasks.workunit.client.0.smithi082.stdout:2/207: chown d1/f1f 608 1 2024-09-17T01:41:27.500 INFO:tasks.workunit.client.1.smithi167.stdout:1/486: chown d0/d9/d16/d22/c23 4297 1 2024-09-17T01:41:27.500 INFO:tasks.workunit.client.0.smithi082.stdout:7/261: truncate d0/d3/db/f29 4974475 0 2024-09-17T01:41:27.501 INFO:tasks.workunit.client.1.smithi167.stdout:1/487: fsync d0/d9/d16/d48/d54/d78/f92 0 2024-09-17T01:41:27.503 INFO:tasks.workunit.client.0.smithi082.stdout:7/262: stat d0/l24 0 2024-09-17T01:41:27.505 INFO:tasks.workunit.client.0.smithi082.stdout:2/208: truncate d1/d35/f3c 919270 0 2024-09-17T01:41:27.506 INFO:tasks.workunit.client.0.smithi082.stdout:8/213: rename d3/lc to d3/dd/l40 0 2024-09-17T01:41:27.507 INFO:tasks.workunit.client.0.smithi082.stdout:5/231: dwrite db/d12/f15 [4194304,4194304] 0 2024-09-17T01:41:27.509 INFO:tasks.workunit.client.0.smithi082.stdout:2/209: write d1/d17/f21 [1648669,31842] 0 2024-09-17T01:41:27.510 INFO:tasks.workunit.client.0.smithi082.stdout:3/172: chown d9/f21 1595 1 2024-09-17T01:41:27.512 INFO:tasks.workunit.client.1.smithi167.stdout:9/572: rename d4/d9/d21/d43/d47 to d4/d9/d21/d2d/d33/d90/dac 0 2024-09-17T01:41:27.512 INFO:tasks.workunit.client.1.smithi167.stdout:9/573: fsync d4/d4a/f55 0 2024-09-17T01:41:27.513 INFO:tasks.workunit.client.0.smithi082.stdout:2/210: readlink d1/d17/l39 0 2024-09-17T01:41:27.516 INFO:tasks.workunit.client.0.smithi082.stdout:0/179: write f8 [1079149,76580] 0 2024-09-17T01:41:27.517 INFO:tasks.workunit.client.1.smithi167.stdout:8/582: rmdir dc/d56/d57/d5c 39 2024-09-17T01:41:27.519 INFO:tasks.workunit.client.0.smithi082.stdout:7/263: dwrite d0/f48 [0,4194304] 0 2024-09-17T01:41:27.524 INFO:tasks.workunit.client.0.smithi082.stdout:0/180: chown da/c10 4 1 2024-09-17T01:41:27.525 INFO:tasks.workunit.client.0.smithi082.stdout:1/276: mkdir d2/df/d5e 0 2024-09-17T01:41:27.528 INFO:tasks.workunit.client.0.smithi082.stdout:8/214: dwrite d3/f33 [0,4194304] 0 2024-09-17T01:41:27.529 INFO:tasks.workunit.client.0.smithi082.stdout:3/173: dwrite d9/f24 [0,4194304] 0 2024-09-17T01:41:27.532 INFO:tasks.workunit.client.1.smithi167.stdout:6/639: symlink d7/d54/d90/d13/d2f/d30/d32/le6 0 2024-09-17T01:41:27.533 INFO:tasks.workunit.client.1.smithi167.stdout:6/640: stat d7/d52/d79 0 2024-09-17T01:41:27.534 INFO:tasks.workunit.client.1.smithi167.stdout:6/641: readlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/la9 0 2024-09-17T01:41:27.536 INFO:tasks.workunit.client.0.smithi082.stdout:4/252: rename d9/d15/d37/d45/d49 to d9/d15/d37/d4c 0 2024-09-17T01:41:27.536 INFO:tasks.workunit.client.0.smithi082.stdout:0/181: dwrite da/df/d27/f29 [0,4194304] 0 2024-09-17T01:41:27.537 INFO:tasks.workunit.client.1.smithi167.stdout:5/420: truncate d0/d24/f35 377917 0 2024-09-17T01:41:27.538 INFO:tasks.workunit.client.1.smithi167.stdout:3/501: getdents d7/d8/d10/d14/d24/d62/d92 0 2024-09-17T01:41:27.539 INFO:tasks.workunit.client.0.smithi082.stdout:0/182: write da/d24/f3b [961701,41245] 0 2024-09-17T01:41:27.539 INFO:tasks.workunit.client.1.smithi167.stdout:3/502: dread - d7/d8/d10/d14/d24/d62/f69 zero size 2024-09-17T01:41:27.543 INFO:tasks.workunit.client.1.smithi167.stdout:7/488: getdents d0/d2/d14/d6f/d87 0 2024-09-17T01:41:27.543 INFO:tasks.workunit.client.0.smithi082.stdout:4/253: write d9/d15/d16/d18/f38 [3402753,33735] 0 2024-09-17T01:41:27.544 INFO:tasks.workunit.client.0.smithi082.stdout:4/254: stat d9/d15/d16/d18/f3a 0 2024-09-17T01:41:27.545 INFO:tasks.workunit.client.1.smithi167.stdout:1/488: mkdir d0/d9/d16/d48/d54/d78/d90/da3 0 2024-09-17T01:41:27.547 INFO:tasks.workunit.client.0.smithi082.stdout:9/211: symlink d4/d27/d21/d2e/d11/d39/d44/l4a 0 2024-09-17T01:41:27.553 INFO:tasks.workunit.client.1.smithi167.stdout:6/642: unlink d7/d42/f9d 0 2024-09-17T01:41:27.554 INFO:tasks.workunit.client.1.smithi167.stdout:6/643: readlink d7/d52/db7/lba 0 2024-09-17T01:41:27.554 INFO:tasks.workunit.client.1.smithi167.stdout:2/467: sync 2024-09-17T01:41:27.554 INFO:tasks.workunit.client.0.smithi082.stdout:3/174: rmdir d9 39 2024-09-17T01:41:27.558 INFO:tasks.workunit.client.1.smithi167.stdout:7/489: rmdir d0/d2/d14/d19 39 2024-09-17T01:41:27.559 INFO:tasks.workunit.client.1.smithi167.stdout:1/489: mkdir d0/d5/d34/d83/da4 0 2024-09-17T01:41:27.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/255: dread d9/fd [0,4194304] 0 2024-09-17T01:41:27.569 INFO:tasks.workunit.client.1.smithi167.stdout:2/468: chown d5/d10/l3a 11 1 2024-09-17T01:41:27.570 INFO:tasks.workunit.client.0.smithi082.stdout:7/264: write d0/d3/db/f14 [386203,21319] 0 2024-09-17T01:41:27.570 INFO:tasks.workunit.client.1.smithi167.stdout:6/644: creat d7/d54/d90/d13/d2f/d7f/fe7 x:0 0 0 2024-09-17T01:41:27.571 INFO:tasks.workunit.client.1.smithi167.stdout:9/574: dwrite d4/d9/f6d [0,4194304] 0 2024-09-17T01:41:27.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/421: rename d0/d24/d2b/d49/d4b/c59 to d0/d28/d3a/d4d/c7c 0 2024-09-17T01:41:27.574 INFO:tasks.workunit.client.1.smithi167.stdout:9/575: write d4/d9/f1d [3205509,114502] 0 2024-09-17T01:41:27.574 INFO:tasks.workunit.client.1.smithi167.stdout:3/503: fsync d7/d8/d10/d14/d25/f48 0 2024-09-17T01:41:27.575 INFO:tasks.workunit.client.1.smithi167.stdout:5/422: chown d0/d24/d2b/d4e/d63 7339 1 2024-09-17T01:41:27.575 INFO:tasks.workunit.client.1.smithi167.stdout:8/583: dwrite dc/d56/d59/d65/fa9 [0,4194304] 0 2024-09-17T01:41:27.576 INFO:tasks.workunit.client.0.smithi082.stdout:9/212: mknod d4/d27/d21/d2e/d11/d39/d44/c4b 0 2024-09-17T01:41:27.576 INFO:tasks.workunit.client.0.smithi082.stdout:0/183: write da/fc [4030694,113616] 0 2024-09-17T01:41:27.576 INFO:tasks.workunit.client.1.smithi167.stdout:5/423: chown d0/d9/d1c 558314576 1 2024-09-17T01:41:27.578 INFO:tasks.workunit.client.1.smithi167.stdout:3/504: write d7/d8/d10/d29/d75/f86 [702195,113250] 0 2024-09-17T01:41:27.579 INFO:tasks.workunit.client.1.smithi167.stdout:9/576: dread - d4/d9/d21/d43/d6c/d9e/da1/fa6 zero size 2024-09-17T01:41:27.579 INFO:tasks.workunit.client.1.smithi167.stdout:7/490: chown d0/d2/d14/d19/d26/c5a 97 1 2024-09-17T01:41:27.579 INFO:tasks.workunit.client.1.smithi167.stdout:1/490: symlink d0/d9/d16/d48/d54/d78/la5 0 2024-09-17T01:41:27.580 INFO:tasks.workunit.client.0.smithi082.stdout:3/175: chown d9/db/c1d 7 1 2024-09-17T01:41:27.583 INFO:tasks.workunit.client.0.smithi082.stdout:5/232: creat db/f4b x:0 0 0 2024-09-17T01:41:27.583 INFO:tasks.workunit.client.1.smithi167.stdout:4/535: getdents d0/d4/d7/da/d48/d40/d51/d2d/d74 0 2024-09-17T01:41:27.584 INFO:tasks.workunit.client.1.smithi167.stdout:4/536: chown d0/d4/d7/da/c49 124 1 2024-09-17T01:41:27.586 INFO:tasks.workunit.client.1.smithi167.stdout:3/505: dread d7/d8/d2a/d7a/f88 [0,4194304] 0 2024-09-17T01:41:27.587 INFO:tasks.workunit.client.0.smithi082.stdout:8/215: mknod d3/c41 0 2024-09-17T01:41:27.588 INFO:tasks.workunit.client.1.smithi167.stdout:2/469: creat d5/d6d/fa5 x:0 0 0 2024-09-17T01:41:27.588 INFO:tasks.workunit.client.1.smithi167.stdout:6/645: creat d7/d52/db7/fe8 x:0 0 0 2024-09-17T01:41:27.589 INFO:tasks.workunit.client.1.smithi167.stdout:6/646: fsync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 0 2024-09-17T01:41:27.590 INFO:tasks.workunit.client.0.smithi082.stdout:3/176: dwrite d9/db/f17 [0,4194304] 0 2024-09-17T01:41:27.591 INFO:tasks.workunit.client.1.smithi167.stdout:6/647: write d7/d54/d90/d13/f2d [3559842,1145] 0 2024-09-17T01:41:27.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/211: creat d1/f3d x:0 0 0 2024-09-17T01:41:27.592 INFO:tasks.workunit.client.1.smithi167.stdout:6/648: write d7/d54/d90/d13/d2f/d30/d32/fcf [887562,50858] 0 2024-09-17T01:41:27.594 INFO:tasks.workunit.client.1.smithi167.stdout:5/424: rmdir d0/d24/d2b/d3d 39 2024-09-17T01:41:27.596 INFO:tasks.workunit.client.1.smithi167.stdout:1/491: creat d0/d5/d34/d6d/fa6 x:0 0 0 2024-09-17T01:41:27.597 INFO:tasks.workunit.client.1.smithi167.stdout:9/577: chown d4/d9/d21/d2d/d33/d3a 1 1 2024-09-17T01:41:27.598 INFO:tasks.workunit.client.1.smithi167.stdout:0/452: sync 2024-09-17T01:41:27.600 INFO:tasks.workunit.client.1.smithi167.stdout:7/491: rename d0/d2/d14/d19/d32/d80 to d0/d2/d88/d6e/da3 0 2024-09-17T01:41:27.600 INFO:tasks.workunit.client.1.smithi167.stdout:4/537: rmdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f 39 2024-09-17T01:41:27.601 INFO:tasks.workunit.client.0.smithi082.stdout:5/233: mknod db/d12/d29/c4c 0 2024-09-17T01:41:27.602 INFO:tasks.workunit.client.1.smithi167.stdout:0/453: dread - d5/d6b/d77/d37/d45/f8c zero size 2024-09-17T01:41:27.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/454: write d5/d8/d9/f7f [724476,10019] 0 2024-09-17T01:41:27.605 INFO:tasks.workunit.client.1.smithi167.stdout:2/470: creat d5/d3c/d4c/d4d/fa6 x:0 0 0 2024-09-17T01:41:27.605 INFO:tasks.workunit.client.1.smithi167.stdout:9/578: dwrite d4/d9/d21/d43/d6c/f99 [0,4194304] 0 2024-09-17T01:41:27.606 INFO:tasks.workunit.client.0.smithi082.stdout:4/256: mknod d9/d31/d48/c4d 0 2024-09-17T01:41:27.606 INFO:tasks.workunit.client.1.smithi167.stdout:9/579: fsync d4/d9/f3d 0 2024-09-17T01:41:27.609 INFO:tasks.workunit.client.0.smithi082.stdout:5/234: dwrite db/d12/d18/f40 [0,4194304] 0 2024-09-17T01:41:27.609 INFO:tasks.workunit.client.0.smithi082.stdout:3/177: rename f1 to d9/db/d26/f3a 0 2024-09-17T01:41:27.610 INFO:tasks.workunit.client.0.smithi082.stdout:1/277: truncate d2/df/d46/f52 743149 0 2024-09-17T01:41:27.614 INFO:tasks.workunit.client.0.smithi082.stdout:2/212: symlink d1/d10/l3e 0 2024-09-17T01:41:27.617 INFO:tasks.workunit.client.0.smithi082.stdout:1/278: write f0 [791155,80598] 0 2024-09-17T01:41:27.618 INFO:tasks.workunit.client.1.smithi167.stdout:8/584: write dc/d21/f44 [1082897,58002] 0 2024-09-17T01:41:27.618 INFO:tasks.workunit.client.0.smithi082.stdout:4/257: dwrite d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:27.620 INFO:tasks.workunit.client.1.smithi167.stdout:2/471: write d5/d10/d1a/d45/f79 [2738,84207] 0 2024-09-17T01:41:27.621 INFO:tasks.workunit.client.1.smithi167.stdout:6/649: creat d7/d54/d90/d13/d2f/d7f/d98/fe9 x:0 0 0 2024-09-17T01:41:27.622 INFO:tasks.workunit.client.1.smithi167.stdout:6/650: dread - d7/d52/d79/da4/fb4 zero size 2024-09-17T01:41:27.628 INFO:tasks.workunit.client.1.smithi167.stdout:7/492: write d0/d2/f2e [1762434,60578] 0 2024-09-17T01:41:27.629 INFO:tasks.workunit.client.1.smithi167.stdout:1/492: rename d0/d5/d34/d3c/d74/f75 to d0/d5/d34/fa7 0 2024-09-17T01:41:27.631 INFO:tasks.workunit.client.1.smithi167.stdout:7/493: write d0/d2/d14/d19/d32/f4d [1223068,115207] 0 2024-09-17T01:41:27.631 INFO:tasks.workunit.client.1.smithi167.stdout:1/493: stat d0/d9/d16/d48/d54/d78 0 2024-09-17T01:41:27.631 INFO:tasks.workunit.client.1.smithi167.stdout:4/538: mknod d0/d4/cb2 0 2024-09-17T01:41:27.631 INFO:tasks.workunit.client.1.smithi167.stdout:7/494: stat d0/f4f 0 2024-09-17T01:41:27.632 INFO:tasks.workunit.client.0.smithi082.stdout:5/235: mkdir db/d1e/d20/d4d 0 2024-09-17T01:41:27.632 INFO:tasks.workunit.client.1.smithi167.stdout:3/506: mknod d7/d8f/d9b/c9d 0 2024-09-17T01:41:27.632 INFO:tasks.workunit.client.1.smithi167.stdout:1/494: write d0/d5/d34/f14 [2849049,129734] 0 2024-09-17T01:41:27.634 INFO:tasks.workunit.client.0.smithi082.stdout:8/216: dwrite d3/f10 [0,4194304] 0 2024-09-17T01:41:27.634 INFO:tasks.workunit.client.1.smithi167.stdout:3/507: fdatasync d7/d8/d10/d29/f98 0 2024-09-17T01:41:27.635 INFO:tasks.workunit.client.1.smithi167.stdout:3/508: chown d7/d8f/d9b/c9d 28315 1 2024-09-17T01:41:27.636 INFO:tasks.workunit.client.1.smithi167.stdout:3/509: truncate d7/d8/d10/d14/d2c/f71 960088 0 2024-09-17T01:41:27.638 INFO:tasks.workunit.client.0.smithi082.stdout:4/258: creat d9/d15/d16/d3e/f4e x:0 0 0 2024-09-17T01:41:27.639 INFO:tasks.workunit.client.0.smithi082.stdout:8/217: dread d3/f25 [0,4194304] 0 2024-09-17T01:41:27.640 INFO:tasks.workunit.client.1.smithi167.stdout:9/580: mknod d4/cad 0 2024-09-17T01:41:27.641 INFO:tasks.workunit.client.1.smithi167.stdout:8/585: mkdir dc/d56/d59/d82/d8f/d90/dba 0 2024-09-17T01:41:27.643 INFO:tasks.workunit.client.1.smithi167.stdout:8/586: write dc/d1a/f86 [556593,109255] 0 2024-09-17T01:41:27.646 INFO:tasks.workunit.client.0.smithi082.stdout:9/213: truncate d4/d27/d2d/d3d/f47 4068949 0 2024-09-17T01:41:27.647 INFO:tasks.workunit.client.1.smithi167.stdout:9/581: dwrite d4/d9/d21/f2f [0,4194304] 0 2024-09-17T01:41:27.648 INFO:tasks.workunit.client.1.smithi167.stdout:9/582: fsync d4/d9/d21/d43/d6c/f99 0 2024-09-17T01:41:27.651 INFO:tasks.workunit.client.0.smithi082.stdout:9/214: dread d4/f1a [0,4194304] 0 2024-09-17T01:41:27.652 INFO:tasks.workunit.client.1.smithi167.stdout:6/651: mknod d7/d54/d90/d13/d2f/d30/cea 0 2024-09-17T01:41:27.652 INFO:tasks.workunit.client.1.smithi167.stdout:8/587: dread dc/d21/d61/fb1 [0,4194304] 0 2024-09-17T01:41:27.652 INFO:tasks.workunit.client.1.smithi167.stdout:8/588: fdatasync dc/d21/d6b/f78 0 2024-09-17T01:41:27.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/215: chown d4/d27/d21/d2e/d11/l32 1 1 2024-09-17T01:41:27.653 INFO:tasks.workunit.client.1.smithi167.stdout:6/652: rename d7/d54/d90 to d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/deb 22 2024-09-17T01:41:27.658 INFO:tasks.workunit.client.0.smithi082.stdout:4/259: mkdir d9/d15/d16/d18/d4f 0 2024-09-17T01:41:27.658 INFO:tasks.workunit.client.1.smithi167.stdout:6/653: dwrite d7/d52/db7/fe0 [0,4194304] 0 2024-09-17T01:41:27.658 INFO:tasks.workunit.client.1.smithi167.stdout:6/654: fdatasync d7/d52/d79/da4/fb4 0 2024-09-17T01:41:27.659 INFO:tasks.workunit.client.1.smithi167.stdout:6/655: write d7/d42/f71 [851324,17655] 0 2024-09-17T01:41:27.661 INFO:tasks.workunit.client.0.smithi082.stdout:8/218: write d3/f20 [2280783,88843] 0 2024-09-17T01:41:27.663 INFO:tasks.workunit.client.0.smithi082.stdout:4/260: dread d9/fd [0,4194304] 0 2024-09-17T01:41:27.664 INFO:tasks.workunit.client.1.smithi167.stdout:7/495: creat d0/d2/d14/d4c/fa4 x:0 0 0 2024-09-17T01:41:27.664 INFO:tasks.workunit.client.1.smithi167.stdout:4/539: unlink d0/d4/d7/d6/d2b/d6d/d7e/d92/f9f 0 2024-09-17T01:41:27.665 INFO:tasks.workunit.client.0.smithi082.stdout:4/261: fsync d9/d15/d16/f4b 0 2024-09-17T01:41:27.666 INFO:tasks.workunit.client.1.smithi167.stdout:4/540: write d0/f3 [1832217,101001] 0 2024-09-17T01:41:27.666 INFO:tasks.workunit.client.1.smithi167.stdout:4/541: chown d0/d4/d7/d6/f83 14 1 2024-09-17T01:41:27.670 INFO:tasks.workunit.client.1.smithi167.stdout:1/495: creat d0/d9/d16/d48/d54/d6e/d7e/fa8 x:0 0 0 2024-09-17T01:41:27.671 INFO:tasks.workunit.client.1.smithi167.stdout:1/496: chown d0/d9/d16/d48/d54/c76 225416 1 2024-09-17T01:41:27.672 INFO:tasks.workunit.client.0.smithi082.stdout:4/262: dread d9/d15/f1e [0,4194304] 0 2024-09-17T01:41:27.675 INFO:tasks.workunit.client.0.smithi082.stdout:3/178: dwrite d9/fe [0,4194304] 0 2024-09-17T01:41:27.675 INFO:tasks.workunit.client.0.smithi082.stdout:2/213: creat d1/f3f x:0 0 0 2024-09-17T01:41:27.676 INFO:tasks.workunit.client.0.smithi082.stdout:4/263: write d9/d15/d16/d3e/f4e [780937,109132] 0 2024-09-17T01:41:27.682 INFO:tasks.workunit.client.0.smithi082.stdout:7/265: link d0/d3/db/l4e d0/d3/l52 0 2024-09-17T01:41:27.685 INFO:tasks.workunit.client.1.smithi167.stdout:4/542: dread d0/d4/d7/da/d48/d40/d51/f84 [0,4194304] 0 2024-09-17T01:41:27.687 INFO:tasks.workunit.client.0.smithi082.stdout:1/279: rename d2/da/d2f/f44 to d2/f5f 0 2024-09-17T01:41:27.687 INFO:tasks.workunit.client.0.smithi082.stdout:2/214: rename d1/d17/d29 to d1/d17/d29/d40 22 2024-09-17T01:41:27.688 INFO:tasks.workunit.client.1.smithi167.stdout:0/455: truncate d5/d6b/d77/d4d/f38 907203 0 2024-09-17T01:41:27.689 INFO:tasks.workunit.client.0.smithi082.stdout:1/280: write d2/da/d2f/d47/f50 [774995,16867] 0 2024-09-17T01:41:27.689 INFO:tasks.workunit.client.1.smithi167.stdout:9/583: unlink d4/d9/d21/d2d/c85 0 2024-09-17T01:41:27.690 INFO:tasks.workunit.client.1.smithi167.stdout:9/584: chown d4/d9/d21/d2d/d33/d3a/c94 117732919 1 2024-09-17T01:41:27.691 INFO:tasks.workunit.client.0.smithi082.stdout:1/281: read d2/d3f/f19 [3613753,49491] 0 2024-09-17T01:41:27.691 INFO:tasks.workunit.client.1.smithi167.stdout:5/425: link d0/d9/f34 d0/d28/d3a/f7d 0 2024-09-17T01:41:27.691 INFO:tasks.workunit.client.1.smithi167.stdout:5/426: write d0/d28/f2a [489458,39110] 0 2024-09-17T01:41:27.692 INFO:tasks.workunit.client.0.smithi082.stdout:5/236: write db/f19 [1748868,50690] 0 2024-09-17T01:41:27.693 INFO:tasks.workunit.client.1.smithi167.stdout:5/427: dread d0/d24/d2b/d4e/f70 [0,4194304] 0 2024-09-17T01:41:27.694 INFO:tasks.workunit.client.0.smithi082.stdout:8/219: dread d3/dd/d18/f24 [0,4194304] 0 2024-09-17T01:41:27.695 INFO:tasks.workunit.client.0.smithi082.stdout:8/220: chown d3/f25 12988 1 2024-09-17T01:41:27.695 INFO:tasks.workunit.client.1.smithi167.stdout:8/589: symlink dc/d56/lbb 0 2024-09-17T01:41:27.696 INFO:tasks.workunit.client.1.smithi167.stdout:8/590: write f8 [2869251,66743] 0 2024-09-17T01:41:27.702 INFO:tasks.workunit.client.1.smithi167.stdout:7/496: fsync d0/f4f 0 2024-09-17T01:41:27.713 INFO:tasks.workunit.client.0.smithi082.stdout:6/308: sync 2024-09-17T01:41:27.749 INFO:tasks.workunit.client.1.smithi167.stdout:3/510: getdents d7/d8/d10/d14/d2c/d6f 0 2024-09-17T01:41:27.758 INFO:tasks.workunit.client.0.smithi082.stdout:3/179: creat d9/db/d26/f3b x:0 0 0 2024-09-17T01:41:27.759 INFO:tasks.workunit.client.0.smithi082.stdout:4/264: creat d9/d15/d16/d3e/f50 x:0 0 0 2024-09-17T01:41:27.760 INFO:tasks.workunit.client.0.smithi082.stdout:1/282: symlink d2/da/d2f/l60 0 2024-09-17T01:41:27.761 INFO:tasks.workunit.client.0.smithi082.stdout:8/221: dread d3/f33 [0,4194304] 0 2024-09-17T01:41:27.762 INFO:tasks.workunit.client.1.smithi167.stdout:0/456: symlink d5/d8/d9/d2f/l8f 0 2024-09-17T01:41:27.767 INFO:tasks.workunit.client.1.smithi167.stdout:0/457: dwrite d5/d8/d9/f7f [0,4194304] 0 2024-09-17T01:41:27.768 INFO:tasks.workunit.client.0.smithi082.stdout:3/180: dwrite d9/db/f18 [4194304,4194304] 0 2024-09-17T01:41:27.778 INFO:tasks.workunit.client.0.smithi082.stdout:6/309: creat d1/d3/f72 x:0 0 0 2024-09-17T01:41:27.779 INFO:tasks.workunit.client.1.smithi167.stdout:8/591: mkdir dc/d56/d59/d82/d8f/dbc 0 2024-09-17T01:41:27.781 INFO:tasks.workunit.client.1.smithi167.stdout:8/592: write dc/d56/d57/d7e/fa8 [876233,72063] 0 2024-09-17T01:41:27.782 INFO:tasks.workunit.client.1.smithi167.stdout:6/656: symlink d7/d54/d90/d13/d2f/d96/lec 0 2024-09-17T01:41:27.787 INFO:tasks.workunit.client.1.smithi167.stdout:8/593: dwrite dc/d21/f44 [0,4194304] 0 2024-09-17T01:41:27.789 INFO:tasks.workunit.client.1.smithi167.stdout:7/497: rename d0/d55 to d0/d2/d14/d19/d26/d83/da5 0 2024-09-17T01:41:27.791 INFO:tasks.workunit.client.0.smithi082.stdout:1/283: symlink d2/df/l61 0 2024-09-17T01:41:27.792 INFO:tasks.workunit.client.1.smithi167.stdout:8/594: dwrite dc/d21/f3a [0,4194304] 0 2024-09-17T01:41:27.795 INFO:tasks.workunit.client.0.smithi082.stdout:4/265: fdatasync d9/d15/d16/d18/f20 0 2024-09-17T01:41:27.796 INFO:tasks.workunit.client.0.smithi082.stdout:4/266: chown d9 20026 1 2024-09-17T01:41:27.797 INFO:tasks.workunit.client.1.smithi167.stdout:3/511: mkdir d7/d8/d10/d14/d25/d9e 0 2024-09-17T01:41:27.808 INFO:tasks.workunit.client.0.smithi082.stdout:6/310: rmdir d1/d7/d10/d4f/dc/d2b/d48 39 2024-09-17T01:41:27.813 INFO:tasks.workunit.client.1.smithi167.stdout:0/458: mkdir d5/d6b/d77/d6d/d90 0 2024-09-17T01:41:27.819 INFO:tasks.workunit.client.0.smithi082.stdout:8/222: creat d3/dd/d18/d2d/d2e/f42 x:0 0 0 2024-09-17T01:41:27.820 INFO:tasks.workunit.client.0.smithi082.stdout:8/223: stat d3/dd/f23 0 2024-09-17T01:41:27.821 INFO:tasks.workunit.client.0.smithi082.stdout:5/237: link db/d12/d29/f2c db/d1e/d20/d30/d47/f4e 0 2024-09-17T01:41:27.823 INFO:tasks.workunit.client.0.smithi082.stdout:8/224: dread d3/f10 [4194304,4194304] 0 2024-09-17T01:41:27.825 INFO:tasks.workunit.client.0.smithi082.stdout:6/311: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/f73 x:0 0 0 2024-09-17T01:41:27.827 INFO:tasks.workunit.client.0.smithi082.stdout:6/312: write d1/d7/d10/d4f/dc/d1d/d36/d56/f71 [323457,120906] 0 2024-09-17T01:41:27.830 INFO:tasks.workunit.client.1.smithi167.stdout:8/595: stat dc/f10 0 2024-09-17T01:41:27.831 INFO:tasks.workunit.client.1.smithi167.stdout:8/596: write dc/d56/f70 [1970698,123029] 0 2024-09-17T01:41:27.838 INFO:tasks.workunit.client.1.smithi167.stdout:0/459: write d5/d8/d9/d2f/f3b [3189587,124122] 0 2024-09-17T01:41:27.838 INFO:tasks.workunit.client.1.smithi167.stdout:0/460: read - d5/f83 zero size 2024-09-17T01:41:27.840 INFO:tasks.workunit.client.0.smithi082.stdout:7/266: rename d0/d3/db/c43 to d0/dd/d34/c53 0 2024-09-17T01:41:27.842 INFO:tasks.workunit.client.0.smithi082.stdout:7/267: read d0/d3/f4 [776617,110874] 0 2024-09-17T01:41:27.843 INFO:tasks.workunit.client.0.smithi082.stdout:7/268: fdatasync d0/dd/f1f 0 2024-09-17T01:41:27.843 INFO:tasks.workunit.client.0.smithi082.stdout:6/313: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/c74 0 2024-09-17T01:41:27.846 INFO:tasks.workunit.client.1.smithi167.stdout:6/657: symlink d7/d54/d90/d13/d2f/d64/d6b/d95/db1/led 0 2024-09-17T01:41:27.846 INFO:tasks.workunit.client.1.smithi167.stdout:6/658: fdatasync d7/d54/d90/d13/d2f/d96/dab/fda 0 2024-09-17T01:41:27.852 INFO:tasks.workunit.client.0.smithi082.stdout:8/225: mkdir d3/dd/d18/d2d/d3e/d43 0 2024-09-17T01:41:27.853 INFO:tasks.workunit.client.0.smithi082.stdout:8/226: dread - d3/f14 zero size 2024-09-17T01:41:27.853 INFO:tasks.workunit.client.1.smithi167.stdout:3/512: fdatasync d7/d8/d10/d14/d24/f97 0 2024-09-17T01:41:27.857 INFO:tasks.workunit.client.0.smithi082.stdout:7/269: mkdir d0/dd/d2c/d54 0 2024-09-17T01:41:27.859 INFO:tasks.workunit.client.1.smithi167.stdout:3/513: dwrite d7/d8/d2a/d4e/f58 [0,4194304] 0 2024-09-17T01:41:27.863 INFO:tasks.workunit.client.0.smithi082.stdout:6/314: dread d1/d7/d10/d4f/dc/d1d/d2c/f60 [0,4194304] 0 2024-09-17T01:41:27.865 INFO:tasks.workunit.client.0.smithi082.stdout:7/270: mkdir d0/dd/d2c/d55 0 2024-09-17T01:41:27.865 INFO:tasks.workunit.client.0.smithi082.stdout:8/227: dread d3/f7 [4194304,4194304] 0 2024-09-17T01:41:27.865 INFO:tasks.workunit.client.1.smithi167.stdout:3/514: dwrite d7/d8/d10/d14/d2c/f2f [0,4194304] 0 2024-09-17T01:41:27.866 INFO:tasks.workunit.client.0.smithi082.stdout:8/228: readlink d3/dd/d18/l19 0 2024-09-17T01:41:27.866 INFO:tasks.workunit.client.0.smithi082.stdout:7/271: write d0/d3/db/d10/f27 [3002314,79579] 0 2024-09-17T01:41:27.867 INFO:tasks.workunit.client.1.smithi167.stdout:6/659: creat d7/d54/d90/d34/dc8/fee x:0 0 0 2024-09-17T01:41:27.871 INFO:tasks.workunit.client.0.smithi082.stdout:6/315: creat d1/d3/f75 x:0 0 0 2024-09-17T01:41:27.873 INFO:tasks.workunit.client.0.smithi082.stdout:6/316: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49 55247 1 2024-09-17T01:41:27.874 INFO:tasks.workunit.client.1.smithi167.stdout:3/515: dwrite d7/d8/d10/f42 [4194304,4194304] 0 2024-09-17T01:41:27.879 INFO:tasks.workunit.client.0.smithi082.stdout:9/216: creat d4/f4c x:0 0 0 2024-09-17T01:41:27.879 INFO:tasks.workunit.client.0.smithi082.stdout:7/272: mknod d0/dd/d34/c56 0 2024-09-17T01:41:27.880 INFO:tasks.workunit.client.0.smithi082.stdout:7/273: chown d0 91481320 1 2024-09-17T01:41:27.881 INFO:tasks.workunit.client.0.smithi082.stdout:7/274: fsync d0/dd/f1f 0 2024-09-17T01:41:27.881 INFO:tasks.workunit.client.0.smithi082.stdout:9/217: truncate d4/d27/d21/d2e/fb 1559770 0 2024-09-17T01:41:27.882 INFO:tasks.workunit.client.0.smithi082.stdout:9/218: readlink d4/d27/d2d/d3d/l43 0 2024-09-17T01:41:27.889 INFO:tasks.workunit.client.0.smithi082.stdout:8/229: creat d3/dd/d18/d2d/d3e/d43/f44 x:0 0 0 2024-09-17T01:41:27.890 INFO:tasks.workunit.client.0.smithi082.stdout:8/230: read d3/f25 [3783245,77574] 0 2024-09-17T01:41:27.891 INFO:tasks.workunit.client.0.smithi082.stdout:9/219: unlink d4/d27/d21/d2e/d11/d39/d44/c4b 0 2024-09-17T01:41:27.892 INFO:tasks.workunit.client.0.smithi082.stdout:9/220: stat d4/d27/d21/d2e/d11/l32 0 2024-09-17T01:41:27.893 INFO:tasks.workunit.client.0.smithi082.stdout:6/317: creat d1/d7/d10/d4f/dc/d2b/d48/f76 x:0 0 0 2024-09-17T01:41:27.894 INFO:tasks.workunit.client.0.smithi082.stdout:7/275: creat d0/dd/d2c/d42/f57 x:0 0 0 2024-09-17T01:41:27.898 INFO:tasks.workunit.client.0.smithi082.stdout:7/276: write d0/dd/f17 [547302,129205] 0 2024-09-17T01:41:27.901 INFO:tasks.workunit.client.0.smithi082.stdout:6/318: dread d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:27.902 INFO:tasks.workunit.client.1.smithi167.stdout:4/543: dwrite d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 [0,4194304] 0 2024-09-17T01:41:27.902 INFO:tasks.workunit.client.0.smithi082.stdout:7/277: truncate d0/d3/db/f33 1088187 0 2024-09-17T01:41:27.903 INFO:tasks.workunit.client.0.smithi082.stdout:9/221: dwrite d4/d27/d21/d2e/fb [0,4194304] 0 2024-09-17T01:41:27.906 INFO:tasks.workunit.client.1.smithi167.stdout:4/544: rmdir d0/d4/d7/d6/d2b/d6d/d7e 39 2024-09-17T01:41:27.908 INFO:tasks.workunit.client.1.smithi167.stdout:4/545: readlink d0/d4/d7/da/d48/l9a 0 2024-09-17T01:41:27.923 INFO:tasks.workunit.client.1.smithi167.stdout:1/497: write d0/d9/d16/d48/d54/f60 [642084,82976] 0 2024-09-17T01:41:27.925 INFO:tasks.workunit.client.1.smithi167.stdout:1/498: read d0/d5/d34/f49 [389743,93492] 0 2024-09-17T01:41:27.926 INFO:tasks.workunit.client.1.smithi167.stdout:2/472: creat d5/d10/d1a/fa7 x:0 0 0 2024-09-17T01:41:27.927 INFO:tasks.workunit.client.1.smithi167.stdout:2/473: fsync d5/f2f 0 2024-09-17T01:41:27.927 INFO:tasks.workunit.client.1.smithi167.stdout:2/474: dread - d5/d10/f9c zero size 2024-09-17T01:41:27.928 INFO:tasks.workunit.client.0.smithi082.stdout:5/238: fsync db/d1e/d20/d30/d47/f4e 0 2024-09-17T01:41:27.930 INFO:tasks.workunit.client.1.smithi167.stdout:1/499: symlink d0/d9/d16/d48/d54/la9 0 2024-09-17T01:41:27.931 INFO:tasks.workunit.client.0.smithi082.stdout:5/239: mkdir db/d12/d29/d4f 0 2024-09-17T01:41:27.932 INFO:tasks.workunit.client.0.smithi082.stdout:5/240: read - db/d1e/d20/d30/f33 zero size 2024-09-17T01:41:27.933 INFO:tasks.workunit.client.1.smithi167.stdout:1/500: truncate d0/d5/f73 3593631 0 2024-09-17T01:41:27.933 INFO:tasks.workunit.client.1.smithi167.stdout:1/501: stat d0/d9/d16 0 2024-09-17T01:41:27.933 INFO:tasks.workunit.client.0.smithi082.stdout:5/241: truncate db/f4b 547198 0 2024-09-17T01:41:27.933 INFO:tasks.workunit.client.1.smithi167.stdout:1/502: chown d0/d5/d34/d83 3452 1 2024-09-17T01:41:27.934 INFO:tasks.workunit.client.0.smithi082.stdout:4/267: write d9/fc [752836,14048] 0 2024-09-17T01:41:27.938 INFO:tasks.workunit.client.0.smithi082.stdout:4/268: dread d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:27.939 INFO:tasks.workunit.client.1.smithi167.stdout:1/503: symlink d0/d5/d61/laa 0 2024-09-17T01:41:27.940 INFO:tasks.workunit.client.1.smithi167.stdout:2/475: dread d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:27.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/284: write d2/da/f35 [1235240,1769] 0 2024-09-17T01:41:27.943 INFO:tasks.workunit.client.0.smithi082.stdout:4/269: creat d9/d15/d37/d45/f51 x:0 0 0 2024-09-17T01:41:27.944 INFO:tasks.workunit.client.0.smithi082.stdout:5/242: getdents db/d12/d18 0 2024-09-17T01:41:27.945 INFO:tasks.workunit.client.0.smithi082.stdout:4/270: dread d9/d15/d16/d18/f20 [0,4194304] 0 2024-09-17T01:41:27.951 INFO:tasks.workunit.client.1.smithi167.stdout:5/428: write d0/d24/d2b/d3d/d3b/f5c [9046539,129290] 0 2024-09-17T01:41:27.955 INFO:tasks.workunit.client.0.smithi082.stdout:4/271: mkdir d9/d15/d16/d18/d4a/d52 0 2024-09-17T01:41:27.957 INFO:tasks.workunit.client.0.smithi082.stdout:1/285: dread d2/da/d16/f1c [0,4194304] 0 2024-09-17T01:41:27.957 INFO:tasks.workunit.client.1.smithi167.stdout:2/476: rmdir d5/d6d 39 2024-09-17T01:41:27.959 INFO:tasks.workunit.client.0.smithi082.stdout:6/319: creat d1/d7/d10/d4f/dc/f77 x:0 0 0 2024-09-17T01:41:27.960 INFO:tasks.workunit.client.1.smithi167.stdout:1/504: mknod d0/d5/cab 0 2024-09-17T01:41:27.961 INFO:tasks.workunit.client.1.smithi167.stdout:1/505: dread d0/d9/d16/d22/f66 [0,4194304] 0 2024-09-17T01:41:27.962 INFO:tasks.workunit.client.1.smithi167.stdout:2/477: creat d5/d33/d48/fa8 x:0 0 0 2024-09-17T01:41:27.962 INFO:tasks.workunit.client.1.smithi167.stdout:1/506: fdatasync d0/d9/d16/d48/d54/d78/f92 0 2024-09-17T01:41:27.963 INFO:tasks.workunit.client.1.smithi167.stdout:7/498: creat d0/d2/d14/d19/d26/fa6 x:0 0 0 2024-09-17T01:41:27.963 INFO:tasks.workunit.client.1.smithi167.stdout:1/507: write d0/f2e [55248,2790] 0 2024-09-17T01:41:27.964 INFO:tasks.workunit.client.0.smithi082.stdout:5/243: creat db/d12/f50 x:0 0 0 2024-09-17T01:41:27.965 INFO:tasks.workunit.client.1.smithi167.stdout:1/508: stat d0/d5/d34/d3c/f42 0 2024-09-17T01:41:27.965 INFO:tasks.workunit.client.1.smithi167.stdout:0/461: sync 2024-09-17T01:41:27.965 INFO:tasks.workunit.client.1.smithi167.stdout:5/429: rename d0/d24/d2b/l2c to d0/d28/d3a/l7e 0 2024-09-17T01:41:27.966 INFO:tasks.workunit.client.0.smithi082.stdout:0/184: sync 2024-09-17T01:41:27.969 INFO:tasks.workunit.client.0.smithi082.stdout:5/244: creat db/d1e/d20/d30/f51 x:0 0 0 2024-09-17T01:41:27.969 INFO:tasks.workunit.client.0.smithi082.stdout:5/245: stat db/d1e/d20/d30/c49 0 2024-09-17T01:41:27.971 INFO:tasks.workunit.client.1.smithi167.stdout:9/585: mkdir d4/d9/d21/d2d/dae 0 2024-09-17T01:41:27.972 INFO:tasks.workunit.client.1.smithi167.stdout:7/499: mknod d0/d2/d14/d19/d26/d83/ca7 0 2024-09-17T01:41:27.972 INFO:tasks.workunit.client.0.smithi082.stdout:1/286: link d2/d3f/d24/c27 d2/da/d2f/c62 0 2024-09-17T01:41:27.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/287: write d2/da/f33 [915874,118665] 0 2024-09-17T01:41:27.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/288: stat d2/d3f/f19 0 2024-09-17T01:41:27.974 INFO:tasks.workunit.client.1.smithi167.stdout:8/597: mknod dc/d21/cbd 0 2024-09-17T01:41:27.974 INFO:tasks.workunit.client.0.smithi082.stdout:1/289: chown d2/f20 27564 1 2024-09-17T01:41:27.975 INFO:tasks.workunit.client.1.smithi167.stdout:2/478: dread d5/d10/d16/f1b [0,4194304] 0 2024-09-17T01:41:27.976 INFO:tasks.workunit.client.0.smithi082.stdout:1/290: read d2/da/f37 [470423,119597] 0 2024-09-17T01:41:27.976 INFO:tasks.workunit.client.1.smithi167.stdout:0/462: chown d5/d6b/d77/d37/d45/l7c 246391509 1 2024-09-17T01:41:27.977 INFO:tasks.workunit.client.0.smithi082.stdout:6/320: rename d1/d3/f5b to d1/d7/d10/d4f/f78 0 2024-09-17T01:41:27.977 INFO:tasks.workunit.client.1.smithi167.stdout:2/479: readlink d5/d10/d1a/d45/d8e/l60 0 2024-09-17T01:41:27.977 INFO:tasks.workunit.client.1.smithi167.stdout:6/660: write d7/f21 [1296571,27425] 0 2024-09-17T01:41:27.977 INFO:tasks.workunit.client.1.smithi167.stdout:5/430: rmdir d0/d54/d56 39 2024-09-17T01:41:27.979 INFO:tasks.workunit.client.1.smithi167.stdout:1/509: dwrite d0/f46 [4194304,4194304] 0 2024-09-17T01:41:27.980 INFO:tasks.workunit.client.1.smithi167.stdout:2/480: chown d5/d10/d1a/d45/d8e/f64 784981 1 2024-09-17T01:41:27.981 INFO:tasks.workunit.client.1.smithi167.stdout:1/510: fdatasync d0/d5/d34/f14 0 2024-09-17T01:41:27.981 INFO:tasks.workunit.client.1.smithi167.stdout:3/516: truncate d7/d8/d2a/f2e 700980 0 2024-09-17T01:41:27.983 INFO:tasks.workunit.client.1.smithi167.stdout:3/517: fsync d7/d8/d10/d14/d2c/f2f 0 2024-09-17T01:41:27.983 INFO:tasks.workunit.client.1.smithi167.stdout:7/500: rename d0/d2/d14/d19 to d0/d2/d14/d19/d22/da8 22 2024-09-17T01:41:27.983 INFO:tasks.workunit.client.0.smithi082.stdout:1/291: rmdir d2/da/d2f 39 2024-09-17T01:41:27.984 INFO:tasks.workunit.client.1.smithi167.stdout:3/518: fdatasync d7/f72 0 2024-09-17T01:41:27.987 INFO:tasks.workunit.client.1.smithi167.stdout:0/463: creat d5/d6b/d77/d4d/d56/d7b/f91 x:0 0 0 2024-09-17T01:41:27.987 INFO:tasks.workunit.client.1.smithi167.stdout:1/511: dwrite d0/d9/d16/d48/f65 [0,4194304] 0 2024-09-17T01:41:27.990 INFO:tasks.workunit.client.1.smithi167.stdout:5/431: symlink d0/d28/d3a/d44/d69/l7f 0 2024-09-17T01:41:27.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/231: write d3/dd/ff [284355,49414] 0 2024-09-17T01:41:27.991 INFO:tasks.workunit.client.1.smithi167.stdout:2/481: fsync d5/d10/d16/f73 0 2024-09-17T01:41:27.997 INFO:tasks.workunit.client.1.smithi167.stdout:0/464: dwrite d5/f83 [0,4194304] 0 2024-09-17T01:41:27.999 INFO:tasks.workunit.client.1.smithi167.stdout:4/546: creat d0/d4/d7/da/d48/fb3 x:0 0 0 2024-09-17T01:41:28.002 INFO:tasks.workunit.client.0.smithi082.stdout:7/278: dwrite d0/d3/db/f29 [0,4194304] 0 2024-09-17T01:41:28.002 INFO:tasks.workunit.client.0.smithi082.stdout:0/185: rename da/d1e/c3a to da/c3e 0 2024-09-17T01:41:28.003 INFO:tasks.workunit.client.1.smithi167.stdout:4/547: read d0/d4/d7/da/f30 [1242673,113615] 0 2024-09-17T01:41:28.004 INFO:tasks.workunit.client.0.smithi082.stdout:9/222: dwrite d4/d27/d2d/d3d/f47 [4194304,4194304] 0 2024-09-17T01:41:28.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:27 smithi167 ceph-mon[35643]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 186 MiB/s wr, 352 op/s 2024-09-17T01:41:28.005 INFO:tasks.workunit.client.0.smithi082.stdout:9/223: chown d4/d27/d21/d2e/d11 42681 1 2024-09-17T01:41:28.006 INFO:tasks.workunit.client.1.smithi167.stdout:0/465: dwrite d5/d6b/d77/d37/d80/f82 [0,4194304] 0 2024-09-17T01:41:28.008 INFO:tasks.workunit.client.0.smithi082.stdout:5/246: getdents db/d12/d29 0 2024-09-17T01:41:28.009 INFO:tasks.workunit.client.1.smithi167.stdout:7/501: read d0/d2/d14/d19/f1e [919575,80664] 0 2024-09-17T01:41:28.009 INFO:tasks.workunit.client.0.smithi082.stdout:5/247: fdatasync db/d1e/d20/f3e 0 2024-09-17T01:41:28.010 INFO:tasks.workunit.client.0.smithi082.stdout:5/248: write db/d12/d18/f4a [1022742,91676] 0 2024-09-17T01:41:28.011 INFO:tasks.workunit.client.1.smithi167.stdout:7/502: fdatasync d0/d2/d14/d19/d26/fa6 0 2024-09-17T01:41:28.013 INFO:tasks.workunit.client.0.smithi082.stdout:6/321: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l52 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55/l79 0 2024-09-17T01:41:28.015 INFO:tasks.workunit.client.0.smithi082.stdout:6/322: write d1/d7/d10/d4f/dc/d1d/d36/f67 [52111,9862] 0 2024-09-17T01:41:28.016 INFO:tasks.workunit.client.1.smithi167.stdout:1/512: creat d0/d5/d61/fac x:0 0 0 2024-09-17T01:41:28.017 INFO:tasks.workunit.client.0.smithi082.stdout:0/186: creat da/d16/f3f x:0 0 0 2024-09-17T01:41:28.019 INFO:tasks.workunit.client.1.smithi167.stdout:1/513: write d0/d5/d34/f14 [8578659,80876] 0 2024-09-17T01:41:28.021 INFO:tasks.workunit.client.1.smithi167.stdout:1/514: truncate d0/d5/f8d 519524 0 2024-09-17T01:41:28.026 INFO:tasks.workunit.client.0.smithi082.stdout:5/249: creat db/d1e/f52 x:0 0 0 2024-09-17T01:41:28.027 INFO:tasks.workunit.client.0.smithi082.stdout:5/250: dread - db/d1e/d20/f3f zero size 2024-09-17T01:41:28.027 INFO:tasks.workunit.client.1.smithi167.stdout:9/586: creat d4/d9/d21/d43/faf x:0 0 0 2024-09-17T01:41:28.029 INFO:tasks.workunit.client.0.smithi082.stdout:4/272: symlink d9/l53 0 2024-09-17T01:41:28.030 INFO:tasks.workunit.client.0.smithi082.stdout:3/181: sync 2024-09-17T01:41:28.030 INFO:tasks.workunit.client.0.smithi082.stdout:2/215: sync 2024-09-17T01:41:28.033 INFO:tasks.workunit.client.0.smithi082.stdout:7/279: getdents d0/d3/db/d10/d47 0 2024-09-17T01:41:28.035 INFO:tasks.workunit.client.1.smithi167.stdout:7/503: dread d0/d2/d14/d19/d22/f25 [0,4194304] 0 2024-09-17T01:41:28.037 INFO:tasks.workunit.client.0.smithi082.stdout:6/323: dwrite d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:28.037 INFO:tasks.workunit.client.1.smithi167.stdout:7/504: chown d0/d2/d14/d19/d26/f1c 89 1 2024-09-17T01:41:28.038 INFO:tasks.workunit.client.1.smithi167.stdout:7/505: write d0/f74 [910641,114036] 0 2024-09-17T01:41:28.038 INFO:tasks.workunit.client.0.smithi082.stdout:5/251: rename db/d1e/d20/d30/f51 to db/d12/d29/d4f/f53 0 2024-09-17T01:41:28.038 INFO:tasks.workunit.client.1.smithi167.stdout:4/548: dwrite d0/d4/d69/f6b [0,4194304] 0 2024-09-17T01:41:28.040 INFO:tasks.workunit.client.0.smithi082.stdout:5/252: truncate fa 1155624 0 2024-09-17T01:41:28.041 INFO:tasks.workunit.client.0.smithi082.stdout:3/182: dwrite d9/db/d26/f27 [0,4194304] 0 2024-09-17T01:41:28.042 INFO:tasks.workunit.client.1.smithi167.stdout:0/466: unlink d5/d8/f79 0 2024-09-17T01:41:28.043 INFO:tasks.workunit.client.1.smithi167.stdout:0/467: stat d5/d6b/d77/d4d/l64 0 2024-09-17T01:41:28.043 INFO:tasks.workunit.client.1.smithi167.stdout:0/468: chown d5/d6b/d77/d6d 78073240 1 2024-09-17T01:41:28.043 INFO:tasks.workunit.client.0.smithi082.stdout:7/280: fdatasync d0/d3/db/f29 0 2024-09-17T01:41:28.043 INFO:tasks.workunit.client.0.smithi082.stdout:5/253: write db/d12/f50 [470242,124471] 0 2024-09-17T01:41:28.044 INFO:tasks.workunit.client.0.smithi082.stdout:7/281: chown d0/dd 3892 1 2024-09-17T01:41:28.046 INFO:tasks.workunit.client.0.smithi082.stdout:4/273: mkdir d9/d15/d16/d3e/d54 0 2024-09-17T01:41:28.049 INFO:tasks.workunit.client.1.smithi167.stdout:5/432: mkdir d0/d28/d80 0 2024-09-17T01:41:28.049 INFO:tasks.workunit.client.0.smithi082.stdout:0/187: symlink da/d1b/l40 0 2024-09-17T01:41:28.052 INFO:tasks.workunit.client.0.smithi082.stdout:0/188: truncate da/f31 1199508 0 2024-09-17T01:41:28.052 INFO:tasks.workunit.client.1.smithi167.stdout:1/515: creat d0/d9/d16/fad x:0 0 0 2024-09-17T01:41:28.053 INFO:tasks.workunit.client.0.smithi082.stdout:0/189: read - da/d16/f3f zero size 2024-09-17T01:41:28.054 INFO:tasks.workunit.client.0.smithi082.stdout:5/254: read db/d12/f1c [2507006,43685] 0 2024-09-17T01:41:28.055 INFO:tasks.workunit.client.1.smithi167.stdout:2/482: symlink d5/d33/d48/d72/d94/la9 0 2024-09-17T01:41:28.055 INFO:tasks.workunit.client.0.smithi082.stdout:0/190: readlink da/d1b/d23/l2d 0 2024-09-17T01:41:28.057 INFO:tasks.workunit.client.1.smithi167.stdout:6/661: link d7/d54/d90/d13/d2f/d96/dab/f31 d7/d54/d90/d13/d2f/d64/d6b/fef 0 2024-09-17T01:41:28.057 INFO:tasks.workunit.client.1.smithi167.stdout:2/483: write d5/d10/d1a/d45/d8e/f64 [1923935,123372] 0 2024-09-17T01:41:28.058 INFO:tasks.workunit.client.0.smithi082.stdout:7/282: dwrite d0/d3/db/f33 [0,4194304] 0 2024-09-17T01:41:28.061 INFO:tasks.workunit.client.1.smithi167.stdout:9/587: truncate d4/d9/d21/d2d/d33/d80/f9f 818389 0 2024-09-17T01:41:28.062 INFO:tasks.workunit.client.1.smithi167.stdout:8/598: getdents dc/d21 0 2024-09-17T01:41:28.070 INFO:tasks.workunit.client.0.smithi082.stdout:2/216: dread d1/d35/f24 [0,4194304] 0 2024-09-17T01:41:28.072 INFO:tasks.workunit.client.0.smithi082.stdout:2/217: chown d1/fd 3977 1 2024-09-17T01:41:28.072 INFO:tasks.workunit.client.0.smithi082.stdout:4/274: write d9/d15/f2e [4107686,125498] 0 2024-09-17T01:41:28.073 INFO:tasks.workunit.client.0.smithi082.stdout:2/218: readlink d1/l1d 0 2024-09-17T01:41:28.073 INFO:tasks.workunit.client.0.smithi082.stdout:8/232: write d3/f25 [4183703,47730] 0 2024-09-17T01:41:28.074 INFO:tasks.workunit.client.1.smithi167.stdout:0/469: mkdir d5/d6b/d77/d92 0 2024-09-17T01:41:28.075 INFO:tasks.workunit.client.1.smithi167.stdout:0/470: chown d5/d8/d9/d2f/c5e 32 1 2024-09-17T01:41:28.076 INFO:tasks.workunit.client.0.smithi082.stdout:9/224: getdents d4/d27 0 2024-09-17T01:41:28.077 INFO:tasks.workunit.client.0.smithi082.stdout:2/219: truncate d1/d17/f3b 33390 0 2024-09-17T01:41:28.079 INFO:tasks.workunit.client.1.smithi167.stdout:4/549: dread d0/d4/d7/da/d48/d40/d51/d2d/d2e/f3d [0,4194304] 0 2024-09-17T01:41:28.079 INFO:tasks.workunit.client.0.smithi082.stdout:1/292: dwrite d2/da/d2f/f31 [0,4194304] 0 2024-09-17T01:41:28.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/220: fdatasync d1/f1b 0 2024-09-17T01:41:28.080 INFO:tasks.workunit.client.1.smithi167.stdout:0/471: dread d5/d8/d9/f7f [0,4194304] 0 2024-09-17T01:41:28.080 INFO:tasks.workunit.client.0.smithi082.stdout:1/293: stat d2/d3f/d24/f23 0 2024-09-17T01:41:28.087 INFO:tasks.workunit.client.1.smithi167.stdout:6/662: rmdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56 39 2024-09-17T01:41:28.089 INFO:tasks.workunit.client.1.smithi167.stdout:2/484: mknod d5/d10/d1a/d45/d6b/caa 0 2024-09-17T01:41:28.092 INFO:tasks.workunit.client.0.smithi082.stdout:3/183: dread d9/f29 [0,4194304] 0 2024-09-17T01:41:28.093 INFO:tasks.workunit.client.1.smithi167.stdout:6/663: dwrite d7/f8a [0,4194304] 0 2024-09-17T01:41:28.094 INFO:tasks.workunit.client.1.smithi167.stdout:1/516: dread d0/f2e [0,4194304] 0 2024-09-17T01:41:28.095 INFO:tasks.workunit.client.1.smithi167.stdout:8/599: mkdir dc/d56/d59/d82/dbe 0 2024-09-17T01:41:28.095 INFO:tasks.workunit.client.0.smithi082.stdout:8/233: creat d3/dd/d18/d2d/d3e/d43/f45 x:0 0 0 2024-09-17T01:41:28.097 INFO:tasks.workunit.client.1.smithi167.stdout:8/600: write dc/d56/d57/d7e/f93 [604128,28488] 0 2024-09-17T01:41:28.098 INFO:tasks.workunit.client.1.smithi167.stdout:3/519: getdents d7/d8 0 2024-09-17T01:41:28.099 INFO:tasks.workunit.client.0.smithi082.stdout:5/255: symlink db/d12/d18/d23/l54 0 2024-09-17T01:41:28.107 INFO:tasks.workunit.client.0.smithi082.stdout:0/191: symlink da/df/d2b/l41 0 2024-09-17T01:41:28.107 INFO:tasks.workunit.client.0.smithi082.stdout:6/324: write d1/d1f/f64 [103676,8259] 0 2024-09-17T01:41:28.109 INFO:tasks.workunit.client.0.smithi082.stdout:7/283: fdatasync d0/dd/d2c/f40 0 2024-09-17T01:41:28.111 INFO:tasks.workunit.client.0.smithi082.stdout:9/225: mknod d4/c4d 0 2024-09-17T01:41:28.113 INFO:tasks.workunit.client.0.smithi082.stdout:5/256: creat db/d1e/f55 x:0 0 0 2024-09-17T01:41:28.114 INFO:tasks.workunit.client.0.smithi082.stdout:5/257: truncate db/d1e/d20/d30/f33 920333 0 2024-09-17T01:41:28.115 INFO:tasks.workunit.client.1.smithi167.stdout:9/588: symlink d4/d9/d21/d43/lb0 0 2024-09-17T01:41:28.116 INFO:tasks.workunit.client.1.smithi167.stdout:1/517: symlink d0/lae 0 2024-09-17T01:41:28.117 INFO:tasks.workunit.client.1.smithi167.stdout:9/589: dread - d4/d9/d21/d2d/d33/d3a/fa0 zero size 2024-09-17T01:41:28.118 INFO:tasks.workunit.client.1.smithi167.stdout:6/664: rename d7/d54/d90/d13/d2f/d64/ccb to d7/d54/d90/d13/d2f/d96/dab/de3/cf0 0 2024-09-17T01:41:28.119 INFO:tasks.workunit.client.1.smithi167.stdout:8/601: creat dc/d56/d59/d82/d8f/d90/fbf x:0 0 0 2024-09-17T01:41:28.120 INFO:tasks.workunit.client.1.smithi167.stdout:8/602: chown dc/f17 3 1 2024-09-17T01:41:28.120 INFO:tasks.workunit.client.0.smithi082.stdout:1/294: mknod d2/c63 0 2024-09-17T01:41:28.121 INFO:tasks.workunit.client.1.smithi167.stdout:3/520: mknod d7/d8/d10/d14/d24/c9f 0 2024-09-17T01:41:28.122 INFO:tasks.workunit.client.1.smithi167.stdout:7/506: creat d0/fa9 x:0 0 0 2024-09-17T01:41:28.122 INFO:tasks.workunit.client.0.smithi082.stdout:7/284: mkdir d0/dd/d34/d58 0 2024-09-17T01:41:28.123 INFO:tasks.workunit.client.0.smithi082.stdout:7/285: write d0/d3/db/d10/f22 [1188354,59644] 0 2024-09-17T01:41:28.125 INFO:tasks.workunit.client.1.smithi167.stdout:4/550: dread d0/d4/d7/da/d48/d40/d51/d2d/f65 [0,4194304] 0 2024-09-17T01:41:28.131 INFO:tasks.workunit.client.0.smithi082.stdout:1/295: dread d2/d3f/f26 [0,4194304] 0 2024-09-17T01:41:28.131 INFO:tasks.workunit.client.0.smithi082.stdout:1/296: chown d2/da/d16 137900724 1 2024-09-17T01:41:28.134 INFO:tasks.workunit.client.0.smithi082.stdout:1/297: dread d2/da/f35 [0,4194304] 0 2024-09-17T01:41:28.210 INFO:tasks.workunit.client.0.smithi082.stdout:1/298: dwrite d2/da/d2f/d47/f4d [0,4194304] 0 2024-09-17T01:41:28.212 INFO:tasks.workunit.client.0.smithi082.stdout:1/299: fdatasync d2/da/d2d/f45 0 2024-09-17T01:41:28.212 INFO:tasks.workunit.client.1.smithi167.stdout:2/485: mknod d5/d6d/cab 0 2024-09-17T01:41:28.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:27 smithi082 ceph-mon[28077]: pgmap v17: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 34 MiB/s rd, 186 MiB/s wr, 352 op/s 2024-09-17T01:41:28.214 INFO:tasks.workunit.client.0.smithi082.stdout:1/300: fdatasync d2/da/f33 0 2024-09-17T01:41:28.214 INFO:tasks.workunit.client.0.smithi082.stdout:9/226: dwrite d4/f17 [8388608,4194304] 0 2024-09-17T01:41:28.217 INFO:tasks.workunit.client.1.smithi167.stdout:1/518: rmdir d0/d9/d16/d48 39 2024-09-17T01:41:28.223 INFO:tasks.workunit.client.0.smithi082.stdout:2/221: dwrite d1/f1f [0,4194304] 0 2024-09-17T01:41:28.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/275: truncate d9/d15/d16/f36 3096765 0 2024-09-17T01:41:28.226 INFO:tasks.workunit.client.1.smithi167.stdout:8/603: mkdir dc/d21/d6b/d74/d83/dc0 0 2024-09-17T01:41:28.226 INFO:tasks.workunit.client.1.smithi167.stdout:8/604: stat dc/d1a/f7d 0 2024-09-17T01:41:28.229 INFO:tasks.workunit.client.1.smithi167.stdout:3/521: creat d7/d8/d10/d29/d75/fa0 x:0 0 0 2024-09-17T01:41:28.230 INFO:tasks.workunit.client.1.smithi167.stdout:3/522: readlink d7/d8/d10/d14/d24/l56 0 2024-09-17T01:41:28.231 INFO:tasks.workunit.client.1.smithi167.stdout:3/523: dread - d7/d8/d10/d14/d2c/f89 zero size 2024-09-17T01:41:28.234 INFO:tasks.workunit.client.1.smithi167.stdout:4/551: fdatasync d0/d4/d7/da/d48/d40/d51/d2d/f65 0 2024-09-17T01:41:28.237 INFO:tasks.workunit.client.1.smithi167.stdout:5/433: getdents d0/d24/d2b/d3d 0 2024-09-17T01:41:28.239 INFO:tasks.workunit.client.1.smithi167.stdout:0/472: link d5/d6b/d77/d4d/l64 d5/d8/d9/l93 0 2024-09-17T01:41:28.239 INFO:tasks.workunit.client.1.smithi167.stdout:0/473: chown d5/d6b/d77/d37/d80 0 1 2024-09-17T01:41:28.240 INFO:tasks.workunit.client.0.smithi082.stdout:3/184: truncate d9/db/d26/f3a 1591572 0 2024-09-17T01:41:28.240 INFO:tasks.workunit.client.0.smithi082.stdout:3/185: write f6 [381472,22170] 0 2024-09-17T01:41:28.241 INFO:tasks.workunit.client.0.smithi082.stdout:9/227: rmdir d4/d27/d21/d2e/d11 39 2024-09-17T01:41:28.246 INFO:tasks.workunit.client.1.smithi167.stdout:1/519: mkdir d0/d9/d16/d36/daf 0 2024-09-17T01:41:28.247 INFO:tasks.workunit.client.1.smithi167.stdout:1/520: write d0/d5/f12 [5410085,86441] 0 2024-09-17T01:41:28.247 INFO:tasks.workunit.client.0.smithi082.stdout:5/258: rename db/d12 to db/d56 0 2024-09-17T01:41:28.248 INFO:tasks.workunit.client.1.smithi167.stdout:1/521: dread - d0/d9/d16/fad zero size 2024-09-17T01:41:28.248 INFO:tasks.workunit.client.0.smithi082.stdout:5/259: readlink db/l27 0 2024-09-17T01:41:28.249 INFO:tasks.workunit.client.1.smithi167.stdout:9/590: creat d4/d9/d21/d2d/d33/d3a/d9c/fb1 x:0 0 0 2024-09-17T01:41:28.250 INFO:tasks.workunit.client.0.smithi082.stdout:2/222: creat d1/d10/f41 x:0 0 0 2024-09-17T01:41:28.253 INFO:tasks.workunit.client.0.smithi082.stdout:4/276: rename d9/d31 to d9/d15/d16/d18/d4a/d52/d55 0 2024-09-17T01:41:28.253 INFO:tasks.workunit.client.0.smithi082.stdout:0/192: dwrite da/df/d2b/f39 [0,4194304] 0 2024-09-17T01:41:28.254 INFO:tasks.workunit.client.1.smithi167.stdout:8/605: mkdir dc/d56/d57/da0/da7/dc1 0 2024-09-17T01:41:28.255 INFO:tasks.workunit.client.0.smithi082.stdout:0/193: write da/f31 [1463896,104459] 0 2024-09-17T01:41:28.256 INFO:tasks.workunit.client.0.smithi082.stdout:0/194: chown da/d24/f2a 1 1 2024-09-17T01:41:28.257 INFO:tasks.workunit.client.1.smithi167.stdout:3/524: creat d7/d8/d10/d14/d66/d6c/fa1 x:0 0 0 2024-09-17T01:41:28.261 INFO:tasks.workunit.client.0.smithi082.stdout:9/228: creat d4/d27/d36/f4e x:0 0 0 2024-09-17T01:41:28.261 INFO:tasks.workunit.client.0.smithi082.stdout:9/229: chown d4 1665978 1 2024-09-17T01:41:28.262 INFO:tasks.workunit.client.1.smithi167.stdout:4/552: mkdir d0/d4/db4 0 2024-09-17T01:41:28.263 INFO:tasks.workunit.client.1.smithi167.stdout:4/553: write d0/d4/d7/d6/d5d/f68 [919514,104232] 0 2024-09-17T01:41:28.265 INFO:tasks.workunit.client.0.smithi082.stdout:2/223: dread d1/f9 [0,4194304] 0 2024-09-17T01:41:28.272 INFO:tasks.workunit.client.1.smithi167.stdout:8/606: rmdir dc/d18 39 2024-09-17T01:41:28.274 INFO:tasks.workunit.client.1.smithi167.stdout:3/525: mkdir d7/d8/d10/d14/d66/d6c/da2 0 2024-09-17T01:41:28.275 INFO:tasks.workunit.client.1.smithi167.stdout:3/526: chown d7/d8/d2a/c99 90 1 2024-09-17T01:41:28.277 INFO:tasks.workunit.client.1.smithi167.stdout:7/507: creat d0/d2/faa x:0 0 0 2024-09-17T01:41:28.280 INFO:tasks.workunit.client.0.smithi082.stdout:1/301: dwrite d2/df/f1d [0,4194304] 0 2024-09-17T01:41:28.281 INFO:tasks.workunit.client.1.smithi167.stdout:2/486: dwrite d5/d10/d1a/d45/f68 [4194304,4194304] 0 2024-09-17T01:41:28.283 INFO:tasks.workunit.client.1.smithi167.stdout:2/487: read - d5/d10/d1a/d2e/f7d zero size 2024-09-17T01:41:28.283 INFO:tasks.workunit.client.1.smithi167.stdout:4/554: rmdir d0/d4/d7/d6/d5d 39 2024-09-17T01:41:28.283 INFO:tasks.workunit.client.0.smithi082.stdout:1/302: write d2/da/d2f/d47/f51 [373380,70087] 0 2024-09-17T01:41:28.283 INFO:tasks.workunit.client.0.smithi082.stdout:5/260: dread f9 [4194304,4194304] 0 2024-09-17T01:41:28.286 INFO:tasks.workunit.client.0.smithi082.stdout:3/186: creat d9/db/f3c x:0 0 0 2024-09-17T01:41:28.288 INFO:tasks.workunit.client.1.smithi167.stdout:1/522: creat d0/d9/d16/d48/fb0 x:0 0 0 2024-09-17T01:41:28.290 INFO:tasks.workunit.client.0.smithi082.stdout:2/224: mkdir d1/d17/d38/d42 0 2024-09-17T01:41:28.292 INFO:tasks.workunit.client.1.smithi167.stdout:6/665: getdents d7/d54/d90/d13/d2f/d7f/d98/d27/d3a 0 2024-09-17T01:41:28.294 INFO:tasks.workunit.client.1.smithi167.stdout:9/591: dread d4/d9/d21/d2d/d33/d3a/f40 [0,4194304] 0 2024-09-17T01:41:28.295 INFO:tasks.workunit.client.1.smithi167.stdout:9/592: chown d4/d9/d21/d43/f69 67264 1 2024-09-17T01:41:28.297 INFO:tasks.workunit.client.1.smithi167.stdout:3/527: mkdir d7/d8/d10/d14/d24/d9c/da3 0 2024-09-17T01:41:28.297 INFO:tasks.workunit.client.0.smithi082.stdout:2/225: dwrite d1/d35/f37 [0,4194304] 0 2024-09-17T01:41:28.299 INFO:tasks.workunit.client.0.smithi082.stdout:1/303: write d2/f5f [525758,127994] 0 2024-09-17T01:41:28.305 INFO:tasks.workunit.client.1.smithi167.stdout:5/434: rename d0/d24/d2b/d3d/d3b/f3e to d0/d24/d2b/f81 0 2024-09-17T01:41:28.306 INFO:tasks.workunit.client.1.smithi167.stdout:5/435: dread - d0/d28/d3a/d44/f5e zero size 2024-09-17T01:41:28.307 INFO:tasks.workunit.client.0.smithi082.stdout:3/187: chown d9/ff 528 1 2024-09-17T01:41:28.307 INFO:tasks.workunit.client.0.smithi082.stdout:1/304: dwrite d2/d3f/f5a [0,4194304] 0 2024-09-17T01:41:28.307 INFO:tasks.workunit.client.0.smithi082.stdout:0/195: write da/fb [1404023,38061] 0 2024-09-17T01:41:28.308 INFO:tasks.workunit.client.1.smithi167.stdout:5/436: read d0/d24/d2b/f81 [3345954,43733] 0 2024-09-17T01:41:28.317 INFO:tasks.workunit.client.1.smithi167.stdout:3/528: creat d7/d8/d10/d29/fa4 x:0 0 0 2024-09-17T01:41:28.318 INFO:tasks.workunit.client.1.smithi167.stdout:3/529: fsync d7/d8/d2a/d4e/f58 0 2024-09-17T01:41:28.321 INFO:tasks.workunit.client.1.smithi167.stdout:1/523: rename d0/d9/d16/d48/d80/l8e to d0/d9/d16/d48/d54/d6e/lb1 0 2024-09-17T01:41:28.322 INFO:tasks.workunit.client.1.smithi167.stdout:1/524: fsync d0/d5/d34/d3c/f2b 0 2024-09-17T01:41:28.322 INFO:tasks.workunit.client.1.smithi167.stdout:4/555: creat d0/d4/db4/fb5 x:0 0 0 2024-09-17T01:41:28.323 INFO:tasks.workunit.client.1.smithi167.stdout:2/488: write d5/d10/d1a/d46/f4f [3909696,87484] 0 2024-09-17T01:41:28.323 INFO:tasks.workunit.client.1.smithi167.stdout:9/593: mknod d4/d9/cb2 0 2024-09-17T01:41:28.325 INFO:tasks.workunit.client.1.smithi167.stdout:2/489: fsync d5/d10/d1a/f37 0 2024-09-17T01:41:28.326 INFO:tasks.workunit.client.1.smithi167.stdout:6/666: creat d7/ff1 x:0 0 0 2024-09-17T01:41:28.330 INFO:tasks.workunit.client.1.smithi167.stdout:1/525: creat d0/d9/d16/d48/d54/d6e/d7e/fb2 x:0 0 0 2024-09-17T01:41:28.330 INFO:tasks.workunit.client.1.smithi167.stdout:7/508: link d0/d2/d14/d19/d26/d83/da5/d5b/f60 d0/d2/d88/fab 0 2024-09-17T01:41:28.331 INFO:tasks.workunit.client.1.smithi167.stdout:6/667: read d7/d52/d79/da4/fce [7203696,19026] 0 2024-09-17T01:41:28.332 INFO:tasks.workunit.client.1.smithi167.stdout:4/556: unlink d0/d4/d7/da/d48/d40/dad/fae 0 2024-09-17T01:41:28.333 INFO:tasks.workunit.client.1.smithi167.stdout:8/607: dwrite dc/d56/d57/d5c/f5d [4194304,4194304] 0 2024-09-17T01:41:28.334 INFO:tasks.workunit.client.1.smithi167.stdout:2/490: creat d5/d3c/d4c/d4d/fac x:0 0 0 2024-09-17T01:41:28.335 INFO:tasks.workunit.client.1.smithi167.stdout:6/668: chown d7/d54/d90/d34/dc8 1233067 1 2024-09-17T01:41:28.337 INFO:tasks.workunit.client.1.smithi167.stdout:9/594: dwrite d4/f4e [0,4194304] 0 2024-09-17T01:41:28.337 INFO:tasks.workunit.client.1.smithi167.stdout:1/526: unlink d0/d5/d61/ca0 0 2024-09-17T01:41:28.338 INFO:tasks.workunit.client.1.smithi167.stdout:2/491: truncate d5/d33/f57 983336 0 2024-09-17T01:41:28.339 INFO:tasks.workunit.client.1.smithi167.stdout:2/492: dread - d5/d3c/d4c/d4d/fa6 zero size 2024-09-17T01:41:28.342 INFO:tasks.workunit.client.1.smithi167.stdout:7/509: creat d0/d2/d14/d6f/d8b/fac x:0 0 0 2024-09-17T01:41:28.343 INFO:tasks.workunit.client.1.smithi167.stdout:3/530: dread d7/f54 [0,4194304] 0 2024-09-17T01:41:28.343 INFO:tasks.workunit.client.1.smithi167.stdout:9/595: creat d4/d4a/fb3 x:0 0 0 2024-09-17T01:41:28.344 INFO:tasks.workunit.client.1.smithi167.stdout:9/596: write d4/f4e [2651092,95528] 0 2024-09-17T01:41:28.346 INFO:tasks.workunit.client.1.smithi167.stdout:4/557: creat d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/fb6 x:0 0 0 2024-09-17T01:41:28.347 INFO:tasks.workunit.client.1.smithi167.stdout:1/527: symlink d0/d5/d34/d3c/lb3 0 2024-09-17T01:41:28.349 INFO:tasks.workunit.client.1.smithi167.stdout:8/608: mkdir dc/d56/d57/dc2 0 2024-09-17T01:41:28.351 INFO:tasks.workunit.client.1.smithi167.stdout:8/609: truncate dc/f7a 4575346 0 2024-09-17T01:41:28.351 INFO:tasks.workunit.client.1.smithi167.stdout:7/510: dwrite d0/d2/d88/f6c [0,4194304] 0 2024-09-17T01:41:28.351 INFO:tasks.workunit.client.1.smithi167.stdout:6/669: dread d7/fae [0,4194304] 0 2024-09-17T01:41:28.352 INFO:tasks.workunit.client.1.smithi167.stdout:8/610: chown dc/dae 1 1 2024-09-17T01:41:28.353 INFO:tasks.workunit.client.1.smithi167.stdout:9/597: creat d4/d9/d21/d2d/fb4 x:0 0 0 2024-09-17T01:41:28.356 INFO:tasks.workunit.client.1.smithi167.stdout:7/511: fdatasync d0/d2/f9d 0 2024-09-17T01:41:28.356 INFO:tasks.workunit.client.1.smithi167.stdout:6/670: mknod d7/d54/d90/d34/dc8/cf2 0 2024-09-17T01:41:28.356 INFO:tasks.workunit.client.1.smithi167.stdout:4/558: symlink d0/d4/d7/d6/d5d/lb7 0 2024-09-17T01:41:28.356 INFO:tasks.workunit.client.1.smithi167.stdout:2/493: link d5/d10/d1a/d45/l86 d5/d33/lad 0 2024-09-17T01:41:28.357 INFO:tasks.workunit.client.1.smithi167.stdout:1/528: creat d0/d5/d61/da2/fb4 x:0 0 0 2024-09-17T01:41:28.357 INFO:tasks.workunit.client.1.smithi167.stdout:8/611: mkdir dc/d56/d57/da0/da7/dc3 0 2024-09-17T01:41:28.361 INFO:tasks.workunit.client.1.smithi167.stdout:1/529: read - d0/d9/d16/d48/d54/d6e/f7b zero size 2024-09-17T01:41:28.361 INFO:tasks.workunit.client.1.smithi167.stdout:3/531: dwrite d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:28.364 INFO:tasks.workunit.client.1.smithi167.stdout:6/671: creat d7/d52/d8c/ff3 x:0 0 0 2024-09-17T01:41:28.364 INFO:tasks.workunit.client.1.smithi167.stdout:1/530: truncate d0/f46 9208924 0 2024-09-17T01:41:28.370 INFO:tasks.workunit.client.1.smithi167.stdout:7/512: creat d0/d2/d14/fad x:0 0 0 2024-09-17T01:41:28.371 INFO:tasks.workunit.client.1.smithi167.stdout:8/612: fsync dc/d18/f46 0 2024-09-17T01:41:28.372 INFO:tasks.workunit.client.1.smithi167.stdout:4/559: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8 0 2024-09-17T01:41:28.373 INFO:tasks.workunit.client.1.smithi167.stdout:6/672: readlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/lbd 0 2024-09-17T01:41:28.374 INFO:tasks.workunit.client.1.smithi167.stdout:6/673: stat d7/d52/db7/fe8 0 2024-09-17T01:41:28.374 INFO:tasks.workunit.client.1.smithi167.stdout:4/560: write d0/d4/d7/da/d48/d40/d51/d2d/d2e/f63 [3728896,118538] 0 2024-09-17T01:41:28.375 INFO:tasks.workunit.client.1.smithi167.stdout:7/513: readlink d0/d2/l91 0 2024-09-17T01:41:28.377 INFO:tasks.workunit.client.1.smithi167.stdout:8/613: readlink dc/d56/d57/l84 0 2024-09-17T01:41:28.377 INFO:tasks.workunit.client.1.smithi167.stdout:6/674: write d7/d54/d90/d13/fd3 [226462,23161] 0 2024-09-17T01:41:28.379 INFO:tasks.workunit.client.1.smithi167.stdout:1/531: mkdir d0/d5/d34/d3c/d85/db5 0 2024-09-17T01:41:28.381 INFO:tasks.workunit.client.1.smithi167.stdout:7/514: truncate d0/f13 2352927 0 2024-09-17T01:41:28.382 INFO:tasks.workunit.client.1.smithi167.stdout:8/614: readlink dc/le 0 2024-09-17T01:41:28.383 INFO:tasks.workunit.client.1.smithi167.stdout:6/675: mkdir d7/d42/df4 0 2024-09-17T01:41:28.383 INFO:tasks.workunit.client.1.smithi167.stdout:4/561: symlink d0/d4/d7/d6/d2b/d6d/d7e/da8/lb9 0 2024-09-17T01:41:28.385 INFO:tasks.workunit.client.1.smithi167.stdout:0/474: sync 2024-09-17T01:41:28.385 INFO:tasks.workunit.client.1.smithi167.stdout:7/515: stat d0/d2/d14/f1b 0 2024-09-17T01:41:28.385 INFO:tasks.workunit.client.1.smithi167.stdout:1/532: fdatasync d0/d9/d16/d48/d54/f64 0 2024-09-17T01:41:28.387 INFO:tasks.workunit.client.1.smithi167.stdout:9/598: dwrite d4/d9/d21/f3b [0,4194304] 0 2024-09-17T01:41:28.389 INFO:tasks.workunit.client.1.smithi167.stdout:8/615: creat dc/fc4 x:0 0 0 2024-09-17T01:41:28.389 INFO:tasks.workunit.client.1.smithi167.stdout:4/562: write d0/d4/fa5 [221452,63092] 0 2024-09-17T01:41:28.393 INFO:tasks.workunit.client.1.smithi167.stdout:3/532: dwrite d7/d1e/f80 [4194304,4194304] 0 2024-09-17T01:41:28.393 INFO:tasks.workunit.client.1.smithi167.stdout:6/676: mknod d7/d54/d90/d13/d2f/d64/d6b/cf5 0 2024-09-17T01:41:28.394 INFO:tasks.workunit.client.1.smithi167.stdout:2/494: dread d5/d10/d1a/d46/f4f [0,4194304] 0 2024-09-17T01:41:28.396 INFO:tasks.workunit.client.1.smithi167.stdout:8/616: symlink dc/d56/lc5 0 2024-09-17T01:41:28.397 INFO:tasks.workunit.client.1.smithi167.stdout:1/533: symlink d0/d5/d34/d3c/d74/lb6 0 2024-09-17T01:41:28.399 INFO:tasks.workunit.client.1.smithi167.stdout:2/495: creat d5/d71/fae x:0 0 0 2024-09-17T01:41:28.400 INFO:tasks.workunit.client.1.smithi167.stdout:7/516: dread d0/d2/d14/d19/d32/d62/f64 [0,4194304] 0 2024-09-17T01:41:28.400 INFO:tasks.workunit.client.1.smithi167.stdout:9/599: mknod d4/da4/cb5 0 2024-09-17T01:41:28.401 INFO:tasks.workunit.client.1.smithi167.stdout:4/563: symlink d0/d4/d7/da/d48/d40/d51/d2d/lba 0 2024-09-17T01:41:28.403 INFO:tasks.workunit.client.1.smithi167.stdout:3/533: creat d7/d8/d10/d29/fa5 x:0 0 0 2024-09-17T01:41:28.405 INFO:tasks.workunit.client.1.smithi167.stdout:0/475: dwrite d5/d6b/d77/d4d/f2b [0,4194304] 0 2024-09-17T01:41:28.405 INFO:tasks.workunit.client.1.smithi167.stdout:8/617: write dc/f29 [3992556,72509] 0 2024-09-17T01:41:28.405 INFO:tasks.workunit.client.1.smithi167.stdout:1/534: rmdir d0/d5/d34/d3c/d85 39 2024-09-17T01:41:28.407 INFO:tasks.workunit.client.1.smithi167.stdout:7/517: chown d0/d2/d14/d6f/d8b/fac 8980774 1 2024-09-17T01:41:28.409 INFO:tasks.workunit.client.1.smithi167.stdout:3/534: write d7/d8/d10/f40 [1112087,81295] 0 2024-09-17T01:41:28.412 INFO:tasks.workunit.client.1.smithi167.stdout:6/677: link d7/d54/d90/d13/d2f/d30/fc9 d7/d54/d90/d34/ff6 0 2024-09-17T01:41:28.413 INFO:tasks.workunit.client.1.smithi167.stdout:4/564: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/c4a 0 1 2024-09-17T01:41:28.414 INFO:tasks.workunit.client.1.smithi167.stdout:7/518: dread - d0/d2/d14/d6f/d8b/fac zero size 2024-09-17T01:41:28.417 INFO:tasks.workunit.client.1.smithi167.stdout:2/496: dread d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:28.417 INFO:tasks.workunit.client.1.smithi167.stdout:9/600: dwrite d4/d9/d21/d43/d6c/f9d [0,4194304] 0 2024-09-17T01:41:28.418 INFO:tasks.workunit.client.1.smithi167.stdout:4/565: stat d0/d4/d7/da/d48/l89 0 2024-09-17T01:41:28.418 INFO:tasks.workunit.client.1.smithi167.stdout:8/618: rmdir dc/d56/d57/da0/da7/dc3 0 2024-09-17T01:41:28.419 INFO:tasks.workunit.client.1.smithi167.stdout:6/678: truncate d7/d54/d90/d13/f75 658200 0 2024-09-17T01:41:28.421 INFO:tasks.workunit.client.1.smithi167.stdout:7/519: mkdir d0/d2/d14/d6f/d87/dae 0 2024-09-17T01:41:28.424 INFO:tasks.workunit.client.1.smithi167.stdout:4/566: creat d0/d4/d69/fbb x:0 0 0 2024-09-17T01:41:28.424 INFO:tasks.workunit.client.1.smithi167.stdout:7/520: fdatasync d0/d2/d14/d19/f82 0 2024-09-17T01:41:28.424 INFO:tasks.workunit.client.1.smithi167.stdout:6/679: stat d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/l6a 0 2024-09-17T01:41:28.426 INFO:tasks.workunit.client.1.smithi167.stdout:2/497: creat d5/d33/d48/d72/d94/faf x:0 0 0 2024-09-17T01:41:28.426 INFO:tasks.workunit.client.1.smithi167.stdout:4/567: readlink d0/d4/d7/da/d48/l5b 0 2024-09-17T01:41:28.427 INFO:tasks.workunit.client.1.smithi167.stdout:7/521: dread - d0/d2/d14/f6b zero size 2024-09-17T01:41:28.427 INFO:tasks.workunit.client.1.smithi167.stdout:8/619: creat dc/d56/d57/d5c/fc6 x:0 0 0 2024-09-17T01:41:28.427 INFO:tasks.workunit.client.1.smithi167.stdout:9/601: mknod d4/d9/d97/cb6 0 2024-09-17T01:41:28.429 INFO:tasks.workunit.client.1.smithi167.stdout:3/535: getdents d7/d8/d10/d14/d24 0 2024-09-17T01:41:28.429 INFO:tasks.workunit.client.1.smithi167.stdout:1/535: dwrite d0/d9/d16/d36/f3e [0,4194304] 0 2024-09-17T01:41:28.432 INFO:tasks.workunit.client.1.smithi167.stdout:3/536: chown d7/d8/d10/f64 134 1 2024-09-17T01:41:28.434 INFO:tasks.workunit.client.1.smithi167.stdout:8/620: mkdir dc/d21/d6b/d74/d83/dc0/dc7 0 2024-09-17T01:41:28.434 INFO:tasks.workunit.client.1.smithi167.stdout:5/437: sync 2024-09-17T01:41:28.437 INFO:tasks.workunit.client.1.smithi167.stdout:1/536: symlink d0/d5/d34/d3c/d85/lb7 0 2024-09-17T01:41:28.439 INFO:tasks.workunit.client.1.smithi167.stdout:8/621: truncate f6 10566299 0 2024-09-17T01:41:28.439 INFO:tasks.workunit.client.1.smithi167.stdout:4/568: rename d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/l33 to d0/d4/d7/da/lbc 0 2024-09-17T01:41:28.441 INFO:tasks.workunit.client.1.smithi167.stdout:3/537: mknod d7/d8/d10/d14/d25/ca6 0 2024-09-17T01:41:28.441 INFO:tasks.workunit.client.1.smithi167.stdout:9/602: truncate d4/d9/d21/d2d/d33/d3a/d9c/fb1 1049 0 2024-09-17T01:41:28.443 INFO:tasks.workunit.client.1.smithi167.stdout:5/438: truncate d0/d28/f5b 1805233 0 2024-09-17T01:41:28.446 INFO:tasks.workunit.client.1.smithi167.stdout:6/680: dwrite d7/d54/d90/d13/d2f/d7f/d98/f1c [0,4194304] 0 2024-09-17T01:41:28.447 INFO:tasks.workunit.client.1.smithi167.stdout:7/522: dwrite d0/d2/d14/d19/d26/f59 [0,4194304] 0 2024-09-17T01:41:28.447 INFO:tasks.workunit.client.1.smithi167.stdout:8/622: fdatasync dc/d56/d57/f8a 0 2024-09-17T01:41:28.448 INFO:tasks.workunit.client.1.smithi167.stdout:1/537: symlink d0/d9/d16/d48/d54/d78/d90/lb8 0 2024-09-17T01:41:28.448 INFO:tasks.workunit.client.1.smithi167.stdout:2/498: dwrite d5/d10/d1a/d2e/f87 [0,4194304] 0 2024-09-17T01:41:28.450 INFO:tasks.workunit.client.1.smithi167.stdout:5/439: stat d0/d9/d1c/l72 0 2024-09-17T01:41:28.450 INFO:tasks.workunit.client.1.smithi167.stdout:0/476: dread d5/d6b/d77/d4d/d56/f59 [0,4194304] 0 2024-09-17T01:41:28.453 INFO:tasks.workunit.client.1.smithi167.stdout:9/603: dread d4/d9/d21/d2d/d33/d80/f9f [0,4194304] 0 2024-09-17T01:41:28.453 INFO:tasks.workunit.client.1.smithi167.stdout:1/538: mkdir d0/d5/d34/d6d/db9 0 2024-09-17T01:41:28.455 INFO:tasks.workunit.client.1.smithi167.stdout:2/499: mkdir d5/d10/d1a/d39/da3/db0 0 2024-09-17T01:41:28.456 INFO:tasks.workunit.client.1.smithi167.stdout:6/681: truncate d7/d54/d90/d13/d2f/d64/d6b/d95/db1/fc6 5088813 0 2024-09-17T01:41:28.458 INFO:tasks.workunit.client.1.smithi167.stdout:9/604: truncate d4/d9/d21/d2d/d33/d3a/f3f 245693 0 2024-09-17T01:41:28.460 INFO:tasks.workunit.client.1.smithi167.stdout:8/623: creat dc/d56/d59/d82/d8f/d90/fc8 x:0 0 0 2024-09-17T01:41:28.461 INFO:tasks.workunit.client.1.smithi167.stdout:7/523: mkdir d0/d2/d14/d6f/d87/dae/daf 0 2024-09-17T01:41:28.463 INFO:tasks.workunit.client.0.smithi082.stdout:4/277: write f7 [586589,78822] 0 2024-09-17T01:41:28.465 INFO:tasks.workunit.client.0.smithi082.stdout:1/305: creat d2/df/d46/f64 x:0 0 0 2024-09-17T01:41:28.465 INFO:tasks.workunit.client.1.smithi167.stdout:1/539: rename d0/d9/d16/d48/d54/d6e/f94 to d0/d5/d34/d6d/fba 0 2024-09-17T01:41:28.466 INFO:tasks.workunit.client.0.smithi082.stdout:4/278: fsync d9/d15/d16/d18/f38 0 2024-09-17T01:41:28.467 INFO:tasks.workunit.client.0.smithi082.stdout:0/196: mkdir da/d1b/d23/d42 0 2024-09-17T01:41:28.468 INFO:tasks.workunit.client.1.smithi167.stdout:6/682: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1/cf7 0 2024-09-17T01:41:28.469 INFO:tasks.workunit.client.1.smithi167.stdout:8/624: dwrite f6 [4194304,4194304] 0 2024-09-17T01:41:28.470 INFO:tasks.workunit.client.0.smithi082.stdout:5/261: dwrite db/d56/d29/f2c [0,4194304] 0 2024-09-17T01:41:28.472 INFO:tasks.workunit.client.1.smithi167.stdout:9/605: creat d4/d9/d21/d2d/d33/d90/fb7 x:0 0 0 2024-09-17T01:41:28.472 INFO:tasks.workunit.client.1.smithi167.stdout:5/440: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:28.472 INFO:tasks.workunit.client.0.smithi082.stdout:2/226: creat d1/d17/d38/d42/f43 x:0 0 0 2024-09-17T01:41:28.473 INFO:tasks.workunit.client.1.smithi167.stdout:5/441: write d0/d24/d2b/f39 [1409915,10882] 0 2024-09-17T01:41:28.476 INFO:tasks.workunit.client.0.smithi082.stdout:3/188: symlink d9/l3d 0 2024-09-17T01:41:28.478 INFO:tasks.workunit.client.0.smithi082.stdout:3/189: truncate d9/db/d26/f27 4541481 0 2024-09-17T01:41:28.480 INFO:tasks.workunit.client.0.smithi082.stdout:1/306: dread d2/df/d46/f52 [0,4194304] 0 2024-09-17T01:41:28.483 INFO:tasks.workunit.client.1.smithi167.stdout:7/524: creat d0/d2/d14/d19/d32/d62/fb0 x:0 0 0 2024-09-17T01:41:28.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/279: mknod d9/d15/d37/d4c/c56 0 2024-09-17T01:41:28.485 INFO:tasks.workunit.client.1.smithi167.stdout:2/500: link d5/d10/d1a/d45/d6b/f6f d5/d10/d1a/d39/d5e/fb1 0 2024-09-17T01:41:28.487 INFO:tasks.workunit.client.0.smithi082.stdout:5/262: creat db/d56/d29/d4f/f57 x:0 0 0 2024-09-17T01:41:28.488 INFO:tasks.workunit.client.0.smithi082.stdout:2/227: symlink d1/d10/l44 0 2024-09-17T01:41:28.489 INFO:tasks.workunit.client.0.smithi082.stdout:2/228: read - d1/f3d zero size 2024-09-17T01:41:28.489 INFO:tasks.workunit.client.1.smithi167.stdout:9/606: mknod d4/d9/d21/d2d/d33/d3a/d9c/cb8 0 2024-09-17T01:41:28.491 INFO:tasks.workunit.client.0.smithi082.stdout:1/307: rmdir d2/d3f 39 2024-09-17T01:41:28.491 INFO:tasks.workunit.client.1.smithi167.stdout:2/501: dwrite d5/d10/d1a/d2e/f36 [0,4194304] 0 2024-09-17T01:41:28.492 INFO:tasks.workunit.client.0.smithi082.stdout:5/263: dread db/d1e/d20/d30/d47/f4e [0,4194304] 0 2024-09-17T01:41:28.494 INFO:tasks.workunit.client.1.smithi167.stdout:1/540: dread d0/d9/f37 [0,4194304] 0 2024-09-17T01:41:28.494 INFO:tasks.workunit.client.0.smithi082.stdout:5/264: read f3 [2806976,90602] 0 2024-09-17T01:41:28.495 INFO:tasks.workunit.client.0.smithi082.stdout:0/197: mkdir da/d1b/d23/d42/d43 0 2024-09-17T01:41:28.495 INFO:tasks.workunit.client.0.smithi082.stdout:5/265: chown db/f19 110548555 1 2024-09-17T01:41:28.496 INFO:tasks.workunit.client.0.smithi082.stdout:5/266: chown db/f16 137232819 1 2024-09-17T01:41:28.496 INFO:tasks.workunit.client.1.smithi167.stdout:6/683: mknod d7/d54/d90/d13/cf8 0 2024-09-17T01:41:28.497 INFO:tasks.workunit.client.0.smithi082.stdout:0/198: read da/df/d27/f21 [1767470,36780] 0 2024-09-17T01:41:28.499 INFO:tasks.workunit.client.1.smithi167.stdout:9/607: dwrite d4/d9/d21/d2d/d33/d3a/f98 [0,4194304] 0 2024-09-17T01:41:28.503 INFO:tasks.workunit.client.1.smithi167.stdout:7/525: rename d0/d2/cc to d0/d2/d14/d6f/d87/cb1 0 2024-09-17T01:41:28.504 INFO:tasks.workunit.client.0.smithi082.stdout:2/229: rename d1/d35/f3c to d1/d17/d38/d42/f45 0 2024-09-17T01:41:28.505 INFO:tasks.workunit.client.1.smithi167.stdout:3/538: dread d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:28.506 INFO:tasks.workunit.client.1.smithi167.stdout:2/502: creat d5/d10/d1a/d45/d6b/fb2 x:0 0 0 2024-09-17T01:41:28.507 INFO:tasks.workunit.client.1.smithi167.stdout:3/539: chown d7/d8/d1f/c28 0 1 2024-09-17T01:41:28.507 INFO:tasks.workunit.client.1.smithi167.stdout:2/503: chown d5/d10/d16/c38 221 1 2024-09-17T01:41:28.508 INFO:tasks.workunit.client.1.smithi167.stdout:0/477: dread d5/d8/d9/f62 [0,4194304] 0 2024-09-17T01:41:28.510 INFO:tasks.workunit.client.1.smithi167.stdout:1/541: creat d0/d9/d16/d22/fbb x:0 0 0 2024-09-17T01:41:28.513 INFO:tasks.workunit.client.0.smithi082.stdout:5/267: symlink db/d56/d29/l58 0 2024-09-17T01:41:28.514 INFO:tasks.workunit.client.1.smithi167.stdout:6/684: creat d7/d54/d90/dd5/ff9 x:0 0 0 2024-09-17T01:41:28.515 INFO:tasks.workunit.client.1.smithi167.stdout:4/569: truncate d0/d4/d7/da/d48/d40/d51/d2d/f61 171807 0 2024-09-17T01:41:28.516 INFO:tasks.workunit.client.1.smithi167.stdout:9/608: mkdir d4/d9/d21/d81/db9 0 2024-09-17T01:41:28.517 INFO:tasks.workunit.client.1.smithi167.stdout:5/442: truncate d0/d9/fb 2030549 0 2024-09-17T01:41:28.518 INFO:tasks.workunit.client.1.smithi167.stdout:5/443: fsync d0/d28/d3a/f78 0 2024-09-17T01:41:28.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/190: creat d9/db/f3e x:0 0 0 2024-09-17T01:41:28.521 INFO:tasks.workunit.client.1.smithi167.stdout:3/540: symlink d7/d8/d10/d14/d2c/d74/la7 0 2024-09-17T01:41:28.523 INFO:tasks.workunit.client.0.smithi082.stdout:2/230: symlink d1/d17/d29/l46 0 2024-09-17T01:41:28.524 INFO:tasks.workunit.client.1.smithi167.stdout:7/526: dwrite d0/d2/f7a [4194304,4194304] 0 2024-09-17T01:41:28.524 INFO:tasks.workunit.client.1.smithi167.stdout:2/504: mknod d5/d33/d48/d72/cb3 0 2024-09-17T01:41:28.525 INFO:tasks.workunit.client.0.smithi082.stdout:1/308: symlink d2/da/d16/l65 0 2024-09-17T01:41:28.526 INFO:tasks.workunit.client.0.smithi082.stdout:1/309: fdatasync d2/da/f56 0 2024-09-17T01:41:28.526 INFO:tasks.workunit.client.1.smithi167.stdout:2/505: truncate d5/d10/d1a/d45/d6b/fb2 75339 0 2024-09-17T01:41:28.526 INFO:tasks.workunit.client.1.smithi167.stdout:0/478: mkdir d5/d94 0 2024-09-17T01:41:28.527 INFO:tasks.workunit.client.0.smithi082.stdout:4/280: link d9/d15/l39 d9/d15/d16/d18/d4a/l57 0 2024-09-17T01:41:28.527 INFO:tasks.workunit.client.0.smithi082.stdout:1/310: stat d2/f20 0 2024-09-17T01:41:28.528 INFO:tasks.workunit.client.0.smithi082.stdout:1/311: write f0 [4748325,124174] 0 2024-09-17T01:41:28.531 INFO:tasks.workunit.client.0.smithi082.stdout:2/231: dwrite d1/f3d [0,4194304] 0 2024-09-17T01:41:28.532 INFO:tasks.workunit.client.1.smithi167.stdout:4/570: creat d0/d4/d7/d6/d5d/fbd x:0 0 0 2024-09-17T01:41:28.533 INFO:tasks.workunit.client.0.smithi082.stdout:2/232: truncate d1/d10/f41 87977 0 2024-09-17T01:41:28.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/268: readlink l2 0 2024-09-17T01:41:28.535 INFO:tasks.workunit.client.1.smithi167.stdout:6/685: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/cfa 0 2024-09-17T01:41:28.540 INFO:tasks.workunit.client.0.smithi082.stdout:4/281: write d9/d15/f22 [26256,116653] 0 2024-09-17T01:41:28.541 INFO:tasks.workunit.client.0.smithi082.stdout:4/282: chown d9/f46 8134298 1 2024-09-17T01:41:28.549 INFO:tasks.workunit.client.0.smithi082.stdout:5/269: mkdir db/d2b/d59 0 2024-09-17T01:41:28.556 INFO:tasks.workunit.client.0.smithi082.stdout:2/233: dread d1/d10/f28 [0,4194304] 0 2024-09-17T01:41:28.556 INFO:tasks.workunit.client.0.smithi082.stdout:4/283: rename c5 to d9/d15/d16/d3e/d54/c58 0 2024-09-17T01:41:28.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/284: dread - d9/d15/d16/d3e/f50 zero size 2024-09-17T01:41:28.561 INFO:tasks.workunit.client.0.smithi082.stdout:0/199: getdents da/d1e 0 2024-09-17T01:41:28.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/285: creat d9/d15/d16/d18/d4a/d52/f59 x:0 0 0 2024-09-17T01:41:28.565 INFO:tasks.workunit.client.1.smithi167.stdout:6/686: dwrite d7/d54/d90/d13/d2f/fca [0,4194304] 0 2024-09-17T01:41:28.565 INFO:tasks.workunit.client.1.smithi167.stdout:2/506: fsync d5/d10/d1a/d2e/f4b 0 2024-09-17T01:41:28.566 INFO:tasks.workunit.client.1.smithi167.stdout:4/571: unlink d0/d4/d7/f23 0 2024-09-17T01:41:28.566 INFO:tasks.workunit.client.0.smithi082.stdout:1/312: getdents d2 0 2024-09-17T01:41:28.567 INFO:tasks.workunit.client.1.smithi167.stdout:3/541: write d7/d8/d2a/d7a/f88 [874402,44044] 0 2024-09-17T01:41:28.570 INFO:tasks.workunit.client.1.smithi167.stdout:2/507: write d5/d10/d1a/d45/d6b/fb2 [869596,101651] 0 2024-09-17T01:41:28.570 INFO:tasks.workunit.client.0.smithi082.stdout:5/270: creat db/f5a x:0 0 0 2024-09-17T01:41:28.571 INFO:tasks.workunit.client.0.smithi082.stdout:5/271: fdatasync db/d1e/d20/f3e 0 2024-09-17T01:41:28.572 INFO:tasks.workunit.client.1.smithi167.stdout:6/687: truncate d7/d54/d90/d13/d2f/d64/d6b/d95/fd8 536521 0 2024-09-17T01:41:28.572 INFO:tasks.workunit.client.1.smithi167.stdout:6/688: stat d7/d54/d90/l74 0 2024-09-17T01:41:28.573 INFO:tasks.workunit.client.1.smithi167.stdout:1/542: creat d0/d5/d34/d3c/fbc x:0 0 0 2024-09-17T01:41:28.574 INFO:tasks.workunit.client.0.smithi082.stdout:1/313: unlink d2/da/d16/f57 0 2024-09-17T01:41:28.576 INFO:tasks.workunit.client.0.smithi082.stdout:2/234: truncate d1/f9 1438831 0 2024-09-17T01:41:28.576 INFO:tasks.workunit.client.0.smithi082.stdout:0/200: dread f0 [0,4194304] 0 2024-09-17T01:41:28.577 INFO:tasks.workunit.client.0.smithi082.stdout:4/286: mknod d9/d2b/c5a 0 2024-09-17T01:41:28.577 INFO:tasks.workunit.client.0.smithi082.stdout:5/272: mkdir db/d1e/d5b 0 2024-09-17T01:41:28.578 INFO:tasks.workunit.client.0.smithi082.stdout:5/273: readlink l2 0 2024-09-17T01:41:28.583 INFO:tasks.workunit.client.1.smithi167.stdout:7/527: link d0/d2/d88/d6e/l9a d0/d2/d14/d6f/lb2 0 2024-09-17T01:41:28.584 INFO:tasks.workunit.client.0.smithi082.stdout:1/314: creat d2/d3f/d24/d54/f66 x:0 0 0 2024-09-17T01:41:28.584 INFO:tasks.workunit.client.0.smithi082.stdout:2/235: truncate d1/f16 1637152 0 2024-09-17T01:41:28.585 INFO:tasks.workunit.client.1.smithi167.stdout:2/508: creat d5/d10/d1a/d39/da3/fb4 x:0 0 0 2024-09-17T01:41:28.586 INFO:tasks.workunit.client.1.smithi167.stdout:2/509: truncate d5/d10/d1a/d45/d6b/fb2 1975190 0 2024-09-17T01:41:28.587 INFO:tasks.workunit.client.1.smithi167.stdout:1/543: mknod d0/d5/d61/da2/cbd 0 2024-09-17T01:41:28.589 INFO:tasks.workunit.client.1.smithi167.stdout:9/609: link d4/d9/d21/l4f d4/d9/d21/lba 0 2024-09-17T01:41:28.589 INFO:tasks.workunit.client.0.smithi082.stdout:1/315: truncate d2/d3f/f13 8277368 0 2024-09-17T01:41:28.590 INFO:tasks.workunit.client.1.smithi167.stdout:5/444: link d0/l1 d0/d9/d64/l82 0 2024-09-17T01:41:28.591 INFO:tasks.workunit.client.0.smithi082.stdout:5/274: dwrite db/d1e/d20/d30/f33 [0,4194304] 0 2024-09-17T01:41:28.595 INFO:tasks.workunit.client.0.smithi082.stdout:2/236: dread d1/d35/f25 [0,4194304] 0 2024-09-17T01:41:28.596 INFO:tasks.workunit.client.1.smithi167.stdout:6/689: symlink d7/d54/d90/d13/d2f/d30/d88/da2/lfb 0 2024-09-17T01:41:28.598 INFO:tasks.workunit.client.1.smithi167.stdout:2/510: creat d5/d3c/d4c/fb5 x:0 0 0 2024-09-17T01:41:28.599 INFO:tasks.workunit.client.1.smithi167.stdout:2/511: truncate d5/f44 1874084 0 2024-09-17T01:41:28.600 INFO:tasks.workunit.client.0.smithi082.stdout:1/316: dwrite d2/da/f33 [0,4194304] 0 2024-09-17T01:41:28.600 INFO:tasks.workunit.client.0.smithi082.stdout:4/287: rename d9/d15/d16/d18/f20 to d9/f5b 0 2024-09-17T01:41:28.600 INFO:tasks.workunit.client.1.smithi167.stdout:7/528: dread d0/d2/d14/d23/f58 [0,4194304] 0 2024-09-17T01:41:28.602 INFO:tasks.workunit.client.1.smithi167.stdout:1/544: unlink d0/d5/d34/f14 0 2024-09-17T01:41:28.602 INFO:tasks.workunit.client.0.smithi082.stdout:1/317: dread - d2/da/f56 zero size 2024-09-17T01:41:28.603 INFO:tasks.workunit.client.0.smithi082.stdout:5/275: dwrite db/d56/f50 [0,4194304] 0 2024-09-17T01:41:28.604 INFO:tasks.workunit.client.1.smithi167.stdout:1/545: dread - d0/d9/d16/d48/d54/d78/f92 zero size 2024-09-17T01:41:28.605 INFO:tasks.workunit.client.0.smithi082.stdout:1/318: chown d2/f5f 202021 1 2024-09-17T01:41:28.605 INFO:tasks.workunit.client.1.smithi167.stdout:5/445: creat d0/d24/f83 x:0 0 0 2024-09-17T01:41:28.606 INFO:tasks.workunit.client.0.smithi082.stdout:0/201: getdents da/df 0 2024-09-17T01:41:28.608 INFO:tasks.workunit.client.1.smithi167.stdout:4/572: mknod d0/d4/d7/da/d48/d40/dad/cbe 0 2024-09-17T01:41:28.609 INFO:tasks.workunit.client.1.smithi167.stdout:2/512: dwrite d5/d3c/f81 [0,4194304] 0 2024-09-17T01:41:28.611 INFO:tasks.workunit.client.1.smithi167.stdout:8/625: sync 2024-09-17T01:41:28.611 INFO:tasks.workunit.client.1.smithi167.stdout:3/542: rename d7/d8/d10/d14/d2c/f2f to d7/d8/d10/fa8 0 2024-09-17T01:41:28.612 INFO:tasks.workunit.client.0.smithi082.stdout:5/276: dwrite db/d1e/f52 [0,4194304] 0 2024-09-17T01:41:28.614 INFO:tasks.workunit.client.0.smithi082.stdout:5/277: dread - db/f5a zero size 2024-09-17T01:41:28.615 INFO:tasks.workunit.client.0.smithi082.stdout:0/202: mknod da/d1e/c44 0 2024-09-17T01:41:28.616 INFO:tasks.workunit.client.1.smithi167.stdout:4/573: dwrite d0/f3 [4194304,4194304] 0 2024-09-17T01:41:28.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/278: dread db/d1e/d20/f3e [0,4194304] 0 2024-09-17T01:41:28.621 INFO:tasks.workunit.client.0.smithi082.stdout:4/288: rename d9/c11 to d9/d2b/c5c 0 2024-09-17T01:41:28.624 INFO:tasks.workunit.client.1.smithi167.stdout:1/546: symlink d0/d5/d34/d6d/lbe 0 2024-09-17T01:41:28.625 INFO:tasks.workunit.client.1.smithi167.stdout:5/446: mknod d0/d24/d2b/d3d/d3b/c84 0 2024-09-17T01:41:28.626 INFO:tasks.workunit.client.0.smithi082.stdout:1/319: rename d2/df/c30 to d2/da/d2f/c67 0 2024-09-17T01:41:28.628 INFO:tasks.workunit.client.1.smithi167.stdout:2/513: unlink d5/d10/d1a/d39/da3/c43 0 2024-09-17T01:41:28.628 INFO:tasks.workunit.client.1.smithi167.stdout:3/543: rmdir d7/d8/d10/d29/d75 39 2024-09-17T01:41:28.630 INFO:tasks.workunit.client.0.smithi082.stdout:5/279: dwrite db/d56/f15 [4194304,4194304] 0 2024-09-17T01:41:28.631 INFO:tasks.workunit.client.1.smithi167.stdout:3/544: chown d7/d8/d10/d29/c33 103 1 2024-09-17T01:41:28.631 INFO:tasks.workunit.client.1.smithi167.stdout:4/574: chown d0/d4/d7/da/lbc 6 1 2024-09-17T01:41:28.632 INFO:tasks.workunit.client.1.smithi167.stdout:1/547: dwrite d0/d9/d16/d22/fbb [0,4194304] 0 2024-09-17T01:41:28.632 INFO:tasks.workunit.client.0.smithi082.stdout:1/320: creat d2/d3f/d24/f68 x:0 0 0 2024-09-17T01:41:28.633 INFO:tasks.workunit.client.1.smithi167.stdout:1/548: fsync d0/d5/d61/f71 0 2024-09-17T01:41:28.633 INFO:tasks.workunit.client.0.smithi082.stdout:0/203: dwrite da/f14 [0,4194304] 0 2024-09-17T01:41:28.633 INFO:tasks.workunit.client.1.smithi167.stdout:8/626: symlink dc/d21/d6b/d74/d83/dc0/dc7/lc9 0 2024-09-17T01:41:28.635 INFO:tasks.workunit.client.1.smithi167.stdout:1/549: truncate d0/d9/d16/d48/d54/d6e/f7b 477896 0 2024-09-17T01:41:28.635 INFO:tasks.workunit.client.1.smithi167.stdout:2/514: rename d5/d10/d1a/f56 to d5/d10/d1a/d46/fb6 0 2024-09-17T01:41:28.637 INFO:tasks.workunit.client.1.smithi167.stdout:1/550: write d0/d9/d16/fad [469795,110105] 0 2024-09-17T01:41:28.637 INFO:tasks.workunit.client.0.smithi082.stdout:1/321: unlink d2/da/d2f/d47/f53 0 2024-09-17T01:41:28.640 INFO:tasks.workunit.client.1.smithi167.stdout:8/627: read fb [398060,64996] 0 2024-09-17T01:41:28.643 INFO:tasks.workunit.client.0.smithi082.stdout:0/204: rename da/d1b/f35 to da/d1e/f45 0 2024-09-17T01:41:28.645 INFO:tasks.workunit.client.0.smithi082.stdout:5/280: dwrite db/d1e/d20/f3e [0,4194304] 0 2024-09-17T01:41:28.650 INFO:tasks.workunit.client.0.smithi082.stdout:1/322: dwrite d2/da/d2d/f45 [4194304,4194304] 0 2024-09-17T01:41:28.652 INFO:tasks.workunit.client.1.smithi167.stdout:3/545: mkdir d7/d8/d10/d14/d66/d6c/d7c/da9 0 2024-09-17T01:41:28.657 INFO:tasks.workunit.client.1.smithi167.stdout:1/551: mkdir d0/d5/dbf 0 2024-09-17T01:41:28.660 INFO:tasks.workunit.client.0.smithi082.stdout:5/281: mknod db/d56/d18/c5c 0 2024-09-17T01:41:28.662 INFO:tasks.workunit.client.1.smithi167.stdout:8/628: link dc/f7a dc/d56/d57/da0/da7/dc1/fca 0 2024-09-17T01:41:28.665 INFO:tasks.workunit.client.1.smithi167.stdout:5/447: stat d0/f13 0 2024-09-17T01:41:28.667 INFO:tasks.workunit.client.0.smithi082.stdout:1/323: rename d2/da/d16/f5d to d2/d3f/d24/f69 0 2024-09-17T01:41:28.670 INFO:tasks.workunit.client.0.smithi082.stdout:5/282: symlink db/d2b/l5d 0 2024-09-17T01:41:28.670 INFO:tasks.workunit.client.1.smithi167.stdout:4/575: dread d0/d4/d7/da/d48/d40/d51/d2d/f61 [0,4194304] 0 2024-09-17T01:41:28.673 INFO:tasks.workunit.client.1.smithi167.stdout:0/479: sync 2024-09-17T01:41:28.673 INFO:tasks.workunit.client.1.smithi167.stdout:6/690: sync 2024-09-17T01:41:28.675 INFO:tasks.workunit.client.1.smithi167.stdout:5/448: rename d0/d28/d3a/f78 to d0/d28/d3a/d44/d69/f85 0 2024-09-17T01:41:28.676 INFO:tasks.workunit.client.1.smithi167.stdout:5/449: chown d0/f14 2138 1 2024-09-17T01:41:28.677 INFO:tasks.workunit.client.1.smithi167.stdout:1/552: dread d0/d9/d16/fad [0,4194304] 0 2024-09-17T01:41:28.678 INFO:tasks.workunit.client.1.smithi167.stdout:8/629: creat dc/d56/d57/d7e/dad/fcb x:0 0 0 2024-09-17T01:41:28.678 INFO:tasks.workunit.client.1.smithi167.stdout:1/553: chown d0/d5/d34/d8a 1063836 1 2024-09-17T01:41:28.680 INFO:tasks.workunit.client.0.smithi082.stdout:0/205: link da/df/d27/c2c da/d16/c46 0 2024-09-17T01:41:28.681 INFO:tasks.workunit.client.0.smithi082.stdout:0/206: write da/d24/f3b [998051,71845] 0 2024-09-17T01:41:28.682 INFO:tasks.workunit.client.1.smithi167.stdout:0/480: symlink d5/d6b/d77/d37/l95 0 2024-09-17T01:41:28.683 INFO:tasks.workunit.client.1.smithi167.stdout:0/481: write d5/d8/d9/f2c [1813923,23167] 0 2024-09-17T01:41:28.685 INFO:tasks.workunit.client.1.smithi167.stdout:0/482: write d5/d6b/d7e/f86 [285840,120263] 0 2024-09-17T01:41:28.685 INFO:tasks.workunit.client.0.smithi082.stdout:5/283: mknod db/d1e/d20/d4d/c5e 0 2024-09-17T01:41:28.688 INFO:tasks.workunit.client.1.smithi167.stdout:5/450: rmdir d0/d24/d2b 39 2024-09-17T01:41:28.689 INFO:tasks.workunit.client.0.smithi082.stdout:0/207: mknod da/d1b/d23/c47 0 2024-09-17T01:41:28.692 INFO:tasks.workunit.client.0.smithi082.stdout:1/324: rename d2/f20 to d2/da/f6a 0 2024-09-17T01:41:28.692 INFO:tasks.workunit.client.1.smithi167.stdout:4/576: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/f98 [0,4194304] 0 2024-09-17T01:41:28.693 INFO:tasks.workunit.client.1.smithi167.stdout:8/630: creat dc/d21/d6b/d74/d83/dc0/fcc x:0 0 0 2024-09-17T01:41:28.694 INFO:tasks.workunit.client.0.smithi082.stdout:5/284: rename db/d56/d29/l37 to db/d56/d29/l5f 0 2024-09-17T01:41:28.694 INFO:tasks.workunit.client.1.smithi167.stdout:4/577: chown d0/d4/d7/d6/f29 6991250 1 2024-09-17T01:41:28.695 INFO:tasks.workunit.client.1.smithi167.stdout:8/631: write dc/d18/f2e [284677,2590] 0 2024-09-17T01:41:28.695 INFO:tasks.workunit.client.1.smithi167.stdout:9/610: truncate d4/d9/d21/d43/d6c/fa2 509122 0 2024-09-17T01:41:28.698 INFO:tasks.workunit.client.1.smithi167.stdout:1/554: dwrite d0/d5/d34/f7d [0,4194304] 0 2024-09-17T01:41:28.698 INFO:tasks.workunit.client.0.smithi082.stdout:2/237: truncate d1/d10/f28 1251983 0 2024-09-17T01:41:28.698 INFO:tasks.workunit.client.1.smithi167.stdout:2/515: write d5/d3c/d4c/d4d/fac [57004,70003] 0 2024-09-17T01:41:28.699 INFO:tasks.workunit.client.0.smithi082.stdout:0/208: rename da/d24/f3b to da/d16/f48 0 2024-09-17T01:41:28.699 INFO:tasks.workunit.client.1.smithi167.stdout:2/516: write d5/d71/fae [416842,95506] 0 2024-09-17T01:41:28.700 INFO:tasks.workunit.client.0.smithi082.stdout:0/209: fsync da/df/f15 0 2024-09-17T01:41:28.706 INFO:tasks.workunit.client.0.smithi082.stdout:2/238: symlink d1/d17/l47 0 2024-09-17T01:41:28.706 INFO:tasks.workunit.client.1.smithi167.stdout:1/555: dwrite d0/d9/d16/d48/d54/f64 [8388608,4194304] 0 2024-09-17T01:41:28.708 INFO:tasks.workunit.client.1.smithi167.stdout:7/529: write d0/d2/d14/d19/d22/f25 [1379388,15796] 0 2024-09-17T01:41:28.710 INFO:tasks.workunit.client.1.smithi167.stdout:5/451: rename d0/d28/l3c to d0/d28/d3a/l86 0 2024-09-17T01:41:28.712 INFO:tasks.workunit.client.0.smithi082.stdout:0/210: mknod da/d24/c49 0 2024-09-17T01:41:28.717 INFO:tasks.workunit.client.0.smithi082.stdout:2/239: dread d1/d17/d29/f2d [0,4194304] 0 2024-09-17T01:41:28.717 INFO:tasks.workunit.client.1.smithi167.stdout:9/611: chown d4/d9/c63 36417918 1 2024-09-17T01:41:28.718 INFO:tasks.workunit.client.0.smithi082.stdout:2/240: dread - d1/d17/f34 zero size 2024-09-17T01:41:28.718 INFO:tasks.workunit.client.0.smithi082.stdout:2/241: chown d1/l22 37003 1 2024-09-17T01:41:28.719 INFO:tasks.workunit.client.0.smithi082.stdout:0/211: rename da/f31 to da/df/f4a 0 2024-09-17T01:41:28.719 INFO:tasks.workunit.client.0.smithi082.stdout:2/242: write d1/f1b [753468,126454] 0 2024-09-17T01:41:28.720 INFO:tasks.workunit.client.0.smithi082.stdout:2/243: chown d1/fd 27582 1 2024-09-17T01:41:28.721 INFO:tasks.workunit.client.1.smithi167.stdout:4/578: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 [1775088,113371] 0 2024-09-17T01:41:28.721 INFO:tasks.workunit.client.1.smithi167.stdout:4/579: dread - d0/d4/d7/d6/d2b/d6d/f97 zero size 2024-09-17T01:41:28.723 INFO:tasks.workunit.client.1.smithi167.stdout:8/632: creat dc/d56/d57/d7e/dad/fcd x:0 0 0 2024-09-17T01:41:28.724 INFO:tasks.workunit.client.0.smithi082.stdout:2/244: dread d1/d35/f37 [0,4194304] 0 2024-09-17T01:41:28.725 INFO:tasks.workunit.client.1.smithi167.stdout:2/517: creat d5/d33/d48/d72/d94/fb7 x:0 0 0 2024-09-17T01:41:28.726 INFO:tasks.workunit.client.0.smithi082.stdout:0/212: mkdir da/d1b/d23/d42/d4b 0 2024-09-17T01:41:28.728 INFO:tasks.workunit.client.0.smithi082.stdout:5/285: getdents db 0 2024-09-17T01:41:28.729 INFO:tasks.workunit.client.0.smithi082.stdout:5/286: chown db/d1e/d20 1211439 1 2024-09-17T01:41:28.730 INFO:tasks.workunit.client.0.smithi082.stdout:5/287: fdatasync db/d1e/d20/f3f 0 2024-09-17T01:41:28.730 INFO:tasks.workunit.client.0.smithi082.stdout:0/213: dread da/df/f15 [0,4194304] 0 2024-09-17T01:41:28.730 INFO:tasks.workunit.client.1.smithi167.stdout:1/556: unlink d0/d9/d16/d48/d54/d78/d90/lb8 0 2024-09-17T01:41:28.731 INFO:tasks.workunit.client.0.smithi082.stdout:0/214: chown da/df/d27 32964584 1 2024-09-17T01:41:28.734 INFO:tasks.workunit.client.1.smithi167.stdout:7/530: rename d0/d2/d14/d19/d26/c5a to d0/d2/d88/d6e/cb3 0 2024-09-17T01:41:28.735 INFO:tasks.workunit.client.1.smithi167.stdout:3/546: dwrite d7/d8/d10/d14/d25/f48 [0,4194304] 0 2024-09-17T01:41:28.736 INFO:tasks.workunit.client.0.smithi082.stdout:2/245: mknod d1/d17/d29/c48 0 2024-09-17T01:41:28.737 INFO:tasks.workunit.client.1.smithi167.stdout:5/452: write d0/d24/d2b/d3d/f4f [161110,22346] 0 2024-09-17T01:41:28.737 INFO:tasks.workunit.client.1.smithi167.stdout:5/453: dread - d0/d9/f7a zero size 2024-09-17T01:41:28.738 INFO:tasks.workunit.client.1.smithi167.stdout:5/454: readlink d0/d24/d2b/d3d/l43 0 2024-09-17T01:41:28.739 INFO:tasks.workunit.client.1.smithi167.stdout:5/455: write d0/f1d [965328,8465] 0 2024-09-17T01:41:28.741 INFO:tasks.workunit.client.1.smithi167.stdout:5/456: chown d0/d24/d2b/d3d/c50 233 1 2024-09-17T01:41:28.743 INFO:tasks.workunit.client.0.smithi082.stdout:0/215: symlink da/d16/l4c 0 2024-09-17T01:41:28.745 INFO:tasks.workunit.client.1.smithi167.stdout:0/483: creat d5/d8/f96 x:0 0 0 2024-09-17T01:41:28.746 INFO:tasks.workunit.client.0.smithi082.stdout:5/288: dwrite db/d56/d29/d4f/f53 [0,4194304] 0 2024-09-17T01:41:28.748 INFO:tasks.workunit.client.0.smithi082.stdout:2/246: unlink d1/d35/f25 0 2024-09-17T01:41:28.749 INFO:tasks.workunit.client.0.smithi082.stdout:2/247: dread - d1/d17/f34 zero size 2024-09-17T01:41:28.750 INFO:tasks.workunit.client.1.smithi167.stdout:1/557: creat d0/d5/d34/fc0 x:0 0 0 2024-09-17T01:41:28.752 INFO:tasks.workunit.client.1.smithi167.stdout:1/558: write d0/d9/d16/d48/d54/d78/f92 [838733,26619] 0 2024-09-17T01:41:28.756 INFO:tasks.workunit.client.1.smithi167.stdout:9/612: rename d4/d9/d21/d43/d6c/l72 to d4/d9/d2b/da3/lbb 0 2024-09-17T01:41:28.757 INFO:tasks.workunit.client.1.smithi167.stdout:9/613: fdatasync d4/d9/d21/d2d/d33/d3a/d74/f89 0 2024-09-17T01:41:28.760 INFO:tasks.workunit.client.1.smithi167.stdout:6/691: truncate d7/d54/d90/d13/d2f/d30/d32/f47 299815 0 2024-09-17T01:41:28.760 INFO:tasks.workunit.client.1.smithi167.stdout:6/692: stat d7/d52/c67 0 2024-09-17T01:41:28.760 INFO:tasks.workunit.client.1.smithi167.stdout:7/531: mkdir d0/d2/d14/d19/d7f/db4 0 2024-09-17T01:41:28.762 INFO:tasks.workunit.client.1.smithi167.stdout:4/580: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8/lbf 0 2024-09-17T01:41:28.762 INFO:tasks.workunit.client.1.smithi167.stdout:4/581: chown d0/f3 5 1 2024-09-17T01:41:28.763 INFO:tasks.workunit.client.1.smithi167.stdout:4/582: fdatasync d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/fb6 0 2024-09-17T01:41:28.764 INFO:tasks.workunit.client.0.smithi082.stdout:2/248: dread d1/d35/f37 [0,4194304] 0 2024-09-17T01:41:28.766 INFO:tasks.workunit.client.1.smithi167.stdout:8/633: getdents dc/d1a/d45 0 2024-09-17T01:41:28.770 INFO:tasks.workunit.client.1.smithi167.stdout:5/457: chown d0/d9/c1b 1324654331 1 2024-09-17T01:41:28.770 INFO:tasks.workunit.client.0.smithi082.stdout:2/249: mknod d1/d17/d38/c49 0 2024-09-17T01:41:28.771 INFO:tasks.workunit.client.0.smithi082.stdout:0/216: getdents da/d1b/d23 0 2024-09-17T01:41:28.777 INFO:tasks.workunit.client.1.smithi167.stdout:9/614: mkdir d4/d9/d21/d43/d6c/d9e/da1/dbc 0 2024-09-17T01:41:28.778 INFO:tasks.workunit.client.0.smithi082.stdout:0/217: rename da/d24 to da/d1b/d23/d4d 0 2024-09-17T01:41:28.780 INFO:tasks.workunit.client.0.smithi082.stdout:1/325: getdents d2/d3f 0 2024-09-17T01:41:28.781 INFO:tasks.workunit.client.1.smithi167.stdout:7/532: creat d0/d2/d14/d6f/d87/dae/fb5 x:0 0 0 2024-09-17T01:41:28.782 INFO:tasks.workunit.client.1.smithi167.stdout:7/533: chown d0/d2/d14 43918 1 2024-09-17T01:41:28.784 INFO:tasks.workunit.client.0.smithi082.stdout:2/250: dread d1/d17/f18 [0,4194304] 0 2024-09-17T01:41:28.786 INFO:tasks.workunit.client.1.smithi167.stdout:4/583: rename d0/d4/d7/da/lbc to d0/d4/d7/d6/d5d/da2/lc0 0 2024-09-17T01:41:28.787 INFO:tasks.workunit.client.0.smithi082.stdout:5/289: write db/d56/f35 [1450296,85336] 0 2024-09-17T01:41:28.787 INFO:tasks.workunit.client.1.smithi167.stdout:4/584: stat d0/d4/d7/f77 0 2024-09-17T01:41:28.789 INFO:tasks.workunit.client.0.smithi082.stdout:0/218: dread f7 [0,4194304] 0 2024-09-17T01:41:28.796 INFO:tasks.workunit.client.0.smithi082.stdout:2/251: rmdir d1/d10 39 2024-09-17T01:41:28.796 INFO:tasks.workunit.client.1.smithi167.stdout:2/518: rename d5/d10/d1a/d39 to d5/d10/d1a/db8 0 2024-09-17T01:41:28.797 INFO:tasks.workunit.client.1.smithi167.stdout:1/559: write d0/d9/d16/d36/f53 [3332933,130559] 0 2024-09-17T01:41:28.799 INFO:tasks.workunit.client.0.smithi082.stdout:0/219: creat da/d1b/d23/d42/f4e x:0 0 0 2024-09-17T01:41:28.800 INFO:tasks.workunit.client.0.smithi082.stdout:0/220: write da/d16/f3f [809339,83179] 0 2024-09-17T01:41:28.800 INFO:tasks.workunit.client.1.smithi167.stdout:9/615: creat d4/d9/d21/d43/d6c/d9e/fbd x:0 0 0 2024-09-17T01:41:28.802 INFO:tasks.workunit.client.0.smithi082.stdout:2/252: rmdir d1 39 2024-09-17T01:41:28.804 INFO:tasks.workunit.client.1.smithi167.stdout:6/693: mkdir d7/d54/d90/dfc 0 2024-09-17T01:41:28.805 INFO:tasks.workunit.client.1.smithi167.stdout:6/694: write d7/d54/d90/d34/dc8/fee [819449,115390] 0 2024-09-17T01:41:28.806 INFO:tasks.workunit.client.0.smithi082.stdout:1/326: rename d2/c63 to d2/df/d46/c6b 0 2024-09-17T01:41:28.808 INFO:tasks.workunit.client.0.smithi082.stdout:0/221: creat da/d1b/f4f x:0 0 0 2024-09-17T01:41:28.811 INFO:tasks.workunit.client.1.smithi167.stdout:3/547: link d7/d1e/c61 d7/d8/caa 0 2024-09-17T01:41:28.812 INFO:tasks.workunit.client.1.smithi167.stdout:8/634: dwrite fb [0,4194304] 0 2024-09-17T01:41:28.813 INFO:tasks.workunit.client.0.smithi082.stdout:5/290: rename db/d1e/c1f to db/d2b/d59/c60 0 2024-09-17T01:41:28.817 INFO:tasks.workunit.client.0.smithi082.stdout:2/253: symlink d1/d17/l4a 0 2024-09-17T01:41:28.820 INFO:tasks.workunit.client.1.smithi167.stdout:2/519: mknod d5/d33/d48/cb9 0 2024-09-17T01:41:28.826 INFO:tasks.workunit.client.1.smithi167.stdout:0/484: creat d5/d8/f97 x:0 0 0 2024-09-17T01:41:28.828 INFO:tasks.workunit.client.1.smithi167.stdout:7/534: dread d0/d2/d14/f16 [0,4194304] 0 2024-09-17T01:41:28.829 INFO:tasks.workunit.client.1.smithi167.stdout:9/616: creat d4/da4/fbe x:0 0 0 2024-09-17T01:41:28.830 INFO:tasks.workunit.client.0.smithi082.stdout:5/291: write f6 [1989721,3957] 0 2024-09-17T01:41:28.830 INFO:tasks.workunit.client.0.smithi082.stdout:2/254: chown d1/d35/c23 936354 1 2024-09-17T01:41:28.831 INFO:tasks.workunit.client.0.smithi082.stdout:0/222: dread da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:28.832 INFO:tasks.workunit.client.0.smithi082.stdout:1/327: mkdir d2/da/d2d/d6c 0 2024-09-17T01:41:28.833 INFO:tasks.workunit.client.0.smithi082.stdout:0/223: chown da/df/c20 113736167 1 2024-09-17T01:41:28.837 INFO:tasks.workunit.client.1.smithi167.stdout:5/458: creat d0/d28/f87 x:0 0 0 2024-09-17T01:41:28.839 INFO:tasks.workunit.client.1.smithi167.stdout:1/560: mkdir d0/d5/d34/d3c/d85/db5/dc1 0 2024-09-17T01:41:28.840 INFO:tasks.workunit.client.0.smithi082.stdout:1/328: symlink d2/d3f/l6d 0 2024-09-17T01:41:28.841 INFO:tasks.workunit.client.1.smithi167.stdout:0/485: creat d5/d6b/d77/d37/f98 x:0 0 0 2024-09-17T01:41:28.841 INFO:tasks.workunit.client.0.smithi082.stdout:0/224: write f7 [476164,99513] 0 2024-09-17T01:41:28.842 INFO:tasks.workunit.client.1.smithi167.stdout:0/486: write d5/d8/d9/d2f/f3b [3292315,45120] 0 2024-09-17T01:41:28.842 INFO:tasks.workunit.client.0.smithi082.stdout:5/292: symlink db/d1e/d5b/l61 0 2024-09-17T01:41:28.843 INFO:tasks.workunit.client.1.smithi167.stdout:0/487: chown d5/d6b/d77/d4d/c1c 6143 1 2024-09-17T01:41:28.844 INFO:tasks.workunit.client.0.smithi082.stdout:5/293: fsync db/d1e/d20/d30/f3b 0 2024-09-17T01:41:28.845 INFO:tasks.workunit.client.0.smithi082.stdout:1/329: unlink d2/da/d16/f1c 0 2024-09-17T01:41:28.846 INFO:tasks.workunit.client.1.smithi167.stdout:9/617: dread d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:28.847 INFO:tasks.workunit.client.1.smithi167.stdout:2/520: mknod d5/d10/d1a/db8/da3/db0/cba 0 2024-09-17T01:41:28.848 INFO:tasks.workunit.client.1.smithi167.stdout:3/548: dread d7/d8/d2a/f63 [0,4194304] 0 2024-09-17T01:41:28.848 INFO:tasks.workunit.client.1.smithi167.stdout:2/521: readlink d5/d10/d1a/l35 0 2024-09-17T01:41:28.848 INFO:tasks.workunit.client.0.smithi082.stdout:0/225: unlink da/df/d27/f29 0 2024-09-17T01:41:28.848 INFO:tasks.workunit.client.1.smithi167.stdout:9/618: truncate d4/d9/d21/d43/d6c/d9e/da1/fa6 76454 0 2024-09-17T01:41:28.850 INFO:tasks.workunit.client.0.smithi082.stdout:5/294: chown db/d1e/d20/l39 47340 1 2024-09-17T01:41:28.851 INFO:tasks.workunit.client.0.smithi082.stdout:2/255: link d1/d17/d38/c49 d1/d35/c4b 0 2024-09-17T01:41:28.852 INFO:tasks.workunit.client.1.smithi167.stdout:5/459: dread d0/d24/f35 [0,4194304] 0 2024-09-17T01:41:28.852 INFO:tasks.workunit.client.0.smithi082.stdout:2/256: chown d1/d17/d29/f2d 616203273 1 2024-09-17T01:41:28.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/257: write d1/f1b [776332,26208] 0 2024-09-17T01:41:28.854 INFO:tasks.workunit.client.1.smithi167.stdout:5/460: readlink d0/d9/d1c/l72 0 2024-09-17T01:41:28.854 INFO:tasks.workunit.client.1.smithi167.stdout:0/488: truncate d5/d8/f44 1726343 0 2024-09-17T01:41:28.855 INFO:tasks.workunit.client.1.smithi167.stdout:5/461: rename d0/d24/d2b/d49/d4b to d0/d24/d2b/d49/d4b/d88 22 2024-09-17T01:41:28.855 INFO:tasks.workunit.client.1.smithi167.stdout:5/462: chown d0/f1d 12920922 1 2024-09-17T01:41:28.856 INFO:tasks.workunit.client.0.smithi082.stdout:0/226: rename da/d16/f3f to da/d16/f50 0 2024-09-17T01:41:28.856 INFO:tasks.workunit.client.0.smithi082.stdout:0/227: chown da/d1b/d23/d42/d4b 939201526 1 2024-09-17T01:41:28.857 INFO:tasks.workunit.client.1.smithi167.stdout:5/463: dread d0/d54/f75 [0,4194304] 0 2024-09-17T01:41:28.857 INFO:tasks.workunit.client.1.smithi167.stdout:4/585: getdents d0/d4/d7/da/d48/d40/d51/d2d 0 2024-09-17T01:41:28.858 INFO:tasks.workunit.client.0.smithi082.stdout:5/295: rmdir db/d1e/d20/d4d 39 2024-09-17T01:41:28.858 INFO:tasks.workunit.client.0.smithi082.stdout:5/296: readlink db/d1e/l25 0 2024-09-17T01:41:28.860 INFO:tasks.workunit.client.1.smithi167.stdout:9/619: dread d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:28.862 INFO:tasks.workunit.client.0.smithi082.stdout:2/258: creat d1/d17/d29/f4c x:0 0 0 2024-09-17T01:41:28.862 INFO:tasks.workunit.client.0.smithi082.stdout:2/259: chown d1/l22 23542 1 2024-09-17T01:41:28.866 INFO:tasks.workunit.client.1.smithi167.stdout:7/535: link d0/d2/d14/d19/d32/f4d d0/d2/fb6 0 2024-09-17T01:41:28.866 INFO:tasks.workunit.client.1.smithi167.stdout:8/635: getdents dc/d56/d57/da0 0 2024-09-17T01:41:28.874 INFO:tasks.workunit.client.0.smithi082.stdout:1/330: link d2/d3f/d24/f68 d2/da/d2d/d6c/f6e 0 2024-09-17T01:41:28.875 INFO:tasks.workunit.client.1.smithi167.stdout:5/464: rename d0/d9/ff to d0/d9/d64/f89 0 2024-09-17T01:41:28.878 INFO:tasks.workunit.client.0.smithi082.stdout:2/260: creat d1/f4d x:0 0 0 2024-09-17T01:41:28.878 INFO:tasks.workunit.client.0.smithi082.stdout:2/261: dread - d1/f4d zero size 2024-09-17T01:41:28.879 INFO:tasks.workunit.client.1.smithi167.stdout:3/549: mkdir d7/d8/d10/d14/d66/d6c/dab 0 2024-09-17T01:41:28.880 INFO:tasks.workunit.client.0.smithi082.stdout:5/297: write f9 [841669,121031] 0 2024-09-17T01:41:28.880 INFO:tasks.workunit.client.0.smithi082.stdout:1/331: fdatasync d2/d3f/d24/f69 0 2024-09-17T01:41:28.881 INFO:tasks.workunit.client.0.smithi082.stdout:5/298: stat db/d56/d18/c5c 0 2024-09-17T01:41:28.882 INFO:tasks.workunit.client.1.smithi167.stdout:9/620: mkdir d4/d9/d21/d81/dbf 0 2024-09-17T01:41:28.884 INFO:tasks.workunit.client.0.smithi082.stdout:2/262: fsync d1/d10/f41 0 2024-09-17T01:41:28.885 INFO:tasks.workunit.client.1.smithi167.stdout:3/550: dwrite d7/d1e/f80 [0,4194304] 0 2024-09-17T01:41:28.886 INFO:tasks.workunit.client.1.smithi167.stdout:3/551: truncate d7/d8/d10/d14/d2c/f89 271263 0 2024-09-17T01:41:28.886 INFO:tasks.workunit.client.1.smithi167.stdout:2/522: link d5/d10/d1a/d2e/f87 d5/d3c/d4c/d4d/d91/fbb 0 2024-09-17T01:41:28.887 INFO:tasks.workunit.client.1.smithi167.stdout:2/523: write d5/d71/fae [1109093,83464] 0 2024-09-17T01:41:28.888 INFO:tasks.workunit.client.1.smithi167.stdout:3/552: write d7/d8/d10/d14/d2c/f2d [8901691,49656] 0 2024-09-17T01:41:28.889 INFO:tasks.workunit.client.1.smithi167.stdout:2/524: dread - d5/d3c/d4c/d4d/fa6 zero size 2024-09-17T01:41:28.890 INFO:tasks.workunit.client.1.smithi167.stdout:7/536: rmdir d0/d2/d14/d4c 39 2024-09-17T01:41:28.891 INFO:tasks.workunit.client.1.smithi167.stdout:3/553: write d7/d8/d10/d14/d2c/f81 [8733254,20925] 0 2024-09-17T01:41:28.891 INFO:tasks.workunit.client.0.smithi082.stdout:5/299: creat db/d56/d18/f62 x:0 0 0 2024-09-17T01:41:28.892 INFO:tasks.workunit.client.0.smithi082.stdout:0/228: link da/df/f15 da/d16/f51 0 2024-09-17T01:41:28.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/300: write f9 [376040,109952] 0 2024-09-17T01:41:28.893 INFO:tasks.workunit.client.1.smithi167.stdout:0/489: mknod d5/d6b/d77/d92/c99 0 2024-09-17T01:41:28.894 INFO:tasks.workunit.client.1.smithi167.stdout:3/554: write d7/d8/d10/d14/d24/d62/f69 [201688,121274] 0 2024-09-17T01:41:28.896 INFO:tasks.workunit.client.1.smithi167.stdout:4/586: dwrite d0/d4/d7/da/d48/d40/d51/f3a [0,4194304] 0 2024-09-17T01:41:28.897 INFO:tasks.workunit.client.1.smithi167.stdout:0/490: dread d5/d6b/d77/d4d/f40 [0,4194304] 0 2024-09-17T01:41:28.897 INFO:tasks.workunit.client.1.smithi167.stdout:5/465: unlink d0/c17 0 2024-09-17T01:41:28.898 INFO:tasks.workunit.client.1.smithi167.stdout:5/466: chown d0/d28/d3a/d44 14497 1 2024-09-17T01:41:28.899 INFO:tasks.workunit.client.0.smithi082.stdout:1/332: rename d2/l5 to d2/da/d2f/l6f 0 2024-09-17T01:41:28.899 INFO:tasks.workunit.client.1.smithi167.stdout:5/467: dread - d0/d28/d3a/d44/f5e zero size 2024-09-17T01:41:28.900 INFO:tasks.workunit.client.1.smithi167.stdout:0/491: truncate d5/d8/d9/d2f/f3b 4261892 0 2024-09-17T01:41:28.901 INFO:tasks.workunit.client.1.smithi167.stdout:0/492: dread - d5/d8/d9/d2f/f72 zero size 2024-09-17T01:41:28.901 INFO:tasks.workunit.client.0.smithi082.stdout:0/229: creat da/d1b/f52 x:0 0 0 2024-09-17T01:41:28.904 INFO:tasks.workunit.client.0.smithi082.stdout:2/263: unlink d1/c3 0 2024-09-17T01:41:28.906 INFO:tasks.workunit.client.0.smithi082.stdout:0/230: creat da/df/f53 x:0 0 0 2024-09-17T01:41:28.907 INFO:tasks.workunit.client.1.smithi167.stdout:9/621: dwrite d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:28.907 INFO:tasks.workunit.client.1.smithi167.stdout:2/525: write d5/d10/d16/f1b [1788353,56569] 0 2024-09-17T01:41:28.910 INFO:tasks.workunit.client.0.smithi082.stdout:2/264: read d1/f16 [1202816,44697] 0 2024-09-17T01:41:28.915 INFO:tasks.workunit.client.1.smithi167.stdout:9/622: dwrite d4/d9/f9a [0,4194304] 0 2024-09-17T01:41:28.916 INFO:tasks.workunit.client.1.smithi167.stdout:2/526: dwrite d5/d10/f22 [0,4194304] 0 2024-09-17T01:41:28.917 INFO:tasks.workunit.client.1.smithi167.stdout:2/527: dread - d5/d10/f9c zero size 2024-09-17T01:41:28.918 INFO:tasks.workunit.client.1.smithi167.stdout:2/528: stat d5/d6d/fa5 0 2024-09-17T01:41:28.919 INFO:tasks.workunit.client.0.smithi082.stdout:5/301: link db/d56/d18/c5c db/d1e/d20/c63 0 2024-09-17T01:41:28.919 INFO:tasks.workunit.client.0.smithi082.stdout:5/302: fdatasync db/d56/d29/d4f/f57 0 2024-09-17T01:41:28.920 INFO:tasks.workunit.client.1.smithi167.stdout:5/468: fsync d0/d9/f34 0 2024-09-17T01:41:28.921 INFO:tasks.workunit.client.0.smithi082.stdout:5/303: write db/d56/f15 [822597,67824] 0 2024-09-17T01:41:28.926 INFO:tasks.workunit.client.1.smithi167.stdout:2/529: read d5/d10/d16/f18 [3726045,118872] 0 2024-09-17T01:41:28.929 INFO:tasks.workunit.client.1.smithi167.stdout:2/530: dread d5/d10/d16/f29 [0,4194304] 0 2024-09-17T01:41:28.931 INFO:tasks.workunit.client.0.smithi082.stdout:5/304: symlink db/d1e/l64 0 2024-09-17T01:41:28.932 INFO:tasks.workunit.client.0.smithi082.stdout:0/231: link da/d1b/c36 da/d16/c54 0 2024-09-17T01:41:28.941 INFO:tasks.workunit.client.0.smithi082.stdout:1/333: chown d2/df/d46/c55 25595 1 2024-09-17T01:41:28.942 INFO:tasks.workunit.client.1.smithi167.stdout:4/587: symlink d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d75/lc1 0 2024-09-17T01:41:28.943 INFO:tasks.workunit.client.1.smithi167.stdout:6/695: sync 2024-09-17T01:41:28.944 INFO:tasks.workunit.client.1.smithi167.stdout:6/696: fdatasync d7/d52/fcc 0 2024-09-17T01:41:28.945 INFO:tasks.workunit.client.1.smithi167.stdout:5/469: symlink d0/d28/d3a/d4d/l8a 0 2024-09-17T01:41:28.947 INFO:tasks.workunit.client.0.smithi082.stdout:2/265: dwrite d1/f16 [0,4194304] 0 2024-09-17T01:41:28.947 INFO:tasks.workunit.client.0.smithi082.stdout:0/232: symlink da/d1b/d23/d42/d43/l55 0 2024-09-17T01:41:28.947 INFO:tasks.workunit.client.0.smithi082.stdout:8/234: sync 2024-09-17T01:41:28.948 INFO:tasks.workunit.client.1.smithi167.stdout:0/493: creat d5/d6b/d77/d6d/d90/f9a x:0 0 0 2024-09-17T01:41:28.953 INFO:tasks.workunit.client.1.smithi167.stdout:7/537: creat d0/fb7 x:0 0 0 2024-09-17T01:41:28.955 INFO:tasks.workunit.client.1.smithi167.stdout:8/636: getdents dc/d21/d6b/d74/d83 0 2024-09-17T01:41:28.959 INFO:tasks.workunit.client.1.smithi167.stdout:2/531: dread d5/d10/d1a/d45/f68 [0,4194304] 0 2024-09-17T01:41:28.960 INFO:tasks.workunit.client.1.smithi167.stdout:2/532: write d5/d33/f57 [595293,16627] 0 2024-09-17T01:41:28.960 INFO:tasks.workunit.client.1.smithi167.stdout:9/623: symlink d4/d9/d21/d43/d6c/da5/lc0 0 2024-09-17T01:41:28.963 INFO:tasks.workunit.client.1.smithi167.stdout:9/624: read d4/d9/d21/d43/d6c/f86 [2660459,39346] 0 2024-09-17T01:41:28.964 INFO:tasks.workunit.client.1.smithi167.stdout:9/625: dread - d4/d9/d21/d43/f7d zero size 2024-09-17T01:41:28.965 INFO:tasks.workunit.client.0.smithi082.stdout:5/305: getdents db/d1e/d5b 0 2024-09-17T01:41:28.966 INFO:tasks.workunit.client.0.smithi082.stdout:5/306: read db/d1e/f31 [2821190,113255] 0 2024-09-17T01:41:28.967 INFO:tasks.workunit.client.0.smithi082.stdout:8/235: creat d3/dd/d18/d3a/f46 x:0 0 0 2024-09-17T01:41:28.973 INFO:tasks.workunit.client.0.smithi082.stdout:1/334: dread d2/d3f/d24/f23 [0,4194304] 0 2024-09-17T01:41:28.982 INFO:tasks.workunit.client.1.smithi167.stdout:1/561: sync 2024-09-17T01:41:28.984 INFO:tasks.workunit.client.1.smithi167.stdout:4/588: rmdir d0/d4/d7/da/d48/d40/d51/d2d/d2e 39 2024-09-17T01:41:28.985 INFO:tasks.workunit.client.1.smithi167.stdout:6/697: rmdir d7/d54/d90/d34 39 2024-09-17T01:41:28.986 INFO:tasks.workunit.client.1.smithi167.stdout:6/698: chown d7/d54/d90/d13/d2f/d64/fbe 20519 1 2024-09-17T01:41:28.987 INFO:tasks.workunit.client.1.smithi167.stdout:5/470: mknod d0/d28/d3a/d44/c8b 0 2024-09-17T01:41:28.988 INFO:tasks.workunit.client.1.smithi167.stdout:0/494: mkdir d5/d8/d9/d2f/d9b 0 2024-09-17T01:41:28.988 INFO:tasks.workunit.client.1.smithi167.stdout:0/495: fdatasync d5/d6b/d77/d37/f98 0 2024-09-17T01:41:28.990 INFO:tasks.workunit.client.1.smithi167.stdout:7/538: creat d0/d2/d14/d19/d22/d40/fb8 x:0 0 0 2024-09-17T01:41:28.991 INFO:tasks.workunit.client.1.smithi167.stdout:3/555: getdents d7/d8/d2a 0 2024-09-17T01:41:28.994 INFO:tasks.workunit.client.1.smithi167.stdout:8/637: rename dc/d1a/f30 to dc/d21/d6b/d74/d83/dc0/dc7/fce 0 2024-09-17T01:41:28.997 INFO:tasks.workunit.client.1.smithi167.stdout:2/533: creat d5/d10/d1a/db8/d5e/fbc x:0 0 0 2024-09-17T01:41:29.000 INFO:tasks.workunit.client.1.smithi167.stdout:1/562: creat d0/d9/fc2 x:0 0 0 2024-09-17T01:41:29.000 INFO:tasks.workunit.client.1.smithi167.stdout:4/589: rmdir d0/d4/d7/da/d48/d40/d51/d2d 39 2024-09-17T01:41:29.001 INFO:tasks.workunit.client.1.smithi167.stdout:1/563: write d0/d5/d61/f71 [3872004,67027] 0 2024-09-17T01:41:29.002 INFO:tasks.workunit.client.1.smithi167.stdout:0/496: creat d5/d6b/d77/d4d/f9c x:0 0 0 2024-09-17T01:41:29.004 INFO:tasks.workunit.client.1.smithi167.stdout:1/564: dread - d0/d5/d61/fac zero size 2024-09-17T01:41:29.005 INFO:tasks.workunit.client.1.smithi167.stdout:7/539: write d0/d2/d14/f6b [799820,90426] 0 2024-09-17T01:41:29.005 INFO:tasks.workunit.client.1.smithi167.stdout:3/556: symlink d7/d8f/lac 0 2024-09-17T01:41:29.006 INFO:tasks.workunit.client.1.smithi167.stdout:3/557: chown d7/d8/d2a/l27 341188789 1 2024-09-17T01:41:29.006 INFO:tasks.workunit.client.1.smithi167.stdout:7/540: fsync d0/d2/d14/d19/d26/f81 0 2024-09-17T01:41:29.007 INFO:tasks.workunit.client.1.smithi167.stdout:6/699: rename d7/d54/d90/d13/d2f/d30/d32/f9a to d7/d54/d90/d13/d2f/d64/d6b/d95/db1/ffd 0 2024-09-17T01:41:29.007 INFO:tasks.workunit.client.1.smithi167.stdout:8/638: truncate dc/d21/d61/f88 3962605 0 2024-09-17T01:41:29.009 INFO:tasks.workunit.client.1.smithi167.stdout:4/590: dwrite d0/d4/d7/d6/d2b/f7d [0,4194304] 0 2024-09-17T01:41:29.013 INFO:tasks.workunit.client.1.smithi167.stdout:1/565: rename d0/d9/d16/fad to d0/d9/d16/d22/fc3 0 2024-09-17T01:41:29.015 INFO:tasks.workunit.client.1.smithi167.stdout:6/700: creat d7/d54/d90/d13/d2f/d64/d6b/ffe x:0 0 0 2024-09-17T01:41:29.015 INFO:tasks.workunit.client.1.smithi167.stdout:7/541: dread d0/d2/d14/f16 [0,4194304] 0 2024-09-17T01:41:29.016 INFO:tasks.workunit.client.1.smithi167.stdout:5/471: creat d0/d9/f8c x:0 0 0 2024-09-17T01:41:29.018 INFO:tasks.workunit.client.1.smithi167.stdout:3/558: dwrite d7/d8/d10/d14/f5a [4194304,4194304] 0 2024-09-17T01:41:29.018 INFO:tasks.workunit.client.1.smithi167.stdout:6/701: chown d7/d54/d90/cb0 3650 1 2024-09-17T01:41:29.020 INFO:tasks.workunit.client.1.smithi167.stdout:3/559: readlink d7/d8/d2a/l84 0 2024-09-17T01:41:29.022 INFO:tasks.workunit.client.1.smithi167.stdout:0/497: dwrite d5/d8/f20 [0,4194304] 0 2024-09-17T01:41:29.025 INFO:tasks.workunit.client.1.smithi167.stdout:1/566: creat d0/d9/d16/d48/d54/d78/fc4 x:0 0 0 2024-09-17T01:41:29.025 INFO:tasks.workunit.client.1.smithi167.stdout:9/626: truncate d4/d9/d21/d43/f78 951922 0 2024-09-17T01:41:29.027 INFO:tasks.workunit.client.1.smithi167.stdout:3/560: readlink d7/d8/d10/d14/d2c/d74/l8e 0 2024-09-17T01:41:29.029 INFO:tasks.workunit.client.1.smithi167.stdout:1/567: dread - d0/d9/d16/d48/d54/d6e/d7e/fb2 zero size 2024-09-17T01:41:29.031 INFO:tasks.workunit.client.1.smithi167.stdout:7/542: rename d0/d2/d14/d19/d32/d62/f79 to d0/d2/d14/d19/fb9 0 2024-09-17T01:41:29.033 INFO:tasks.workunit.client.1.smithi167.stdout:4/591: truncate d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d4f/f9e 261868 0 2024-09-17T01:41:29.033 INFO:tasks.workunit.client.1.smithi167.stdout:2/534: dread d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:29.034 INFO:tasks.workunit.client.1.smithi167.stdout:6/702: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [0,4194304] 0 2024-09-17T01:41:29.036 INFO:tasks.workunit.client.1.smithi167.stdout:7/543: stat d0/d2/d88/d6e/l9a 0 2024-09-17T01:41:29.037 INFO:tasks.workunit.client.1.smithi167.stdout:3/561: mkdir d7/d8/d10/d14/d24/d9c/da3/dad 0 2024-09-17T01:41:29.038 INFO:tasks.workunit.client.1.smithi167.stdout:1/568: truncate d0/f17 1408215 0 2024-09-17T01:41:29.040 INFO:tasks.workunit.client.1.smithi167.stdout:5/472: rename d0/l1 to d0/d54/d56/l8d 0 2024-09-17T01:41:29.040 INFO:tasks.workunit.client.1.smithi167.stdout:0/498: dwrite d5/d6b/d77/d6d/f81 [0,4194304] 0 2024-09-17T01:41:29.041 INFO:tasks.workunit.client.1.smithi167.stdout:3/562: creat d7/d8f/fae x:0 0 0 2024-09-17T01:41:29.041 INFO:tasks.workunit.client.1.smithi167.stdout:1/569: chown d0/d9/c57 295052053 1 2024-09-17T01:41:29.043 INFO:tasks.workunit.client.1.smithi167.stdout:4/592: write d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/f46 [16174936,127077] 0 2024-09-17T01:41:29.043 INFO:tasks.workunit.client.1.smithi167.stdout:1/570: chown d0 1276 1 2024-09-17T01:41:29.043 INFO:tasks.workunit.client.1.smithi167.stdout:5/473: chown d0/d28/d3a/l42 1834549 1 2024-09-17T01:41:29.043 INFO:tasks.workunit.client.1.smithi167.stdout:7/544: unlink d0/d2/d14/d19/d32/f92 0 2024-09-17T01:41:29.047 INFO:tasks.workunit.client.1.smithi167.stdout:9/627: rename d4/d9/d21/d43/faf to d4/d9/d21/d43/d6c/d9e/da1/dbc/fc1 0 2024-09-17T01:41:29.066 INFO:tasks.workunit.client.0.smithi082.stdout:5/307: rename db/d56/d29/f32 to db/d56/d18/d23/f65 0 2024-09-17T01:41:29.067 INFO:tasks.workunit.client.0.smithi082.stdout:2/266: symlink d1/l4e 0 2024-09-17T01:41:29.068 INFO:tasks.workunit.client.0.smithi082.stdout:1/335: fsync d2/d3f/d34/f59 0 2024-09-17T01:41:29.069 INFO:tasks.workunit.client.0.smithi082.stdout:1/336: readlink d2/d3f/d24/l5b 0 2024-09-17T01:41:29.069 INFO:tasks.workunit.client.0.smithi082.stdout:5/308: creat db/d56/d18/d23/f66 x:0 0 0 2024-09-17T01:41:29.071 INFO:tasks.workunit.client.0.smithi082.stdout:2/267: rename d1/l1d to d1/d17/d38/d42/l4f 0 2024-09-17T01:41:29.071 INFO:tasks.workunit.client.0.smithi082.stdout:2/268: chown d1/d17/l47 35535 1 2024-09-17T01:41:29.071 INFO:tasks.workunit.client.0.smithi082.stdout:1/337: creat d2/df/f70 x:0 0 0 2024-09-17T01:41:29.074 INFO:tasks.workunit.client.0.smithi082.stdout:2/269: mkdir d1/d17/d29/d50 0 2024-09-17T01:41:29.076 INFO:tasks.workunit.client.0.smithi082.stdout:2/270: mknod d1/d17/d29/c51 0 2024-09-17T01:41:29.077 INFO:tasks.workunit.client.0.smithi082.stdout:1/338: dread d2/d3f/f5a [0,4194304] 0 2024-09-17T01:41:29.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/271: mkdir d1/d17/d38/d42/d52 0 2024-09-17T01:41:29.081 INFO:tasks.workunit.client.0.smithi082.stdout:5/309: truncate db/d56/d29/d4f/f53 2420583 0 2024-09-17T01:41:29.081 INFO:tasks.workunit.client.0.smithi082.stdout:1/339: dread d2/da/f35 [0,4194304] 0 2024-09-17T01:41:29.083 INFO:tasks.workunit.client.0.smithi082.stdout:5/310: unlink db/d1e/d20/f3f 0 2024-09-17T01:41:29.084 INFO:tasks.workunit.client.0.smithi082.stdout:1/340: symlink d2/l71 0 2024-09-17T01:41:29.085 INFO:tasks.workunit.client.0.smithi082.stdout:5/311: mknod db/c67 0 2024-09-17T01:41:29.087 INFO:tasks.workunit.client.0.smithi082.stdout:1/341: creat d2/da/d2f/f72 x:0 0 0 2024-09-17T01:41:29.089 INFO:tasks.workunit.client.0.smithi082.stdout:1/342: write d2/df/f70 [362283,19002] 0 2024-09-17T01:41:29.091 INFO:tasks.workunit.client.0.smithi082.stdout:1/343: chown d2/f1b 1703093 1 2024-09-17T01:41:29.095 INFO:tasks.workunit.client.0.smithi082.stdout:5/312: write db/d56/d18/f4a [1544497,31834] 0 2024-09-17T01:41:29.096 INFO:tasks.workunit.client.0.smithi082.stdout:5/313: creat db/d56/d29/f68 x:0 0 0 2024-09-17T01:41:29.099 INFO:tasks.workunit.client.0.smithi082.stdout:5/314: rmdir db/d1e/d20/d4d 39 2024-09-17T01:41:29.111 INFO:tasks.workunit.client.1.smithi167.stdout:6/703: mknod d7/d54/d90/d13/d2f/d64/d6b/d95/cff 0 2024-09-17T01:41:29.112 INFO:tasks.workunit.client.0.smithi082.stdout:5/315: dread db/d56/d18/f1d [0,4194304] 0 2024-09-17T01:41:29.113 INFO:tasks.workunit.client.1.smithi167.stdout:5/474: symlink d0/d24/d2b/d49/d66/l8e 0 2024-09-17T01:41:29.113 INFO:tasks.workunit.client.1.smithi167.stdout:2/535: link d5/d10/d1a/d45/d6b/f6f d5/d6d/fbd 0 2024-09-17T01:41:29.113 INFO:tasks.workunit.client.1.smithi167.stdout:7/545: rmdir d0/d2/d14/d19/d26 39 2024-09-17T01:41:29.113 INFO:tasks.workunit.client.1.smithi167.stdout:4/593: write d0/d4/d7/da/f6e [550355,5515] 0 2024-09-17T01:41:29.114 INFO:tasks.workunit.client.1.smithi167.stdout:5/475: write d0/f47 [538275,99153] 0 2024-09-17T01:41:29.114 INFO:tasks.workunit.client.1.smithi167.stdout:9/628: mkdir d4/dc2 0 2024-09-17T01:41:29.114 INFO:tasks.workunit.client.1.smithi167.stdout:6/704: chown d7/d54/d90/d13/d2f/d96/f9e 30492 1 2024-09-17T01:41:29.116 INFO:tasks.workunit.client.1.smithi167.stdout:5/476: dread - d0/d24/f62 zero size 2024-09-17T01:41:29.116 INFO:tasks.workunit.client.0.smithi082.stdout:5/316: rename db/d1e/d20/d30/c46 to db/c69 0 2024-09-17T01:41:29.117 INFO:tasks.workunit.client.1.smithi167.stdout:4/594: chown d0/d4/d7/da/d48/d40/d51/d2d/d2e/d31/d75 1026043 1 2024-09-17T01:41:29.118 INFO:tasks.workunit.client.1.smithi167.stdout:3/563: creat d7/faf x:0 0 0 2024-09-17T01:41:29.118 INFO:tasks.workunit.client.1.smithi167.stdout:4/595: chown d0/l1a 125163 1 2024-09-17T01:41:29.118 INFO:tasks.workunit.client.1.smithi167.stdout:2/536: chown d5/d10/d1a/d45/d8e/c9d 37976 1 2024-09-17T01:41:29.119 INFO:tasks.workunit.client.1.smithi167.stdout:7/546: mknod d0/d2/d14/d6f/cba 0 2024-09-17T01:41:29.119 INFO:tasks.workunit.client.1.smithi167.stdout:7/547: dread - d0/d2/d14/f8a zero size 2024-09-17T01:41:29.120 INFO:tasks.workunit.client.0.smithi082.stdout:5/317: read db/d56/d29/d4f/f53 [1600655,114971] 0 2024-09-17T01:41:29.120 INFO:tasks.workunit.client.1.smithi167.stdout:7/548: read d0/d2/d88/f6c [1508133,126055] 0 2024-09-17T01:41:29.122 INFO:tasks.workunit.client.1.smithi167.stdout:7/549: dread d0/d2/d14/d19/d32/d62/f64 [0,4194304] 0 2024-09-17T01:41:29.123 INFO:tasks.workunit.client.0.smithi082.stdout:5/318: creat db/d56/d29/f6a x:0 0 0 2024-09-17T01:41:29.123 INFO:tasks.workunit.client.1.smithi167.stdout:4/596: dread d0/d4/d7/d6/f29 [0,4194304] 0 2024-09-17T01:41:29.124 INFO:tasks.workunit.client.0.smithi082.stdout:5/319: truncate db/d56/d18/f62 221406 0 2024-09-17T01:41:29.125 INFO:tasks.workunit.client.1.smithi167.stdout:2/537: mknod d5/d71/cbe 0 2024-09-17T01:41:29.129 INFO:tasks.workunit.client.1.smithi167.stdout:1/571: getdents d0/d5/d61/da2 0 2024-09-17T01:41:29.130 INFO:tasks.workunit.client.1.smithi167.stdout:5/477: write d0/d54/f75 [694715,71332] 0 2024-09-17T01:41:29.131 INFO:tasks.workunit.client.0.smithi082.stdout:5/320: unlink db/f16 0 2024-09-17T01:41:29.135 INFO:tasks.workunit.client.1.smithi167.stdout:5/478: dwrite d0/d24/d2b/f39 [0,4194304] 0 2024-09-17T01:41:29.136 INFO:tasks.workunit.client.0.smithi082.stdout:5/321: rmdir db/d1e/d20/d30 39 2024-09-17T01:41:29.137 INFO:tasks.workunit.client.1.smithi167.stdout:9/629: truncate d4/d9/f4c 300726 0 2024-09-17T01:41:29.140 INFO:tasks.workunit.client.0.smithi082.stdout:5/322: write db/f2d [727189,67411] 0 2024-09-17T01:41:29.145 INFO:tasks.workunit.client.1.smithi167.stdout:3/564: truncate d7/f41 1220690 0 2024-09-17T01:41:29.146 INFO:tasks.workunit.client.1.smithi167.stdout:3/565: chown d7/d8/d2a/c35 3 1 2024-09-17T01:41:29.147 INFO:tasks.workunit.client.1.smithi167.stdout:7/550: dwrite d0/d2/d88/f7c [0,4194304] 0 2024-09-17T01:41:29.148 INFO:tasks.workunit.client.0.smithi082.stdout:5/323: unlink db/f4b 0 2024-09-17T01:41:29.151 INFO:tasks.workunit.client.0.smithi082.stdout:5/324: mkdir db/d56/d6b 0 2024-09-17T01:41:29.153 INFO:tasks.workunit.client.1.smithi167.stdout:1/572: dread d0/d5/d34/d3c/f2b [0,4194304] 0 2024-09-17T01:41:29.154 INFO:tasks.workunit.client.0.smithi082.stdout:5/325: rmdir db/d56 39 2024-09-17T01:41:29.154 INFO:tasks.workunit.client.1.smithi167.stdout:1/573: chown d0/d9/d16/d36/l7a 1 1 2024-09-17T01:41:29.156 INFO:tasks.workunit.client.1.smithi167.stdout:8/639: sync 2024-09-17T01:41:29.156 INFO:tasks.workunit.client.1.smithi167.stdout:8/640: fdatasync f8 0 2024-09-17T01:41:29.158 INFO:tasks.workunit.client.1.smithi167.stdout:6/705: getdents d7/d54/d90/d13/d2f/d96 0 2024-09-17T01:41:29.160 INFO:tasks.workunit.client.1.smithi167.stdout:1/574: dread d0/d5/d34/fa7 [0,4194304] 0 2024-09-17T01:41:29.161 INFO:tasks.workunit.client.0.smithi082.stdout:5/326: dwrite db/d1e/f55 [0,4194304] 0 2024-09-17T01:41:29.162 INFO:tasks.workunit.client.1.smithi167.stdout:3/566: creat d7/d8/d10/d14/d66/d6c/fb0 x:0 0 0 2024-09-17T01:41:29.164 INFO:tasks.workunit.client.1.smithi167.stdout:5/479: mknod d0/d28/d80/c8f 0 2024-09-17T01:41:29.165 INFO:tasks.workunit.client.1.smithi167.stdout:7/551: dread d0/d2/d14/d19/d26/f59 [0,4194304] 0 2024-09-17T01:41:29.165 INFO:tasks.workunit.client.1.smithi167.stdout:9/630: mknod d4/d9/d21/cc3 0 2024-09-17T01:41:29.165 INFO:tasks.workunit.client.1.smithi167.stdout:5/480: chown d0/d28/d3a/d44/d69/c73 24203888 1 2024-09-17T01:41:29.169 INFO:tasks.workunit.client.1.smithi167.stdout:2/538: rename d5/d10/d1a/d45/d8e/fa0 to d5/d10/d1a/d45/fbf 0 2024-09-17T01:41:29.172 INFO:tasks.workunit.client.1.smithi167.stdout:8/641: chown dc/c51 1527 1 2024-09-17T01:41:29.173 INFO:tasks.workunit.client.1.smithi167.stdout:6/706: creat d7/d52/db7/f100 x:0 0 0 2024-09-17T01:41:29.173 INFO:tasks.workunit.client.1.smithi167.stdout:6/707: dread - d7/d52/d8c/ff3 zero size 2024-09-17T01:41:29.175 INFO:tasks.workunit.client.0.smithi082.stdout:5/327: dread f9 [0,4194304] 0 2024-09-17T01:41:29.177 INFO:tasks.workunit.client.1.smithi167.stdout:5/481: fdatasync d0/d24/f38 0 2024-09-17T01:41:29.178 INFO:tasks.workunit.client.1.smithi167.stdout:5/482: readlink d0/d28/d3a/d4d/l8a 0 2024-09-17T01:41:29.181 INFO:tasks.workunit.client.1.smithi167.stdout:2/539: creat d5/d10/d1a/db8/d5e/fc0 x:0 0 0 2024-09-17T01:41:29.181 INFO:tasks.workunit.client.1.smithi167.stdout:2/540: readlink d5/d10/d1a/d2e/l99 0 2024-09-17T01:41:29.182 INFO:tasks.workunit.client.0.smithi082.stdout:5/328: creat db/d56/d18/d23/f6c x:0 0 0 2024-09-17T01:41:29.182 INFO:tasks.workunit.client.1.smithi167.stdout:9/631: dread d4/d9/d21/d2d/d33/d90/dac/f68 [0,4194304] 0 2024-09-17T01:41:29.183 INFO:tasks.workunit.client.1.smithi167.stdout:4/597: link d0/d4/d7/f67 d0/d4/d7/d6/d2b/d6d/fc2 0 2024-09-17T01:41:29.184 INFO:tasks.workunit.client.1.smithi167.stdout:4/598: stat d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a 0 2024-09-17T01:41:29.184 INFO:tasks.workunit.client.0.smithi082.stdout:5/329: rmdir db 39 2024-09-17T01:41:29.186 INFO:tasks.workunit.client.1.smithi167.stdout:1/575: creat d0/d5/dbf/fc5 x:0 0 0 2024-09-17T01:41:29.186 INFO:tasks.workunit.client.1.smithi167.stdout:6/708: symlink d7/d52/l101 0 2024-09-17T01:41:29.189 INFO:tasks.workunit.client.1.smithi167.stdout:7/552: rename d0/d2/d14/d19/f1e to d0/d2/d14/d19/d26/d83/da5/d70/fbb 0 2024-09-17T01:41:29.191 INFO:tasks.workunit.client.1.smithi167.stdout:8/642: getdents dc/d1a/d45 0 2024-09-17T01:41:29.192 INFO:tasks.workunit.client.0.smithi082.stdout:5/330: dwrite db/d56/d29/d4f/f57 [0,4194304] 0 2024-09-17T01:41:29.192 INFO:tasks.workunit.client.1.smithi167.stdout:6/709: dwrite d7/d54/d90/d13/d2f/fca [0,4194304] 0 2024-09-17T01:41:29.193 INFO:tasks.workunit.client.1.smithi167.stdout:5/483: symlink d0/d54/l90 0 2024-09-17T01:41:29.194 INFO:tasks.workunit.client.1.smithi167.stdout:5/484: truncate d0/d24/f62 686103 0 2024-09-17T01:41:29.198 INFO:tasks.workunit.client.1.smithi167.stdout:9/632: mkdir d4/d9/d21/d43/dc4 0 2024-09-17T01:41:29.200 INFO:tasks.workunit.client.1.smithi167.stdout:9/633: chown d4/d9/d2b/l39 1154715553 1 2024-09-17T01:41:29.200 INFO:tasks.workunit.client.1.smithi167.stdout:3/567: getdents d7/d8/d10/d14/d66/d6c/d7c 0 2024-09-17T01:41:29.202 INFO:tasks.workunit.client.1.smithi167.stdout:1/576: symlink d0/d9/d16/d48/d54/d6f/lc6 0 2024-09-17T01:41:29.204 INFO:tasks.workunit.client.0.smithi082.stdout:5/331: dread db/d56/d18/d23/f65 [0,4194304] 0 2024-09-17T01:41:29.205 INFO:tasks.workunit.client.1.smithi167.stdout:8/643: symlink dc/d56/d57/da0/da7/lcf 0 2024-09-17T01:41:29.209 INFO:tasks.workunit.client.1.smithi167.stdout:6/710: fdatasync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 0 2024-09-17T01:41:29.209 INFO:tasks.workunit.client.1.smithi167.stdout:5/485: mknod d0/d24/d2b/d49/c91 0 2024-09-17T01:41:29.210 INFO:tasks.workunit.client.1.smithi167.stdout:3/568: dwrite d7/d8/d10/d14/d2c/f81 [4194304,4194304] 0 2024-09-17T01:41:29.212 INFO:tasks.workunit.client.1.smithi167.stdout:9/634: mknod d4/d9/d21/d43/d6c/d9e/da1/dbc/cc5 0 2024-09-17T01:41:29.213 INFO:tasks.workunit.client.0.smithi082.stdout:5/332: symlink db/d1e/d20/l6d 0 2024-09-17T01:41:29.213 INFO:tasks.workunit.client.1.smithi167.stdout:3/569: chown d7/d8/d10/d14/f5a 15 1 2024-09-17T01:41:29.215 INFO:tasks.workunit.client.1.smithi167.stdout:2/541: dwrite d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:29.215 INFO:tasks.workunit.client.1.smithi167.stdout:5/486: read d0/f14 [2476440,28380] 0 2024-09-17T01:41:29.216 INFO:tasks.workunit.client.0.smithi082.stdout:5/333: dread db/d56/d29/d4f/f53 [0,4194304] 0 2024-09-17T01:41:29.221 INFO:tasks.workunit.client.0.smithi082.stdout:5/334: write db/d2b/f36 [3061780,99168] 0 2024-09-17T01:41:29.224 INFO:tasks.workunit.client.1.smithi167.stdout:9/635: rename d4/d9/d2b/l49 to d4/d9/d2b/da3/lc6 0 2024-09-17T01:41:29.224 INFO:tasks.workunit.client.1.smithi167.stdout:6/711: dwrite d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:29.226 INFO:tasks.workunit.client.1.smithi167.stdout:6/712: readlink d7/d54/d90/l74 0 2024-09-17T01:41:29.227 INFO:tasks.workunit.client.1.smithi167.stdout:7/553: dread d0/d2/f41 [0,4194304] 0 2024-09-17T01:41:29.228 INFO:tasks.workunit.client.0.smithi082.stdout:5/335: symlink db/d2b/l6e 0 2024-09-17T01:41:29.232 INFO:tasks.workunit.client.1.smithi167.stdout:7/554: chown d0/d2/d14/l68 202455 1 2024-09-17T01:41:29.233 INFO:tasks.workunit.client.1.smithi167.stdout:6/713: read d7/d54/d90/d13/d2f/d7f/fc5 [411805,106141] 0 2024-09-17T01:41:29.235 INFO:tasks.workunit.client.0.smithi082.stdout:5/336: read db/d56/d18/f40 [3860511,119760] 0 2024-09-17T01:41:29.236 INFO:tasks.workunit.client.1.smithi167.stdout:3/570: creat d7/d8/d10/d14/d25/d9e/fb1 x:0 0 0 2024-09-17T01:41:29.237 INFO:tasks.workunit.client.1.smithi167.stdout:1/577: dread d0/f46 [4194304,4194304] 0 2024-09-17T01:41:29.239 INFO:tasks.workunit.client.1.smithi167.stdout:2/542: write d5/d10/d1a/f31 [3422846,2736] 0 2024-09-17T01:41:29.239 INFO:tasks.workunit.client.1.smithi167.stdout:0/499: sync 2024-09-17T01:41:29.240 INFO:tasks.workunit.client.0.smithi082.stdout:5/337: dwrite db/d56/f15 [0,4194304] 0 2024-09-17T01:41:29.241 INFO:tasks.workunit.client.1.smithi167.stdout:3/571: fdatasync d7/d8/d10/d29/f87 0 2024-09-17T01:41:29.242 INFO:tasks.workunit.client.1.smithi167.stdout:7/555: truncate d0/d2/d14/f72 775886 0 2024-09-17T01:41:29.242 INFO:tasks.workunit.client.1.smithi167.stdout:9/636: dread d4/d9/f25 [0,4194304] 0 2024-09-17T01:41:29.243 INFO:tasks.workunit.client.0.smithi082.stdout:5/338: truncate db/d56/d18/d23/f6c 106750 0 2024-09-17T01:41:29.243 INFO:tasks.workunit.client.1.smithi167.stdout:5/487: dwrite d0/d28/d3a/d44/d69/f6b [0,4194304] 0 2024-09-17T01:41:29.245 INFO:tasks.workunit.client.1.smithi167.stdout:1/578: creat d0/d5/d61/da2/fc7 x:0 0 0 2024-09-17T01:41:29.246 INFO:tasks.workunit.client.1.smithi167.stdout:2/543: chown d5/d10/d1a/db8/l6e 90 1 2024-09-17T01:41:29.246 INFO:tasks.workunit.client.0.smithi082.stdout:5/339: mkdir db/d2b/d6f 0 2024-09-17T01:41:29.249 INFO:tasks.workunit.client.1.smithi167.stdout:9/637: truncate d4/d9/d21/d2d/d33/d3a/d9c/faa 1017830 0 2024-09-17T01:41:29.250 INFO:tasks.workunit.client.1.smithi167.stdout:6/714: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/c102 0 2024-09-17T01:41:29.250 INFO:tasks.workunit.client.1.smithi167.stdout:3/572: truncate d7/d8/d10/d14/d24/d62/f77 5102211 0 2024-09-17T01:41:29.251 INFO:tasks.workunit.client.1.smithi167.stdout:7/556: mknod d0/d2/d14/d6f/d8b/cbc 0 2024-09-17T01:41:29.252 INFO:tasks.workunit.client.1.smithi167.stdout:3/573: readlink d7/d8/d10/d14/l96 0 2024-09-17T01:41:29.253 INFO:tasks.workunit.client.0.smithi082.stdout:5/340: creat db/d56/d18/f70 x:0 0 0 2024-09-17T01:41:29.253 INFO:tasks.workunit.client.1.smithi167.stdout:8/644: dread dc/d21/f47 [4194304,4194304] 0 2024-09-17T01:41:29.254 INFO:tasks.workunit.client.1.smithi167.stdout:6/715: readlink d7/d54/d90/d13/d2f/d30/d88/da2/lfb 0 2024-09-17T01:41:29.254 INFO:tasks.workunit.client.1.smithi167.stdout:1/579: stat d0/f17 0 2024-09-17T01:41:29.255 INFO:tasks.workunit.client.1.smithi167.stdout:5/488: mkdir d0/d24/d2b/d3d/d3b/d92 0 2024-09-17T01:41:29.259 INFO:tasks.workunit.client.0.smithi082.stdout:5/341: rename db/d2b/l42 to db/d56/d18/d23/l71 0 2024-09-17T01:41:29.261 INFO:tasks.workunit.client.0.smithi082.stdout:5/342: write db/d56/d29/f68 [143775,41957] 0 2024-09-17T01:41:29.261 INFO:tasks.workunit.client.1.smithi167.stdout:7/557: symlink d0/d2/d14/d19/d32/d62/lbd 0 2024-09-17T01:41:29.261 INFO:tasks.workunit.client.1.smithi167.stdout:7/558: truncate d0/fa9 932983 0 2024-09-17T01:41:29.264 INFO:tasks.workunit.client.1.smithi167.stdout:1/580: creat d0/d5/d34/d3c/d74/fc8 x:0 0 0 2024-09-17T01:41:29.264 INFO:tasks.workunit.client.1.smithi167.stdout:3/574: symlink d7/d8/d10/d14/lb2 0 2024-09-17T01:41:29.265 INFO:tasks.workunit.client.0.smithi082.stdout:5/343: read f6 [2198763,56032] 0 2024-09-17T01:41:29.265 INFO:tasks.workunit.client.0.smithi082.stdout:5/344: rename db to db/d56/d29/d72 22 2024-09-17T01:41:29.266 INFO:tasks.workunit.client.1.smithi167.stdout:5/489: mkdir d0/d24/d93 0 2024-09-17T01:41:29.267 INFO:tasks.workunit.client.0.smithi082.stdout:6/325: sync 2024-09-17T01:41:29.267 INFO:tasks.workunit.client.0.smithi082.stdout:5/345: rmdir db/d1e/d20 39 2024-09-17T01:41:29.267 INFO:tasks.workunit.client.1.smithi167.stdout:4/599: sync 2024-09-17T01:41:29.269 INFO:tasks.workunit.client.0.smithi082.stdout:6/326: chown d1/d7/d10/d4f/dc/d1d/d36/d56/f71 162 1 2024-09-17T01:41:29.269 INFO:tasks.workunit.client.1.smithi167.stdout:4/600: write d0/fd [3177337,115724] 0 2024-09-17T01:41:29.271 INFO:tasks.workunit.client.1.smithi167.stdout:4/601: write d0/f64 [3610559,99184] 0 2024-09-17T01:41:29.272 INFO:tasks.workunit.client.1.smithi167.stdout:1/581: creat d0/d5/d34/d3c/d85/db5/fc9 x:0 0 0 2024-09-17T01:41:29.273 INFO:tasks.workunit.client.1.smithi167.stdout:5/490: write d0/d9/f7a [3266,10661] 0 2024-09-17T01:41:29.274 INFO:tasks.workunit.client.1.smithi167.stdout:1/582: fdatasync d0/d9/f31 0 2024-09-17T01:41:29.274 INFO:tasks.workunit.client.1.smithi167.stdout:7/559: dwrite d0/d2/f2e [0,4194304] 0 2024-09-17T01:41:29.276 INFO:tasks.workunit.client.1.smithi167.stdout:3/575: mknod d7/d8/d10/d14/d66/cb3 0 2024-09-17T01:41:29.277 INFO:tasks.workunit.client.1.smithi167.stdout:2/544: getdents d5/d10/d1a/db8/da3/db0 0 2024-09-17T01:41:29.279 INFO:tasks.workunit.client.0.smithi082.stdout:6/327: mkdir d1/d7/d10/d4f/dc/d1d/d36/d7a 0 2024-09-17T01:41:29.280 INFO:tasks.workunit.client.0.smithi082.stdout:6/328: unlink d1/d3/c6 0 2024-09-17T01:41:29.281 INFO:tasks.workunit.client.1.smithi167.stdout:0/500: dread d5/d8/d9/f39 [0,4194304] 0 2024-09-17T01:41:29.282 INFO:tasks.workunit.client.0.smithi082.stdout:5/346: creat db/d1e/d20/f73 x:0 0 0 2024-09-17T01:41:29.282 INFO:tasks.workunit.client.1.smithi167.stdout:2/545: fdatasync d5/d10/d1a/d2e/f51 0 2024-09-17T01:41:29.283 INFO:tasks.workunit.client.0.smithi082.stdout:6/329: creat d1/d3/f7b x:0 0 0 2024-09-17T01:41:29.285 INFO:tasks.workunit.client.1.smithi167.stdout:1/583: dwrite d0/d5/d61/f71 [0,4194304] 0 2024-09-17T01:41:29.286 INFO:tasks.workunit.client.0.smithi082.stdout:6/330: dread d1/d7/d10/d4f/dc/d1d/d36/f67 [0,4194304] 0 2024-09-17T01:41:29.287 INFO:tasks.workunit.client.1.smithi167.stdout:8/645: dwrite dc/d21/f31 [0,4194304] 0 2024-09-17T01:41:29.289 INFO:tasks.workunit.client.1.smithi167.stdout:7/560: fsync d0/d2/d14/d19/d32/f4d 0 2024-09-17T01:41:29.290 INFO:tasks.workunit.client.1.smithi167.stdout:6/716: getdents d7/d52/d79 0 2024-09-17T01:41:29.290 INFO:tasks.workunit.client.0.smithi082.stdout:5/347: rmdir db/d2b/d6f 0 2024-09-17T01:41:29.292 INFO:tasks.workunit.client.1.smithi167.stdout:9/638: link f1 d4/d9/d21/d2d/d33/d80/fc7 0 2024-09-17T01:41:29.292 INFO:tasks.workunit.client.0.smithi082.stdout:6/331: rename d1/d7/d10/d4f/dc/d1d/d2c/f62 to d1/d7/d10/d4f/dc/d1d/f7c 0 2024-09-17T01:41:29.295 INFO:tasks.workunit.client.1.smithi167.stdout:3/576: symlink d7/d8/d10/d14/d24/d9c/da3/lb4 0 2024-09-17T01:41:29.295 INFO:tasks.workunit.client.1.smithi167.stdout:0/501: dwrite d5/d6b/f5d [0,4194304] 0 2024-09-17T01:41:29.295 INFO:tasks.workunit.client.1.smithi167.stdout:9/639: chown d4/d9/d2b/l39 0 1 2024-09-17T01:41:29.298 INFO:tasks.workunit.client.1.smithi167.stdout:0/502: write d5/d8/f96 [599971,48862] 0 2024-09-17T01:41:29.299 INFO:tasks.workunit.client.1.smithi167.stdout:4/602: mkdir d0/d4/d7/da/d48/d40/d51/dc3 0 2024-09-17T01:41:29.301 INFO:tasks.workunit.client.1.smithi167.stdout:3/577: write d7/d8/d2a/d4e/f58 [958548,70639] 0 2024-09-17T01:41:29.303 INFO:tasks.workunit.client.0.smithi082.stdout:6/332: creat d1/d7/d10/d4f/dc/d1d/d36/d56/f7d x:0 0 0 2024-09-17T01:41:29.305 INFO:tasks.workunit.client.1.smithi167.stdout:7/561: dwrite d0/d2/d14/d6f/d75/f84 [0,4194304] 0 2024-09-17T01:41:29.307 INFO:tasks.workunit.client.1.smithi167.stdout:7/562: readlink d0/d2/d14/d19/d22/l73 0 2024-09-17T01:41:29.307 INFO:tasks.workunit.client.1.smithi167.stdout:1/584: creat d0/d5/d34/d3c/d74/fca x:0 0 0 2024-09-17T01:41:29.309 INFO:tasks.workunit.client.1.smithi167.stdout:8/646: creat dc/d1a/d45/fd0 x:0 0 0 2024-09-17T01:41:29.309 INFO:tasks.workunit.client.0.smithi082.stdout:6/333: symlink d1/l7e 0 2024-09-17T01:41:29.311 INFO:tasks.workunit.client.1.smithi167.stdout:5/491: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:29.311 INFO:tasks.workunit.client.1.smithi167.stdout:6/717: mknod d7/d54/d90/d13/d2f/d7f/d98/c103 0 2024-09-17T01:41:29.317 INFO:tasks.workunit.client.0.smithi082.stdout:6/334: mknod d1/d7/c7f 0 2024-09-17T01:41:29.319 INFO:tasks.workunit.client.1.smithi167.stdout:2/546: symlink d5/d10/lc1 0 2024-09-17T01:41:29.321 INFO:tasks.workunit.client.1.smithi167.stdout:3/578: rename d7/d8/d10/d14/lb2 to d7/d8/d10/d14/d66/d6c/lb5 0 2024-09-17T01:41:29.321 INFO:tasks.workunit.client.0.smithi082.stdout:5/348: dwrite db/d56/d29/d4f/f53 [0,4194304] 0 2024-09-17T01:41:29.322 INFO:tasks.workunit.client.1.smithi167.stdout:3/579: stat d7/d8/d10/d14/d24/d9c 0 2024-09-17T01:41:29.323 INFO:tasks.workunit.client.0.smithi082.stdout:6/335: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55/d80 0 2024-09-17T01:41:29.328 INFO:tasks.workunit.client.1.smithi167.stdout:8/647: mkdir dc/d56/dd1 0 2024-09-17T01:41:29.331 INFO:tasks.workunit.client.0.smithi082.stdout:6/336: dwrite d1/d7/f5c [0,4194304] 0 2024-09-17T01:41:29.334 INFO:tasks.workunit.client.1.smithi167.stdout:5/492: unlink d0/d24/d2b/d49/d4b/f6f 0 2024-09-17T01:41:29.335 INFO:tasks.workunit.client.0.smithi082.stdout:6/337: write d1/d7/d10/d4f/f78 [751079,112174] 0 2024-09-17T01:41:29.336 INFO:tasks.workunit.client.1.smithi167.stdout:6/718: creat d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/f104 x:0 0 0 2024-09-17T01:41:29.340 INFO:tasks.workunit.client.0.smithi082.stdout:6/338: mknod d1/d7/d10/d4f/dc/d2b/d48/c81 0 2024-09-17T01:41:29.343 INFO:tasks.workunit.client.0.smithi082.stdout:6/339: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 x:0 0 0 2024-09-17T01:41:29.344 INFO:tasks.workunit.client.0.smithi082.stdout:6/340: chown d1/d3/l44 636936300 1 2024-09-17T01:41:29.345 INFO:tasks.workunit.client.1.smithi167.stdout:5/493: fsync d0/f20 0 2024-09-17T01:41:29.346 INFO:tasks.workunit.client.0.smithi082.stdout:6/341: stat d1/d7/d10/d4f/dc/d1d/c6b 0 2024-09-17T01:41:29.347 INFO:tasks.workunit.client.1.smithi167.stdout:9/640: link d4/d9/f1d d4/d9/d21/fc8 0 2024-09-17T01:41:29.347 INFO:tasks.workunit.client.1.smithi167.stdout:4/603: symlink d0/d4/d7/d10/lc4 0 2024-09-17T01:41:29.348 INFO:tasks.workunit.client.0.smithi082.stdout:6/342: write d1/d1f/f66 [538031,96860] 0 2024-09-17T01:41:29.349 INFO:tasks.workunit.client.0.smithi082.stdout:5/349: dwrite db/f17 [0,4194304] 0 2024-09-17T01:41:29.350 INFO:tasks.workunit.client.0.smithi082.stdout:6/343: fsync d1/d7/d10/f6f 0 2024-09-17T01:41:29.350 INFO:tasks.workunit.client.0.smithi082.stdout:5/350: truncate db/d56/f50 4924571 0 2024-09-17T01:41:29.351 INFO:tasks.workunit.client.1.smithi167.stdout:6/719: rmdir d7/d54/d90/d13/d2f/d96 39 2024-09-17T01:41:29.352 INFO:tasks.workunit.client.1.smithi167.stdout:6/720: fsync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f8f 0 2024-09-17T01:41:29.354 INFO:tasks.workunit.client.1.smithi167.stdout:7/563: creat d0/fbe x:0 0 0 2024-09-17T01:41:29.355 INFO:tasks.workunit.client.1.smithi167.stdout:3/580: mkdir d7/d8/d10/d14/d2c/d6f/db6 0 2024-09-17T01:41:29.356 INFO:tasks.workunit.client.0.smithi082.stdout:5/351: write db/d56/d18/f1d [2023934,126138] 0 2024-09-17T01:41:29.358 INFO:tasks.workunit.client.1.smithi167.stdout:5/494: symlink d0/d24/d2b/d49/d66/l94 0 2024-09-17T01:41:29.359 INFO:tasks.workunit.client.0.smithi082.stdout:5/352: dread - db/d56/d18/d23/f66 zero size 2024-09-17T01:41:29.359 INFO:tasks.workunit.client.1.smithi167.stdout:9/641: mknod d4/d9/d21/d2d/d33/d3a/d74/cc9 0 2024-09-17T01:41:29.360 INFO:tasks.workunit.client.0.smithi082.stdout:6/344: dwrite d1/d7/d10/d4f/dc/d2b/f53 [0,4194304] 0 2024-09-17T01:41:29.360 INFO:tasks.workunit.client.1.smithi167.stdout:0/503: getdents d5/d8/d9 0 2024-09-17T01:41:29.361 INFO:tasks.workunit.client.1.smithi167.stdout:4/604: symlink d0/d4/d7/da/d48/d40/d51/d2d/d74/lc5 0 2024-09-17T01:41:29.362 INFO:tasks.workunit.client.1.smithi167.stdout:2/547: creat d5/d10/d1a/d2e/fc2 x:0 0 0 2024-09-17T01:41:29.363 INFO:tasks.workunit.client.1.smithi167.stdout:2/548: stat d5/d10/d1a/db8/d5e 0 2024-09-17T01:41:29.364 INFO:tasks.workunit.client.1.smithi167.stdout:6/721: unlink d7/d54/d90/d13/d2f/d64/d6b/cdc 0 2024-09-17T01:41:29.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/353: chown db/d56/d18/d23/l71 439218179 1 2024-09-17T01:41:29.370 INFO:tasks.workunit.client.1.smithi167.stdout:8/648: write dc/d56/d59/d65/fb4 [254734,59297] 0 2024-09-17T01:41:29.372 INFO:tasks.workunit.client.1.smithi167.stdout:1/585: getdents d0/d5/d34/d3c 0 2024-09-17T01:41:29.377 INFO:tasks.workunit.client.1.smithi167.stdout:5/495: chown d0/c27 41 1 2024-09-17T01:41:29.377 INFO:tasks.workunit.client.1.smithi167.stdout:5/496: stat d0/d24/f38 0 2024-09-17T01:41:29.378 INFO:tasks.workunit.client.1.smithi167.stdout:3/581: write d7/d1e/f43 [3680190,11831] 0 2024-09-17T01:41:29.379 INFO:tasks.workunit.client.1.smithi167.stdout:4/605: mknod d0/d4/db4/cc6 0 2024-09-17T01:41:29.379 INFO:tasks.workunit.client.0.smithi082.stdout:5/354: write db/d56/f1c [3926059,5854] 0 2024-09-17T01:41:29.380 INFO:tasks.workunit.client.1.smithi167.stdout:2/549: symlink d5/d10/d1a/d45/d6b/lc3 0 2024-09-17T01:41:29.381 INFO:tasks.workunit.client.1.smithi167.stdout:7/564: mkdir d0/d2/d14/d19/d7f/db4/dbf 0 2024-09-17T01:41:29.382 INFO:tasks.workunit.client.0.smithi082.stdout:6/345: dwrite d1/d7/d10/d4f/f30 [0,4194304] 0 2024-09-17T01:41:29.382 INFO:tasks.workunit.client.1.smithi167.stdout:8/649: symlink dc/d56/d59/d82/d85/ld2 0 2024-09-17T01:41:29.383 INFO:tasks.workunit.client.1.smithi167.stdout:9/642: mkdir d4/d9/d21/d81/dbf/dca 0 2024-09-17T01:41:29.385 INFO:tasks.workunit.client.1.smithi167.stdout:5/497: truncate d0/d28/d3a/f7d 1720369 0 2024-09-17T01:41:29.387 INFO:tasks.workunit.client.1.smithi167.stdout:0/504: truncate d5/d6b/d77/d4d/d56/f59 58161 0 2024-09-17T01:41:29.388 INFO:tasks.workunit.client.1.smithi167.stdout:3/582: mknod d7/d8/d10/d14/d2c/d6f/cb7 0 2024-09-17T01:41:29.389 INFO:tasks.workunit.client.1.smithi167.stdout:6/722: mkdir d7/d54/d90/dfc/d105 0 2024-09-17T01:41:29.390 INFO:tasks.workunit.client.1.smithi167.stdout:4/606: dwrite d0/d4/d7/d6/d2b/d6d/d7e/f94 [0,4194304] 0 2024-09-17T01:41:29.390 INFO:tasks.workunit.client.1.smithi167.stdout:2/550: dwrite d5/f44 [0,4194304] 0 2024-09-17T01:41:29.391 INFO:tasks.workunit.client.0.smithi082.stdout:6/346: creat d1/f83 x:0 0 0 2024-09-17T01:41:29.392 INFO:tasks.workunit.client.1.smithi167.stdout:4/607: stat d0/d4/d7/d10/d70/la7 0 2024-09-17T01:41:29.395 INFO:tasks.workunit.client.1.smithi167.stdout:4/608: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 111 1 2024-09-17T01:41:29.396 INFO:tasks.workunit.client.1.smithi167.stdout:4/609: chown d0/d4/d7/da/d48/d40/d51/f3a 1455 1 2024-09-17T01:41:29.398 INFO:tasks.workunit.client.1.smithi167.stdout:5/498: read d0/d24/d2b/d4e/f70 [205892,46423] 0 2024-09-17T01:41:29.400 INFO:tasks.workunit.client.1.smithi167.stdout:6/723: readlink d7/d54/d90/d34/l9b 0 2024-09-17T01:41:29.401 INFO:tasks.workunit.client.1.smithi167.stdout:1/586: link d0/d5/d34/l21 d0/d9/d16/d36/d8f/lcb 0 2024-09-17T01:41:29.401 INFO:tasks.workunit.client.1.smithi167.stdout:7/565: read d0/d2/d14/d6f/d87/f93 [3203748,26332] 0 2024-09-17T01:41:29.401 INFO:tasks.workunit.client.1.smithi167.stdout:1/587: chown d0/d5/dbf 3342 1 2024-09-17T01:41:29.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/347: dwrite d1/d1f/f26 [0,4194304] 0 2024-09-17T01:41:29.402 INFO:tasks.workunit.client.1.smithi167.stdout:1/588: readlink d0/d5/d61/l79 0 2024-09-17T01:41:29.403 INFO:tasks.workunit.client.1.smithi167.stdout:7/566: write d0/d2/d14/d19/d22/f25 [475565,25028] 0 2024-09-17T01:41:29.403 INFO:tasks.workunit.client.1.smithi167.stdout:0/505: rename d5/d6b/d77/d4d/d56/d7b/f91 to d5/d6b/d77/d6d/d90/f9d 0 2024-09-17T01:41:29.404 INFO:tasks.workunit.client.1.smithi167.stdout:0/506: write d5/f84 [126229,66846] 0 2024-09-17T01:41:29.405 INFO:tasks.workunit.client.0.smithi082.stdout:6/348: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/f70 181746 0 2024-09-17T01:41:29.406 INFO:tasks.workunit.client.1.smithi167.stdout:8/650: mkdir dc/d56/d59/d82/d8f/d90/dba/dd3 0 2024-09-17T01:41:29.409 INFO:tasks.workunit.client.1.smithi167.stdout:9/643: symlink d4/d9/d21/d2d/d33/d3a/lcb 0 2024-09-17T01:41:29.413 INFO:tasks.workunit.client.1.smithi167.stdout:4/610: mkdir d0/d4/d7/d10/d70/dc7 0 2024-09-17T01:41:29.413 INFO:tasks.workunit.client.1.smithi167.stdout:5/499: mkdir d0/d9/d64/d95 0 2024-09-17T01:41:29.416 INFO:tasks.workunit.client.1.smithi167.stdout:6/724: symlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1/l106 0 2024-09-17T01:41:29.416 INFO:tasks.workunit.client.1.smithi167.stdout:0/507: dwrite d5/d6b/d77/d6d/f81 [0,4194304] 0 2024-09-17T01:41:29.417 INFO:tasks.workunit.client.0.smithi082.stdout:6/349: creat d1/d7/d10/f84 x:0 0 0 2024-09-17T01:41:29.419 INFO:tasks.workunit.client.1.smithi167.stdout:1/589: creat d0/d5/d34/d8a/fcc x:0 0 0 2024-09-17T01:41:29.420 INFO:tasks.workunit.client.1.smithi167.stdout:6/725: stat d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61 0 2024-09-17T01:41:29.422 INFO:tasks.workunit.client.1.smithi167.stdout:1/590: chown d0/d9/d16/d48/d54/d78/d90 25377 1 2024-09-17T01:41:29.422 INFO:tasks.workunit.client.1.smithi167.stdout:9/644: dwrite d4/d9/d21/d43/d6c/f99 [4194304,4194304] 0 2024-09-17T01:41:29.423 INFO:tasks.workunit.client.1.smithi167.stdout:3/583: link d7/d8/d10/d14/d25/ca6 d7/d8/d10/d14/d25/cb8 0 2024-09-17T01:41:29.423 INFO:tasks.workunit.client.1.smithi167.stdout:8/651: write dc/d21/d6b/d74/d83/dc0/dc7/fce [1426829,943] 0 2024-09-17T01:41:29.424 INFO:tasks.workunit.client.1.smithi167.stdout:5/500: truncate d0/d24/d2b/d4e/f70 590211 0 2024-09-17T01:41:29.426 INFO:tasks.workunit.client.1.smithi167.stdout:0/508: fdatasync d5/d6b/d77/d37/d45/f4b 0 2024-09-17T01:41:29.427 INFO:tasks.workunit.client.1.smithi167.stdout:5/501: write d0/d28/f52 [229438,104392] 0 2024-09-17T01:41:29.427 INFO:tasks.workunit.client.1.smithi167.stdout:9/645: unlink d4/d9/d21/d2d/d33/c8c 0 2024-09-17T01:41:29.428 INFO:tasks.workunit.client.1.smithi167.stdout:0/509: chown d5/d6b/d77/d4d/f2b 17 1 2024-09-17T01:41:29.429 INFO:tasks.workunit.client.1.smithi167.stdout:6/726: fdatasync d7/d54/d90/d13/d2f/d64/d6b/d95/db1/ffd 0 2024-09-17T01:41:29.429 INFO:tasks.workunit.client.1.smithi167.stdout:0/510: readlink d5/d8/d9/d2f/l51 0 2024-09-17T01:41:29.430 INFO:tasks.workunit.client.1.smithi167.stdout:0/511: chown d5/d6b/d77/d4d/f5a 1543558733 1 2024-09-17T01:41:29.433 INFO:tasks.workunit.client.1.smithi167.stdout:1/591: creat d0/d5/d34/d3c/d85/db5/fcd x:0 0 0 2024-09-17T01:41:29.435 INFO:tasks.workunit.client.1.smithi167.stdout:6/727: creat d7/d54/d90/d13/d2f/d30/d32/f107 x:0 0 0 2024-09-17T01:41:29.435 INFO:tasks.workunit.client.1.smithi167.stdout:7/567: link d0/d2/d14/d19/d32/d62/f64 d0/d2/d14/d19/d26/fc0 0 2024-09-17T01:41:29.435 INFO:tasks.workunit.client.1.smithi167.stdout:3/584: symlink d7/d8/d10/d14/d66/d6c/dab/lb9 0 2024-09-17T01:41:29.436 INFO:tasks.workunit.client.1.smithi167.stdout:8/652: symlink dc/d56/d57/ld4 0 2024-09-17T01:41:29.438 INFO:tasks.workunit.client.1.smithi167.stdout:9/646: dwrite d4/d9/d21/d43/d6c/d9e/fbd [0,4194304] 0 2024-09-17T01:41:29.441 INFO:tasks.workunit.client.1.smithi167.stdout:7/568: truncate d0/d2/d14/d4c/fa4 655700 0 2024-09-17T01:41:29.444 INFO:tasks.workunit.client.0.smithi082.stdout:6/350: dread d1/d7/d10/d4f/fb [0,4194304] 0 2024-09-17T01:41:29.444 INFO:tasks.workunit.client.0.smithi082.stdout:6/351: chown d1/la 46553484 1 2024-09-17T01:41:29.445 INFO:tasks.workunit.client.1.smithi167.stdout:7/569: fdatasync d0/d2/d14/d19/f3e 0 2024-09-17T01:41:29.448 INFO:tasks.workunit.client.1.smithi167.stdout:1/592: dwrite d0/f46 [4194304,4194304] 0 2024-09-17T01:41:29.450 INFO:tasks.workunit.client.1.smithi167.stdout:3/585: dwrite d7/d8/d10/d14/d25/f6b [0,4194304] 0 2024-09-17T01:41:29.454 INFO:tasks.workunit.client.1.smithi167.stdout:1/593: mknod d0/d5/d34/cce 0 2024-09-17T01:41:29.454 INFO:tasks.workunit.client.1.smithi167.stdout:9/647: dwrite d4/d9/d21/d2d/d33/d90/dac/f82 [0,4194304] 0 2024-09-17T01:41:29.455 INFO:tasks.workunit.client.0.smithi082.stdout:6/352: dread d1/d7/d10/d4f/dc/f29 [0,4194304] 0 2024-09-17T01:41:29.455 INFO:tasks.workunit.client.1.smithi167.stdout:9/648: stat d4/l88 0 2024-09-17T01:41:29.455 INFO:tasks.workunit.client.1.smithi167.stdout:6/728: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fde [4194304,4194304] 0 2024-09-17T01:41:29.456 INFO:tasks.workunit.client.0.smithi082.stdout:6/353: fsync d1/f5d 0 2024-09-17T01:41:29.456 INFO:tasks.workunit.client.1.smithi167.stdout:3/586: chown d7/d8/d2a/d4e/f59 2433445 1 2024-09-17T01:41:29.457 INFO:tasks.workunit.client.0.smithi082.stdout:6/354: stat d1/d7/d10/f33 0 2024-09-17T01:41:29.461 INFO:tasks.workunit.client.1.smithi167.stdout:7/570: dwrite d0/d2/d14/d4c/f9b [4194304,4194304] 0 2024-09-17T01:41:29.462 INFO:tasks.workunit.client.1.smithi167.stdout:7/571: fdatasync d0/d2/d14/f72 0 2024-09-17T01:41:29.463 INFO:tasks.workunit.client.1.smithi167.stdout:7/572: dread - d0/d2/d14/f8a zero size 2024-09-17T01:41:29.465 INFO:tasks.workunit.client.0.smithi082.stdout:6/355: creat d1/d7/f85 x:0 0 0 2024-09-17T01:41:29.466 INFO:tasks.workunit.client.0.smithi082.stdout:6/356: chown d1/d7/d10/l22 0 1 2024-09-17T01:41:29.467 INFO:tasks.workunit.client.1.smithi167.stdout:6/729: dread d7/d42/f71 [0,4194304] 0 2024-09-17T01:41:29.467 INFO:tasks.workunit.client.0.smithi082.stdout:6/357: stat d1/d1f/f26 0 2024-09-17T01:41:29.469 INFO:tasks.workunit.client.0.smithi082.stdout:6/358: stat d1/d7/d10/d4f/dc/d1d/d36 0 2024-09-17T01:41:29.469 INFO:tasks.workunit.client.1.smithi167.stdout:3/587: symlink d7/d8/d10/d29/d75/lba 0 2024-09-17T01:41:29.470 INFO:tasks.workunit.client.0.smithi082.stdout:6/359: chown d1/l7e 9506 1 2024-09-17T01:41:29.471 INFO:tasks.workunit.client.0.smithi082.stdout:6/360: readlink d1/d7/d10/d4f/dc/d1d/d2c/l45 0 2024-09-17T01:41:29.475 INFO:tasks.workunit.client.1.smithi167.stdout:7/573: creat d0/d2/d14/d19/d7f/db4/dbf/fc1 x:0 0 0 2024-09-17T01:41:29.477 INFO:tasks.workunit.client.1.smithi167.stdout:6/730: read d7/fa [3125677,5264] 0 2024-09-17T01:41:29.478 INFO:tasks.workunit.client.1.smithi167.stdout:3/588: unlink d7/d1e/f80 0 2024-09-17T01:41:29.480 INFO:tasks.workunit.client.1.smithi167.stdout:6/731: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 [0,4194304] 0 2024-09-17T01:41:29.480 INFO:tasks.workunit.client.1.smithi167.stdout:2/551: truncate d5/d10/d1a/d46/f4f 3322800 0 2024-09-17T01:41:29.482 INFO:tasks.workunit.client.0.smithi082.stdout:6/361: rename d1/d1f/f26 to d1/d7/f86 0 2024-09-17T01:41:29.484 INFO:tasks.workunit.client.1.smithi167.stdout:7/574: rename d0/d2/d14/l68 to d0/d2/d14/d19/d7f/lc2 0 2024-09-17T01:41:29.486 INFO:tasks.workunit.client.1.smithi167.stdout:3/589: mkdir d7/d8/d10/d14/d2c/d74/dbb 0 2024-09-17T01:41:29.487 INFO:tasks.workunit.client.1.smithi167.stdout:3/590: stat d7/d8/d2a/l27 0 2024-09-17T01:41:29.488 INFO:tasks.workunit.client.1.smithi167.stdout:2/552: unlink d5/f2f 0 2024-09-17T01:41:29.488 INFO:tasks.workunit.client.0.smithi082.stdout:6/362: mkdir d1/d7/d10/d4f/dc/d1d/d36/d7a/d87 0 2024-09-17T01:41:29.489 INFO:tasks.workunit.client.1.smithi167.stdout:3/591: write d7/d8/f78 [80169,74926] 0 2024-09-17T01:41:29.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/363: chown d1/d7/d10/d4f/dc/d2b/c6e 860 1 2024-09-17T01:41:29.491 INFO:tasks.workunit.client.0.smithi082.stdout:6/364: chown d1/l7e 40052 1 2024-09-17T01:41:29.491 INFO:tasks.workunit.client.1.smithi167.stdout:9/649: getdents d4/d9/d21/d2d/d33 0 2024-09-17T01:41:29.492 INFO:tasks.workunit.client.1.smithi167.stdout:4/611: dwrite d0/d4/d7/da/d48/d40/d51/d2d/f61 [0,4194304] 0 2024-09-17T01:41:29.493 INFO:tasks.workunit.client.0.smithi082.stdout:6/365: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/f7d 147442 0 2024-09-17T01:41:29.494 INFO:tasks.workunit.client.0.smithi082.stdout:6/366: write d1/f83 [1012999,83044] 0 2024-09-17T01:41:29.496 INFO:tasks.workunit.client.0.smithi082.stdout:6/367: fdatasync d1/d7/d10/f5e 0 2024-09-17T01:41:29.498 INFO:tasks.workunit.client.1.smithi167.stdout:3/592: creat d7/d8/d2a/d7a/fbc x:0 0 0 2024-09-17T01:41:29.500 INFO:tasks.workunit.client.1.smithi167.stdout:3/593: read - d7/d8/d10/d29/f98 zero size 2024-09-17T01:41:29.501 INFO:tasks.workunit.client.1.smithi167.stdout:7/575: mknod d0/d2/d14/d19/d22/cc3 0 2024-09-17T01:41:29.501 INFO:tasks.workunit.client.1.smithi167.stdout:9/650: dwrite d4/d9/d21/d2d/d33/d3a/f98 [0,4194304] 0 2024-09-17T01:41:29.503 INFO:tasks.workunit.client.1.smithi167.stdout:0/512: truncate d5/d6b/f5d 3753024 0 2024-09-17T01:41:29.504 INFO:tasks.workunit.client.1.smithi167.stdout:9/651: truncate d4/d9/d21/f3b 4442072 0 2024-09-17T01:41:29.504 INFO:tasks.workunit.client.1.smithi167.stdout:1/594: dread d0/d9/d16/d36/f53 [0,4194304] 0 2024-09-17T01:41:29.505 INFO:tasks.workunit.client.1.smithi167.stdout:2/553: chown d5/d10/d1a/d46/f4f 190055273 1 2024-09-17T01:41:29.505 INFO:tasks.workunit.client.0.smithi082.stdout:6/368: link d1/d7/d10/d4f/dc/d2b/d48/f2a d1/d7/d10/d4f/dc/f88 0 2024-09-17T01:41:29.507 INFO:tasks.workunit.client.1.smithi167.stdout:8/653: truncate dc/d1a/f7d 306564 0 2024-09-17T01:41:29.508 INFO:tasks.workunit.client.1.smithi167.stdout:3/594: creat d7/d8/d10/d14/d25/fbd x:0 0 0 2024-09-17T01:41:29.509 INFO:tasks.workunit.client.1.smithi167.stdout:0/513: read d5/d8/d9/d2f/f3b [280181,17524] 0 2024-09-17T01:41:29.510 INFO:tasks.workunit.client.0.smithi082.stdout:6/369: rmdir d1/d7/d10/d4f/dc/d2b/d48 39 2024-09-17T01:41:29.511 INFO:tasks.workunit.client.0.smithi082.stdout:6/370: dread - d1/d7/d10/f84 zero size 2024-09-17T01:41:29.512 INFO:tasks.workunit.client.0.smithi082.stdout:6/371: stat d1/d7/d10/d4f/dc/f29 0 2024-09-17T01:41:29.513 INFO:tasks.workunit.client.1.smithi167.stdout:2/554: unlink d5/d33/f89 0 2024-09-17T01:41:29.514 INFO:tasks.workunit.client.1.smithi167.stdout:1/595: symlink d0/d5/d34/d6d/lcf 0 2024-09-17T01:41:29.515 INFO:tasks.workunit.client.1.smithi167.stdout:1/596: fsync d0/d5/d61/f7f 0 2024-09-17T01:41:29.516 INFO:tasks.workunit.client.1.smithi167.stdout:1/597: write d0/d5/d34/d3c/f41 [1969066,83587] 0 2024-09-17T01:41:29.516 INFO:tasks.workunit.client.1.smithi167.stdout:8/654: rename dc/d56/l66 to dc/d21/ld5 0 2024-09-17T01:41:29.517 INFO:tasks.workunit.client.1.smithi167.stdout:3/595: symlink d7/d8f/lbe 0 2024-09-17T01:41:29.518 INFO:tasks.workunit.client.1.smithi167.stdout:3/596: chown d7/d8/d2a/d4e/f67 345457 1 2024-09-17T01:41:29.519 INFO:tasks.workunit.client.1.smithi167.stdout:0/514: stat d5/d6b/d77/d4d/d56/f59 0 2024-09-17T01:41:29.520 INFO:tasks.workunit.client.1.smithi167.stdout:0/515: read - d5/d6b/d77/d6d/d90/f9d zero size 2024-09-17T01:41:29.521 INFO:tasks.workunit.client.1.smithi167.stdout:9/652: creat d4/d9/d21/d81/db9/fcc x:0 0 0 2024-09-17T01:41:29.521 INFO:tasks.workunit.client.1.smithi167.stdout:9/653: stat d4/d9/d21/d2d/d33/d90/dac 0 2024-09-17T01:41:29.528 INFO:tasks.workunit.client.1.smithi167.stdout:7/576: link d0/d2/d14/d19/d26/c36 d0/d2/d14/d6f/d8b/cc4 0 2024-09-17T01:41:29.530 INFO:tasks.workunit.client.1.smithi167.stdout:3/597: unlink d7/d8/d2a/d7a/fbc 0 2024-09-17T01:41:29.531 INFO:tasks.workunit.client.1.smithi167.stdout:0/516: chown d5/d8/l14 2483374 1 2024-09-17T01:41:29.534 INFO:tasks.workunit.client.1.smithi167.stdout:9/654: mknod d4/d9/d21/d2d/d33/d90/dac/ccd 0 2024-09-17T01:41:29.535 INFO:tasks.workunit.client.1.smithi167.stdout:8/655: creat dc/d56/d57/dc2/fd6 x:0 0 0 2024-09-17T01:41:29.537 INFO:tasks.workunit.client.1.smithi167.stdout:7/577: truncate d0/d2/f66 923282 0 2024-09-17T01:41:29.537 INFO:tasks.workunit.client.1.smithi167.stdout:0/517: creat d5/d6b/d77/d4d/f9e x:0 0 0 2024-09-17T01:41:29.540 INFO:tasks.workunit.client.1.smithi167.stdout:6/732: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [0,4194304] 0 2024-09-17T01:41:29.541 INFO:tasks.workunit.client.1.smithi167.stdout:6/733: chown d7/d54/d90/cb0 92438534 1 2024-09-17T01:41:29.541 INFO:tasks.workunit.client.1.smithi167.stdout:3/598: mknod d7/d8/d10/cbf 0 2024-09-17T01:41:29.542 INFO:tasks.workunit.client.1.smithi167.stdout:6/734: fsync d7/d54/d90/d13/f2d 0 2024-09-17T01:41:29.543 INFO:tasks.workunit.client.1.smithi167.stdout:2/555: getdents d5/d3c 0 2024-09-17T01:41:29.547 INFO:tasks.workunit.client.1.smithi167.stdout:0/518: fdatasync d5/d6b/d77/d4d/f5a 0 2024-09-17T01:41:29.550 INFO:tasks.workunit.client.1.smithi167.stdout:8/656: unlink dc/d56/d57/l67 0 2024-09-17T01:41:29.557 INFO:tasks.workunit.client.1.smithi167.stdout:0/519: rmdir d5/d6b 39 2024-09-17T01:41:29.557 INFO:tasks.workunit.client.1.smithi167.stdout:0/520: read d5/d8/d9/f39 [1797422,96769] 0 2024-09-17T01:41:29.558 INFO:tasks.workunit.client.1.smithi167.stdout:8/657: unlink dc/d18/l20 0 2024-09-17T01:41:29.559 INFO:tasks.workunit.client.1.smithi167.stdout:5/502: sync 2024-09-17T01:41:29.560 INFO:tasks.workunit.client.1.smithi167.stdout:1/598: write d0/d5/d34/f49 [3884320,65456] 0 2024-09-17T01:41:29.561 INFO:tasks.workunit.client.1.smithi167.stdout:1/599: write d0/d5/d34/d3c/d74/fca [255475,127779] 0 2024-09-17T01:41:29.561 INFO:tasks.workunit.client.1.smithi167.stdout:0/521: fdatasync d5/d6b/d7e/f86 0 2024-09-17T01:41:29.562 INFO:tasks.workunit.client.1.smithi167.stdout:8/658: creat dc/d56/d57/d7e/dad/fd7 x:0 0 0 2024-09-17T01:41:29.568 INFO:tasks.workunit.client.1.smithi167.stdout:8/659: creat dc/d56/d57/d7e/fd8 x:0 0 0 2024-09-17T01:41:29.568 INFO:tasks.workunit.client.1.smithi167.stdout:1/600: dwrite d0/d9/d16/d22/f84 [0,4194304] 0 2024-09-17T01:41:29.569 INFO:tasks.workunit.client.1.smithi167.stdout:5/503: mknod d0/d28/c96 0 2024-09-17T01:41:29.573 INFO:tasks.workunit.client.1.smithi167.stdout:1/601: fdatasync d0/d5/d34/f70 0 2024-09-17T01:41:29.575 INFO:tasks.workunit.client.1.smithi167.stdout:1/602: write d0/d5/d34/d6d/fa6 [330947,30404] 0 2024-09-17T01:41:29.577 INFO:tasks.workunit.client.1.smithi167.stdout:2/556: write d5/d10/d1a/d45/d3f/f74 [414049,63715] 0 2024-09-17T01:41:29.577 INFO:tasks.workunit.client.1.smithi167.stdout:9/655: dwrite d4/d9/d21/d2d/d33/d80/fc7 [0,4194304] 0 2024-09-17T01:41:29.578 INFO:tasks.workunit.client.0.smithi082.stdout:7/286: sync 2024-09-17T01:41:29.579 INFO:tasks.workunit.client.1.smithi167.stdout:5/504: symlink d0/d9/d64/d95/l97 0 2024-09-17T01:41:29.582 INFO:tasks.workunit.client.1.smithi167.stdout:0/522: getdents d5/d6b/d77 0 2024-09-17T01:41:29.584 INFO:tasks.workunit.client.0.smithi082.stdout:7/287: symlink d0/d3/db/d10/l59 0 2024-09-17T01:41:29.584 INFO:tasks.workunit.client.1.smithi167.stdout:6/735: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 [0,4194304] 0 2024-09-17T01:41:29.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/288: chown d0/c39 1135334 1 2024-09-17T01:41:29.586 INFO:tasks.workunit.client.1.smithi167.stdout:1/603: write d0/f2e [3656913,124063] 0 2024-09-17T01:41:29.588 INFO:tasks.workunit.client.1.smithi167.stdout:3/599: dwrite d7/d8/d10/d14/d2c/f81 [4194304,4194304] 0 2024-09-17T01:41:29.592 INFO:tasks.workunit.client.1.smithi167.stdout:5/505: creat d0/d24/d2b/d3d/d3b/f98 x:0 0 0 2024-09-17T01:41:29.593 INFO:tasks.workunit.client.1.smithi167.stdout:0/523: fsync d5/d6b/d77/d6d/d90/f9d 0 2024-09-17T01:41:29.593 INFO:tasks.workunit.client.1.smithi167.stdout:5/506: chown d0/d54/d56/l5d 1034730 1 2024-09-17T01:41:29.594 INFO:tasks.workunit.client.1.smithi167.stdout:5/507: write d0/f1d [5239391,76536] 0 2024-09-17T01:41:29.595 INFO:tasks.workunit.client.1.smithi167.stdout:0/524: chown d5/d6b/d77/d37/c4f 71583 1 2024-09-17T01:41:29.596 INFO:tasks.workunit.client.1.smithi167.stdout:9/656: fdatasync d4/d9/d21/d2d/d33/d80/fc7 0 2024-09-17T01:41:29.596 INFO:tasks.workunit.client.0.smithi082.stdout:7/289: dwrite d0/d3/f35 [0,4194304] 0 2024-09-17T01:41:29.596 INFO:tasks.workunit.client.1.smithi167.stdout:5/508: read d0/d9/f7a [4685,92623] 0 2024-09-17T01:41:29.598 INFO:tasks.workunit.client.1.smithi167.stdout:1/604: creat d0/d5/d61/fd0 x:0 0 0 2024-09-17T01:41:29.598 INFO:tasks.workunit.client.1.smithi167.stdout:1/605: stat d0/d5/l62 0 2024-09-17T01:41:29.599 INFO:tasks.workunit.client.1.smithi167.stdout:1/606: chown d0/d5/d34/d3c/d85/db5 635884152 1 2024-09-17T01:41:29.600 INFO:tasks.workunit.client.1.smithi167.stdout:6/736: mknod d7/d54/d90/d13/d2f/d30/c108 0 2024-09-17T01:41:29.607 INFO:tasks.workunit.client.1.smithi167.stdout:8/660: write dc/d1a/f7d [1176368,72769] 0 2024-09-17T01:41:29.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/290: creat d0/dd/d2c/d54/f5a x:0 0 0 2024-09-17T01:41:29.608 INFO:tasks.workunit.client.1.smithi167.stdout:5/509: readlink d0/d28/d3a/l86 0 2024-09-17T01:41:29.608 INFO:tasks.workunit.client.1.smithi167.stdout:6/737: dwrite d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:29.609 INFO:tasks.workunit.client.1.smithi167.stdout:0/525: rename d5/d8/d9/d2f/l8f to d5/d6b/l9f 0 2024-09-17T01:41:29.610 INFO:tasks.workunit.client.1.smithi167.stdout:1/607: rmdir d0/d5/d34/d3c/d74 39 2024-09-17T01:41:29.612 INFO:tasks.workunit.client.1.smithi167.stdout:3/600: mknod d7/cc0 0 2024-09-17T01:41:29.613 INFO:tasks.workunit.client.1.smithi167.stdout:2/557: link d5/d71/cbe d5/d10/d1a/d45/d8e/d98/cc4 0 2024-09-17T01:41:29.616 INFO:tasks.workunit.client.1.smithi167.stdout:8/661: dread - dc/d56/d57/d7e/f91 zero size 2024-09-17T01:41:29.616 INFO:tasks.workunit.client.1.smithi167.stdout:9/657: mknod d4/d9/cce 0 2024-09-17T01:41:29.616 INFO:tasks.workunit.client.1.smithi167.stdout:3/601: fdatasync d7/d8/d2a/d4e/f94 0 2024-09-17T01:41:29.617 INFO:tasks.workunit.client.1.smithi167.stdout:6/738: mkdir d7/d52/d79/d109 0 2024-09-17T01:41:29.617 INFO:tasks.workunit.client.1.smithi167.stdout:5/510: mkdir d0/d24/d93/d99 0 2024-09-17T01:41:29.618 INFO:tasks.workunit.client.1.smithi167.stdout:2/558: write d5/d10/d1a/db8/d5e/fc0 [668944,65322] 0 2024-09-17T01:41:29.620 INFO:tasks.workunit.client.1.smithi167.stdout:0/526: dwrite d5/d6b/d77/d6d/f81 [0,4194304] 0 2024-09-17T01:41:29.622 INFO:tasks.workunit.client.1.smithi167.stdout:8/662: creat dc/dae/fd9 x:0 0 0 2024-09-17T01:41:29.622 INFO:tasks.workunit.client.1.smithi167.stdout:9/658: write d4/d9/d21/d2d/d33/d90/fb7 [722340,104399] 0 2024-09-17T01:41:29.623 INFO:tasks.workunit.client.1.smithi167.stdout:6/739: dread - d7/d54/d90/d13/d2f/d64/d6b/ffe zero size 2024-09-17T01:41:29.625 INFO:tasks.workunit.client.1.smithi167.stdout:5/511: dread - d0/d28/d3a/d44/d69/f85 zero size 2024-09-17T01:41:29.626 INFO:tasks.workunit.client.1.smithi167.stdout:2/559: chown d5/d33/d48/d72/d94/fb7 11710119 1 2024-09-17T01:41:29.627 INFO:tasks.workunit.client.1.smithi167.stdout:8/663: write dc/d21/f44 [3102070,26116] 0 2024-09-17T01:41:29.628 INFO:tasks.workunit.client.1.smithi167.stdout:0/527: stat d5/d6b/d77/d4d/d56/d7b/f89 0 2024-09-17T01:41:29.628 INFO:tasks.workunit.client.1.smithi167.stdout:9/659: stat d4/d9/d21/d2d/d33/d90/dac/f82 0 2024-09-17T01:41:29.630 INFO:tasks.workunit.client.1.smithi167.stdout:8/664: stat dc/fc4 0 2024-09-17T01:41:29.630 INFO:tasks.workunit.client.1.smithi167.stdout:1/608: dwrite d0/d9/d16/d36/f53 [0,4194304] 0 2024-09-17T01:41:29.632 INFO:tasks.workunit.client.0.smithi082.stdout:7/291: fsync d0/d3/f35 0 2024-09-17T01:41:29.633 INFO:tasks.workunit.client.1.smithi167.stdout:1/609: chown d0/d5/d34/d83 20566693 1 2024-09-17T01:41:29.633 INFO:tasks.workunit.client.0.smithi082.stdout:7/292: write d0/fa [3677586,127917] 0 2024-09-17T01:41:29.634 INFO:tasks.workunit.client.1.smithi167.stdout:4/612: sync 2024-09-17T01:41:29.634 INFO:tasks.workunit.client.0.smithi082.stdout:7/293: write d0/dd/f3d [289373,119252] 0 2024-09-17T01:41:29.636 INFO:tasks.workunit.client.1.smithi167.stdout:1/610: write d0/d9/d16/d36/f53 [5190463,31266] 0 2024-09-17T01:41:29.640 INFO:tasks.workunit.client.1.smithi167.stdout:5/512: truncate d0/f13 666302 0 2024-09-17T01:41:29.640 INFO:tasks.workunit.client.1.smithi167.stdout:9/660: dread d4/d9/f25 [0,4194304] 0 2024-09-17T01:41:29.643 INFO:tasks.workunit.client.1.smithi167.stdout:4/613: creat d0/d4/d7/da/d48/fc8 x:0 0 0 2024-09-17T01:41:29.643 INFO:tasks.workunit.client.0.smithi082.stdout:7/294: link d0/d3/db/d10/l59 d0/dd/d2c/d55/l5b 0 2024-09-17T01:41:29.644 INFO:tasks.workunit.client.1.smithi167.stdout:2/560: dwrite d5/d33/d48/d72/d94/faf [0,4194304] 0 2024-09-17T01:41:29.646 INFO:tasks.workunit.client.1.smithi167.stdout:9/661: write d4/d4a/fb3 [328795,4500] 0 2024-09-17T01:41:29.646 INFO:tasks.workunit.client.1.smithi167.stdout:6/740: link d7/d54/d90/d13/fd3 d7/d54/d90/d13/d2f/d64/d6b/d95/f10a 0 2024-09-17T01:41:29.650 INFO:tasks.workunit.client.1.smithi167.stdout:8/665: getdents dc/d56/d59/d82 0 2024-09-17T01:41:29.651 INFO:tasks.workunit.client.1.smithi167.stdout:2/561: fdatasync d5/d10/d1a/d45/d3f/f74 0 2024-09-17T01:41:29.654 INFO:tasks.workunit.client.1.smithi167.stdout:4/614: mknod d0/d4/d7/d6/d2b/d6d/d7e/da8/cc9 0 2024-09-17T01:41:29.659 INFO:tasks.workunit.client.1.smithi167.stdout:8/666: fdatasync dc/d56/d59/d65/f69 0 2024-09-17T01:41:29.663 INFO:tasks.workunit.client.1.smithi167.stdout:9/662: write d4/d9/d21/fc8 [5097716,86369] 0 2024-09-17T01:41:29.665 INFO:tasks.workunit.client.1.smithi167.stdout:8/667: chown dc/d56/d57 1 1 2024-09-17T01:41:29.665 INFO:tasks.workunit.client.1.smithi167.stdout:1/611: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:29.665 INFO:tasks.workunit.client.1.smithi167.stdout:5/513: dwrite d0/d9/f8c [0,4194304] 0 2024-09-17T01:41:29.667 INFO:tasks.workunit.client.1.smithi167.stdout:3/602: dread d7/d8/d10/d14/d2c/f2d [0,4194304] 0 2024-09-17T01:41:29.673 INFO:tasks.workunit.client.1.smithi167.stdout:4/615: rmdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f 39 2024-09-17T01:41:29.677 INFO:tasks.workunit.client.1.smithi167.stdout:0/528: dread d5/d6b/d77/d37/d45/f4b [0,4194304] 0 2024-09-17T01:41:29.678 INFO:tasks.workunit.client.1.smithi167.stdout:9/663: write d4/da4/fbe [91108,10071] 0 2024-09-17T01:41:29.678 INFO:tasks.workunit.client.1.smithi167.stdout:5/514: write d0/d28/f5b [2543285,62708] 0 2024-09-17T01:41:29.680 INFO:tasks.workunit.client.0.smithi082.stdout:7/295: dread d0/dd/f16 [0,4194304] 0 2024-09-17T01:41:29.682 INFO:tasks.workunit.client.1.smithi167.stdout:6/741: dwrite d7/d42/f71 [0,4194304] 0 2024-09-17T01:41:29.682 INFO:tasks.workunit.client.1.smithi167.stdout:2/562: dwrite d5/d3c/f40 [0,4194304] 0 2024-09-17T01:41:29.683 INFO:tasks.workunit.client.1.smithi167.stdout:1/612: fdatasync d0/d9/d16/d22/f4d 0 2024-09-17T01:41:29.685 INFO:tasks.workunit.client.1.smithi167.stdout:3/603: truncate d7/faf 719976 0 2024-09-17T01:41:29.687 INFO:tasks.workunit.client.0.smithi082.stdout:7/296: dwrite d0/d3/db/f2e [0,4194304] 0 2024-09-17T01:41:29.690 INFO:tasks.workunit.client.1.smithi167.stdout:1/613: readlink d0/d9/d16/d22/l5e 0 2024-09-17T01:41:29.692 INFO:tasks.workunit.client.1.smithi167.stdout:4/616: mknod d0/d4/d7/da/d48/d40/cca 0 2024-09-17T01:41:29.692 INFO:tasks.workunit.client.1.smithi167.stdout:0/529: unlink d5/d8/d9/d2f/f72 0 2024-09-17T01:41:29.694 INFO:tasks.workunit.client.1.smithi167.stdout:8/668: dwrite dc/d56/d57/d7e/dad/fcb [0,4194304] 0 2024-09-17T01:41:29.694 INFO:tasks.workunit.client.1.smithi167.stdout:7/578: sync 2024-09-17T01:41:29.695 INFO:tasks.workunit.client.1.smithi167.stdout:1/614: fdatasync d0/d9/d16/d22/fbb 0 2024-09-17T01:41:29.695 INFO:tasks.workunit.client.1.smithi167.stdout:2/563: mknod d5/cc5 0 2024-09-17T01:41:29.699 INFO:tasks.workunit.client.1.smithi167.stdout:8/669: dread - dc/d56/d59/d82/f9f zero size 2024-09-17T01:41:29.699 INFO:tasks.workunit.client.1.smithi167.stdout:1/615: write d0/d9/d16/d48/fb0 [51713,63027] 0 2024-09-17T01:41:29.701 INFO:tasks.workunit.client.1.smithi167.stdout:8/670: write dc/f29 [1458694,96185] 0 2024-09-17T01:41:29.730 INFO:tasks.workunit.client.1.smithi167.stdout:1/616: dread d0/d5/d34/f63 [0,4194304] 0 2024-09-17T01:41:29.734 INFO:tasks.workunit.client.1.smithi167.stdout:6/742: symlink d7/d54/d90/l10b 0 2024-09-17T01:41:29.735 INFO:tasks.workunit.client.1.smithi167.stdout:7/579: unlink d0/d2/fb6 0 2024-09-17T01:41:29.737 INFO:tasks.workunit.client.1.smithi167.stdout:6/743: chown d7/d54/d90/d13/d2f/d30/d88/da2 18041112 1 2024-09-17T01:41:29.739 INFO:tasks.workunit.client.1.smithi167.stdout:3/604: dwrite d7/d8/d2a/d4e/f59 [0,4194304] 0 2024-09-17T01:41:29.739 INFO:tasks.workunit.client.1.smithi167.stdout:5/515: dwrite d0/d9/f34 [0,4194304] 0 2024-09-17T01:41:29.740 INFO:tasks.workunit.client.1.smithi167.stdout:6/744: fsync d7/d54/d90/d13/f65 0 2024-09-17T01:41:29.742 INFO:tasks.workunit.client.1.smithi167.stdout:5/516: chown d0/d9/d64/d95 4 1 2024-09-17T01:41:29.744 INFO:tasks.workunit.client.1.smithi167.stdout:5/517: fdatasync d0/d28/f2a 0 2024-09-17T01:41:29.746 INFO:tasks.workunit.client.1.smithi167.stdout:5/518: write d0/d24/d2b/f39 [2425933,36042] 0 2024-09-17T01:41:29.748 INFO:tasks.workunit.client.1.smithi167.stdout:6/745: dread d7/d54/d90/d34/dc8/fee [0,4194304] 0 2024-09-17T01:41:29.749 INFO:tasks.workunit.client.1.smithi167.stdout:7/580: dwrite d0/d2/d14/d19/d22/d40/fb8 [0,4194304] 0 2024-09-17T01:41:29.794 INFO:tasks.workunit.client.1.smithi167.stdout:0/530: symlink d5/d6b/d7e/la0 0 2024-09-17T01:41:29.795 INFO:tasks.workunit.client.1.smithi167.stdout:4/617: rename d0/d4/d7/da/d48/d40 to d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb 0 2024-09-17T01:41:29.798 INFO:tasks.workunit.client.1.smithi167.stdout:8/671: creat dc/d56/d59/fda x:0 0 0 2024-09-17T01:41:29.799 INFO:tasks.workunit.client.1.smithi167.stdout:1/617: creat d0/d9/d16/d48/d54/d6f/fd1 x:0 0 0 2024-09-17T01:41:29.800 INFO:tasks.workunit.client.1.smithi167.stdout:9/664: creat d4/d9/d21/d2d/d33/d80/fcf x:0 0 0 2024-09-17T01:41:29.801 INFO:tasks.workunit.client.1.smithi167.stdout:9/665: chown d4/d9/d21/d43/d6c/f8f 15069 1 2024-09-17T01:41:29.803 INFO:tasks.workunit.client.1.smithi167.stdout:9/666: write d4/d9/d21/d2d/d33/d3a/d74/f89 [223090,81611] 0 2024-09-17T01:41:29.805 INFO:tasks.workunit.client.1.smithi167.stdout:9/667: fsync d4/d9/d21/d2d/d33/d3a/f3f 0 2024-09-17T01:41:29.806 INFO:tasks.workunit.client.1.smithi167.stdout:2/564: dwrite d5/d10/d1a/d45/d3f/f4a [0,4194304] 0 2024-09-17T01:41:29.807 INFO:tasks.workunit.client.1.smithi167.stdout:5/519: symlink d0/d9/d1c/l9a 0 2024-09-17T01:41:29.808 INFO:tasks.workunit.client.1.smithi167.stdout:7/581: symlink d0/d2/d14/d6f/d87/lc5 0 2024-09-17T01:41:29.810 INFO:tasks.workunit.client.1.smithi167.stdout:0/531: creat d5/d6b/d77/d37/d45/fa1 x:0 0 0 2024-09-17T01:41:29.813 INFO:tasks.workunit.client.1.smithi167.stdout:1/618: creat d0/d9/d16/d48/d54/d6e/fd2 x:0 0 0 2024-09-17T01:41:29.813 INFO:tasks.workunit.client.1.smithi167.stdout:2/565: dwrite d5/d71/fae [0,4194304] 0 2024-09-17T01:41:29.815 INFO:tasks.workunit.client.1.smithi167.stdout:1/619: read d0/d9/d16/d48/f65 [2987515,3772] 0 2024-09-17T01:41:29.816 INFO:tasks.workunit.client.1.smithi167.stdout:4/618: write d0/d4/d7/d6/d2b/d6d/fc2 [2541922,90961] 0 2024-09-17T01:41:29.824 INFO:tasks.workunit.client.1.smithi167.stdout:3/605: getdents d7/d8/d10 0 2024-09-17T01:41:29.825 INFO:tasks.workunit.client.1.smithi167.stdout:2/566: creat d5/d3c/d4c/d4d/d91/fc6 x:0 0 0 2024-09-17T01:41:29.826 INFO:tasks.workunit.client.1.smithi167.stdout:1/620: creat d0/d9/d16/d36/daf/fd3 x:0 0 0 2024-09-17T01:41:29.826 INFO:tasks.workunit.client.1.smithi167.stdout:6/746: getdents d7/d54/d90/dfc 0 2024-09-17T01:41:29.826 INFO:tasks.workunit.client.1.smithi167.stdout:2/567: chown d5/d10/d1a/d45/d8e 0 1 2024-09-17T01:41:29.827 INFO:tasks.workunit.client.1.smithi167.stdout:1/621: readlink d0/d5/d61/laa 0 2024-09-17T01:41:29.827 INFO:tasks.workunit.client.1.smithi167.stdout:8/672: link dc/c3f dc/d21/d6b/d74/d83/dc0/dc7/cdb 0 2024-09-17T01:41:29.828 INFO:tasks.workunit.client.1.smithi167.stdout:2/568: truncate d5/d71/fae 5157135 0 2024-09-17T01:41:29.829 INFO:tasks.workunit.client.1.smithi167.stdout:8/673: chown dc/d56/d57/d7e/f91 79565 1 2024-09-17T01:41:29.829 INFO:tasks.workunit.client.1.smithi167.stdout:5/520: getdents d0/d24 0 2024-09-17T01:41:29.830 INFO:tasks.workunit.client.1.smithi167.stdout:7/582: getdents d0/d2/d14/d19/d7f/db4 0 2024-09-17T01:41:29.830 INFO:tasks.workunit.client.1.smithi167.stdout:1/622: read d0/f17 [175369,114480] 0 2024-09-17T01:41:29.831 INFO:tasks.workunit.client.1.smithi167.stdout:0/532: getdents d5/d6b/d77/d4d/d56 0 2024-09-17T01:41:29.831 INFO:tasks.workunit.client.1.smithi167.stdout:2/569: mkdir d5/d71/dc7 0 2024-09-17T01:41:29.832 INFO:tasks.workunit.client.1.smithi167.stdout:8/674: write dc/d56/d59/d82/f95 [4806605,59683] 0 2024-09-17T01:41:29.833 INFO:tasks.workunit.client.1.smithi167.stdout:7/583: write d0/d2/f41 [1579844,50790] 0 2024-09-17T01:41:29.833 INFO:tasks.workunit.client.1.smithi167.stdout:1/623: chown d0/d5/d34/f5f 56001 1 2024-09-17T01:41:29.834 INFO:tasks.workunit.client.1.smithi167.stdout:2/570: chown d5/d10/d16/c3d 138037 1 2024-09-17T01:41:29.835 INFO:tasks.workunit.client.1.smithi167.stdout:6/747: dwrite d7/d52/db7/fe0 [0,4194304] 0 2024-09-17T01:41:29.836 INFO:tasks.workunit.client.1.smithi167.stdout:5/521: mknod d0/d24/d2b/d3d/d3b/d92/c9b 0 2024-09-17T01:41:29.838 INFO:tasks.workunit.client.1.smithi167.stdout:0/533: rename d5/d8/c43 to d5/d6b/d77/d4d/ca2 0 2024-09-17T01:41:29.839 INFO:tasks.workunit.client.1.smithi167.stdout:8/675: creat dc/d56/d59/d82/d8f/fdc x:0 0 0 2024-09-17T01:41:29.841 INFO:tasks.workunit.client.1.smithi167.stdout:1/624: symlink d0/d9/d16/d48/d54/d78/d90/da3/ld4 0 2024-09-17T01:41:29.843 INFO:tasks.workunit.client.1.smithi167.stdout:7/584: creat d0/d2/d14/d19/d22/fc6 x:0 0 0 2024-09-17T01:41:29.843 INFO:tasks.workunit.client.1.smithi167.stdout:0/534: symlink d5/d6b/d77/d37/d45/la3 0 2024-09-17T01:41:29.844 INFO:tasks.workunit.client.1.smithi167.stdout:8/676: write dc/d56/d57/dc2/fd6 [558808,118635] 0 2024-09-17T01:41:29.847 INFO:tasks.workunit.client.1.smithi167.stdout:7/585: write d0/fa9 [1839286,40199] 0 2024-09-17T01:41:29.849 INFO:tasks.workunit.client.1.smithi167.stdout:0/535: dread - d5/d6b/d77/d6d/d90/f9d zero size 2024-09-17T01:41:29.850 INFO:tasks.workunit.client.1.smithi167.stdout:8/677: unlink dc/d1a/f52 0 2024-09-17T01:41:29.851 INFO:tasks.workunit.client.1.smithi167.stdout:5/522: dwrite d0/d28/f37 [0,4194304] 0 2024-09-17T01:41:29.852 INFO:tasks.workunit.client.1.smithi167.stdout:6/748: dwrite d7/d54/d90/d13/f75 [0,4194304] 0 2024-09-17T01:41:29.853 INFO:tasks.workunit.client.1.smithi167.stdout:7/586: write d0/d2/d14/f18 [3525481,108707] 0 2024-09-17T01:41:29.857 INFO:tasks.workunit.client.1.smithi167.stdout:0/536: mkdir d5/d8/da4 0 2024-09-17T01:41:29.858 INFO:tasks.workunit.client.1.smithi167.stdout:5/523: write d0/d24/d2b/d3d/d3b/f5c [6043090,67112] 0 2024-09-17T01:41:29.859 INFO:tasks.workunit.client.1.smithi167.stdout:1/625: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:29.860 INFO:tasks.workunit.client.1.smithi167.stdout:7/587: rmdir d0/d2/d14/d19/d26/d83 39 2024-09-17T01:41:29.861 INFO:tasks.workunit.client.1.smithi167.stdout:6/749: mkdir d7/d54/d90/dfc/d10c 0 2024-09-17T01:41:29.863 INFO:tasks.workunit.client.1.smithi167.stdout:8/678: mkdir dc/d21/d6b/d74/d83/dc0/dc7/ddd 0 2024-09-17T01:41:29.864 INFO:tasks.workunit.client.1.smithi167.stdout:8/679: write f8 [1172637,88057] 0 2024-09-17T01:41:29.865 INFO:tasks.workunit.client.1.smithi167.stdout:5/524: mknod d0/d24/d2b/d3d/d3b/c9c 0 2024-09-17T01:41:29.865 INFO:tasks.workunit.client.1.smithi167.stdout:7/588: mknod d0/d2/d14/d19/d22/d40/cc7 0 2024-09-17T01:41:29.866 INFO:tasks.workunit.client.1.smithi167.stdout:6/750: mkdir d7/d52/d8c/d10d 0 2024-09-17T01:41:29.867 INFO:tasks.workunit.client.1.smithi167.stdout:8/680: write dc/d56/d57/d7e/dad/fd7 [618821,82761] 0 2024-09-17T01:41:29.868 INFO:tasks.workunit.client.1.smithi167.stdout:6/751: chown d7/d52/db7/fe0 10030 1 2024-09-17T01:41:29.869 INFO:tasks.workunit.client.1.smithi167.stdout:8/681: write dc/d21/f31 [4215280,21670] 0 2024-09-17T01:41:29.869 INFO:tasks.workunit.client.1.smithi167.stdout:5/525: mkdir d0/d54/d9d 0 2024-09-17T01:41:29.871 INFO:tasks.workunit.client.1.smithi167.stdout:6/752: chown d7/d54/d90/d13/d2f/d7f/fc5 43658 1 2024-09-17T01:41:29.873 INFO:tasks.workunit.client.1.smithi167.stdout:8/682: creat dc/d21/fde x:0 0 0 2024-09-17T01:41:29.874 INFO:tasks.workunit.client.1.smithi167.stdout:7/589: link d0/d2/d14/d19/d32/d62/fb0 d0/fc8 0 2024-09-17T01:41:29.880 INFO:tasks.workunit.client.1.smithi167.stdout:6/753: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f89 [0,4194304] 0 2024-09-17T01:41:29.882 INFO:tasks.workunit.client.1.smithi167.stdout:6/754: chown d7/d54/d90/d13/f49 10315931 1 2024-09-17T01:41:29.882 INFO:tasks.workunit.client.1.smithi167.stdout:8/683: dwrite dc/d1a/d45/fd0 [0,4194304] 0 2024-09-17T01:41:29.909 INFO:tasks.workunit.client.1.smithi167.stdout:7/590: dread d0/d2/d88/f5d [0,4194304] 0 2024-09-17T01:41:29.912 INFO:tasks.workunit.client.1.smithi167.stdout:7/591: read d0/d2/d88/f7c [786055,4231] 0 2024-09-17T01:41:29.915 INFO:tasks.workunit.client.1.smithi167.stdout:7/592: truncate d0/d2/d14/d19/d22/f2a 1281512 0 2024-09-17T01:41:29.916 INFO:tasks.workunit.client.1.smithi167.stdout:7/593: dread d0/d2/f66 [0,4194304] 0 2024-09-17T01:41:29.927 INFO:tasks.workunit.client.1.smithi167.stdout:9/668: dwrite d4/d9/d21/f27 [0,4194304] 0 2024-09-17T01:41:29.928 INFO:tasks.workunit.client.1.smithi167.stdout:4/619: truncate d0/d4/d7/d10/f3f 55051 0 2024-09-17T01:41:29.933 INFO:tasks.workunit.client.1.smithi167.stdout:2/571: write d5/d10/d1a/d45/fbf [467978,79727] 0 2024-09-17T01:41:29.934 INFO:tasks.workunit.client.1.smithi167.stdout:3/606: dwrite d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:29.934 INFO:tasks.workunit.client.1.smithi167.stdout:4/620: truncate d0/d4/d7/f77 3922667 0 2024-09-17T01:41:29.935 INFO:tasks.workunit.client.1.smithi167.stdout:2/572: chown d5/d10/d1a/d45/d8e/l60 2023676184 1 2024-09-17T01:41:29.936 INFO:tasks.workunit.client.1.smithi167.stdout:1/626: getdents d0/d9/d16/d48/d54/d78/d90/da3 0 2024-09-17T01:41:29.937 INFO:tasks.workunit.client.1.smithi167.stdout:3/607: symlink d7/d8f/lc1 0 2024-09-17T01:41:29.938 INFO:tasks.workunit.client.1.smithi167.stdout:2/573: mkdir d5/d10/d1a/db8/da3/dc8 0 2024-09-17T01:41:29.939 INFO:tasks.workunit.client.1.smithi167.stdout:1/627: creat d0/d5/d34/d83/fd5 x:0 0 0 2024-09-17T01:41:29.942 INFO:tasks.workunit.client.1.smithi167.stdout:2/574: creat d5/d3c/d4c/d4d/fc9 x:0 0 0 2024-09-17T01:41:29.948 INFO:tasks.workunit.client.1.smithi167.stdout:3/608: mkdir d7/d8/d10/d14/d24/d9c/da3/dad/dc2 0 2024-09-17T01:41:29.949 INFO:tasks.workunit.client.1.smithi167.stdout:1/628: creat d0/d5/d61/da2/fd6 x:0 0 0 2024-09-17T01:41:29.951 INFO:tasks.workunit.client.1.smithi167.stdout:3/609: truncate d7/d8/d2a/f95 5207391 0 2024-09-17T01:41:29.951 INFO:tasks.workunit.client.1.smithi167.stdout:1/629: chown d0/d9/d16/d48/d54/d6e/l86 1941042378 1 2024-09-17T01:41:29.952 INFO:tasks.workunit.client.1.smithi167.stdout:5/526: write d0/d24/f38 [1144963,6749] 0 2024-09-17T01:41:29.953 INFO:tasks.workunit.client.1.smithi167.stdout:5/527: read d0/d28/d3a/f7d [837197,2010] 0 2024-09-17T01:41:29.956 INFO:tasks.workunit.client.1.smithi167.stdout:6/755: write d7/fa [1970265,119271] 0 2024-09-17T01:41:29.956 INFO:tasks.workunit.client.1.smithi167.stdout:6/756: stat d7/d54/d90/d13/f2d 0 2024-09-17T01:41:29.957 INFO:tasks.workunit.client.1.smithi167.stdout:6/757: stat d7/d52/d8c/d10d 0 2024-09-17T01:41:29.960 INFO:tasks.workunit.client.1.smithi167.stdout:7/594: write d0/d2/d14/d19/d26/fc0 [807691,32528] 0 2024-09-17T01:41:29.962 INFO:tasks.workunit.client.1.smithi167.stdout:7/595: chown d0/d2/d14/f72 2111861 1 2024-09-17T01:41:29.966 INFO:tasks.workunit.client.1.smithi167.stdout:2/575: readlink d5/d10/d1a/d45/l86 0 2024-09-17T01:41:29.967 INFO:tasks.workunit.client.1.smithi167.stdout:2/576: stat d5/d3c/f40 0 2024-09-17T01:41:29.970 INFO:tasks.workunit.client.1.smithi167.stdout:5/528: creat d0/d24/d2b/d4e/f9e x:0 0 0 2024-09-17T01:41:29.972 INFO:tasks.workunit.client.1.smithi167.stdout:7/596: unlink d0/d2/d14/d19/d22/cc3 0 2024-09-17T01:41:29.973 INFO:tasks.workunit.client.1.smithi167.stdout:1/630: mkdir d0/d5/dd7 0 2024-09-17T01:41:29.975 INFO:tasks.workunit.client.1.smithi167.stdout:3/610: mkdir d7/d8/d10/d14/d66/d6c/da2/dc3 0 2024-09-17T01:41:29.977 INFO:tasks.workunit.client.1.smithi167.stdout:6/758: symlink d7/d54/d90/d13/d60/l10e 0 2024-09-17T01:41:29.977 INFO:tasks.workunit.client.1.smithi167.stdout:5/529: truncate d0/f20 819248 0 2024-09-17T01:41:29.978 INFO:tasks.workunit.client.1.smithi167.stdout:7/597: dwrite d0/d2/d14/d6f/d8b/fac [0,4194304] 0 2024-09-17T01:41:29.980 INFO:tasks.workunit.client.1.smithi167.stdout:3/611: fdatasync d7/d8/d10/d14/d24/f97 0 2024-09-17T01:41:29.984 INFO:tasks.workunit.client.1.smithi167.stdout:6/759: dwrite d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:29.992 INFO:tasks.workunit.client.1.smithi167.stdout:1/631: link d0/d5/d34/d3c/f4e d0/d9/d16/d48/d54/d6e/d7e/fd8 0 2024-09-17T01:41:29.994 INFO:tasks.workunit.client.1.smithi167.stdout:2/577: write d5/d71/fae [4422258,119956] 0 2024-09-17T01:41:29.998 INFO:tasks.workunit.client.1.smithi167.stdout:2/578: unlink d5/d10/d1a/d45/fbf 0 2024-09-17T01:41:29.999 INFO:tasks.workunit.client.1.smithi167.stdout:1/632: dwrite d0/d9/d16/d48/d54/d6e/fd2 [0,4194304] 0 2024-09-17T01:41:30.001 INFO:tasks.workunit.client.1.smithi167.stdout:1/633: write d0/f46 [3444474,67806] 0 2024-09-17T01:41:30.001 INFO:tasks.workunit.client.1.smithi167.stdout:2/579: stat d5/d33/d48/d72/d94/fb7 0 2024-09-17T01:41:30.002 INFO:tasks.workunit.client.1.smithi167.stdout:2/580: chown d5/d3c/d4c/fb5 63 1 2024-09-17T01:41:30.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:29 smithi167 ceph-mon[35643]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 172 MiB/s wr, 274 op/s 2024-09-17T01:41:30.004 INFO:tasks.workunit.client.1.smithi167.stdout:1/634: mknod d0/d9/d16/d48/d54/d6e/d7e/cd9 0 2024-09-17T01:41:30.005 INFO:tasks.workunit.client.1.smithi167.stdout:6/760: dread d7/d54/d90/d13/f49 [0,4194304] 0 2024-09-17T01:41:30.007 INFO:tasks.workunit.client.1.smithi167.stdout:3/612: dread d7/d8/d2a/f95 [0,4194304] 0 2024-09-17T01:41:30.008 INFO:tasks.workunit.client.1.smithi167.stdout:3/613: stat d7/d8/d10/d14/d24/c9f 0 2024-09-17T01:41:30.009 INFO:tasks.workunit.client.1.smithi167.stdout:1/635: read d0/d5/d34/f5b [3285300,109557] 0 2024-09-17T01:41:30.010 INFO:tasks.workunit.client.1.smithi167.stdout:3/614: dread d7/d8/d10/d14/d2c/f89 [0,4194304] 0 2024-09-17T01:41:30.011 INFO:tasks.workunit.client.1.smithi167.stdout:6/761: mkdir d7/d54/d90/d13/d2f/d10f 0 2024-09-17T01:41:30.012 INFO:tasks.workunit.client.1.smithi167.stdout:5/530: dwrite d0/f19 [0,4194304] 0 2024-09-17T01:41:30.016 INFO:tasks.workunit.client.1.smithi167.stdout:3/615: mkdir d7/d8/d10/d14/d66/dc4 0 2024-09-17T01:41:30.017 INFO:tasks.workunit.client.1.smithi167.stdout:5/531: write d0/d28/d3a/d44/d69/f85 [466879,15010] 0 2024-09-17T01:41:30.022 INFO:tasks.workunit.client.1.smithi167.stdout:6/762: link d7/d42/f71 d7/d54/d90/f110 0 2024-09-17T01:41:30.024 INFO:tasks.workunit.client.1.smithi167.stdout:3/616: creat d7/d8/d10/d14/d24/d9c/da3/dad/dc2/fc5 x:0 0 0 2024-09-17T01:41:30.028 INFO:tasks.workunit.client.1.smithi167.stdout:3/617: rmdir d7/d8/d10/d14/d25 39 2024-09-17T01:41:30.028 INFO:tasks.workunit.client.1.smithi167.stdout:3/618: fsync d7/f54 0 2024-09-17T01:41:30.028 INFO:tasks.workunit.client.1.smithi167.stdout:5/532: getdents d0/d9 0 2024-09-17T01:41:30.028 INFO:tasks.workunit.client.1.smithi167.stdout:5/533: write d0/d24/d2b/f6e [526777,44122] 0 2024-09-17T01:41:30.029 INFO:tasks.workunit.client.1.smithi167.stdout:2/581: write d5/d10/d1a/d2e/f87 [3966127,87734] 0 2024-09-17T01:41:30.030 INFO:tasks.workunit.client.1.smithi167.stdout:3/619: unlink d7/d8/d2a/d4e/f83 0 2024-09-17T01:41:30.031 INFO:tasks.workunit.client.1.smithi167.stdout:2/582: write d5/d10/d1a/d2e/f51 [1485801,27572] 0 2024-09-17T01:41:30.032 INFO:tasks.workunit.client.1.smithi167.stdout:6/763: link d7/d54/d90/d13/d2f/d7f/d98/lb8 d7/d52/d79/da4/l111 0 2024-09-17T01:41:30.033 INFO:tasks.workunit.client.1.smithi167.stdout:5/534: symlink d0/d28/d3a/l9f 0 2024-09-17T01:41:30.036 INFO:tasks.workunit.client.1.smithi167.stdout:5/535: creat d0/d24/d2b/d4e/fa0 x:0 0 0 2024-09-17T01:41:30.038 INFO:tasks.workunit.client.1.smithi167.stdout:6/764: rename d7/d52/l5e to d7/d54/d90/d13/d2f/d96/dab/de3/l112 0 2024-09-17T01:41:30.039 INFO:tasks.workunit.client.1.smithi167.stdout:2/583: dwrite d5/d10/d1a/d2e/f59 [0,4194304] 0 2024-09-17T01:41:30.040 INFO:tasks.workunit.client.1.smithi167.stdout:6/765: symlink d7/d52/l113 0 2024-09-17T01:41:30.041 INFO:tasks.workunit.client.1.smithi167.stdout:3/620: dwrite d7/d8/d10/fa8 [4194304,4194304] 0 2024-09-17T01:41:30.042 INFO:tasks.workunit.client.1.smithi167.stdout:6/766: dread - d7/ff1 zero size 2024-09-17T01:41:30.044 INFO:tasks.workunit.client.1.smithi167.stdout:3/621: write d7/d8/d10/f42 [872563,22273] 0 2024-09-17T01:41:30.046 INFO:tasks.workunit.client.1.smithi167.stdout:3/622: write d7/d8/d10/d29/d75/f86 [211588,38308] 0 2024-09-17T01:41:30.046 INFO:tasks.workunit.client.1.smithi167.stdout:0/537: sync 2024-09-17T01:41:30.049 INFO:tasks.workunit.client.1.smithi167.stdout:0/538: write d5/d6b/d77/d37/d45/f8c [369247,17232] 0 2024-09-17T01:41:30.050 INFO:tasks.workunit.client.1.smithi167.stdout:5/536: link d0/d24/d2b/d3d/f65 d0/d9/d64/fa1 0 2024-09-17T01:41:30.055 INFO:tasks.workunit.client.1.smithi167.stdout:0/539: symlink d5/d6b/d77/d4d/la5 0 2024-09-17T01:41:30.055 INFO:tasks.workunit.client.1.smithi167.stdout:2/584: dwrite d5/d3c/d4c/f90 [0,4194304] 0 2024-09-17T01:41:30.059 INFO:tasks.workunit.client.1.smithi167.stdout:3/623: dwrite d7/d8/d10/d29/fa5 [0,4194304] 0 2024-09-17T01:41:30.063 INFO:tasks.workunit.client.1.smithi167.stdout:0/540: creat d5/d8/d9/d2f/fa6 x:0 0 0 2024-09-17T01:41:30.064 INFO:tasks.workunit.client.1.smithi167.stdout:6/767: fsync d7/d54/d90/f110 0 2024-09-17T01:41:30.065 INFO:tasks.workunit.client.1.smithi167.stdout:5/537: dwrite d0/f19 [4194304,4194304] 0 2024-09-17T01:41:30.073 INFO:tasks.workunit.client.0.smithi082.stdout:3/191: sync 2024-09-17T01:41:30.073 INFO:tasks.workunit.client.0.smithi082.stdout:9/230: sync 2024-09-17T01:41:30.074 INFO:tasks.workunit.client.0.smithi082.stdout:9/231: fdatasync d4/f49 0 2024-09-17T01:41:30.079 INFO:tasks.workunit.client.0.smithi082.stdout:3/192: creat d9/db/d26/f3f x:0 0 0 2024-09-17T01:41:30.081 INFO:tasks.workunit.client.0.smithi082.stdout:9/232: mkdir d4/d27/d21/d2e/d11/d39/d4f 0 2024-09-17T01:41:30.083 INFO:tasks.workunit.client.0.smithi082.stdout:9/233: symlink d4/l50 0 2024-09-17T01:41:30.089 INFO:tasks.workunit.client.0.smithi082.stdout:9/234: read d4/d27/d21/d2e/f18 [2980710,123622] 0 2024-09-17T01:41:30.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:29 smithi082 ceph-mon[28077]: pgmap v18: 65 pgs: 65 active+clean; 1.3 GiB data, 3.9 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 172 MiB/s wr, 274 op/s 2024-09-17T01:41:30.093 INFO:tasks.workunit.client.0.smithi082.stdout:9/235: write d4/d27/d21/d2e/f18 [836979,81459] 0 2024-09-17T01:41:30.096 INFO:tasks.workunit.client.0.smithi082.stdout:9/236: rename d4/f1a to d4/d27/d21/d2e/f51 0 2024-09-17T01:41:30.097 INFO:tasks.workunit.client.0.smithi082.stdout:9/237: dread - d4/d27/d21/d2e/d11/d39/f41 zero size 2024-09-17T01:41:30.100 INFO:tasks.workunit.client.0.smithi082.stdout:9/238: creat d4/d27/d21/d2e/d11/d37/f52 x:0 0 0 2024-09-17T01:41:30.102 INFO:tasks.workunit.client.0.smithi082.stdout:3/193: dread d9/db/f18 [4194304,4194304] 0 2024-09-17T01:41:30.105 INFO:tasks.workunit.client.0.smithi082.stdout:3/194: creat d9/f40 x:0 0 0 2024-09-17T01:41:30.105 INFO:tasks.workunit.client.0.smithi082.stdout:9/239: dwrite d4/f49 [0,4194304] 0 2024-09-17T01:41:30.106 INFO:tasks.workunit.client.0.smithi082.stdout:9/240: chown d4/c4d 133700939 1 2024-09-17T01:41:30.107 INFO:tasks.workunit.client.0.smithi082.stdout:9/241: fsync d4/f1d 0 2024-09-17T01:41:30.108 INFO:tasks.workunit.client.0.smithi082.stdout:3/195: symlink d9/db/d26/d28/l41 0 2024-09-17T01:41:30.109 INFO:tasks.workunit.client.0.smithi082.stdout:9/242: symlink d4/d27/d21/d2e/d11/d37/l53 0 2024-09-17T01:41:30.110 INFO:tasks.workunit.client.0.smithi082.stdout:3/196: symlink d9/db/d26/d28/l42 0 2024-09-17T01:41:30.117 INFO:tasks.workunit.client.0.smithi082.stdout:3/197: dwrite d9/f40 [0,4194304] 0 2024-09-17T01:41:30.119 INFO:tasks.workunit.client.0.smithi082.stdout:3/198: write d9/db/d26/f27 [672886,64740] 0 2024-09-17T01:41:30.120 INFO:tasks.workunit.client.0.smithi082.stdout:3/199: stat d9/f29 0 2024-09-17T01:41:30.122 INFO:tasks.workunit.client.0.smithi082.stdout:9/243: dwrite d4/d27/d21/d2e/f51 [0,4194304] 0 2024-09-17T01:41:30.124 INFO:tasks.workunit.client.0.smithi082.stdout:4/289: sync 2024-09-17T01:41:30.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/200: creat d9/d35/f43 x:0 0 0 2024-09-17T01:41:30.126 INFO:tasks.workunit.client.0.smithi082.stdout:3/201: fdatasync d9/db/f17 0 2024-09-17T01:41:30.126 INFO:tasks.workunit.client.0.smithi082.stdout:9/244: fdatasync d4/f8 0 2024-09-17T01:41:30.127 INFO:tasks.workunit.client.0.smithi082.stdout:9/245: readlink d4/lf 0 2024-09-17T01:41:30.128 INFO:tasks.workunit.client.1.smithi167.stdout:2/585: mkdir d5/d10/d1a/d45/d8e/d98/dca 0 2024-09-17T01:41:30.129 INFO:tasks.workunit.client.0.smithi082.stdout:3/202: symlink d9/l44 0 2024-09-17T01:41:30.130 INFO:tasks.workunit.client.1.smithi167.stdout:6/768: write d7/d54/d90/d13/f75 [4982301,89273] 0 2024-09-17T01:41:30.131 INFO:tasks.workunit.client.0.smithi082.stdout:9/246: getdents d4/d27/d2d/d3d 0 2024-09-17T01:41:30.132 INFO:tasks.workunit.client.0.smithi082.stdout:9/247: fsync d4/f17 0 2024-09-17T01:41:30.133 INFO:tasks.workunit.client.1.smithi167.stdout:5/538: creat d0/d24/d2b/d49/d4b/fa2 x:0 0 0 2024-09-17T01:41:30.134 INFO:tasks.workunit.client.1.smithi167.stdout:5/539: fsync d0/d24/f83 0 2024-09-17T01:41:30.134 INFO:tasks.workunit.client.0.smithi082.stdout:9/248: dread - d4/f4c zero size 2024-09-17T01:41:30.134 INFO:tasks.workunit.client.1.smithi167.stdout:3/624: creat d7/d8/d10/d14/d24/d62/d92/fc6 x:0 0 0 2024-09-17T01:41:30.137 INFO:tasks.workunit.client.1.smithi167.stdout:0/541: fdatasync d5/d8/f44 0 2024-09-17T01:41:30.138 INFO:tasks.workunit.client.0.smithi082.stdout:3/203: dwrite d9/db/d26/f31 [0,4194304] 0 2024-09-17T01:41:30.142 INFO:tasks.workunit.client.0.smithi082.stdout:3/204: unlink d9/l3d 0 2024-09-17T01:41:30.144 INFO:tasks.workunit.client.1.smithi167.stdout:5/540: getdents d0/d24/d93/d99 0 2024-09-17T01:41:30.146 INFO:tasks.workunit.client.1.smithi167.stdout:5/541: creat d0/d24/d2b/d3d/fa3 x:0 0 0 2024-09-17T01:41:30.147 INFO:tasks.workunit.client.1.smithi167.stdout:2/586: getdents d5/d6d 0 2024-09-17T01:41:30.147 INFO:tasks.workunit.client.1.smithi167.stdout:0/542: getdents d5/d6b/d7e 0 2024-09-17T01:41:30.148 INFO:tasks.workunit.client.1.smithi167.stdout:5/542: fsync d0/f14 0 2024-09-17T01:41:30.148 INFO:tasks.workunit.client.1.smithi167.stdout:0/543: dread - d5/d6b/d77/d4d/f9e zero size 2024-09-17T01:41:30.150 INFO:tasks.workunit.client.1.smithi167.stdout:0/544: stat d5/d6b/d77/d6d/c74 0 2024-09-17T01:41:30.151 INFO:tasks.workunit.client.1.smithi167.stdout:0/545: write d5/d6b/f63 [130888,124130] 0 2024-09-17T01:41:30.151 INFO:tasks.workunit.client.1.smithi167.stdout:0/546: stat d5/d8/d9/c30 0 2024-09-17T01:41:30.153 INFO:tasks.workunit.client.1.smithi167.stdout:0/547: creat d5/d6b/d77/fa7 x:0 0 0 2024-09-17T01:41:30.155 INFO:tasks.workunit.client.1.smithi167.stdout:0/548: unlink d5/d6b/d77/d6d/d90/f9a 0 2024-09-17T01:41:30.158 INFO:tasks.workunit.client.1.smithi167.stdout:0/549: rename d5/d8/d5c/l8a to d5/d8/d9/d2f/d9b/la8 0 2024-09-17T01:41:30.159 INFO:tasks.workunit.client.1.smithi167.stdout:3/625: dread d7/d8/d10/d14/d25/f48 [0,4194304] 0 2024-09-17T01:41:30.159 INFO:tasks.workunit.client.1.smithi167.stdout:0/550: read d5/d6b/f70 [63178,84410] 0 2024-09-17T01:41:30.161 INFO:tasks.workunit.client.1.smithi167.stdout:3/626: mkdir d7/d8/d10/d14/d25/dc7 0 2024-09-17T01:41:30.162 INFO:tasks.workunit.client.1.smithi167.stdout:3/627: write d7/d8/d10/d14/d2c/f2d [9002720,59811] 0 2024-09-17T01:41:30.164 INFO:tasks.workunit.client.1.smithi167.stdout:3/628: mkdir d7/d8/d10/d14/d66/d6c/d7c/dc8 0 2024-09-17T01:41:30.166 INFO:tasks.workunit.client.1.smithi167.stdout:3/629: write d7/d8/d10/d14/d25/f48 [373802,82131] 0 2024-09-17T01:41:30.168 INFO:tasks.workunit.client.1.smithi167.stdout:3/630: mknod d7/d8/d10/d14/d66/dc4/cc9 0 2024-09-17T01:41:30.169 INFO:tasks.workunit.client.1.smithi167.stdout:8/684: sync 2024-09-17T01:41:30.170 INFO:tasks.workunit.client.1.smithi167.stdout:3/631: symlink d7/d8/d10/d14/lca 0 2024-09-17T01:41:30.173 INFO:tasks.workunit.client.1.smithi167.stdout:8/685: link dc/d56/d59/fda dc/d56/d57/d7e/fdf 0 2024-09-17T01:41:30.174 INFO:tasks.workunit.client.1.smithi167.stdout:3/632: creat d7/d8/d10/d14/d24/d62/d92/fcb x:0 0 0 2024-09-17T01:41:30.178 INFO:tasks.workunit.client.1.smithi167.stdout:3/633: dwrite d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:30.180 INFO:tasks.workunit.client.1.smithi167.stdout:3/634: write d7/d8/d10/f42 [3215231,22675] 0 2024-09-17T01:41:30.186 INFO:tasks.workunit.client.1.smithi167.stdout:3/635: dread d7/d8/d2a/d7a/f88 [0,4194304] 0 2024-09-17T01:41:30.189 INFO:tasks.workunit.client.1.smithi167.stdout:3/636: read d7/d8/d10/f64 [2538674,72726] 0 2024-09-17T01:41:30.192 INFO:tasks.workunit.client.1.smithi167.stdout:3/637: link d7/d8/d10/d14/d2c/f71 d7/d8/d10/d14/d66/d6c/dab/fcc 0 2024-09-17T01:41:30.193 INFO:tasks.workunit.client.1.smithi167.stdout:3/638: chown d7/d8/d10/d14/d2c/l38 0 1 2024-09-17T01:41:30.194 INFO:tasks.workunit.client.1.smithi167.stdout:3/639: symlink d7/d8/d10/d14/d24/d9c/da3/dad/dc2/lcd 0 2024-09-17T01:41:30.195 INFO:tasks.workunit.client.1.smithi167.stdout:3/640: chown d7/d8/d10/d14/d24/c60 271 1 2024-09-17T01:41:30.197 INFO:tasks.workunit.client.1.smithi167.stdout:3/641: creat d7/d8/d10/d14/d2c/d7f/fce x:0 0 0 2024-09-17T01:41:30.197 INFO:tasks.workunit.client.1.smithi167.stdout:3/642: fsync d7/d8f/fae 0 2024-09-17T01:41:30.200 INFO:tasks.workunit.client.1.smithi167.stdout:3/643: mkdir d7/d8/d10/d14/d66/d6c/dab/dcf 0 2024-09-17T01:41:30.218 INFO:tasks.workunit.client.0.smithi082.stdout:3/205: write d9/f2b [736330,48872] 0 2024-09-17T01:41:30.219 INFO:tasks.workunit.client.0.smithi082.stdout:9/249: dread d4/d27/d2d/d3d/f47 [0,4194304] 0 2024-09-17T01:41:30.220 INFO:tasks.workunit.client.0.smithi082.stdout:9/250: stat d4/d27/d21/d2e/d11/d37/f38 0 2024-09-17T01:41:30.222 INFO:tasks.workunit.client.0.smithi082.stdout:3/206: symlink d9/l45 0 2024-09-17T01:41:30.223 INFO:tasks.workunit.client.0.smithi082.stdout:3/207: stat d9/db/f37 0 2024-09-17T01:41:30.224 INFO:tasks.workunit.client.0.smithi082.stdout:3/208: read d9/db/f17 [3508043,49498] 0 2024-09-17T01:41:30.225 INFO:tasks.workunit.client.1.smithi167.stdout:2/587: dwrite d5/d10/d16/f19 [0,4194304] 0 2024-09-17T01:41:30.226 INFO:tasks.workunit.client.0.smithi082.stdout:3/209: write d9/db/f22 [5038784,83598] 0 2024-09-17T01:41:30.226 INFO:tasks.workunit.client.1.smithi167.stdout:5/543: creat d0/d24/d2b/d3d/d3b/d5f/fa4 x:0 0 0 2024-09-17T01:41:30.227 INFO:tasks.workunit.client.1.smithi167.stdout:5/544: dread - d0/d24/d2b/d3d/d3b/f98 zero size 2024-09-17T01:41:30.229 INFO:tasks.workunit.client.0.smithi082.stdout:3/210: creat d9/db/d26/f46 x:0 0 0 2024-09-17T01:41:30.232 INFO:tasks.workunit.client.0.smithi082.stdout:9/251: getdents d4/d27/d21/d2e/d11/d37 0 2024-09-17T01:41:30.233 INFO:tasks.workunit.client.1.smithi167.stdout:0/551: truncate d5/d8/d9/f39 2313066 0 2024-09-17T01:41:30.235 INFO:tasks.workunit.client.1.smithi167.stdout:2/588: unlink d5/d3c/d4c/d4d/d91/fbb 0 2024-09-17T01:41:30.235 INFO:tasks.workunit.client.1.smithi167.stdout:2/589: chown d5/d10/d1a/f37 0 1 2024-09-17T01:41:30.241 INFO:tasks.workunit.client.1.smithi167.stdout:0/552: mkdir d5/d6b/d77/d37/d45/da9 0 2024-09-17T01:41:30.242 INFO:tasks.workunit.client.0.smithi082.stdout:9/252: mknod d4/d27/d21/d2e/c54 0 2024-09-17T01:41:30.242 INFO:tasks.workunit.client.1.smithi167.stdout:2/590: rmdir d5/d10/d1a/db8/da3 39 2024-09-17T01:41:30.244 INFO:tasks.workunit.client.0.smithi082.stdout:3/211: rename d9/ff to d9/f47 0 2024-09-17T01:41:30.245 INFO:tasks.workunit.client.0.smithi082.stdout:3/212: stat f0 0 2024-09-17T01:41:30.246 INFO:tasks.workunit.client.1.smithi167.stdout:8/686: dwrite dc/d56/d57/d7e/f91 [0,4194304] 0 2024-09-17T01:41:30.246 INFO:tasks.workunit.client.0.smithi082.stdout:3/213: read d9/f23 [2072574,46488] 0 2024-09-17T01:41:30.247 INFO:tasks.workunit.client.0.smithi082.stdout:9/253: symlink d4/d27/d21/l55 0 2024-09-17T01:41:30.247 INFO:tasks.workunit.client.0.smithi082.stdout:9/254: write d4/f1d [1731856,90882] 0 2024-09-17T01:41:30.252 INFO:tasks.workunit.client.1.smithi167.stdout:3/644: write d7/d8/d2a/f2e [1699854,70846] 0 2024-09-17T01:41:30.254 INFO:tasks.workunit.client.1.smithi167.stdout:3/645: readlink d7/d8/d2a/l27 0 2024-09-17T01:41:30.255 INFO:tasks.workunit.client.1.smithi167.stdout:5/545: dread d0/d9/d1c/f23 [4194304,4194304] 0 2024-09-17T01:41:30.255 INFO:tasks.workunit.client.1.smithi167.stdout:8/687: dwrite dc/d21/d6b/d74/d83/dc0/dc7/fce [4194304,4194304] 0 2024-09-17T01:41:30.255 INFO:tasks.workunit.client.1.smithi167.stdout:2/591: creat d5/d10/d1a/d45/d3f/fcb x:0 0 0 2024-09-17T01:41:30.256 INFO:tasks.workunit.client.1.smithi167.stdout:8/688: chown dc/d56/d57/d7e 15544863 1 2024-09-17T01:41:30.257 INFO:tasks.workunit.client.1.smithi167.stdout:8/689: fsync dc/d21/fde 0 2024-09-17T01:41:30.257 INFO:tasks.workunit.client.0.smithi082.stdout:9/255: truncate d4/f8 683786 0 2024-09-17T01:41:30.258 INFO:tasks.workunit.client.1.smithi167.stdout:5/546: read d0/f21 [3397396,68494] 0 2024-09-17T01:41:30.258 INFO:tasks.workunit.client.1.smithi167.stdout:9/669: sync 2024-09-17T01:41:30.259 INFO:tasks.workunit.client.1.smithi167.stdout:8/690: readlink dc/d56/d57/da0/da7/lcf 0 2024-09-17T01:41:30.260 INFO:tasks.workunit.client.1.smithi167.stdout:9/670: chown d4/d9/d21/d81/c4b 7 1 2024-09-17T01:41:30.260 INFO:tasks.workunit.client.1.smithi167.stdout:3/646: symlink d7/d8/d10/d14/d66/d6c/dab/ld0 0 2024-09-17T01:41:30.262 INFO:tasks.workunit.client.1.smithi167.stdout:2/592: mknod d5/d10/d1a/d45/d8e/ccc 0 2024-09-17T01:41:30.263 INFO:tasks.workunit.client.1.smithi167.stdout:2/593: read d5/d10/d16/f18 [3024079,6572] 0 2024-09-17T01:41:30.264 INFO:tasks.workunit.client.1.smithi167.stdout:5/547: rename d0/d28/f2a to d0/d28/d3a/d44/fa5 0 2024-09-17T01:41:30.265 INFO:tasks.workunit.client.1.smithi167.stdout:5/548: dread - d0/d28/d3a/d44/f5e zero size 2024-09-17T01:41:30.266 INFO:tasks.workunit.client.1.smithi167.stdout:5/549: chown d0/d9/d1c/f60 12155631 1 2024-09-17T01:41:30.271 INFO:tasks.workunit.client.1.smithi167.stdout:2/594: creat d5/d33/d48/fcd x:0 0 0 2024-09-17T01:41:30.272 INFO:tasks.workunit.client.1.smithi167.stdout:3/647: rename d7/d8/d10/d14/d24/d9c/da3/dad to d7/d8/d10/d14/d25/dc7/dd1 0 2024-09-17T01:41:30.275 INFO:tasks.workunit.client.1.smithi167.stdout:0/553: write d5/d8/d9/f35 [2609038,45477] 0 2024-09-17T01:41:30.275 INFO:tasks.workunit.client.1.smithi167.stdout:5/550: chown d0/d24/d2b/d3d/f74 6677 1 2024-09-17T01:41:30.275 INFO:tasks.workunit.client.1.smithi167.stdout:8/691: truncate dc/dae/fb8 2529219 0 2024-09-17T01:41:30.276 INFO:tasks.workunit.client.1.smithi167.stdout:0/554: fdatasync d5/d6b/d77/d4d/d56/d7b/f89 0 2024-09-17T01:41:30.277 INFO:tasks.workunit.client.1.smithi167.stdout:0/555: chown d5/d6b/d77/d4d/f2b 987389649 1 2024-09-17T01:41:30.279 INFO:tasks.workunit.client.1.smithi167.stdout:1/636: sync 2024-09-17T01:41:30.279 INFO:tasks.workunit.client.1.smithi167.stdout:4/621: sync 2024-09-17T01:41:30.279 INFO:tasks.workunit.client.1.smithi167.stdout:7/598: sync 2024-09-17T01:41:30.279 INFO:tasks.workunit.client.1.smithi167.stdout:6/769: sync 2024-09-17T01:41:30.280 INFO:tasks.workunit.client.1.smithi167.stdout:3/648: creat d7/d8/d10/d37/fd2 x:0 0 0 2024-09-17T01:41:30.280 INFO:tasks.workunit.client.1.smithi167.stdout:5/551: mknod d0/d28/d80/ca6 0 2024-09-17T01:41:30.282 INFO:tasks.workunit.client.1.smithi167.stdout:9/671: dread d4/f83 [0,4194304] 0 2024-09-17T01:41:30.283 INFO:tasks.workunit.client.1.smithi167.stdout:2/595: creat d5/d10/d1a/d45/d8e/d98/dca/fce x:0 0 0 2024-09-17T01:41:30.284 INFO:tasks.workunit.client.1.smithi167.stdout:6/770: dread d7/d54/d90/d34/ff6 [0,4194304] 0 2024-09-17T01:41:30.284 INFO:tasks.workunit.client.1.smithi167.stdout:0/556: mkdir d5/d6b/d77/daa 0 2024-09-17T01:41:30.284 INFO:tasks.workunit.client.1.smithi167.stdout:3/649: read d7/d1e/f4f [3094814,92825] 0 2024-09-17T01:41:30.286 INFO:tasks.workunit.client.1.smithi167.stdout:1/637: unlink d0/d9/f31 0 2024-09-17T01:41:30.286 INFO:tasks.workunit.client.1.smithi167.stdout:6/771: write d7/d54/d90/d13/d2f/d30/d32/f107 [960504,105101] 0 2024-09-17T01:41:30.289 INFO:tasks.workunit.client.1.smithi167.stdout:7/599: mknod d0/d2/d14/d4c/cc9 0 2024-09-17T01:41:30.291 INFO:tasks.workunit.client.1.smithi167.stdout:3/650: dwrite d7/d8/d10/fa8 [0,4194304] 0 2024-09-17T01:41:30.291 INFO:tasks.workunit.client.1.smithi167.stdout:4/622: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/lcc 0 2024-09-17T01:41:30.292 INFO:tasks.workunit.client.1.smithi167.stdout:2/596: symlink d5/d3c/d4c/d4d/lcf 0 2024-09-17T01:41:30.294 INFO:tasks.workunit.client.1.smithi167.stdout:3/651: write d7/d8/d10/d14/d25/fbd [210543,9848] 0 2024-09-17T01:41:30.294 INFO:tasks.workunit.client.1.smithi167.stdout:6/772: read d7/f5c [416083,54771] 0 2024-09-17T01:41:30.295 INFO:tasks.workunit.client.1.smithi167.stdout:9/672: dread d4/d9/d21/d2d/d33/d90/dac/f68 [0,4194304] 0 2024-09-17T01:41:30.296 INFO:tasks.workunit.client.1.smithi167.stdout:0/557: symlink d5/d6b/lab 0 2024-09-17T01:41:30.298 INFO:tasks.workunit.client.0.smithi082.stdout:9/256: truncate d4/f8 793069 0 2024-09-17T01:41:30.300 INFO:tasks.workunit.client.1.smithi167.stdout:2/597: dread d5/d10/d1a/db8/d5e/fc0 [0,4194304] 0 2024-09-17T01:41:30.302 INFO:tasks.workunit.client.1.smithi167.stdout:7/600: symlink d0/d2/d14/d19/d7f/db4/dbf/lca 0 2024-09-17T01:41:30.305 INFO:tasks.workunit.client.1.smithi167.stdout:4/623: mknod d0/d4/d7/d6/d2b/ccd 0 2024-09-17T01:41:30.308 INFO:tasks.workunit.client.1.smithi167.stdout:3/652: symlink d7/d8f/ld3 0 2024-09-17T01:41:30.309 INFO:tasks.workunit.client.1.smithi167.stdout:1/638: creat d0/d5/dd7/fda x:0 0 0 2024-09-17T01:41:30.310 INFO:tasks.workunit.client.1.smithi167.stdout:1/639: chown d0/d5/d34/l3d 71967 1 2024-09-17T01:41:30.313 INFO:tasks.workunit.client.1.smithi167.stdout:0/558: creat d5/d6b/d7e/fac x:0 0 0 2024-09-17T01:41:30.314 INFO:tasks.workunit.client.1.smithi167.stdout:0/559: write d5/d6b/d77/f54 [5205237,39011] 0 2024-09-17T01:41:30.315 INFO:tasks.workunit.client.1.smithi167.stdout:0/560: dread - d5/d6b/d7e/fac zero size 2024-09-17T01:41:30.315 INFO:tasks.workunit.client.1.smithi167.stdout:2/598: write d5/d10/d1a/d45/f68 [611602,124676] 0 2024-09-17T01:41:30.317 INFO:tasks.workunit.client.1.smithi167.stdout:7/601: creat d0/d2/d14/d6f/d87/fcb x:0 0 0 2024-09-17T01:41:30.319 INFO:tasks.workunit.client.0.smithi082.stdout:9/257: dread d4/d27/d21/d2e/f34 [0,4194304] 0 2024-09-17T01:41:30.320 INFO:tasks.workunit.client.1.smithi167.stdout:4/624: unlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/l56 0 2024-09-17T01:41:30.320 INFO:tasks.workunit.client.0.smithi082.stdout:9/258: fdatasync d4/d27/d21/d2e/d11/d37/f52 0 2024-09-17T01:41:30.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/259: stat d4/d27/d21/d2e/d11/d37/l53 0 2024-09-17T01:41:30.322 INFO:tasks.workunit.client.1.smithi167.stdout:3/653: mknod d7/d8/d10/d14/d66/dc4/cd4 0 2024-09-17T01:41:30.323 INFO:tasks.workunit.client.1.smithi167.stdout:5/552: dwrite d0/d9/d64/fa1 [0,4194304] 0 2024-09-17T01:41:30.324 INFO:tasks.workunit.client.1.smithi167.stdout:5/553: stat d0/d9/d64 0 2024-09-17T01:41:30.325 INFO:tasks.workunit.client.1.smithi167.stdout:3/654: write d7/d8/d10/d14/d25/f6b [3690064,126584] 0 2024-09-17T01:41:30.326 INFO:tasks.workunit.client.1.smithi167.stdout:9/673: write d4/d9/d21/d2d/d33/d3a/f40 [1651485,62317] 0 2024-09-17T01:41:30.332 INFO:tasks.workunit.client.1.smithi167.stdout:5/554: creat d0/d9/fa7 x:0 0 0 2024-09-17T01:41:30.332 INFO:tasks.workunit.client.1.smithi167.stdout:6/773: dwrite d7/d54/d90/d34/dc8/fee [0,4194304] 0 2024-09-17T01:41:30.333 INFO:tasks.workunit.client.1.smithi167.stdout:1/640: dread d0/d5/d61/f7f [0,4194304] 0 2024-09-17T01:41:30.334 INFO:tasks.workunit.client.1.smithi167.stdout:5/555: write d0/d28/f87 [365743,99464] 0 2024-09-17T01:41:30.334 INFO:tasks.workunit.client.1.smithi167.stdout:2/599: symlink d5/d3c/d4c/ld0 0 2024-09-17T01:41:30.335 INFO:tasks.workunit.client.1.smithi167.stdout:0/561: link d5/d8/d9/f6a d5/d6b/d77/daa/fad 0 2024-09-17T01:41:30.338 INFO:tasks.workunit.client.1.smithi167.stdout:9/674: mkdir d4/d9/d21/d2d/d33/d3a/d9c/dd0 0 2024-09-17T01:41:30.339 INFO:tasks.workunit.client.1.smithi167.stdout:0/562: write d5/d6b/d77/d6d/f81 [1657766,129737] 0 2024-09-17T01:41:30.340 INFO:tasks.workunit.client.1.smithi167.stdout:4/625: mkdir d0/dce 0 2024-09-17T01:41:30.340 INFO:tasks.workunit.client.0.smithi082.stdout:9/260: truncate d4/f30 134965 0 2024-09-17T01:41:30.340 INFO:tasks.workunit.client.0.smithi082.stdout:7/297: sync 2024-09-17T01:41:30.340 INFO:tasks.workunit.client.0.smithi082.stdout:5/355: sync 2024-09-17T01:41:30.341 INFO:tasks.workunit.client.0.smithi082.stdout:6/372: sync 2024-09-17T01:41:30.341 INFO:tasks.workunit.client.0.smithi082.stdout:2/272: sync 2024-09-17T01:41:30.341 INFO:tasks.workunit.client.0.smithi082.stdout:1/344: sync 2024-09-17T01:41:30.342 INFO:tasks.workunit.client.1.smithi167.stdout:3/655: truncate f6 2907894 0 2024-09-17T01:41:30.343 INFO:tasks.workunit.client.0.smithi082.stdout:8/236: sync 2024-09-17T01:41:30.343 INFO:tasks.workunit.client.0.smithi082.stdout:0/233: sync 2024-09-17T01:41:30.343 INFO:tasks.workunit.client.0.smithi082.stdout:1/345: read d2/d3f/f5a [511963,103405] 0 2024-09-17T01:41:30.345 INFO:tasks.workunit.client.0.smithi082.stdout:0/234: chown da/df/d27/c32 0 1 2024-09-17T01:41:30.350 INFO:tasks.workunit.client.0.smithi082.stdout:6/373: unlink d1/d1f/f21 0 2024-09-17T01:41:30.351 INFO:tasks.workunit.client.0.smithi082.stdout:5/356: dwrite db/d56/d29/f6a [0,4194304] 0 2024-09-17T01:41:30.352 INFO:tasks.workunit.client.0.smithi082.stdout:9/261: creat d4/d27/d21/d2e/d11/d39/f56 x:0 0 0 2024-09-17T01:41:30.353 INFO:tasks.workunit.client.1.smithi167.stdout:5/556: symlink d0/d28/d3a/d4d/la8 0 2024-09-17T01:41:30.356 INFO:tasks.workunit.client.0.smithi082.stdout:1/346: dwrite d2/d3f/d24/f69 [0,4194304] 0 2024-09-17T01:41:30.359 INFO:tasks.workunit.client.0.smithi082.stdout:8/237: creat d3/dd/d18/d34/f47 x:0 0 0 2024-09-17T01:41:30.360 INFO:tasks.workunit.client.1.smithi167.stdout:7/602: truncate d0/d2/d88/f96 3340065 0 2024-09-17T01:41:30.362 INFO:tasks.workunit.client.1.smithi167.stdout:7/603: chown d0/d2/d14/d6f/d87/c94 0 1 2024-09-17T01:41:30.366 INFO:tasks.workunit.client.0.smithi082.stdout:2/273: unlink d1/f3f 0 2024-09-17T01:41:30.368 INFO:tasks.workunit.client.1.smithi167.stdout:6/774: write d7/d54/d90/d13/f99 [1392776,19151] 0 2024-09-17T01:41:30.369 INFO:tasks.workunit.client.1.smithi167.stdout:3/656: unlink d7/d8/d10/d14/d66/d6c/dab/fcc 0 2024-09-17T01:41:30.371 INFO:tasks.workunit.client.0.smithi082.stdout:0/235: rename da/d16/l4c to da/d1b/d23/d42/d4b/l56 0 2024-09-17T01:41:30.372 INFO:tasks.workunit.client.1.smithi167.stdout:4/626: truncate d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/f34 2287649 0 2024-09-17T01:41:30.373 INFO:tasks.workunit.client.1.smithi167.stdout:4/627: stat d0/d4/d7/d10/d70/la7 0 2024-09-17T01:41:30.375 INFO:tasks.workunit.client.1.smithi167.stdout:3/657: dwrite d7/d8/d10/d14/f8d [0,4194304] 0 2024-09-17T01:41:30.376 INFO:tasks.workunit.client.0.smithi082.stdout:0/236: dread da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:30.377 INFO:tasks.workunit.client.1.smithi167.stdout:4/628: readlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/lba 0 2024-09-17T01:41:30.377 INFO:tasks.workunit.client.0.smithi082.stdout:7/298: creat d0/d3/db/d10/d47/f5c x:0 0 0 2024-09-17T01:41:30.377 INFO:tasks.workunit.client.1.smithi167.stdout:3/658: read d7/d8/d10/d14/d24/f7d [335324,49838] 0 2024-09-17T01:41:30.378 INFO:tasks.workunit.client.0.smithi082.stdout:7/299: chown d0/d3/db/c51 2934352 1 2024-09-17T01:41:30.378 INFO:tasks.workunit.client.0.smithi082.stdout:7/300: chown d0/d3/f21 248548860 1 2024-09-17T01:41:30.380 INFO:tasks.workunit.client.0.smithi082.stdout:6/374: rmdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55 39 2024-09-17T01:41:30.380 INFO:tasks.workunit.client.1.smithi167.stdout:2/600: creat d5/d3c/d4c/d4d/d91/fd1 x:0 0 0 2024-09-17T01:41:30.382 INFO:tasks.workunit.client.0.smithi082.stdout:9/262: rmdir d4/d27/d21/d2e/d11/d39/d31 39 2024-09-17T01:41:30.383 INFO:tasks.workunit.client.1.smithi167.stdout:1/641: dwrite d0/d5/f73 [0,4194304] 0 2024-09-17T01:41:30.384 INFO:tasks.workunit.client.0.smithi082.stdout:9/263: readlink d4/d27/d21/d2e/d11/d37/l53 0 2024-09-17T01:41:30.385 INFO:tasks.workunit.client.0.smithi082.stdout:9/264: write d4/f49 [4165025,66016] 0 2024-09-17T01:41:30.388 INFO:tasks.workunit.client.1.smithi167.stdout:9/675: fdatasync d4/d9/d21/d43/d6c/fa2 0 2024-09-17T01:41:30.391 INFO:tasks.workunit.client.0.smithi082.stdout:1/347: dread d2/da/d2f/d47/f4d [0,4194304] 0 2024-09-17T01:41:30.391 INFO:tasks.workunit.client.1.smithi167.stdout:9/676: dread d4/d9/d21/d43/f76 [0,4194304] 0 2024-09-17T01:41:30.392 INFO:tasks.workunit.client.0.smithi082.stdout:1/348: stat d2/da/f33 0 2024-09-17T01:41:30.395 INFO:tasks.workunit.client.1.smithi167.stdout:8/692: sync 2024-09-17T01:41:30.396 INFO:tasks.workunit.client.1.smithi167.stdout:7/604: symlink d0/d2/d14/d6f/d75/lcc 0 2024-09-17T01:41:30.401 INFO:tasks.workunit.client.0.smithi082.stdout:2/274: rename d1/d17/f34 to d1/d17/f53 0 2024-09-17T01:41:30.405 INFO:tasks.workunit.client.0.smithi082.stdout:0/237: creat da/d1b/d23/d42/d43/f57 x:0 0 0 2024-09-17T01:41:30.406 INFO:tasks.workunit.client.0.smithi082.stdout:0/238: truncate da/df/f4a 1579411 0 2024-09-17T01:41:30.407 INFO:tasks.workunit.client.0.smithi082.stdout:0/239: chown da/d1b/f52 6793 1 2024-09-17T01:41:30.408 INFO:tasks.workunit.client.1.smithi167.stdout:3/659: mkdir d7/d8/d10/d14/d2c/d7f/dd5 0 2024-09-17T01:41:30.411 INFO:tasks.workunit.client.1.smithi167.stdout:2/601: symlink d5/d10/d1a/d45/d8e/d98/ld2 0 2024-09-17T01:41:30.414 INFO:tasks.workunit.client.0.smithi082.stdout:1/349: symlink d2/d3f/d34/l73 0 2024-09-17T01:41:30.415 INFO:tasks.workunit.client.0.smithi082.stdout:8/238: dread d3/fb [0,4194304] 0 2024-09-17T01:41:30.416 INFO:tasks.workunit.client.1.smithi167.stdout:0/563: dwrite d5/d8/d9/f39 [0,4194304] 0 2024-09-17T01:41:30.418 INFO:tasks.workunit.client.1.smithi167.stdout:9/677: creat d4/d9/d21/d43/d6c/d9e/da1/dbc/fd1 x:0 0 0 2024-09-17T01:41:30.420 INFO:tasks.workunit.client.1.smithi167.stdout:8/693: chown dc/dae/fb8 1367597 1 2024-09-17T01:41:30.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/694: dread - dc/dae/fd9 zero size 2024-09-17T01:41:30.421 INFO:tasks.workunit.client.1.smithi167.stdout:8/695: chown dc/d1a/fb0 0 1 2024-09-17T01:41:30.422 INFO:tasks.workunit.client.0.smithi082.stdout:7/301: creat d0/d3/db/d10/d3f/f5d x:0 0 0 2024-09-17T01:41:30.423 INFO:tasks.workunit.client.0.smithi082.stdout:0/240: fdatasync da/d16/f50 0 2024-09-17T01:41:30.424 INFO:tasks.workunit.client.0.smithi082.stdout:1/350: stat d2/f10 0 2024-09-17T01:41:30.426 INFO:tasks.workunit.client.0.smithi082.stdout:8/239: rename d3/f14 to d3/dd/d18/d2d/d3b/f48 0 2024-09-17T01:41:30.428 INFO:tasks.workunit.client.0.smithi082.stdout:5/357: link db/c69 db/d2b/d59/c74 0 2024-09-17T01:41:30.429 INFO:tasks.workunit.client.1.smithi167.stdout:5/557: creat d0/d24/d2b/fa9 x:0 0 0 2024-09-17T01:41:30.429 INFO:tasks.workunit.client.0.smithi082.stdout:5/358: write db/d56/d29/d4f/f53 [631090,110208] 0 2024-09-17T01:41:30.431 INFO:tasks.workunit.client.0.smithi082.stdout:2/275: dread d1/d35/f24 [0,4194304] 0 2024-09-17T01:41:30.431 INFO:tasks.workunit.client.0.smithi082.stdout:7/302: rmdir d0/dd/d2c/d54 39 2024-09-17T01:41:30.433 INFO:tasks.workunit.client.1.smithi167.stdout:4/629: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/ccf 0 2024-09-17T01:41:30.433 INFO:tasks.workunit.client.0.smithi082.stdout:0/241: fsync da/d16/f48 0 2024-09-17T01:41:30.436 INFO:tasks.workunit.client.0.smithi082.stdout:1/351: creat d2/d3f/d24/d54/f74 x:0 0 0 2024-09-17T01:41:30.438 INFO:tasks.workunit.client.0.smithi082.stdout:8/240: rename d3/dd/d18/d2d/d3b/c3f to d3/dd/d18/d34/c49 0 2024-09-17T01:41:30.441 INFO:tasks.workunit.client.0.smithi082.stdout:6/375: link d1/l28 d1/d7/d10/d4f/l89 0 2024-09-17T01:41:30.443 INFO:tasks.workunit.client.1.smithi167.stdout:2/602: dread d5/d10/d1a/d45/d3f/f7e [0,4194304] 0 2024-09-17T01:41:30.445 INFO:tasks.workunit.client.0.smithi082.stdout:0/242: creat da/d1b/d23/d42/f58 x:0 0 0 2024-09-17T01:41:30.446 INFO:tasks.workunit.client.1.smithi167.stdout:8/696: truncate dc/d56/d57/f8a 933255 0 2024-09-17T01:41:30.447 INFO:tasks.workunit.client.0.smithi082.stdout:1/352: mknod d2/d3f/d24/d54/c75 0 2024-09-17T01:41:30.448 INFO:tasks.workunit.client.1.smithi167.stdout:7/605: symlink d0/d2/d14/d19/d32/d9c/lcd 0 2024-09-17T01:41:30.451 INFO:tasks.workunit.client.1.smithi167.stdout:6/775: creat d7/d54/d90/d13/d2f/d7f/d98/d27/f114 x:0 0 0 2024-09-17T01:41:30.454 INFO:tasks.workunit.client.1.smithi167.stdout:5/558: creat d0/d24/faa x:0 0 0 2024-09-17T01:41:30.454 INFO:tasks.workunit.client.1.smithi167.stdout:5/559: stat d0/d28/d3a/d44/d69/f85 0 2024-09-17T01:41:30.455 INFO:tasks.workunit.client.0.smithi082.stdout:5/359: mknod db/d1e/c75 0 2024-09-17T01:41:30.458 INFO:tasks.workunit.client.0.smithi082.stdout:6/376: symlink d1/d7/d10/d4f/dc/l8a 0 2024-09-17T01:41:30.460 INFO:tasks.workunit.client.0.smithi082.stdout:2/276: creat d1/d10/f54 x:0 0 0 2024-09-17T01:41:30.461 INFO:tasks.workunit.client.1.smithi167.stdout:8/697: dread f8 [4194304,4194304] 0 2024-09-17T01:41:30.462 INFO:tasks.workunit.client.0.smithi082.stdout:0/243: mkdir da/df/d2b/d59 0 2024-09-17T01:41:30.465 INFO:tasks.workunit.client.1.smithi167.stdout:0/564: truncate d5/d6b/f5d 343368 0 2024-09-17T01:41:30.467 INFO:tasks.workunit.client.1.smithi167.stdout:9/678: mknod d4/d9/d21/d2d/d33/d80/cd2 0 2024-09-17T01:41:30.467 INFO:tasks.workunit.client.1.smithi167.stdout:9/679: fdatasync d4/d9/d21/d43/f7d 0 2024-09-17T01:41:30.472 INFO:tasks.workunit.client.1.smithi167.stdout:7/606: creat d0/d2/d14/d19/d7f/fce x:0 0 0 2024-09-17T01:41:30.473 INFO:tasks.workunit.client.0.smithi082.stdout:8/241: dwrite d3/f9 [4194304,4194304] 0 2024-09-17T01:41:30.473 INFO:tasks.workunit.client.1.smithi167.stdout:3/660: truncate d7/d8/d10/d14/d25/f6b 1878335 0 2024-09-17T01:41:30.473 INFO:tasks.workunit.client.1.smithi167.stdout:8/698: dread dc/d56/d57/da0/da7/dc1/fca [0,4194304] 0 2024-09-17T01:41:30.475 INFO:tasks.workunit.client.1.smithi167.stdout:6/776: creat d7/d54/d90/d34/dc8/f115 x:0 0 0 2024-09-17T01:41:30.476 INFO:tasks.workunit.client.0.smithi082.stdout:8/242: write d3/dd/d18/d2d/d3e/d43/f44 [562700,51631] 0 2024-09-17T01:41:30.476 INFO:tasks.workunit.client.0.smithi082.stdout:0/244: rmdir da/df/d27 39 2024-09-17T01:41:30.477 INFO:tasks.workunit.client.1.smithi167.stdout:8/699: dread dc/d56/d57/da0/da7/dc1/fca [0,4194304] 0 2024-09-17T01:41:30.477 INFO:tasks.workunit.client.1.smithi167.stdout:4/630: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d74/f8c [1641911,41256] 0 2024-09-17T01:41:30.478 INFO:tasks.workunit.client.0.smithi082.stdout:0/245: chown da/df/d2b 275234191 1 2024-09-17T01:41:30.478 INFO:tasks.workunit.client.0.smithi082.stdout:8/243: chown d3/dd/d18/d34/l2c 1649 1 2024-09-17T01:41:30.480 INFO:tasks.workunit.client.0.smithi082.stdout:0/246: dread - da/d1b/f4f zero size 2024-09-17T01:41:30.481 INFO:tasks.workunit.client.0.smithi082.stdout:2/277: dwrite d1/f1f [0,4194304] 0 2024-09-17T01:41:30.481 INFO:tasks.workunit.client.0.smithi082.stdout:1/353: unlink d2/da/d2d/c40 0 2024-09-17T01:41:30.483 INFO:tasks.workunit.client.0.smithi082.stdout:7/303: rename d0/d3/d36/f46 to d0/d3/f5e 0 2024-09-17T01:41:30.484 INFO:tasks.workunit.client.0.smithi082.stdout:7/304: fsync d0/dd/f1f 0 2024-09-17T01:41:30.485 INFO:tasks.workunit.client.1.smithi167.stdout:0/565: rename d5/d8/l7a to d5/d6b/d77/d37/lae 0 2024-09-17T01:41:30.487 INFO:tasks.workunit.client.0.smithi082.stdout:8/244: mkdir d3/dd/d18/d2d/d3e/d4a 0 2024-09-17T01:41:30.487 INFO:tasks.workunit.client.0.smithi082.stdout:5/360: dread db/d1e/d20/d30/d47/f4e [0,4194304] 0 2024-09-17T01:41:30.488 INFO:tasks.workunit.client.0.smithi082.stdout:8/245: fsync d3/dd/f2b 0 2024-09-17T01:41:30.489 INFO:tasks.workunit.client.1.smithi167.stdout:9/680: unlink d4/d9/d2b/l9b 0 2024-09-17T01:41:30.489 INFO:tasks.workunit.client.0.smithi082.stdout:5/361: write db/d56/d29/f6a [3192284,26134] 0 2024-09-17T01:41:30.491 INFO:tasks.workunit.client.1.smithi167.stdout:9/681: chown d4/d9/d21/d2d/d33/d3a/f40 361789277 1 2024-09-17T01:41:30.493 INFO:tasks.workunit.client.1.smithi167.stdout:2/603: unlink d5/d10/d1a/db8/da3/db0/cba 0 2024-09-17T01:41:30.493 INFO:tasks.workunit.client.1.smithi167.stdout:0/566: dwrite d5/f1d [4194304,4194304] 0 2024-09-17T01:41:30.500 INFO:tasks.workunit.client.0.smithi082.stdout:0/247: rename da/d1b/d23/c47 to da/df/d2b/d59/c5a 0 2024-09-17T01:41:30.502 INFO:tasks.workunit.client.1.smithi167.stdout:9/682: dwrite d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:30.502 INFO:tasks.workunit.client.0.smithi082.stdout:7/305: mknod d0/d3/db/d10/d47/c5f 0 2024-09-17T01:41:30.503 INFO:tasks.workunit.client.1.smithi167.stdout:2/604: dwrite d5/d10/d16/f73 [0,4194304] 0 2024-09-17T01:41:30.503 INFO:tasks.workunit.client.0.smithi082.stdout:7/306: fsync d0/f48 0 2024-09-17T01:41:30.504 INFO:tasks.workunit.client.0.smithi082.stdout:7/307: rename d0 to d0/d3/db/d10/d47/d60 22 2024-09-17T01:41:30.512 INFO:tasks.workunit.client.0.smithi082.stdout:8/246: creat d3/dd/d18/d3a/f4b x:0 0 0 2024-09-17T01:41:30.515 INFO:tasks.workunit.client.0.smithi082.stdout:5/362: mkdir db/d56/d76 0 2024-09-17T01:41:30.517 INFO:tasks.workunit.client.1.smithi167.stdout:8/700: dread dc/d56/d57/f8a [0,4194304] 0 2024-09-17T01:41:30.518 INFO:tasks.workunit.client.0.smithi082.stdout:2/278: mknod d1/d17/d38/d42/d52/c55 0 2024-09-17T01:41:30.520 INFO:tasks.workunit.client.1.smithi167.stdout:1/642: getdents d0/d5/d34/d3c/d85/db5 0 2024-09-17T01:41:30.520 INFO:tasks.workunit.client.1.smithi167.stdout:8/701: dread - dc/d56/d59/d82/d8f/d90/fbf zero size 2024-09-17T01:41:30.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/377: getdents d1/d3 0 2024-09-17T01:41:30.522 INFO:tasks.workunit.client.0.smithi082.stdout:1/354: write d2/f11 [1697964,6669] 0 2024-09-17T01:41:30.522 INFO:tasks.workunit.client.1.smithi167.stdout:7/607: dwrite d0/fc8 [0,4194304] 0 2024-09-17T01:41:30.524 INFO:tasks.workunit.client.0.smithi082.stdout:1/355: write d2/da/d2f/f31 [4746654,113080] 0 2024-09-17T01:41:30.528 INFO:tasks.workunit.client.0.smithi082.stdout:7/308: rename d0/dd/d34/c56 to d0/d3/db/d10/c61 0 2024-09-17T01:41:30.529 INFO:tasks.workunit.client.1.smithi167.stdout:9/683: creat d4/d4a/fd3 x:0 0 0 2024-09-17T01:41:30.531 INFO:tasks.workunit.client.1.smithi167.stdout:2/605: mknod d5/d10/d1a/d45/d6b/cd3 0 2024-09-17T01:41:30.532 INFO:tasks.workunit.client.1.smithi167.stdout:4/631: dwrite d0/d4/d7/d6/f66 [4194304,4194304] 0 2024-09-17T01:41:30.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/356: dwrite d2/da/d2d/f3e [0,4194304] 0 2024-09-17T01:41:30.533 INFO:tasks.workunit.client.1.smithi167.stdout:4/632: chown d0/d4/d7/da/d48/fc8 26935395 1 2024-09-17T01:41:30.534 INFO:tasks.workunit.client.1.smithi167.stdout:6/777: mkdir d7/d54/d90/d13/d2f/d116 0 2024-09-17T01:41:30.542 INFO:tasks.workunit.client.1.smithi167.stdout:5/560: write d0/d24/d2b/d3d/f4f [857180,88655] 0 2024-09-17T01:41:30.542 INFO:tasks.workunit.client.1.smithi167.stdout:1/643: mkdir d0/d5/dbf/ddb 0 2024-09-17T01:41:30.543 INFO:tasks.workunit.client.1.smithi167.stdout:7/608: dread d0/d2/d14/d23/f58 [0,4194304] 0 2024-09-17T01:41:30.545 INFO:tasks.workunit.client.1.smithi167.stdout:9/684: write d4/f83 [3316024,85265] 0 2024-09-17T01:41:30.546 INFO:tasks.workunit.client.1.smithi167.stdout:9/685: stat d4/d9/f3d 0 2024-09-17T01:41:30.546 INFO:tasks.workunit.client.0.smithi082.stdout:1/357: mkdir d2/da/d76 0 2024-09-17T01:41:30.546 INFO:tasks.workunit.client.0.smithi082.stdout:5/363: dread db/d56/d18/f40 [0,4194304] 0 2024-09-17T01:41:30.547 INFO:tasks.workunit.client.1.smithi167.stdout:9/686: dread - d4/d9/d21/d43/f7d zero size 2024-09-17T01:41:30.547 INFO:tasks.workunit.client.0.smithi082.stdout:1/358: chown d2/da/f56 82 1 2024-09-17T01:41:30.548 INFO:tasks.workunit.client.0.smithi082.stdout:6/378: creat d1/d7/d10/d4f/dc/d1d/d36/f8b x:0 0 0 2024-09-17T01:41:30.549 INFO:tasks.workunit.client.1.smithi167.stdout:4/633: rmdir d0/d4/d7/d10/d70 39 2024-09-17T01:41:30.550 INFO:tasks.workunit.client.1.smithi167.stdout:6/778: rmdir d7/d54/d90/d13/d2f/d96 39 2024-09-17T01:41:30.550 INFO:tasks.workunit.client.0.smithi082.stdout:2/279: dwrite d1/fd [0,4194304] 0 2024-09-17T01:41:30.551 INFO:tasks.workunit.client.1.smithi167.stdout:4/634: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/fb6 [811437,84352] 0 2024-09-17T01:41:30.552 INFO:tasks.workunit.client.0.smithi082.stdout:2/280: dread - d1/d17/d38/d42/f43 zero size 2024-09-17T01:41:30.553 INFO:tasks.workunit.client.0.smithi082.stdout:1/359: symlink d2/df/d46/l77 0 2024-09-17T01:41:30.555 INFO:tasks.workunit.client.1.smithi167.stdout:1/644: readlink d0/d5/d34/d3c/d74/la1 0 2024-09-17T01:41:30.558 INFO:tasks.workunit.client.1.smithi167.stdout:9/687: creat d4/d9/d21/d81/db9/fd4 x:0 0 0 2024-09-17T01:41:30.559 INFO:tasks.workunit.client.0.smithi082.stdout:5/364: dwrite db/d1e/d20/f73 [0,4194304] 0 2024-09-17T01:41:30.559 INFO:tasks.workunit.client.0.smithi082.stdout:1/360: dread d2/da/d2d/f45 [4194304,4194304] 0 2024-09-17T01:41:30.561 INFO:tasks.workunit.client.1.smithi167.stdout:4/635: dwrite d0/d4/db4/fb5 [0,4194304] 0 2024-09-17T01:41:30.564 INFO:tasks.workunit.client.1.smithi167.stdout:6/779: creat d7/d42/f117 x:0 0 0 2024-09-17T01:41:30.565 INFO:tasks.workunit.client.1.smithi167.stdout:6/780: read d7/d54/d90/d34/dc8/fee [3175355,45363] 0 2024-09-17T01:41:30.565 INFO:tasks.workunit.client.1.smithi167.stdout:6/781: dread - d7/d52/d8c/ff3 zero size 2024-09-17T01:41:30.565 INFO:tasks.workunit.client.0.smithi082.stdout:7/309: dread d0/d3/db/f14 [4194304,4194304] 0 2024-09-17T01:41:30.568 INFO:tasks.workunit.client.0.smithi082.stdout:8/247: truncate d3/f10 4135881 0 2024-09-17T01:41:30.569 INFO:tasks.workunit.client.0.smithi082.stdout:3/214: sync 2024-09-17T01:41:30.569 INFO:tasks.workunit.client.0.smithi082.stdout:4/290: sync 2024-09-17T01:41:30.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/661: sync 2024-09-17T01:41:30.571 INFO:tasks.workunit.client.1.smithi167.stdout:3/662: write d7/d8/d10/d37/fd2 [234289,58708] 0 2024-09-17T01:41:30.572 INFO:tasks.workunit.client.0.smithi082.stdout:4/291: dread - d9/d15/d16/f4b zero size 2024-09-17T01:41:30.574 INFO:tasks.workunit.client.0.smithi082.stdout:4/292: stat d9/d15/d16/d3e/f4e 0 2024-09-17T01:41:30.575 INFO:tasks.workunit.client.0.smithi082.stdout:0/248: dwrite da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:30.576 INFO:tasks.workunit.client.0.smithi082.stdout:1/361: fsync d2/d3f/d24/f23 0 2024-09-17T01:41:30.577 INFO:tasks.workunit.client.0.smithi082.stdout:1/362: fsync d2/df/d46/f64 0 2024-09-17T01:41:30.578 INFO:tasks.workunit.client.1.smithi167.stdout:9/688: mknod d4/d9/d21/d81/cd5 0 2024-09-17T01:41:30.581 INFO:tasks.workunit.client.1.smithi167.stdout:2/606: link d5/d10/d16/c3d d5/d10/d1a/db8/da3/dc8/cd4 0 2024-09-17T01:41:30.582 INFO:tasks.workunit.client.0.smithi082.stdout:1/363: dread d2/d3f/d24/f69 [0,4194304] 0 2024-09-17T01:41:30.582 INFO:tasks.workunit.client.1.smithi167.stdout:2/607: truncate d5/d10/d1a/d45/d8e/f9b 285089 0 2024-09-17T01:41:30.585 INFO:tasks.workunit.client.1.smithi167.stdout:1/645: rename d0/d9/d16/d48/f65 to d0/d5/d34/d3c/d85/fdc 0 2024-09-17T01:41:30.589 INFO:tasks.workunit.client.0.smithi082.stdout:6/379: creat d1/d7/d10/f8c x:0 0 0 2024-09-17T01:41:30.589 INFO:tasks.workunit.client.0.smithi082.stdout:1/364: dwrite d2/df/d46/f49 [0,4194304] 0 2024-09-17T01:41:30.590 INFO:tasks.workunit.client.0.smithi082.stdout:1/365: stat d2/df/f1d 0 2024-09-17T01:41:30.591 INFO:tasks.workunit.client.1.smithi167.stdout:0/567: dwrite d5/d6b/f5d [0,4194304] 0 2024-09-17T01:41:30.591 INFO:tasks.workunit.client.0.smithi082.stdout:6/380: write d1/f83 [626699,37211] 0 2024-09-17T01:41:30.592 INFO:tasks.workunit.client.1.smithi167.stdout:0/568: rename d5/d6b/d77 to d5/d6b/d77/d6d/d90/daf 22 2024-09-17T01:41:30.594 INFO:tasks.workunit.client.1.smithi167.stdout:4/636: fsync d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/f84 0 2024-09-17T01:41:30.596 INFO:tasks.workunit.client.1.smithi167.stdout:4/637: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 468719 1 2024-09-17T01:41:30.597 INFO:tasks.workunit.client.0.smithi082.stdout:8/248: rename d3/l38 to d3/dd/d18/d2d/d3e/d4a/l4c 0 2024-09-17T01:41:30.598 INFO:tasks.workunit.client.0.smithi082.stdout:3/215: symlink d9/db/d26/d28/l48 0 2024-09-17T01:41:30.600 INFO:tasks.workunit.client.0.smithi082.stdout:5/365: symlink db/l77 0 2024-09-17T01:41:30.601 INFO:tasks.workunit.client.1.smithi167.stdout:8/702: getdents dc/d56/d57 0 2024-09-17T01:41:30.602 INFO:tasks.workunit.client.1.smithi167.stdout:6/782: write d7/d54/d90/d13/d2f/d96/dab/fd0 [453389,117588] 0 2024-09-17T01:41:30.602 INFO:tasks.workunit.client.1.smithi167.stdout:8/703: write dc/d21/f34 [5906734,52899] 0 2024-09-17T01:41:30.603 INFO:tasks.workunit.client.0.smithi082.stdout:0/249: creat da/d1e/f5b x:0 0 0 2024-09-17T01:41:30.604 INFO:tasks.workunit.client.0.smithi082.stdout:6/381: dread d1/d1f/f66 [0,4194304] 0 2024-09-17T01:41:30.604 INFO:tasks.workunit.client.1.smithi167.stdout:3/663: mkdir d7/d8/d10/d29/d75/dd6 0 2024-09-17T01:41:30.605 INFO:tasks.workunit.client.0.smithi082.stdout:6/382: fdatasync d1/d7/d10/d4f/f78 0 2024-09-17T01:41:30.606 INFO:tasks.workunit.client.1.smithi167.stdout:3/664: fsync d7/d8/d10/d14/d24/d62/d92/fcb 0 2024-09-17T01:41:30.607 INFO:tasks.workunit.client.0.smithi082.stdout:7/310: mkdir d0/d62 0 2024-09-17T01:41:30.607 INFO:tasks.workunit.client.0.smithi082.stdout:6/383: dread d1/d7/d10/d4f/f12 [0,4194304] 0 2024-09-17T01:41:30.610 INFO:tasks.workunit.client.1.smithi167.stdout:6/783: dwrite d7/d54/d90/d13/f17 [0,4194304] 0 2024-09-17T01:41:30.612 INFO:tasks.workunit.client.1.smithi167.stdout:1/646: mkdir d0/d9/d16/d48/d54/d6f/ddd 0 2024-09-17T01:41:30.621 INFO:tasks.workunit.client.0.smithi082.stdout:1/366: symlink d2/da/d2d/l78 0 2024-09-17T01:41:30.622 INFO:tasks.workunit.client.0.smithi082.stdout:4/293: write d9/fd [4050079,111514] 0 2024-09-17T01:41:30.623 INFO:tasks.workunit.client.1.smithi167.stdout:2/608: dread d5/d10/d1a/d45/f68 [0,4194304] 0 2024-09-17T01:41:30.623 INFO:tasks.workunit.client.0.smithi082.stdout:4/294: chown d9/fd 769666417 1 2024-09-17T01:41:30.623 INFO:tasks.workunit.client.1.smithi167.stdout:0/569: symlink d5/d6b/d77/d4d/d56/lb0 0 2024-09-17T01:41:30.624 INFO:tasks.workunit.client.1.smithi167.stdout:5/561: dwrite d0/d9/fb [0,4194304] 0 2024-09-17T01:41:30.624 INFO:tasks.workunit.client.1.smithi167.stdout:2/609: fdatasync d5/d10/d1a/d2e/f7d 0 2024-09-17T01:41:30.625 INFO:tasks.workunit.client.1.smithi167.stdout:4/638: rmdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a 39 2024-09-17T01:41:30.625 INFO:tasks.workunit.client.1.smithi167.stdout:0/570: chown d5/d6b/d77/c4c 201188337 1 2024-09-17T01:41:30.632 INFO:tasks.workunit.client.1.smithi167.stdout:8/704: truncate dc/d18/f2d 1038119 0 2024-09-17T01:41:30.632 INFO:tasks.workunit.client.1.smithi167.stdout:7/609: getdents d0/d2/d14 0 2024-09-17T01:41:30.633 INFO:tasks.workunit.client.1.smithi167.stdout:8/705: dread - dc/d56/d59/d82/d8f/d90/f9e zero size 2024-09-17T01:41:30.635 INFO:tasks.workunit.client.0.smithi082.stdout:2/281: link d1/d10/l2c d1/d17/d38/l56 0 2024-09-17T01:41:30.638 INFO:tasks.workunit.client.1.smithi167.stdout:1/647: creat d0/d5/d34/d83/fde x:0 0 0 2024-09-17T01:41:30.639 INFO:tasks.workunit.client.1.smithi167.stdout:8/706: dwrite dc/d56/d59/d82/d8f/d90/fbf [0,4194304] 0 2024-09-17T01:41:30.640 INFO:tasks.workunit.client.1.smithi167.stdout:8/707: write dc/d21/f31 [4098368,20451] 0 2024-09-17T01:41:30.641 INFO:tasks.workunit.client.0.smithi082.stdout:7/311: symlink d0/d3/db/l63 0 2024-09-17T01:41:30.645 INFO:tasks.workunit.client.1.smithi167.stdout:7/610: mknod d0/d2/d14/d19/d22/d40/ccf 0 2024-09-17T01:41:30.645 INFO:tasks.workunit.client.0.smithi082.stdout:1/367: mkdir d2/da/d2d/d79 0 2024-09-17T01:41:30.646 INFO:tasks.workunit.client.0.smithi082.stdout:1/368: read d2/d3f/d24/f4f [3727216,120353] 0 2024-09-17T01:41:30.647 INFO:tasks.workunit.client.1.smithi167.stdout:9/689: rmdir d4/dc2 0 2024-09-17T01:41:30.651 INFO:tasks.workunit.client.0.smithi082.stdout:4/295: unlink d9/d15/d16/d18/d4a/d52/d55/c41 0 2024-09-17T01:41:30.653 INFO:tasks.workunit.client.0.smithi082.stdout:4/296: write d9/d15/f2e [1350686,74760] 0 2024-09-17T01:41:30.659 INFO:tasks.workunit.client.1.smithi167.stdout:6/784: dwrite d7/d54/d90/f110 [0,4194304] 0 2024-09-17T01:41:30.660 INFO:tasks.workunit.client.0.smithi082.stdout:4/297: dread d9/d15/f22 [0,4194304] 0 2024-09-17T01:41:30.661 INFO:tasks.workunit.client.1.smithi167.stdout:6/785: chown d7/d54/d90/d13/d2f/d7f/d98/d27/fe2 0 1 2024-09-17T01:41:30.661 INFO:tasks.workunit.client.0.smithi082.stdout:6/384: creat d1/d7/d10/d4f/dc/d2b/d48/f8d x:0 0 0 2024-09-17T01:41:30.662 INFO:tasks.workunit.client.0.smithi082.stdout:6/385: write d1/d7/d10/d4f/f30 [4916361,17402] 0 2024-09-17T01:41:30.662 INFO:tasks.workunit.client.1.smithi167.stdout:8/708: mknod dc/d21/d6b/d74/d83/dc0/ce0 0 2024-09-17T01:41:30.665 INFO:tasks.workunit.client.1.smithi167.stdout:0/571: mkdir d5/d6b/d77/daa/db1 0 2024-09-17T01:41:30.667 INFO:tasks.workunit.client.1.smithi167.stdout:4/639: truncate d0/d4/d7/da/f4d 3122564 0 2024-09-17T01:41:30.668 INFO:tasks.workunit.client.1.smithi167.stdout:6/786: dwrite f0 [0,4194304] 0 2024-09-17T01:41:30.669 INFO:tasks.workunit.client.1.smithi167.stdout:6/787: chown d7/d54/d90/d13/f99 7 1 2024-09-17T01:41:30.671 INFO:tasks.workunit.client.1.smithi167.stdout:7/611: rename d0/d2/d14/d4c to d0/d2/d88/d6e/da3/dd0 0 2024-09-17T01:41:30.672 INFO:tasks.workunit.client.1.smithi167.stdout:9/690: mkdir d4/d9/d97/dd6 0 2024-09-17T01:41:30.673 INFO:tasks.workunit.client.1.smithi167.stdout:3/665: link d7/d8/d10/d14/d25/l1b d7/d8/d10/d14/d24/d62/d92/ld7 0 2024-09-17T01:41:30.675 INFO:tasks.workunit.client.1.smithi167.stdout:6/788: dread d7/d54/d90/d13/d2f/d30/d32/f107 [0,4194304] 0 2024-09-17T01:41:30.676 INFO:tasks.workunit.client.0.smithi082.stdout:3/216: rename d9/db/d26/d28 to d9/db/d49 0 2024-09-17T01:41:30.677 INFO:tasks.workunit.client.0.smithi082.stdout:8/249: write d3/f9 [3986940,91169] 0 2024-09-17T01:41:30.677 INFO:tasks.workunit.client.1.smithi167.stdout:9/691: truncate d4/d9/d21/d43/d6c/d9e/da1/fa6 235515 0 2024-09-17T01:41:30.678 INFO:tasks.workunit.client.0.smithi082.stdout:8/250: write d3/f20 [4001360,28091] 0 2024-09-17T01:41:30.678 INFO:tasks.workunit.client.1.smithi167.stdout:9/692: dread - d4/d9/d2b/f7a zero size 2024-09-17T01:41:30.679 INFO:tasks.workunit.client.1.smithi167.stdout:5/562: creat d0/d24/fab x:0 0 0 2024-09-17T01:41:30.684 INFO:tasks.workunit.client.0.smithi082.stdout:1/369: mknod d2/da/d16/c7a 0 2024-09-17T01:41:30.684 INFO:tasks.workunit.client.0.smithi082.stdout:2/282: write d1/f9 [1681470,114412] 0 2024-09-17T01:41:30.685 INFO:tasks.workunit.client.1.smithi167.stdout:8/709: dread dc/d56/d59/d65/fa9 [0,4194304] 0 2024-09-17T01:41:30.685 INFO:tasks.workunit.client.0.smithi082.stdout:1/370: truncate d2/da/f56 1027946 0 2024-09-17T01:41:30.686 INFO:tasks.workunit.client.0.smithi082.stdout:6/386: write d1/d7/d10/d4f/fb [3830056,103421] 0 2024-09-17T01:41:30.690 INFO:tasks.workunit.client.1.smithi167.stdout:3/666: creat d7/d8/d10/d14/d25/dc7/dd1/dc2/fd8 x:0 0 0 2024-09-17T01:41:30.691 INFO:tasks.workunit.client.1.smithi167.stdout:2/610: getdents d5/d71 0 2024-09-17T01:41:30.691 INFO:tasks.workunit.client.0.smithi082.stdout:3/217: mkdir d9/db/d49/d4a 0 2024-09-17T01:41:30.692 INFO:tasks.workunit.client.1.smithi167.stdout:2/611: write d5/d10/d1a/db8/d5e/fbc [81203,24075] 0 2024-09-17T01:41:30.693 INFO:tasks.workunit.client.0.smithi082.stdout:7/312: rename d0/d3/f35 to d0/d3/f64 0 2024-09-17T01:41:30.697 INFO:tasks.workunit.client.1.smithi167.stdout:5/563: rename d0/d28 to d0/d24/d2b/d49/d4b/dac 0 2024-09-17T01:41:30.698 INFO:tasks.workunit.client.0.smithi082.stdout:8/251: mknod d3/dd/d18/d2d/d3b/c4d 0 2024-09-17T01:41:30.700 INFO:tasks.workunit.client.0.smithi082.stdout:4/298: creat d9/d47/f5d x:0 0 0 2024-09-17T01:41:30.701 INFO:tasks.workunit.client.1.smithi167.stdout:0/572: symlink d5/lb2 0 2024-09-17T01:41:30.702 INFO:tasks.workunit.client.0.smithi082.stdout:2/283: write d1/d17/d38/d42/f45 [1744182,75562] 0 2024-09-17T01:41:30.706 INFO:tasks.workunit.client.0.smithi082.stdout:1/371: creat d2/df/d46/f7b x:0 0 0 2024-09-17T01:41:30.707 INFO:tasks.workunit.client.1.smithi167.stdout:3/667: symlink d7/d8/d10/d14/d25/dc7/ld9 0 2024-09-17T01:41:30.707 INFO:tasks.workunit.client.0.smithi082.stdout:1/372: chown d2/d3f/d34 1 1 2024-09-17T01:41:30.709 INFO:tasks.workunit.client.0.smithi082.stdout:2/284: dwrite d1/d10/f54 [0,4194304] 0 2024-09-17T01:41:30.710 INFO:tasks.workunit.client.0.smithi082.stdout:3/218: read d9/db/d26/f3a [187822,41913] 0 2024-09-17T01:41:30.712 INFO:tasks.workunit.client.0.smithi082.stdout:6/387: mkdir d1/d7/d10/d4f/d8e 0 2024-09-17T01:41:30.714 INFO:tasks.workunit.client.0.smithi082.stdout:0/250: rename da/d1b/l40 to da/df/l5c 0 2024-09-17T01:41:30.715 INFO:tasks.workunit.client.0.smithi082.stdout:8/252: rename d3 to d3/dd/d18/d4e 22 2024-09-17T01:41:30.717 INFO:tasks.workunit.client.0.smithi082.stdout:0/251: read - da/d1b/f4f zero size 2024-09-17T01:41:30.718 INFO:tasks.workunit.client.0.smithi082.stdout:2/285: dwrite d1/d10/f41 [0,4194304] 0 2024-09-17T01:41:30.720 INFO:tasks.workunit.client.0.smithi082.stdout:2/286: fsync d1/f1f 0 2024-09-17T01:41:30.720 INFO:tasks.workunit.client.1.smithi167.stdout:8/710: mknod dc/d56/d57/da0/da7/dc1/ce1 0 2024-09-17T01:41:30.721 INFO:tasks.workunit.client.0.smithi082.stdout:8/253: chown d3/dd/d18/d2d/d3e/d43/f45 552585 1 2024-09-17T01:41:30.722 INFO:tasks.workunit.client.0.smithi082.stdout:1/373: truncate d2/f5f 1684909 0 2024-09-17T01:41:30.722 INFO:tasks.workunit.client.1.smithi167.stdout:8/711: chown dc/d56/d59/f64 65187 1 2024-09-17T01:41:30.722 INFO:tasks.workunit.client.1.smithi167.stdout:1/648: sync 2024-09-17T01:41:30.722 INFO:tasks.workunit.client.1.smithi167.stdout:1/649: write d0/d5/d61/fd0 [637974,66048] 0 2024-09-17T01:41:30.722 INFO:tasks.workunit.client.0.smithi082.stdout:8/254: chown d3/dd/ce 3290 1 2024-09-17T01:41:30.723 INFO:tasks.workunit.client.1.smithi167.stdout:4/640: creat d0/d4/d7/d6/d2b/d6d/fd0 x:0 0 0 2024-09-17T01:41:30.724 INFO:tasks.workunit.client.1.smithi167.stdout:0/573: dread d5/d6b/d77/d4d/f38 [0,4194304] 0 2024-09-17T01:41:30.728 INFO:tasks.workunit.client.0.smithi082.stdout:3/219: rmdir d9/db 39 2024-09-17T01:41:30.728 INFO:tasks.workunit.client.0.smithi082.stdout:1/374: dwrite d2/da/d2f/f31 [0,4194304] 0 2024-09-17T01:41:30.728 INFO:tasks.workunit.client.1.smithi167.stdout:6/789: link d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/da1/l106 d7/d52/d79/d109/l118 0 2024-09-17T01:41:30.731 INFO:tasks.workunit.client.1.smithi167.stdout:2/612: mkdir d5/d10/d1a/db8/dd5 0 2024-09-17T01:41:30.733 INFO:tasks.workunit.client.0.smithi082.stdout:6/388: rename d1/d7/d10/d4f/dc/d1d/d36/l68 to d1/d7/d10/d4f/dc/d2b/d48/l8f 0 2024-09-17T01:41:30.736 INFO:tasks.workunit.client.1.smithi167.stdout:9/693: truncate d4/d9/d21/d2d/d33/f70 2077766 0 2024-09-17T01:41:30.737 INFO:tasks.workunit.client.1.smithi167.stdout:9/694: chown d4/d9/d21/d43/f77 110439961 1 2024-09-17T01:41:30.738 INFO:tasks.workunit.client.0.smithi082.stdout:0/252: mkdir da/d1b/d23/d4d/d5d 0 2024-09-17T01:41:30.739 INFO:tasks.workunit.client.0.smithi082.stdout:0/253: fsync da/fb 0 2024-09-17T01:41:30.739 INFO:tasks.workunit.client.1.smithi167.stdout:1/650: chown d0/d5/d34/d3c/d85/fdc 84795 1 2024-09-17T01:41:30.740 INFO:tasks.workunit.client.1.smithi167.stdout:1/651: truncate d0/d5/d34/d3c/d74/fca 391067 0 2024-09-17T01:41:30.741 INFO:tasks.workunit.client.1.smithi167.stdout:1/652: write d0/d5/d61/da2/fc7 [74760,58798] 0 2024-09-17T01:41:30.743 INFO:tasks.workunit.client.1.smithi167.stdout:1/653: write d0/d9/fb [7169736,87202] 0 2024-09-17T01:41:30.743 INFO:tasks.workunit.client.1.smithi167.stdout:0/574: rename d5/d6b/f70 to d5/d6b/d77/d4d/d56/d7b/fb3 0 2024-09-17T01:41:30.746 INFO:tasks.workunit.client.0.smithi082.stdout:8/255: creat d3/dd/d18/d34/f4f x:0 0 0 2024-09-17T01:41:30.747 INFO:tasks.workunit.client.1.smithi167.stdout:3/668: mknod d7/d8/d10/d14/cda 0 2024-09-17T01:41:30.748 INFO:tasks.workunit.client.1.smithi167.stdout:2/613: creat d5/d10/d1a/d45/d8e/d98/dca/fd6 x:0 0 0 2024-09-17T01:41:30.749 INFO:tasks.workunit.client.1.smithi167.stdout:2/614: chown d5/d10/d1a/db8/da3/db0 2 1 2024-09-17T01:41:30.750 INFO:tasks.workunit.client.0.smithi082.stdout:3/220: rename d9/fe to d9/d35/f4b 0 2024-09-17T01:41:30.751 INFO:tasks.workunit.client.0.smithi082.stdout:3/221: stat d9/f40 0 2024-09-17T01:41:30.752 INFO:tasks.workunit.client.1.smithi167.stdout:5/564: link d0/d9/f12 d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad 0 2024-09-17T01:41:30.754 INFO:tasks.workunit.client.0.smithi082.stdout:2/287: fdatasync d1/d10/f28 0 2024-09-17T01:41:30.755 INFO:tasks.workunit.client.0.smithi082.stdout:2/288: readlink d1/d17/l39 0 2024-09-17T01:41:30.756 INFO:tasks.workunit.client.0.smithi082.stdout:7/313: getdents d0/dd 0 2024-09-17T01:41:30.757 INFO:tasks.workunit.client.0.smithi082.stdout:2/289: write d1/d17/d29/f4c [242718,35859] 0 2024-09-17T01:41:30.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/299: getdents d9/d15/d16/d3e/d54 0 2024-09-17T01:41:30.759 INFO:tasks.workunit.client.0.smithi082.stdout:7/314: read d0/dd/f16 [2186315,128061] 0 2024-09-17T01:41:30.760 INFO:tasks.workunit.client.0.smithi082.stdout:1/375: symlink d2/da/l7c 0 2024-09-17T01:41:30.761 INFO:tasks.workunit.client.0.smithi082.stdout:1/376: write d2/df/f1d [51099,45583] 0 2024-09-17T01:41:30.762 INFO:tasks.workunit.client.1.smithi167.stdout:6/790: mknod d7/d42/df4/c119 0 2024-09-17T01:41:30.763 INFO:tasks.workunit.client.1.smithi167.stdout:6/791: dread - d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/f104 zero size 2024-09-17T01:41:30.763 INFO:tasks.workunit.client.0.smithi082.stdout:1/377: write d2/df/f1d [2411332,108141] 0 2024-09-17T01:41:30.763 INFO:tasks.workunit.client.1.smithi167.stdout:6/792: chown d7/d54/d90/d13/d2f/l8d 15 1 2024-09-17T01:41:30.763 INFO:tasks.workunit.client.1.smithi167.stdout:6/793: readlink d7/ld9 0 2024-09-17T01:41:30.765 INFO:tasks.workunit.client.1.smithi167.stdout:3/669: rename d7/d8/d10/d14/d2c/d74/la7 to d7/d8f/ldb 0 2024-09-17T01:41:30.767 INFO:tasks.workunit.client.0.smithi082.stdout:8/256: rename d3/dd/d18/d2d/c35 to d3/dd/c50 0 2024-09-17T01:41:30.768 INFO:tasks.workunit.client.0.smithi082.stdout:8/257: chown d3/fb 2941874 1 2024-09-17T01:41:30.768 INFO:tasks.workunit.client.1.smithi167.stdout:7/612: link d0/d2/d88/f5d d0/d2/d14/d6f/d8b/fd1 0 2024-09-17T01:41:30.770 INFO:tasks.workunit.client.1.smithi167.stdout:2/615: symlink d5/d10/d1a/d45/d3f/ld7 0 2024-09-17T01:41:30.773 INFO:tasks.workunit.client.1.smithi167.stdout:9/695: creat d4/d9/d97/dd6/fd7 x:0 0 0 2024-09-17T01:41:30.773 INFO:tasks.workunit.client.0.smithi082.stdout:8/258: dwrite d3/dd/d18/d2d/d3e/d43/f45 [0,4194304] 0 2024-09-17T01:41:30.776 INFO:tasks.workunit.client.1.smithi167.stdout:5/565: creat d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae x:0 0 0 2024-09-17T01:41:30.779 INFO:tasks.workunit.client.1.smithi167.stdout:1/654: creat d0/d9/d16/d48/d54/d6f/ddd/fdf x:0 0 0 2024-09-17T01:41:30.779 INFO:tasks.workunit.client.1.smithi167.stdout:1/655: chown d0/d9/d16/d22/f66 1704 1 2024-09-17T01:41:30.780 INFO:tasks.workunit.client.0.smithi082.stdout:4/300: symlink d9/d15/d16/d18/d4a/d52/d55/d48/l5e 0 2024-09-17T01:41:30.780 INFO:tasks.workunit.client.0.smithi082.stdout:4/301: fdatasync d9/f46 0 2024-09-17T01:41:30.781 INFO:tasks.workunit.client.1.smithi167.stdout:0/575: link d5/d8/f97 d5/d6b/d77/d92/fb4 0 2024-09-17T01:41:30.781 INFO:tasks.workunit.client.0.smithi082.stdout:4/302: rename d9/d15/d16/d18/d4a/d52 to d9/d15/d16/d18/d4a/d52/d55/d48/d5f 22 2024-09-17T01:41:30.782 INFO:tasks.workunit.client.0.smithi082.stdout:7/315: creat d0/d3/db/d10/f65 x:0 0 0 2024-09-17T01:41:30.783 INFO:tasks.workunit.client.1.smithi167.stdout:4/641: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/fb0 [1888265,16022] 0 2024-09-17T01:41:30.783 INFO:tasks.workunit.client.0.smithi082.stdout:4/303: read d9/d15/d16/d3e/f4e [212739,31901] 0 2024-09-17T01:41:30.787 INFO:tasks.workunit.client.1.smithi167.stdout:3/670: mknod d7/d8/d10/d14/d66/d6c/dab/cdc 0 2024-09-17T01:41:30.788 INFO:tasks.workunit.client.0.smithi082.stdout:3/222: symlink d9/l4c 0 2024-09-17T01:41:30.789 INFO:tasks.workunit.client.1.smithi167.stdout:4/642: dwrite d0/d4/d7/d6/d2b/d6d/fd0 [0,4194304] 0 2024-09-17T01:41:30.790 INFO:tasks.workunit.client.1.smithi167.stdout:2/616: creat d5/d10/d1a/db8/da3/db0/fd8 x:0 0 0 2024-09-17T01:41:30.791 INFO:tasks.workunit.client.1.smithi167.stdout:4/643: read d0/d4/d7/d6/f43 [71669,109624] 0 2024-09-17T01:41:30.792 INFO:tasks.workunit.client.0.smithi082.stdout:6/389: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55/d80/c90 0 2024-09-17T01:41:30.793 INFO:tasks.workunit.client.1.smithi167.stdout:3/671: dread d7/d1e/f43 [0,4194304] 0 2024-09-17T01:41:30.794 INFO:tasks.workunit.client.1.smithi167.stdout:9/696: creat d4/d9/d21/d2d/d33/d3a/d74/fd8 x:0 0 0 2024-09-17T01:41:30.794 INFO:tasks.workunit.client.1.smithi167.stdout:3/672: fdatasync d7/faf 0 2024-09-17T01:41:30.794 INFO:tasks.workunit.client.0.smithi082.stdout:6/390: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/l6d 14890838 1 2024-09-17T01:41:30.795 INFO:tasks.workunit.client.1.smithi167.stdout:5/566: chown d0/l61 297 1 2024-09-17T01:41:30.797 INFO:tasks.workunit.client.0.smithi082.stdout:9/265: sync 2024-09-17T01:41:30.798 INFO:tasks.workunit.client.0.smithi082.stdout:8/259: write d3/dd/d18/d2d/d3b/f48 [1027009,130692] 0 2024-09-17T01:41:30.800 INFO:tasks.workunit.client.1.smithi167.stdout:1/656: creat d0/d5/d34/d6d/fe0 x:0 0 0 2024-09-17T01:41:30.801 INFO:tasks.workunit.client.1.smithi167.stdout:1/657: readlink d0/d5/d34/d3c/d85/lb7 0 2024-09-17T01:41:30.801 INFO:tasks.workunit.client.0.smithi082.stdout:1/378: dread d2/d3f/f26 [0,4194304] 0 2024-09-17T01:41:30.802 INFO:tasks.workunit.client.1.smithi167.stdout:1/658: write d0/d5/d34/fc0 [67624,77079] 0 2024-09-17T01:41:30.802 INFO:tasks.workunit.client.1.smithi167.stdout:0/576: symlink d5/d8/d9/lb5 0 2024-09-17T01:41:30.804 INFO:tasks.workunit.client.1.smithi167.stdout:8/712: sync 2024-09-17T01:41:30.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/304: creat d9/d47/f60 x:0 0 0 2024-09-17T01:41:30.806 INFO:tasks.workunit.client.0.smithi082.stdout:4/305: write d9/d15/d16/d3e/f3f [240326,72806] 0 2024-09-17T01:41:30.806 INFO:tasks.workunit.client.0.smithi082.stdout:3/223: fsync d9/db/f2f 0 2024-09-17T01:41:30.813 INFO:tasks.workunit.client.0.smithi082.stdout:9/266: unlink d4/d27/d2d/l45 0 2024-09-17T01:41:30.814 INFO:tasks.workunit.client.0.smithi082.stdout:4/306: dwrite d9/d15/d16/d18/d4a/d52/d55/f42 [0,4194304] 0 2024-09-17T01:41:30.814 INFO:tasks.workunit.client.0.smithi082.stdout:9/267: chown d4/d27/d21/d2e/c54 87 1 2024-09-17T01:41:30.815 INFO:tasks.workunit.client.1.smithi167.stdout:7/613: rename d0/d2/d14/d19/d26/l4e to d0/d2/d14/d19/d7f/db4/ld2 0 2024-09-17T01:41:30.816 INFO:tasks.workunit.client.0.smithi082.stdout:8/260: mkdir d3/dd/d18/d51 0 2024-09-17T01:41:30.818 INFO:tasks.workunit.client.0.smithi082.stdout:8/261: chown d3/dd/d18/d34/c32 851 1 2024-09-17T01:41:30.819 INFO:tasks.workunit.client.1.smithi167.stdout:2/617: creat d5/d10/d1a/d45/d8e/d98/dca/fd9 x:0 0 0 2024-09-17T01:41:30.819 INFO:tasks.workunit.client.0.smithi082.stdout:8/262: truncate d3/dd/d18/d3a/f4b 907024 0 2024-09-17T01:41:30.821 INFO:tasks.workunit.client.0.smithi082.stdout:2/290: creat d1/d35/f57 x:0 0 0 2024-09-17T01:41:30.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/697: symlink d4/d9/d21/d81/db9/ld9 0 2024-09-17T01:41:30.825 INFO:tasks.workunit.client.0.smithi082.stdout:2/291: dread d1/fd [0,4194304] 0 2024-09-17T01:41:30.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/698: stat d4/d9/d21/d81/db9/fcc 0 2024-09-17T01:41:30.828 INFO:tasks.workunit.client.0.smithi082.stdout:4/307: unlink d9/l23 0 2024-09-17T01:41:30.829 INFO:tasks.workunit.client.1.smithi167.stdout:0/577: rmdir d5/d6b/d77/d92 39 2024-09-17T01:41:30.830 INFO:tasks.workunit.client.0.smithi082.stdout:3/224: dread d9/db/d26/f3a [0,4194304] 0 2024-09-17T01:41:30.832 INFO:tasks.workunit.client.0.smithi082.stdout:8/263: mknod d3/dd/d18/d2d/d3e/c52 0 2024-09-17T01:41:30.834 INFO:tasks.workunit.client.1.smithi167.stdout:8/713: symlink dc/d56/d59/d82/d85/le2 0 2024-09-17T01:41:30.838 INFO:tasks.workunit.client.0.smithi082.stdout:1/379: unlink d2/d3f/c4e 0 2024-09-17T01:41:30.838 INFO:tasks.workunit.client.1.smithi167.stdout:8/714: dwrite dc/d21/d6b/f6c [0,4194304] 0 2024-09-17T01:41:30.839 INFO:tasks.workunit.client.1.smithi167.stdout:8/715: fdatasync dc/dae/fd9 0 2024-09-17T01:41:30.840 INFO:tasks.workunit.client.1.smithi167.stdout:7/614: creat d0/d2/d14/d19/d32/d62/fd3 x:0 0 0 2024-09-17T01:41:30.841 INFO:tasks.workunit.client.1.smithi167.stdout:2/618: dread d5/d10/d1a/f31 [0,4194304] 0 2024-09-17T01:41:30.841 INFO:tasks.workunit.client.0.smithi082.stdout:6/391: creat d1/d7/d10/d4f/dc/d1d/d36/f91 x:0 0 0 2024-09-17T01:41:30.842 INFO:tasks.workunit.client.0.smithi082.stdout:6/392: dread - d1/d3/f75 zero size 2024-09-17T01:41:30.842 INFO:tasks.workunit.client.1.smithi167.stdout:2/619: write d5/d10/d1a/d2e/fc2 [1021114,43451] 0 2024-09-17T01:41:30.843 INFO:tasks.workunit.client.1.smithi167.stdout:2/620: write d5/d10/d1a/d45/d6b/fb2 [367023,120929] 0 2024-09-17T01:41:30.845 INFO:tasks.workunit.client.0.smithi082.stdout:3/225: dread d9/d35/f4b [0,4194304] 0 2024-09-17T01:41:30.845 INFO:tasks.workunit.client.0.smithi082.stdout:4/308: mknod d9/d15/d37/d45/c61 0 2024-09-17T01:41:30.846 INFO:tasks.workunit.client.1.smithi167.stdout:3/673: creat d7/d8/d10/d14/d66/d6c/d7c/dc8/fdd x:0 0 0 2024-09-17T01:41:30.848 INFO:tasks.workunit.client.1.smithi167.stdout:3/674: write d7/d8/d10/d29/fa4 [864867,121364] 0 2024-09-17T01:41:30.850 INFO:tasks.workunit.client.1.smithi167.stdout:0/578: creat d5/d8/d5c/fb6 x:0 0 0 2024-09-17T01:41:30.851 INFO:tasks.workunit.client.1.smithi167.stdout:6/794: getdents d7/d54/d90/dd5 0 2024-09-17T01:41:30.852 INFO:tasks.workunit.client.0.smithi082.stdout:2/292: mkdir d1/d58 0 2024-09-17T01:41:30.855 INFO:tasks.workunit.client.1.smithi167.stdout:7/615: creat d0/d2/d14/d6f/d87/dae/fd4 x:0 0 0 2024-09-17T01:41:30.855 INFO:tasks.workunit.client.0.smithi082.stdout:4/309: creat d9/d15/f62 x:0 0 0 2024-09-17T01:41:30.857 INFO:tasks.workunit.client.1.smithi167.stdout:6/795: dwrite d7/d54/d90/d13/d2f/d7f/d98/f62 [0,4194304] 0 2024-09-17T01:41:30.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/268: rename d4/d27/d21/d2e/f18 to d4/f57 0 2024-09-17T01:41:30.864 INFO:tasks.workunit.client.1.smithi167.stdout:6/796: dwrite d7/d54/d90/d13/d2f/d7f/d98/fe9 [0,4194304] 0 2024-09-17T01:41:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:9/269: dwrite d4/d27/d21/d2e/f16 [0,4194304] 0 2024-09-17T01:41:30.865 INFO:tasks.workunit.client.1.smithi167.stdout:6/797: readlink d7/d54/d90/d13/d2f/d7f/d98/lac 0 2024-09-17T01:41:30.865 INFO:tasks.workunit.client.0.smithi082.stdout:2/293: dread - d1/d35/f30 zero size 2024-09-17T01:41:30.866 INFO:tasks.workunit.client.1.smithi167.stdout:9/699: mknod d4/d9/d21/d2d/dae/cda 0 2024-09-17T01:41:30.868 INFO:tasks.workunit.client.1.smithi167.stdout:9/700: write d4/d9/d21/d43/d6c/f9d [4568397,72688] 0 2024-09-17T01:41:30.871 INFO:tasks.workunit.client.1.smithi167.stdout:3/675: symlink d7/d8/d10/d14/d66/d6c/d7c/dc8/lde 0 2024-09-17T01:41:30.871 INFO:tasks.workunit.client.1.smithi167.stdout:9/701: write d4/d9/d21/d43/d6c/d9e/da1/fa6 [199697,82132] 0 2024-09-17T01:41:30.873 INFO:tasks.workunit.client.1.smithi167.stdout:5/567: write d0/d9/f7a [408263,75321] 0 2024-09-17T01:41:30.888 INFO:tasks.workunit.client.0.smithi082.stdout:9/270: dread d4/d27/d21/f42 [0,4194304] 0 2024-09-17T01:41:30.904 INFO:tasks.workunit.client.1.smithi167.stdout:1/659: sync 2024-09-17T01:41:30.905 INFO:tasks.workunit.client.1.smithi167.stdout:1/660: write d0/d5/d34/f70 [661997,57702] 0 2024-09-17T01:41:30.958 INFO:tasks.workunit.client.1.smithi167.stdout:8/716: write dc/d56/d57/d5c/f9d [390967,25650] 0 2024-09-17T01:41:30.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:30 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:30.964 INFO:tasks.workunit.client.0.smithi082.stdout:6/393: creat d1/d7/d10/f92 x:0 0 0 2024-09-17T01:41:30.965 INFO:tasks.workunit.client.0.smithi082.stdout:1/380: truncate d2/da/d2f/d47/f4d 3643868 0 2024-09-17T01:41:30.966 INFO:tasks.workunit.client.0.smithi082.stdout:3/226: creat d9/f4d x:0 0 0 2024-09-17T01:41:30.967 INFO:tasks.workunit.client.1.smithi167.stdout:2/621: write d5/d10/f42 [894938,13409] 0 2024-09-17T01:41:30.967 INFO:tasks.workunit.client.0.smithi082.stdout:8/264: getdents d3 0 2024-09-17T01:41:30.970 INFO:tasks.workunit.client.0.smithi082.stdout:2/294: rename d1/l3a to d1/d58/l59 0 2024-09-17T01:41:30.973 INFO:tasks.workunit.client.0.smithi082.stdout:3/227: dwrite d9/f4d [0,4194304] 0 2024-09-17T01:41:30.974 INFO:tasks.workunit.client.0.smithi082.stdout:3/228: fsync d9/db/f2f 0 2024-09-17T01:41:30.980 INFO:tasks.workunit.client.1.smithi167.stdout:0/579: mknod d5/d6b/d77/daa/db1/cb7 0 2024-09-17T01:41:30.980 INFO:tasks.workunit.client.0.smithi082.stdout:4/310: dwrite d9/d15/d16/d3e/f50 [0,4194304] 0 2024-09-17T01:41:30.985 INFO:tasks.workunit.client.0.smithi082.stdout:2/295: truncate d1/d35/f30 968982 0 2024-09-17T01:41:30.986 INFO:tasks.workunit.client.1.smithi167.stdout:1/661: mkdir d0/d5/d34/d6d/de1 0 2024-09-17T01:41:30.992 INFO:tasks.workunit.client.0.smithi082.stdout:9/271: rename d4/d27/c24 to d4/d27/d21/d2e/d11/d39/d44/c58 0 2024-09-17T01:41:30.992 INFO:tasks.workunit.client.0.smithi082.stdout:9/272: chown d4/d27/d21/d2e/d11 170849663 1 2024-09-17T01:41:30.994 INFO:tasks.workunit.client.0.smithi082.stdout:1/381: rmdir d2/df/d5e 0 2024-09-17T01:41:30.997 INFO:tasks.workunit.client.0.smithi082.stdout:8/265: rename d3/dd/d18/d2d/d3b/f3d to d3/dd/d18/d2d/f53 0 2024-09-17T01:41:31.000 INFO:tasks.workunit.client.0.smithi082.stdout:1/382: symlink d2/da/d2d/l7d 0 2024-09-17T01:41:31.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:30 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:31.004 INFO:tasks.workunit.client.0.smithi082.stdout:9/273: mkdir d4/d59 0 2024-09-17T01:41:31.005 INFO:tasks.workunit.client.0.smithi082.stdout:9/274: readlink d4/d27/d21/d2e/d11/d39/d44/l4a 0 2024-09-17T01:41:31.006 INFO:tasks.workunit.client.0.smithi082.stdout:9/275: stat d4/d27/d2d/c3f 0 2024-09-17T01:41:31.009 INFO:tasks.workunit.client.0.smithi082.stdout:4/311: link d9/d15/c2d d9/d15/d16/d44/c63 0 2024-09-17T01:41:31.012 INFO:tasks.workunit.client.0.smithi082.stdout:9/276: creat d4/d27/d21/f5a x:0 0 0 2024-09-17T01:41:31.014 INFO:tasks.workunit.client.0.smithi082.stdout:2/296: dwrite d1/d10/f12 [4194304,4194304] 0 2024-09-17T01:41:31.016 INFO:tasks.workunit.client.1.smithi167.stdout:7/616: fdatasync d0/d2/d14/f1b 0 2024-09-17T01:41:31.018 INFO:tasks.workunit.client.1.smithi167.stdout:4/644: link d0/d4/d7/da/d48/ca4 d0/d4/d7/d10/d70/cd1 0 2024-09-17T01:41:31.018 INFO:tasks.workunit.client.0.smithi082.stdout:4/312: chown d9/d15/c29 363011299 1 2024-09-17T01:41:31.019 INFO:tasks.workunit.client.1.smithi167.stdout:4/645: stat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/laf 0 2024-09-17T01:41:31.019 INFO:tasks.workunit.client.0.smithi082.stdout:4/313: stat d9/d15/d16/d18/d4a/d52/f59 0 2024-09-17T01:41:31.020 INFO:tasks.workunit.client.1.smithi167.stdout:2/622: creat d5/d10/d1a/db8/da3/fda x:0 0 0 2024-09-17T01:41:31.022 INFO:tasks.workunit.client.0.smithi082.stdout:8/266: getdents d3/dd/d18/d2d/d3e/d4a 0 2024-09-17T01:41:31.026 INFO:tasks.workunit.client.1.smithi167.stdout:4/646: dwrite d0/fd [0,4194304] 0 2024-09-17T01:41:31.027 INFO:tasks.workunit.client.0.smithi082.stdout:2/297: mkdir d1/d5a 0 2024-09-17T01:41:31.039 INFO:tasks.workunit.client.1.smithi167.stdout:8/717: dread dc/d56/d59/f77 [0,4194304] 0 2024-09-17T01:41:31.040 INFO:tasks.workunit.client.1.smithi167.stdout:8/718: readlink dc/d56/d57/d5c/l97 0 2024-09-17T01:41:31.040 INFO:tasks.workunit.client.0.smithi082.stdout:5/366: sync 2024-09-17T01:41:31.041 INFO:tasks.workunit.client.1.smithi167.stdout:5/568: mknod d0/d24/d2b/d3d/caf 0 2024-09-17T01:41:31.042 INFO:tasks.workunit.client.0.smithi082.stdout:8/267: mknod d3/dd/c54 0 2024-09-17T01:41:31.043 INFO:tasks.workunit.client.1.smithi167.stdout:3/676: rename d7/d8/d2a/c5d to d7/d8/d10/d14/d24/d62/d92/cdf 0 2024-09-17T01:41:31.043 INFO:tasks.workunit.client.0.smithi082.stdout:8/268: truncate d3/dd/d18/d34/f4f 979375 0 2024-09-17T01:41:31.045 INFO:tasks.workunit.client.1.smithi167.stdout:1/662: mknod d0/d9/d16/d22/ce2 0 2024-09-17T01:41:31.046 INFO:tasks.workunit.client.0.smithi082.stdout:4/314: symlink d9/l64 0 2024-09-17T01:41:31.048 INFO:tasks.workunit.client.0.smithi082.stdout:5/367: mkdir db/d56/d78 0 2024-09-17T01:41:31.050 INFO:tasks.workunit.client.0.smithi082.stdout:9/277: getdents d4/d27/d21 0 2024-09-17T01:41:31.053 INFO:tasks.workunit.client.0.smithi082.stdout:4/315: dread - d9/d15/d16/d18/f32 zero size 2024-09-17T01:41:31.053 INFO:tasks.workunit.client.1.smithi167.stdout:2/623: creat d5/d6d/fdb x:0 0 0 2024-09-17T01:41:31.053 INFO:tasks.workunit.client.1.smithi167.stdout:2/624: chown d5/d10/d1a/db8/c7f 1 1 2024-09-17T01:41:31.054 INFO:tasks.workunit.client.1.smithi167.stdout:2/625: read d5/d10/f22 [3515436,84583] 0 2024-09-17T01:41:31.054 INFO:tasks.workunit.client.1.smithi167.stdout:2/626: chown d5/d3c 24251208 1 2024-09-17T01:41:31.055 INFO:tasks.workunit.client.1.smithi167.stdout:0/580: mkdir d5/d6b/d77/d92/db8 0 2024-09-17T01:41:31.057 INFO:tasks.workunit.client.0.smithi082.stdout:1/383: dwrite d2/da/f6a [0,4194304] 0 2024-09-17T01:41:31.058 INFO:tasks.workunit.client.1.smithi167.stdout:6/798: truncate f0 428376 0 2024-09-17T01:41:31.058 INFO:tasks.workunit.client.1.smithi167.stdout:4/647: read d0/d4/d7/d10/f3f [38217,107034] 0 2024-09-17T01:41:31.059 INFO:tasks.workunit.client.0.smithi082.stdout:2/298: rename d1/d17/d38/d42/d52/c55 to d1/c5b 0 2024-09-17T01:41:31.061 INFO:tasks.workunit.client.1.smithi167.stdout:8/719: unlink dc/d56/f70 0 2024-09-17T01:41:31.063 INFO:tasks.workunit.client.1.smithi167.stdout:8/720: dread - dc/d56/d59/d82/d8f/d90/fc8 zero size 2024-09-17T01:41:31.065 INFO:tasks.workunit.client.1.smithi167.stdout:9/702: dwrite d4/d4a/f55 [0,4194304] 0 2024-09-17T01:41:31.069 INFO:tasks.workunit.client.1.smithi167.stdout:7/617: symlink d0/d2/d14/d19/d26/ld5 0 2024-09-17T01:41:31.069 INFO:tasks.workunit.client.0.smithi082.stdout:8/269: rename d3/dd/c1a to d3/dd/d18/c55 0 2024-09-17T01:41:31.071 INFO:tasks.workunit.client.0.smithi082.stdout:2/299: mkdir d1/d17/d38/d5c 0 2024-09-17T01:41:31.071 INFO:tasks.workunit.client.1.smithi167.stdout:0/581: rmdir d5/d6b/d77/d4d/d56 39 2024-09-17T01:41:31.078 INFO:tasks.workunit.client.0.smithi082.stdout:2/300: dwrite d1/d17/f21 [4194304,4194304] 0 2024-09-17T01:41:31.080 INFO:tasks.workunit.client.0.smithi082.stdout:5/368: truncate db/d1e/f52 3759635 0 2024-09-17T01:41:31.081 INFO:tasks.workunit.client.0.smithi082.stdout:2/301: write d1/f1f [3134935,95292] 0 2024-09-17T01:41:31.082 INFO:tasks.workunit.client.0.smithi082.stdout:8/270: write d3/dd/d18/d2d/f53 [583713,96700] 0 2024-09-17T01:41:31.082 INFO:tasks.workunit.client.0.smithi082.stdout:2/302: stat d1/d17/f18 0 2024-09-17T01:41:31.083 INFO:tasks.workunit.client.0.smithi082.stdout:5/369: chown db/d1e/d20/d30/c49 143783598 1 2024-09-17T01:41:31.086 INFO:tasks.workunit.client.1.smithi167.stdout:6/799: unlink d7/d54/d90/d13/d2f/d64/d6b/d95/f10a 0 2024-09-17T01:41:31.088 INFO:tasks.workunit.client.0.smithi082.stdout:4/316: rename d9/d15/d16/d44/c63 to d9/d15/d16/d18/d4a/d52/c65 0 2024-09-17T01:41:31.090 INFO:tasks.workunit.client.0.smithi082.stdout:1/384: truncate d2/da/f56 422758 0 2024-09-17T01:41:31.092 INFO:tasks.workunit.client.1.smithi167.stdout:6/800: dwrite d7/d54/d90/d13/d2f/d30/d32/fcf [0,4194304] 0 2024-09-17T01:41:31.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/271: read d3/dd/d18/f1e [194304,104138] 0 2024-09-17T01:41:31.096 INFO:tasks.workunit.client.1.smithi167.stdout:5/569: mkdir d0/d24/d2b/d3d/d3b/db0 0 2024-09-17T01:41:31.096 INFO:tasks.workunit.client.1.smithi167.stdout:8/721: creat dc/d21/d61/fe3 x:0 0 0 2024-09-17T01:41:31.103 INFO:tasks.workunit.client.0.smithi082.stdout:5/370: dread db/d56/d29/f3c [0,4194304] 0 2024-09-17T01:41:31.103 INFO:tasks.workunit.client.0.smithi082.stdout:8/272: dwrite d3/dd/d18/d2d/d3e/d43/f44 [0,4194304] 0 2024-09-17T01:41:31.104 INFO:tasks.workunit.client.0.smithi082.stdout:1/385: creat d2/d3f/d24/f7e x:0 0 0 2024-09-17T01:41:31.107 INFO:tasks.workunit.client.1.smithi167.stdout:3/677: rename f6 to d7/d8/d10/d14/d2c/d6f/fe0 0 2024-09-17T01:41:31.110 INFO:tasks.workunit.client.0.smithi082.stdout:8/273: dread d3/dd/d18/d2d/d3e/d43/f45 [0,4194304] 0 2024-09-17T01:41:31.111 INFO:tasks.workunit.client.0.smithi082.stdout:2/303: mknod d1/d5a/c5d 0 2024-09-17T01:41:31.116 INFO:tasks.workunit.client.1.smithi167.stdout:0/582: creat d5/d6b/fb9 x:0 0 0 2024-09-17T01:41:31.117 INFO:tasks.workunit.client.0.smithi082.stdout:8/274: dwrite d3/f7 [4194304,4194304] 0 2024-09-17T01:41:31.118 INFO:tasks.workunit.client.0.smithi082.stdout:4/317: creat d9/d15/d37/d45/f66 x:0 0 0 2024-09-17T01:41:31.124 INFO:tasks.workunit.client.1.smithi167.stdout:1/663: truncate d0/d5/d34/f63 2817259 0 2024-09-17T01:41:31.125 INFO:tasks.workunit.client.0.smithi082.stdout:4/318: dwrite d9/d15/d16/f2f [0,4194304] 0 2024-09-17T01:41:31.126 INFO:tasks.workunit.client.0.smithi082.stdout:4/319: dread - d9/d15/d37/d45/f51 zero size 2024-09-17T01:41:31.127 INFO:tasks.workunit.client.0.smithi082.stdout:5/371: rename db/d1e/d20/f3e to db/d2b/f79 0 2024-09-17T01:41:31.129 INFO:tasks.workunit.client.1.smithi167.stdout:1/664: dwrite d0/d5/d34/f70 [0,4194304] 0 2024-09-17T01:41:31.130 INFO:tasks.workunit.client.1.smithi167.stdout:1/665: readlink d0/d9/d16/d22/l5e 0 2024-09-17T01:41:31.131 INFO:tasks.workunit.client.1.smithi167.stdout:1/666: chown d0/d9/d16/d48/d54/d78/fc4 7261742 1 2024-09-17T01:41:31.133 INFO:tasks.workunit.client.1.smithi167.stdout:6/801: readlink d7/d52/d79/da4/l111 0 2024-09-17T01:41:31.133 INFO:tasks.workunit.client.1.smithi167.stdout:1/667: chown d0/d5/d34/f49 1329666 1 2024-09-17T01:41:31.134 INFO:tasks.workunit.client.1.smithi167.stdout:6/802: dread - d7/d52/d8c/ff3 zero size 2024-09-17T01:41:31.134 INFO:tasks.workunit.client.1.smithi167.stdout:9/703: mknod d4/d9/d21/cdb 0 2024-09-17T01:41:31.136 INFO:tasks.workunit.client.1.smithi167.stdout:9/704: write d4/d4a/fb3 [1220241,104352] 0 2024-09-17T01:41:31.140 INFO:tasks.workunit.client.1.smithi167.stdout:0/583: symlink d5/d6b/d77/d37/lba 0 2024-09-17T01:41:31.141 INFO:tasks.workunit.client.1.smithi167.stdout:0/584: fsync d5/d6b/d7e/fac 0 2024-09-17T01:41:31.144 INFO:tasks.workunit.client.0.smithi082.stdout:4/320: mknod d9/d15/d16/d18/d4a/d52/d55/d48/c67 0 2024-09-17T01:41:31.145 INFO:tasks.workunit.client.1.smithi167.stdout:4/648: creat d0/d4/d7/fd2 x:0 0 0 2024-09-17T01:41:31.152 INFO:tasks.workunit.client.1.smithi167.stdout:6/803: symlink d7/d52/l11a 0 2024-09-17T01:41:31.154 INFO:tasks.workunit.client.1.smithi167.stdout:1/668: creat d0/d5/d34/d3c/d74/fe3 x:0 0 0 2024-09-17T01:41:31.156 INFO:tasks.workunit.client.0.smithi082.stdout:1/386: creat d2/d3f/f7f x:0 0 0 2024-09-17T01:41:31.157 INFO:tasks.workunit.client.0.smithi082.stdout:1/387: dread - d2/d3f/f7f zero size 2024-09-17T01:41:31.157 INFO:tasks.workunit.client.1.smithi167.stdout:5/570: mkdir d0/d24/d2b/db1 0 2024-09-17T01:41:31.158 INFO:tasks.workunit.client.0.smithi082.stdout:1/388: chown d2/df/f1d 6828682 1 2024-09-17T01:41:31.158 INFO:tasks.workunit.client.1.smithi167.stdout:5/571: dread - d0/d24/d2b/d3d/d3b/f98 zero size 2024-09-17T01:41:31.159 INFO:tasks.workunit.client.0.smithi082.stdout:1/389: stat d2/da/d2f/d47/f51 0 2024-09-17T01:41:31.159 INFO:tasks.workunit.client.0.smithi082.stdout:4/321: creat d9/d15/d37/f68 x:0 0 0 2024-09-17T01:41:31.159 INFO:tasks.workunit.client.1.smithi167.stdout:5/572: dread - d0/d24/d2b/d4e/f9e zero size 2024-09-17T01:41:31.160 INFO:tasks.workunit.client.1.smithi167.stdout:9/705: creat d4/d9/d21/d81/fdc x:0 0 0 2024-09-17T01:41:31.160 INFO:tasks.workunit.client.0.smithi082.stdout:4/322: write d9/d15/d16/d18/d4a/d52/f59 [286590,22260] 0 2024-09-17T01:41:31.162 INFO:tasks.workunit.client.1.smithi167.stdout:8/722: mkdir dc/d56/d59/d82/d8f/d90/dba/dd3/de4 0 2024-09-17T01:41:31.163 INFO:tasks.workunit.client.0.smithi082.stdout:2/304: truncate d1/d10/f19 1693373 0 2024-09-17T01:41:31.163 INFO:tasks.workunit.client.0.smithi082.stdout:1/390: write d2/d3f/d24/f69 [341588,36633] 0 2024-09-17T01:41:31.164 INFO:tasks.workunit.client.1.smithi167.stdout:7/618: creat d0/d2/d14/d19/fd6 x:0 0 0 2024-09-17T01:41:31.165 INFO:tasks.workunit.client.1.smithi167.stdout:7/619: read - d0/d2/d14/d19/d7f/db4/dbf/fc1 zero size 2024-09-17T01:41:31.165 INFO:tasks.workunit.client.1.smithi167.stdout:0/585: rmdir d5 39 2024-09-17T01:41:31.166 INFO:tasks.workunit.client.0.smithi082.stdout:1/391: stat d2/cc 0 2024-09-17T01:41:31.167 INFO:tasks.workunit.client.0.smithi082.stdout:5/372: dwrite db/d1e/d20/d30/d47/f4e [0,4194304] 0 2024-09-17T01:41:31.167 INFO:tasks.workunit.client.1.smithi167.stdout:2/627: getdents d5/d10/d1a/d45/d8e/d98 0 2024-09-17T01:41:31.167 INFO:tasks.workunit.client.0.smithi082.stdout:1/392: dread - d2/d3f/d24/d54/f74 zero size 2024-09-17T01:41:31.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/305: fdatasync d1/d10/f28 0 2024-09-17T01:41:31.169 INFO:tasks.workunit.client.0.smithi082.stdout:2/306: fsync d1/d17/d29/f33 0 2024-09-17T01:41:31.170 INFO:tasks.workunit.client.1.smithi167.stdout:4/649: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/fd3 x:0 0 0 2024-09-17T01:41:31.172 INFO:tasks.workunit.client.0.smithi082.stdout:4/323: unlink d9/d15/f22 0 2024-09-17T01:41:31.173 INFO:tasks.workunit.client.1.smithi167.stdout:6/804: read d7/d54/d90/d13/d2f/d7f/fc5 [1135103,30974] 0 2024-09-17T01:41:31.175 INFO:tasks.workunit.client.1.smithi167.stdout:6/805: fdatasync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 0 2024-09-17T01:41:31.175 INFO:tasks.workunit.client.1.smithi167.stdout:1/669: fsync d0/d5/d34/d3c/fbc 0 2024-09-17T01:41:31.176 INFO:tasks.workunit.client.1.smithi167.stdout:1/670: chown d0/d5/d34/d83/da4 891 1 2024-09-17T01:41:31.181 INFO:tasks.workunit.client.0.smithi082.stdout:2/307: mknod d1/d17/c5e 0 2024-09-17T01:41:31.185 INFO:tasks.workunit.client.0.smithi082.stdout:4/324: chown d9/d15/d16 0 1 2024-09-17T01:41:31.185 INFO:tasks.workunit.client.0.smithi082.stdout:4/325: write d9/fd [2420358,778] 0 2024-09-17T01:41:31.189 INFO:tasks.workunit.client.0.smithi082.stdout:1/393: mkdir d2/da/d80 0 2024-09-17T01:41:31.190 INFO:tasks.workunit.client.0.smithi082.stdout:2/308: mknod d1/d17/d38/d42/c5f 0 2024-09-17T01:41:31.194 INFO:tasks.workunit.client.0.smithi082.stdout:1/394: write d2/da/d2d/f41 [3509860,45538] 0 2024-09-17T01:41:31.194 INFO:tasks.workunit.client.0.smithi082.stdout:2/309: mkdir d1/d17/d60 0 2024-09-17T01:41:31.196 INFO:tasks.workunit.client.0.smithi082.stdout:5/373: getdents db/d2b/d59 0 2024-09-17T01:41:31.197 INFO:tasks.workunit.client.0.smithi082.stdout:4/326: creat d9/d15/d37/d45/f69 x:0 0 0 2024-09-17T01:41:31.198 INFO:tasks.workunit.client.0.smithi082.stdout:1/395: creat d2/d3f/d24/f81 x:0 0 0 2024-09-17T01:41:31.201 INFO:tasks.workunit.client.0.smithi082.stdout:4/327: creat d9/d15/d16/d18/d4a/d52/f6a x:0 0 0 2024-09-17T01:41:31.201 INFO:tasks.workunit.client.0.smithi082.stdout:5/374: mknod db/d1e/d20/d4d/c7a 0 2024-09-17T01:41:31.201 INFO:tasks.workunit.client.1.smithi167.stdout:9/706: rmdir d4/d9/d21/d43/d6c/d9e/da1 39 2024-09-17T01:41:31.201 INFO:tasks.workunit.client.1.smithi167.stdout:8/723: rename dc/d56/d59/d82/d8f/d90 to dc/d56/d59/d82/d8f/de5 0 2024-09-17T01:41:31.202 INFO:tasks.workunit.client.0.smithi082.stdout:1/396: rmdir d2/da/d16 39 2024-09-17T01:41:31.202 INFO:tasks.workunit.client.1.smithi167.stdout:1/671: rename d0/d5/d34/d3c/d85/db5/dc1 to d0/d5/d34/d3c/d85/db5/dc1/de4 22 2024-09-17T01:41:31.203 INFO:tasks.workunit.client.1.smithi167.stdout:6/806: creat d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/f11b x:0 0 0 2024-09-17T01:41:31.203 INFO:tasks.workunit.client.0.smithi082.stdout:4/328: fsync d9/d15/f2e 0 2024-09-17T01:41:31.204 INFO:tasks.workunit.client.0.smithi082.stdout:2/310: dwrite d1/f1b [0,4194304] 0 2024-09-17T01:41:31.206 INFO:tasks.workunit.client.0.smithi082.stdout:5/375: unlink db/d56/d18/c28 0 2024-09-17T01:41:31.206 INFO:tasks.workunit.client.0.smithi082.stdout:0/254: sync 2024-09-17T01:41:31.207 INFO:tasks.workunit.client.0.smithi082.stdout:0/255: stat da/d1e/c44 0 2024-09-17T01:41:31.208 INFO:tasks.workunit.client.0.smithi082.stdout:5/376: fsync db/d56/d18/d23/f6c 0 2024-09-17T01:41:31.208 INFO:tasks.workunit.client.1.smithi167.stdout:5/573: creat d0/d24/d2b/fb2 x:0 0 0 2024-09-17T01:41:31.209 INFO:tasks.workunit.client.1.smithi167.stdout:5/574: write d0/f19 [4484762,83184] 0 2024-09-17T01:41:31.210 INFO:tasks.workunit.client.1.smithi167.stdout:2/628: dread d5/d10/d1a/d46/f4f [0,4194304] 0 2024-09-17T01:41:31.210 INFO:tasks.workunit.client.1.smithi167.stdout:5/575: read - d0/d24/d2b/d4e/fa0 zero size 2024-09-17T01:41:31.213 INFO:tasks.workunit.client.1.smithi167.stdout:0/586: symlink d5/lbb 0 2024-09-17T01:41:31.213 INFO:tasks.workunit.client.1.smithi167.stdout:5/576: chown d0/d24/d2b/d4e/fa0 231657838 1 2024-09-17T01:41:31.214 INFO:tasks.workunit.client.1.smithi167.stdout:4/650: dread d0/d4/f47 [0,4194304] 0 2024-09-17T01:41:31.215 INFO:tasks.workunit.client.0.smithi082.stdout:2/311: mkdir d1/d5a/d61 0 2024-09-17T01:41:31.219 INFO:tasks.workunit.client.0.smithi082.stdout:2/312: dread d1/d35/f24 [0,4194304] 0 2024-09-17T01:41:31.219 INFO:tasks.workunit.client.1.smithi167.stdout:1/672: creat d0/d9/d16/d48/d54/d6e/d7e/fe5 x:0 0 0 2024-09-17T01:41:31.219 INFO:tasks.workunit.client.0.smithi082.stdout:5/377: fsync f9 0 2024-09-17T01:41:31.220 INFO:tasks.workunit.client.0.smithi082.stdout:2/313: dread d1/d17/f3b [0,4194304] 0 2024-09-17T01:41:31.221 INFO:tasks.workunit.client.0.smithi082.stdout:5/378: stat db/d1e/d20/d4d/c7a 0 2024-09-17T01:41:31.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/256: creat da/d1b/d23/d4d/f5e x:0 0 0 2024-09-17T01:41:31.224 INFO:tasks.workunit.client.0.smithi082.stdout:0/257: write da/d1b/d23/d42/f4e [404929,36026] 0 2024-09-17T01:41:31.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/329: truncate d9/d15/d16/f36 2005670 0 2024-09-17T01:41:31.225 INFO:tasks.workunit.client.0.smithi082.stdout:4/330: chown d9/d15/d37/d4c/c56 30 1 2024-09-17T01:41:31.226 INFO:tasks.workunit.client.0.smithi082.stdout:5/379: dread db/f2d [0,4194304] 0 2024-09-17T01:41:31.229 INFO:tasks.workunit.client.1.smithi167.stdout:8/724: creat dc/d56/d59/d82/d8f/dbc/fe6 x:0 0 0 2024-09-17T01:41:31.232 INFO:tasks.workunit.client.0.smithi082.stdout:5/380: dwrite f9 [4194304,4194304] 0 2024-09-17T01:41:31.239 INFO:tasks.workunit.client.0.smithi082.stdout:0/258: read f8 [2238309,68841] 0 2024-09-17T01:41:31.239 INFO:tasks.workunit.client.0.smithi082.stdout:5/381: dwrite db/d56/f35 [0,4194304] 0 2024-09-17T01:41:31.240 INFO:tasks.workunit.client.0.smithi082.stdout:0/259: chown da/fe 26566805 1 2024-09-17T01:41:31.242 INFO:tasks.workunit.client.1.smithi167.stdout:3/678: sync 2024-09-17T01:41:31.245 INFO:tasks.workunit.client.0.smithi082.stdout:1/397: write d2/da/d2f/d47/f4d [3279766,89449] 0 2024-09-17T01:41:31.245 INFO:tasks.workunit.client.1.smithi167.stdout:9/707: dwrite d4/f16 [0,4194304] 0 2024-09-17T01:41:31.247 INFO:tasks.workunit.client.0.smithi082.stdout:2/314: symlink d1/l62 0 2024-09-17T01:41:31.249 INFO:tasks.workunit.client.1.smithi167.stdout:9/708: dread d4/d9/d21/d2d/d33/d90/dac/f68 [0,4194304] 0 2024-09-17T01:41:31.251 INFO:tasks.workunit.client.1.smithi167.stdout:8/725: mkdir dc/d56/d59/d82/de7 0 2024-09-17T01:41:31.254 INFO:tasks.workunit.client.1.smithi167.stdout:4/651: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/ld4 0 2024-09-17T01:41:31.254 INFO:tasks.workunit.client.0.smithi082.stdout:0/260: truncate f0 1602423 0 2024-09-17T01:41:31.261 INFO:tasks.workunit.client.1.smithi167.stdout:0/587: creat d5/d8/fbc x:0 0 0 2024-09-17T01:41:31.262 INFO:tasks.workunit.client.1.smithi167.stdout:0/588: stat d5/d6b/d77/d4d/f2b 0 2024-09-17T01:41:31.262 INFO:tasks.workunit.client.1.smithi167.stdout:0/589: stat d5/d8 0 2024-09-17T01:41:31.263 INFO:tasks.workunit.client.1.smithi167.stdout:5/577: link d0/l61 d0/d24/d2b/d49/d66/lb3 0 2024-09-17T01:41:31.264 INFO:tasks.workunit.client.1.smithi167.stdout:8/726: read dc/d18/f2d [432281,65358] 0 2024-09-17T01:41:31.264 INFO:tasks.workunit.client.1.smithi167.stdout:2/629: getdents d5/d10/d1a/d45/d8e 0 2024-09-17T01:41:31.265 INFO:tasks.workunit.client.1.smithi167.stdout:3/679: link d7/d8/d10/d29/f98 d7/d8/d10/d14/d66/d6c/fe1 0 2024-09-17T01:41:31.265 INFO:tasks.workunit.client.1.smithi167.stdout:9/709: symlink d4/d9/ldd 0 2024-09-17T01:41:31.266 INFO:tasks.workunit.client.1.smithi167.stdout:1/673: getdents d0/d5/d34/d3c/d74 0 2024-09-17T01:41:31.268 INFO:tasks.workunit.client.1.smithi167.stdout:0/590: creat d5/d6b/d77/d37/d80/fbd x:0 0 0 2024-09-17T01:41:31.271 INFO:tasks.workunit.client.1.smithi167.stdout:8/727: getdents dc/d56/d59/d82/db2 0 2024-09-17T01:41:31.272 INFO:tasks.workunit.client.1.smithi167.stdout:9/710: write d4/d9/d21/f3b [328801,25548] 0 2024-09-17T01:41:31.275 INFO:tasks.workunit.client.1.smithi167.stdout:6/807: dwrite d7/d54/d90/d34/f51 [0,4194304] 0 2024-09-17T01:41:31.275 INFO:tasks.workunit.client.1.smithi167.stdout:0/591: creat d5/d6b/d77/d37/fbe x:0 0 0 2024-09-17T01:41:31.277 INFO:tasks.workunit.client.1.smithi167.stdout:5/578: dwrite d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/f85 [0,4194304] 0 2024-09-17T01:41:31.280 INFO:tasks.workunit.client.1.smithi167.stdout:2/630: dwrite d5/d3c/d4c/d4d/fac [0,4194304] 0 2024-09-17T01:41:31.280 INFO:tasks.workunit.client.1.smithi167.stdout:8/728: creat dc/d21/d6b/d74/fe8 x:0 0 0 2024-09-17T01:41:31.280 INFO:tasks.workunit.client.1.smithi167.stdout:9/711: rmdir d4/d9/d21/d81/db9 39 2024-09-17T01:41:31.283 INFO:tasks.workunit.client.1.smithi167.stdout:0/592: fsync d5/d6b/d77/d92/fb4 0 2024-09-17T01:41:31.284 INFO:tasks.workunit.client.1.smithi167.stdout:5/579: fsync d0/d24/d2b/d49/d4b/dac/f52 0 2024-09-17T01:41:31.286 INFO:tasks.workunit.client.1.smithi167.stdout:0/593: read - d5/d6b/d77/d37/d45/fa1 zero size 2024-09-17T01:41:31.287 INFO:tasks.workunit.client.1.smithi167.stdout:5/580: chown d0/d9/f7a 3579 1 2024-09-17T01:41:31.288 INFO:tasks.workunit.client.1.smithi167.stdout:8/729: creat dc/d21/d61/fe9 x:0 0 0 2024-09-17T01:41:31.292 INFO:tasks.workunit.client.1.smithi167.stdout:5/581: chown d0/d24/d2b/d49/d4b/dac/d80 0 1 2024-09-17T01:41:31.293 INFO:tasks.workunit.client.1.smithi167.stdout:9/712: rename d4/d9/d21/d2d/d33/d3a/f3f to d4/d9/d21/d2d/d33/fde 0 2024-09-17T01:41:31.295 INFO:tasks.workunit.client.1.smithi167.stdout:6/808: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/f11b [0,4194304] 0 2024-09-17T01:41:31.297 INFO:tasks.workunit.client.1.smithi167.stdout:0/594: rename d5/d8/d9/c48 to d5/d6b/d77/d92/db8/cbf 0 2024-09-17T01:41:31.300 INFO:tasks.workunit.client.1.smithi167.stdout:1/674: dwrite d0/d5/d34/f63 [0,4194304] 0 2024-09-17T01:41:31.301 INFO:tasks.workunit.client.1.smithi167.stdout:6/809: chown d7/d52/db7/fe0 864720964 1 2024-09-17T01:41:31.301 INFO:tasks.workunit.client.1.smithi167.stdout:9/713: chown d4/d9/d21/d2d/d33/d80/c8a 133170 1 2024-09-17T01:41:31.303 INFO:tasks.workunit.client.1.smithi167.stdout:8/730: dwrite dc/ff [0,4194304] 0 2024-09-17T01:41:31.305 INFO:tasks.workunit.client.1.smithi167.stdout:8/731: fsync dc/fd 0 2024-09-17T01:41:31.307 INFO:tasks.workunit.client.1.smithi167.stdout:0/595: creat d5/d6b/d77/d92/fc0 x:0 0 0 2024-09-17T01:41:31.307 INFO:tasks.workunit.client.1.smithi167.stdout:5/582: getdents d0/d24/d2b/d49/d4b/dac/d80 0 2024-09-17T01:41:31.310 INFO:tasks.workunit.client.1.smithi167.stdout:8/732: write dc/d21/d6b/d74/fe8 [30390,9448] 0 2024-09-17T01:41:31.312 INFO:tasks.workunit.client.1.smithi167.stdout:5/583: truncate d0/d9/f7a 1308261 0 2024-09-17T01:41:31.313 INFO:tasks.workunit.client.1.smithi167.stdout:6/810: rename d7/d52/d79/da4/ce5 to d7/d54/d90/d13/d2f/d30/d88/c11c 0 2024-09-17T01:41:31.313 INFO:tasks.workunit.client.1.smithi167.stdout:2/631: truncate d5/d33/d48/f80 129421 0 2024-09-17T01:41:31.314 INFO:tasks.workunit.client.1.smithi167.stdout:5/584: read - d0/d9/fa7 zero size 2024-09-17T01:41:31.315 INFO:tasks.workunit.client.1.smithi167.stdout:9/714: dwrite d4/d9/d21/d43/f7d [0,4194304] 0 2024-09-17T01:41:31.318 INFO:tasks.workunit.client.1.smithi167.stdout:8/733: rmdir dc/dae 39 2024-09-17T01:41:31.323 INFO:tasks.workunit.client.1.smithi167.stdout:6/811: mknod d7/d54/d90/d13/d2f/d64/d6b/dbc/c11d 0 2024-09-17T01:41:31.323 INFO:tasks.workunit.client.1.smithi167.stdout:5/585: dread d0/d54/f75 [0,4194304] 0 2024-09-17T01:41:31.324 INFO:tasks.workunit.client.1.smithi167.stdout:9/715: symlink d4/d9/d97/ldf 0 2024-09-17T01:41:31.324 INFO:tasks.workunit.client.1.smithi167.stdout:8/734: mkdir dc/d21/d61/dea 0 2024-09-17T01:41:31.326 INFO:tasks.workunit.client.1.smithi167.stdout:1/675: dwrite d0/d9/d16/d22/f66 [0,4194304] 0 2024-09-17T01:41:31.330 INFO:tasks.workunit.client.1.smithi167.stdout:6/812: unlink d7/d54/d90/d13/d2f/d30/c108 0 2024-09-17T01:41:31.330 INFO:tasks.workunit.client.1.smithi167.stdout:2/632: link d5/d10/d1a/db8/d5e/l82 d5/ldc 0 2024-09-17T01:41:31.334 INFO:tasks.workunit.client.1.smithi167.stdout:1/676: dwrite d0/d9/d16/d48/d54/d6e/fd2 [0,4194304] 0 2024-09-17T01:41:31.335 INFO:tasks.workunit.client.1.smithi167.stdout:9/716: rename d4/d9/d21/cc3 to d4/d9/ce0 0 2024-09-17T01:41:31.336 INFO:tasks.workunit.client.1.smithi167.stdout:6/813: creat d7/d54/f11e x:0 0 0 2024-09-17T01:41:31.338 INFO:tasks.workunit.client.1.smithi167.stdout:8/735: link dc/f29 dc/d56/d57/d5c/feb 0 2024-09-17T01:41:31.339 INFO:tasks.workunit.client.1.smithi167.stdout:2/633: creat d5/d10/d16/fdd x:0 0 0 2024-09-17T01:41:31.341 INFO:tasks.workunit.client.1.smithi167.stdout:0/596: truncate d5/f83 983189 0 2024-09-17T01:41:31.343 INFO:tasks.workunit.client.1.smithi167.stdout:8/736: mkdir dc/d56/d59/d82/d8f/de5/dba/dd3/de4/dec 0 2024-09-17T01:41:31.345 INFO:tasks.workunit.client.1.smithi167.stdout:0/597: readlink d5/d8/d9/d2f/d9b/la8 0 2024-09-17T01:41:31.345 INFO:tasks.workunit.client.1.smithi167.stdout:2/634: dwrite d5/d10/d1a/d2e/f51 [0,4194304] 0 2024-09-17T01:41:31.347 INFO:tasks.workunit.client.1.smithi167.stdout:9/717: link d4/d9/d21/d43/d6c/d9e/da1/dbc/fd1 d4/d9/d21/d81/fe1 0 2024-09-17T01:41:31.348 INFO:tasks.workunit.client.1.smithi167.stdout:0/598: creat d5/d6b/d7e/fc1 x:0 0 0 2024-09-17T01:41:31.349 INFO:tasks.workunit.client.1.smithi167.stdout:2/635: read d5/d10/d1a/d45/d8e/f64 [901563,103500] 0 2024-09-17T01:41:31.352 INFO:tasks.workunit.client.1.smithi167.stdout:9/718: write d4/d9/d21/d43/d6c/f8f [2825344,91858] 0 2024-09-17T01:41:31.355 INFO:tasks.workunit.client.1.smithi167.stdout:8/737: dwrite dc/d1a/f73 [0,4194304] 0 2024-09-17T01:41:31.357 INFO:tasks.workunit.client.1.smithi167.stdout:0/599: getdents d5/d6b/d77/d6d/d90 0 2024-09-17T01:41:31.360 INFO:tasks.workunit.client.0.smithi082.stdout:2/315: truncate d1/d10/f2f 43725 0 2024-09-17T01:41:31.360 INFO:tasks.workunit.client.0.smithi082.stdout:4/331: creat d9/d15/f6b x:0 0 0 2024-09-17T01:41:31.361 INFO:tasks.workunit.client.0.smithi082.stdout:5/382: mkdir db/d1e/d20/d30/d47/d7b 0 2024-09-17T01:41:31.364 INFO:tasks.workunit.client.0.smithi082.stdout:0/261: rmdir da/df/d2b 39 2024-09-17T01:41:31.365 INFO:tasks.workunit.client.0.smithi082.stdout:0/262: stat da 0 2024-09-17T01:41:31.365 INFO:tasks.workunit.client.0.smithi082.stdout:2/316: creat d1/d5a/f63 x:0 0 0 2024-09-17T01:41:31.366 INFO:tasks.workunit.client.1.smithi167.stdout:5/586: dwrite d0/d24/d2b/d49/d4b/f55 [0,4194304] 0 2024-09-17T01:41:31.366 INFO:tasks.workunit.client.1.smithi167.stdout:2/636: dwrite d5/d3c/d4c/d4d/fc9 [0,4194304] 0 2024-09-17T01:41:31.367 INFO:tasks.workunit.client.0.smithi082.stdout:1/398: dwrite d2/d3f/f5a [0,4194304] 0 2024-09-17T01:41:31.368 INFO:tasks.workunit.client.0.smithi082.stdout:2/317: truncate d1/d17/d38/d42/f43 292125 0 2024-09-17T01:41:31.369 INFO:tasks.workunit.client.1.smithi167.stdout:2/637: dread - d5/d10/d1a/d2e/f7d zero size 2024-09-17T01:41:31.369 INFO:tasks.workunit.client.0.smithi082.stdout:1/399: dread - d2/d3f/d24/d54/f66 zero size 2024-09-17T01:41:31.371 INFO:tasks.workunit.client.1.smithi167.stdout:2/638: chown d5/f44 39214773 1 2024-09-17T01:41:31.371 INFO:tasks.workunit.client.1.smithi167.stdout:8/738: unlink dc/d21/d6b/d74/d83/dc0/dc7/cdb 0 2024-09-17T01:41:31.377 INFO:tasks.workunit.client.0.smithi082.stdout:5/383: creat db/d1e/d20/d30/f7c x:0 0 0 2024-09-17T01:41:31.377 INFO:tasks.workunit.client.1.smithi167.stdout:0/600: dwrite d5/d6b/d7e/fac [0,4194304] 0 2024-09-17T01:41:31.380 INFO:tasks.workunit.client.1.smithi167.stdout:9/719: link d4/d9/d21/d2d/d33/d80/fc7 d4/d9/d21/d2d/dae/fe2 0 2024-09-17T01:41:31.382 INFO:tasks.workunit.client.1.smithi167.stdout:9/720: write d4/d9/d21/d2d/d33/d80/fcf [824357,32323] 0 2024-09-17T01:41:31.384 INFO:tasks.workunit.client.1.smithi167.stdout:9/721: chown d4/f16 296564 1 2024-09-17T01:41:31.385 INFO:tasks.workunit.client.1.smithi167.stdout:5/587: mknod d0/cb4 0 2024-09-17T01:41:31.385 INFO:tasks.workunit.client.0.smithi082.stdout:5/384: dwrite db/d56/d29/f68 [0,4194304] 0 2024-09-17T01:41:31.385 INFO:tasks.workunit.client.1.smithi167.stdout:5/588: chown d0/d24/d2b/d49/d4b/dac 2149400 1 2024-09-17T01:41:31.393 INFO:tasks.workunit.client.0.smithi082.stdout:2/318: creat d1/d17/d38/d5c/f64 x:0 0 0 2024-09-17T01:41:31.396 INFO:tasks.workunit.client.0.smithi082.stdout:1/400: fsync d2/d3f/f13 0 2024-09-17T01:41:31.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/401: truncate d2/d3f/d24/f68 766583 0 2024-09-17T01:41:31.404 INFO:tasks.workunit.client.0.smithi082.stdout:4/332: link d9/d15/c29 d9/d15/d16/d44/c6c 0 2024-09-17T01:41:31.405 INFO:tasks.workunit.client.0.smithi082.stdout:1/402: dwrite d2/d3f/f5a [4194304,4194304] 0 2024-09-17T01:41:31.406 INFO:tasks.workunit.client.1.smithi167.stdout:5/589: mkdir d0/d24/d2b/d3d/d3b/db0/db5 0 2024-09-17T01:41:31.406 INFO:tasks.workunit.client.0.smithi082.stdout:4/333: truncate d9/fd 5147538 0 2024-09-17T01:41:31.407 INFO:tasks.workunit.client.0.smithi082.stdout:1/403: dread - d2/d3f/d34/f59 zero size 2024-09-17T01:41:31.410 INFO:tasks.workunit.client.1.smithi167.stdout:0/601: creat d5/d8/fc2 x:0 0 0 2024-09-17T01:41:31.413 INFO:tasks.workunit.client.1.smithi167.stdout:7/620: sync 2024-09-17T01:41:31.413 INFO:tasks.workunit.client.1.smithi167.stdout:2/639: getdents d5/d3c/d4c/d4d/d91 0 2024-09-17T01:41:31.415 INFO:tasks.workunit.client.0.smithi082.stdout:2/319: creat d1/d35/f65 x:0 0 0 2024-09-17T01:41:31.416 INFO:tasks.workunit.client.0.smithi082.stdout:1/404: dwrite d2/da/d2f/d47/f4d [0,4194304] 0 2024-09-17T01:41:31.418 INFO:tasks.workunit.client.1.smithi167.stdout:5/590: creat d0/d24/d2b/d3d/d3b/db0/db5/fb6 x:0 0 0 2024-09-17T01:41:31.421 INFO:tasks.workunit.client.1.smithi167.stdout:0/602: creat d5/d6b/d77/daa/fc3 x:0 0 0 2024-09-17T01:41:31.427 INFO:tasks.workunit.client.1.smithi167.stdout:9/722: dread d4/f4e [0,4194304] 0 2024-09-17T01:41:31.427 INFO:tasks.workunit.client.1.smithi167.stdout:2/640: rename d5/d10/d1a to d5/d3c/dde 0 2024-09-17T01:41:31.430 INFO:tasks.workunit.client.1.smithi167.stdout:8/739: write dc/d18/f33 [3698730,21841] 0 2024-09-17T01:41:31.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/405: rename d2/d3f/d34/l42 to d2/da/d2d/d79/l82 0 2024-09-17T01:41:31.435 INFO:tasks.workunit.client.0.smithi082.stdout:4/334: link d9/d15/c35 d9/d15/d16/d44/c6d 0 2024-09-17T01:41:31.437 INFO:tasks.workunit.client.0.smithi082.stdout:5/385: truncate db/d56/d18/f4a 173438 0 2024-09-17T01:41:31.439 INFO:tasks.workunit.client.1.smithi167.stdout:2/641: unlink d5/d3c/dde/d2e/f3b 0 2024-09-17T01:41:31.440 INFO:tasks.workunit.client.0.smithi082.stdout:1/406: rmdir d2/da/d2f/d47 39 2024-09-17T01:41:31.442 INFO:tasks.workunit.client.1.smithi167.stdout:5/591: mknod d0/d24/d2b/d49/d4b/dac/cb7 0 2024-09-17T01:41:31.443 INFO:tasks.workunit.client.1.smithi167.stdout:5/592: write d0/f19 [4670463,30158] 0 2024-09-17T01:41:31.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/320: dread d1/f16 [0,4194304] 0 2024-09-17T01:41:31.445 INFO:tasks.workunit.client.1.smithi167.stdout:8/740: mkdir dc/d56/d59/d82/d85/ded 0 2024-09-17T01:41:31.447 INFO:tasks.workunit.client.0.smithi082.stdout:1/407: dwrite d2/d3f/d24/f69 [4194304,4194304] 0 2024-09-17T01:41:31.449 INFO:tasks.workunit.client.0.smithi082.stdout:1/408: dread - d2/d3f/d24/f7e zero size 2024-09-17T01:41:31.452 INFO:tasks.workunit.client.1.smithi167.stdout:7/621: rmdir d0/d2/d14/d6f/d87/dae/daf 0 2024-09-17T01:41:31.454 INFO:tasks.workunit.client.0.smithi082.stdout:4/335: creat d9/d15/d16/d18/d4f/f6e x:0 0 0 2024-09-17T01:41:31.456 INFO:tasks.workunit.client.0.smithi082.stdout:5/386: dwrite db/d56/d18/d23/f65 [0,4194304] 0 2024-09-17T01:41:31.456 INFO:tasks.workunit.client.1.smithi167.stdout:7/622: read d0/d2/f7a [3741549,129690] 0 2024-09-17T01:41:31.456 INFO:tasks.workunit.client.1.smithi167.stdout:4/652: sync 2024-09-17T01:41:31.456 INFO:tasks.workunit.client.1.smithi167.stdout:1/677: sync 2024-09-17T01:41:31.457 INFO:tasks.workunit.client.1.smithi167.stdout:3/680: sync 2024-09-17T01:41:31.458 INFO:tasks.workunit.client.0.smithi082.stdout:5/387: dread - db/d1e/d20/d30/f7c zero size 2024-09-17T01:41:31.459 INFO:tasks.workunit.client.0.smithi082.stdout:5/388: chown db/f2d 0 1 2024-09-17T01:41:31.461 INFO:tasks.workunit.client.1.smithi167.stdout:2/642: symlink d5/d33/d48/d72/d94/ldf 0 2024-09-17T01:41:31.464 INFO:tasks.workunit.client.1.smithi167.stdout:0/603: write d5/d8/f46 [1150718,67727] 0 2024-09-17T01:41:31.466 INFO:tasks.workunit.client.1.smithi167.stdout:4/653: dwrite d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/fd3 [0,4194304] 0 2024-09-17T01:41:31.469 INFO:tasks.workunit.client.0.smithi082.stdout:2/321: truncate d1/d10/f19 685186 0 2024-09-17T01:41:31.470 INFO:tasks.workunit.client.0.smithi082.stdout:1/409: symlink d2/da/d80/l83 0 2024-09-17T01:41:31.471 INFO:tasks.workunit.client.0.smithi082.stdout:1/410: readlink d2/d3f/l6d 0 2024-09-17T01:41:31.472 INFO:tasks.workunit.client.1.smithi167.stdout:0/604: dread d5/d8/f44 [0,4194304] 0 2024-09-17T01:41:31.474 INFO:tasks.workunit.client.1.smithi167.stdout:9/723: creat d4/d9/d21/d43/d6c/d9e/fe3 x:0 0 0 2024-09-17T01:41:31.476 INFO:tasks.workunit.client.1.smithi167.stdout:3/681: mknod d7/d8/d10/d14/d66/d6c/d7c/ce2 0 2024-09-17T01:41:31.477 INFO:tasks.workunit.client.1.smithi167.stdout:4/654: dwrite d0/d4/fb1 [0,4194304] 0 2024-09-17T01:41:31.477 INFO:tasks.workunit.client.0.smithi082.stdout:1/411: chown d2/da/d2f/c67 8879 1 2024-09-17T01:41:31.478 INFO:tasks.workunit.client.0.smithi082.stdout:1/412: fdatasync d2/f5f 0 2024-09-17T01:41:31.479 INFO:tasks.workunit.client.1.smithi167.stdout:2/643: creat d5/d3c/dde/d45/d8e/fe0 x:0 0 0 2024-09-17T01:41:31.480 INFO:tasks.workunit.client.0.smithi082.stdout:4/336: rename d9/d47/f5d to d9/d15/f6f 0 2024-09-17T01:41:31.481 INFO:tasks.workunit.client.1.smithi167.stdout:8/741: dread dc/d21/d6b/d74/f92 [0,4194304] 0 2024-09-17T01:41:31.481 INFO:tasks.workunit.client.1.smithi167.stdout:4/655: readlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d74/lc5 0 2024-09-17T01:41:31.483 INFO:tasks.workunit.client.1.smithi167.stdout:5/593: write d0/d9/d1c/f23 [9484948,89921] 0 2024-09-17T01:41:31.489 INFO:tasks.workunit.client.1.smithi167.stdout:0/605: mkdir d5/d6b/d77/d6d/d90/dc4 0 2024-09-17T01:41:31.491 INFO:tasks.workunit.client.1.smithi167.stdout:8/742: dwrite dc/d21/d6b/d74/fe8 [0,4194304] 0 2024-09-17T01:41:31.491 INFO:tasks.workunit.client.1.smithi167.stdout:0/606: fdatasync d5/d6b/d77/d6d/f8e 0 2024-09-17T01:41:31.492 INFO:tasks.workunit.client.1.smithi167.stdout:4/656: dwrite d0/f13 [0,4194304] 0 2024-09-17T01:41:31.495 INFO:tasks.workunit.client.1.smithi167.stdout:1/678: dread d0/d5/d34/d6d/fba [0,4194304] 0 2024-09-17T01:41:31.497 INFO:tasks.workunit.client.1.smithi167.stdout:6/814: sync 2024-09-17T01:41:31.505 INFO:tasks.workunit.client.1.smithi167.stdout:1/679: dwrite d0/d5/d34/d3c/d74/fe3 [0,4194304] 0 2024-09-17T01:41:31.522 INFO:tasks.workunit.client.1.smithi167.stdout:0/607: dread d5/d8/d9/f39 [0,4194304] 0 2024-09-17T01:41:31.523 INFO:tasks.workunit.client.1.smithi167.stdout:0/608: chown d5/d6b/f5d 104 1 2024-09-17T01:41:31.524 INFO:tasks.workunit.client.1.smithi167.stdout:0/609: chown d5/d8/d9/d2f/c5e 25143 1 2024-09-17T01:41:31.549 INFO:tasks.workunit.client.0.smithi082.stdout:7/316: sync 2024-09-17T01:41:31.576 INFO:tasks.workunit.client.0.smithi082.stdout:2/322: getdents d1/d17/d38/d42/d52 0 2024-09-17T01:41:31.580 INFO:tasks.workunit.client.1.smithi167.stdout:9/724: mkdir d4/d9/d21/d2d/de4 0 2024-09-17T01:41:31.580 INFO:tasks.workunit.client.1.smithi167.stdout:9/725: fdatasync d4/d9/d21/fc8 0 2024-09-17T01:41:31.649 INFO:tasks.workunit.client.0.smithi082.stdout:6/394: sync 2024-09-17T01:41:31.664 INFO:tasks.workunit.client.0.smithi082.stdout:7/317: mknod d0/d3/d36/c66 0 2024-09-17T01:41:31.666 INFO:tasks.workunit.client.1.smithi167.stdout:2/644: mknod d5/d3c/dde/db8/da3/db0/ce1 0 2024-09-17T01:41:31.666 INFO:tasks.workunit.client.0.smithi082.stdout:4/337: link d9/d15/d16/d18/f32 d9/d2b/f70 0 2024-09-17T01:41:31.671 INFO:tasks.workunit.client.1.smithi167.stdout:2/645: dwrite d5/d3c/dde/d2e/f7d [0,4194304] 0 2024-09-17T01:41:31.671 INFO:tasks.workunit.client.1.smithi167.stdout:5/594: symlink d0/d24/d2b/d3d/d3b/d92/lb8 0 2024-09-17T01:41:31.672 INFO:tasks.workunit.client.1.smithi167.stdout:5/595: dread - d0/d24/d2b/d3d/d3b/db0/db5/fb6 zero size 2024-09-17T01:41:31.673 INFO:tasks.workunit.client.0.smithi082.stdout:1/413: dwrite d2/d3f/f26 [4194304,4194304] 0 2024-09-17T01:41:31.676 INFO:tasks.workunit.client.1.smithi167.stdout:8/743: rename dc/d21/d6b/d74/d83/dc0/dc7/ddd to dc/d21/d6b/dee 0 2024-09-17T01:41:31.679 INFO:tasks.workunit.client.1.smithi167.stdout:8/744: fsync dc/d21/d61/f6f 0 2024-09-17T01:41:31.681 INFO:tasks.workunit.client.1.smithi167.stdout:2/646: dwrite d5/d33/d48/d72/d94/faf [4194304,4194304] 0 2024-09-17T01:41:31.682 INFO:tasks.workunit.client.1.smithi167.stdout:7/623: dwrite d0/d2/d14/d23/f7b [0,4194304] 0 2024-09-17T01:41:31.682 INFO:tasks.workunit.client.1.smithi167.stdout:1/680: mkdir d0/d9/d16/d48/de6 0 2024-09-17T01:41:31.689 INFO:tasks.workunit.client.1.smithi167.stdout:1/681: dread d0/d5/d34/d3c/d74/fe3 [0,4194304] 0 2024-09-17T01:41:31.690 INFO:tasks.workunit.client.1.smithi167.stdout:9/726: write d4/d9/d21/d43/d6c/d9e/da1/dbc/fc1 [555025,106795] 0 2024-09-17T01:41:31.691 INFO:tasks.workunit.client.1.smithi167.stdout:1/682: truncate d0/d5/f8d 748848 0 2024-09-17T01:41:31.697 INFO:tasks.workunit.client.0.smithi082.stdout:6/395: mknod d1/d7/d10/d4f/dc/d1d/d2c/c93 0 2024-09-17T01:41:31.698 INFO:tasks.workunit.client.0.smithi082.stdout:2/323: getdents d1/d17/d29/d50 0 2024-09-17T01:41:31.703 INFO:tasks.workunit.client.1.smithi167.stdout:8/745: mkdir dc/d56/d57/dc2/def 0 2024-09-17T01:41:31.705 INFO:tasks.workunit.client.0.smithi082.stdout:7/318: rename d0/l8 to d0/d3/d36/d37/l67 0 2024-09-17T01:41:31.706 INFO:tasks.workunit.client.1.smithi167.stdout:0/610: creat d5/d8/da4/fc5 x:0 0 0 2024-09-17T01:41:31.708 INFO:tasks.workunit.client.1.smithi167.stdout:9/727: dread d4/d9/d21/d43/d6c/f8f [0,4194304] 0 2024-09-17T01:41:31.712 INFO:tasks.workunit.client.0.smithi082.stdout:7/319: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:31.713 INFO:tasks.workunit.client.1.smithi167.stdout:5/596: creat d0/d24/d2b/db1/fb9 x:0 0 0 2024-09-17T01:41:31.714 INFO:tasks.workunit.client.1.smithi167.stdout:0/611: dwrite d5/f1d [8388608,4194304] 0 2024-09-17T01:41:31.714 INFO:tasks.workunit.client.1.smithi167.stdout:8/746: creat dc/d56/d57/ff0 x:0 0 0 2024-09-17T01:41:31.715 INFO:tasks.workunit.client.1.smithi167.stdout:3/682: truncate d7/d8/d10/fa8 9709 0 2024-09-17T01:41:31.716 INFO:tasks.workunit.client.1.smithi167.stdout:8/747: stat dc/d56/f9b 0 2024-09-17T01:41:31.717 INFO:tasks.workunit.client.1.smithi167.stdout:0/612: dread - d5/d8/f97 zero size 2024-09-17T01:41:31.720 INFO:tasks.workunit.client.1.smithi167.stdout:9/728: dwrite d4/d9/d21/d43/f69 [4194304,4194304] 0 2024-09-17T01:41:31.723 INFO:tasks.workunit.client.1.smithi167.stdout:7/624: creat d0/d2/d14/fd7 x:0 0 0 2024-09-17T01:41:31.727 INFO:tasks.workunit.client.0.smithi082.stdout:6/396: dwrite d1/d7/f5c [4194304,4194304] 0 2024-09-17T01:41:31.727 INFO:tasks.workunit.client.1.smithi167.stdout:8/748: mkdir dc/d21/d6b/d74/d83/dc0/df1 0 2024-09-17T01:41:31.729 INFO:tasks.workunit.client.0.smithi082.stdout:2/324: write d1/fd [3015721,117175] 0 2024-09-17T01:41:31.729 INFO:tasks.workunit.client.0.smithi082.stdout:4/338: dread d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:31.731 INFO:tasks.workunit.client.1.smithi167.stdout:3/683: dread d7/d8/d10/d14/d24/f7d [0,4194304] 0 2024-09-17T01:41:31.731 INFO:tasks.workunit.client.1.smithi167.stdout:9/729: chown d4/d9/d21/d2d/d33/d3a/l95 41027 1 2024-09-17T01:41:31.732 INFO:tasks.workunit.client.1.smithi167.stdout:4/657: rename d0/d4/d7/l55 to d0/d4/d7/d10/ld5 0 2024-09-17T01:41:31.733 INFO:tasks.workunit.client.1.smithi167.stdout:5/597: dwrite d0/d24/f62 [0,4194304] 0 2024-09-17T01:41:31.734 INFO:tasks.workunit.client.0.smithi082.stdout:1/414: truncate d2/d3f/f5a 7824077 0 2024-09-17T01:41:31.735 INFO:tasks.workunit.client.1.smithi167.stdout:9/730: chown d4/d9/d21/f3b 11332368 1 2024-09-17T01:41:31.735 INFO:tasks.workunit.client.0.smithi082.stdout:6/397: dwrite d1/d7/d10/f8c [0,4194304] 0 2024-09-17T01:41:31.737 INFO:tasks.workunit.client.1.smithi167.stdout:5/598: fdatasync d0/d24/fab 0 2024-09-17T01:41:31.738 INFO:tasks.workunit.client.1.smithi167.stdout:1/683: dread d0/d5/d34/d3c/f2b [8388608,4194304] 0 2024-09-17T01:41:31.743 INFO:tasks.workunit.client.1.smithi167.stdout:0/613: truncate d5/d6b/d77/daa/fad 3901562 0 2024-09-17T01:41:31.745 INFO:tasks.workunit.client.0.smithi082.stdout:2/325: truncate d1/d10/f2f 698044 0 2024-09-17T01:41:31.747 INFO:tasks.workunit.client.1.smithi167.stdout:6/815: rename d7/d54/d90/d13/d2f/d7f/d98/f40 to d7/d54/d90/d13/d2f/d64/d6b/f11f 0 2024-09-17T01:41:31.748 INFO:tasks.workunit.client.0.smithi082.stdout:7/320: dwrite d0/dd/d2c/f40 [0,4194304] 0 2024-09-17T01:41:31.749 INFO:tasks.workunit.client.1.smithi167.stdout:3/684: stat d7/d8/d10/d14/d2c/d74/c8c 0 2024-09-17T01:41:31.750 INFO:tasks.workunit.client.0.smithi082.stdout:4/339: unlink d9/d15/d16/d44/c6c 0 2024-09-17T01:41:31.751 INFO:tasks.workunit.client.1.smithi167.stdout:9/731: write d4/d9/d21/d43/d6c/f8f [4966987,74758] 0 2024-09-17T01:41:31.753 INFO:tasks.workunit.client.0.smithi082.stdout:6/398: dread d1/d7/d10/d4f/dc/d1d/d36/f67 [0,4194304] 0 2024-09-17T01:41:31.753 INFO:tasks.workunit.client.1.smithi167.stdout:9/732: write d4/d9/d21/d43/d6c/d9e/da1/fa6 [49773,33157] 0 2024-09-17T01:41:31.755 INFO:tasks.workunit.client.1.smithi167.stdout:9/733: fdatasync d4/d9/f4c 0 2024-09-17T01:41:31.760 INFO:tasks.workunit.client.1.smithi167.stdout:7/625: unlink d0/d2/d14/d19/d22/f25 0 2024-09-17T01:41:31.761 INFO:tasks.workunit.client.1.smithi167.stdout:5/599: dread d0/d24/d2b/d49/d4b/dac/f5b [0,4194304] 0 2024-09-17T01:41:31.762 INFO:tasks.workunit.client.0.smithi082.stdout:6/399: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 [0,4194304] 0 2024-09-17T01:41:31.764 INFO:tasks.workunit.client.0.smithi082.stdout:7/321: creat d0/d50/f68 x:0 0 0 2024-09-17T01:41:31.765 INFO:tasks.workunit.client.1.smithi167.stdout:6/816: fsync d7/d54/d90/d13/d2f/f7a 0 2024-09-17T01:41:31.768 INFO:tasks.workunit.client.1.smithi167.stdout:5/600: dwrite d0/d24/d2b/fa9 [0,4194304] 0 2024-09-17T01:41:31.769 INFO:tasks.workunit.client.0.smithi082.stdout:6/400: mknod d1/d7/d10/d4f/dc/d2b/d48/c94 0 2024-09-17T01:41:31.770 INFO:tasks.workunit.client.1.smithi167.stdout:5/601: dread - d0/d24/d2b/d3d/d3b/db0/db5/fb6 zero size 2024-09-17T01:41:31.773 INFO:tasks.workunit.client.0.smithi082.stdout:6/401: chown d1/d7/d10/d4f/l89 25804 1 2024-09-17T01:41:31.775 INFO:tasks.workunit.client.0.smithi082.stdout:6/402: dread d1/f63 [0,4194304] 0 2024-09-17T01:41:31.775 INFO:tasks.workunit.client.1.smithi167.stdout:4/658: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/dac 0 2024-09-17T01:41:31.776 INFO:tasks.workunit.client.0.smithi082.stdout:6/403: read - d1/d3/f7b zero size 2024-09-17T01:41:31.776 INFO:tasks.workunit.client.1.smithi167.stdout:7/626: chown d0/d2/d14/d23/f58 215624960 1 2024-09-17T01:41:31.777 INFO:tasks.workunit.client.0.smithi082.stdout:6/404: chown d1/d7/c34 58 1 2024-09-17T01:41:31.777 INFO:tasks.workunit.client.0.smithi082.stdout:7/322: rename d0/d50/f68 to d0/dd/d2c/d54/f69 0 2024-09-17T01:41:31.777 INFO:tasks.workunit.client.1.smithi167.stdout:0/614: dread d5/d6b/d77/f54 [0,4194304] 0 2024-09-17T01:41:31.777 INFO:tasks.workunit.client.0.smithi082.stdout:6/405: stat d1/d3/f7b 0 2024-09-17T01:41:31.778 INFO:tasks.workunit.client.1.smithi167.stdout:7/627: write d0/d2/d14/d19/d26/f85 [2424145,60308] 0 2024-09-17T01:41:31.779 INFO:tasks.workunit.client.1.smithi167.stdout:0/615: chown d5/d6b/d77/d4d/f22 207535797 1 2024-09-17T01:41:31.780 INFO:tasks.workunit.client.1.smithi167.stdout:1/684: dread d0/f2e [0,4194304] 0 2024-09-17T01:41:31.784 INFO:tasks.workunit.client.1.smithi167.stdout:3/685: mknod d7/ce3 0 2024-09-17T01:41:31.785 INFO:tasks.workunit.client.1.smithi167.stdout:7/628: dwrite d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:31.786 INFO:tasks.workunit.client.0.smithi082.stdout:6/406: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95 0 2024-09-17T01:41:31.787 INFO:tasks.workunit.client.0.smithi082.stdout:7/323: creat d0/dd/d34/d58/f6a x:0 0 0 2024-09-17T01:41:31.788 INFO:tasks.workunit.client.0.smithi082.stdout:7/324: fdatasync d0/d3/db/f18 0 2024-09-17T01:41:31.789 INFO:tasks.workunit.client.1.smithi167.stdout:5/602: readlink d0/d9/d64/d95/l97 0 2024-09-17T01:41:31.791 INFO:tasks.workunit.client.0.smithi082.stdout:2/326: truncate d1/d10/f2f 1154249 0 2024-09-17T01:41:31.796 INFO:tasks.workunit.client.0.smithi082.stdout:6/407: dread d1/d7/f24 [0,4194304] 0 2024-09-17T01:41:31.797 INFO:tasks.workunit.client.1.smithi167.stdout:2/647: rename d5/d3c/dde to d5/d3c/d4c/de2 0 2024-09-17T01:41:31.797 INFO:tasks.workunit.client.0.smithi082.stdout:8/275: sync 2024-09-17T01:41:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:5/389: sync 2024-09-17T01:41:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:9/278: sync 2024-09-17T01:41:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:3/229: sync 2024-09-17T01:41:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:0/263: sync 2024-09-17T01:41:31.798 INFO:tasks.workunit.client.0.smithi082.stdout:7/325: creat d0/d3/d36/f6b x:0 0 0 2024-09-17T01:41:31.799 INFO:tasks.workunit.client.0.smithi082.stdout:7/326: write d0/f32 [663259,103185] 0 2024-09-17T01:41:31.800 INFO:tasks.workunit.client.1.smithi167.stdout:3/686: truncate d7/d8/d2a/f3f 4296527 0 2024-09-17T01:41:31.802 INFO:tasks.workunit.client.1.smithi167.stdout:7/629: mkdir d0/d2/d88/d6e/dd8 0 2024-09-17T01:41:31.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/340: truncate d9/fd 4965135 0 2024-09-17T01:41:31.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/341: chown d9/d15/d37/c43 6087 1 2024-09-17T01:41:31.807 INFO:tasks.workunit.client.1.smithi167.stdout:7/630: dread d0/f74 [0,4194304] 0 2024-09-17T01:41:31.808 INFO:tasks.workunit.client.0.smithi082.stdout:4/342: dread - d9/d15/d37/d45/f66 zero size 2024-09-17T01:41:31.808 INFO:tasks.workunit.client.0.smithi082.stdout:3/230: mkdir d9/db/d49/d4e 0 2024-09-17T01:41:31.809 INFO:tasks.workunit.client.1.smithi167.stdout:5/603: chown d0/d24/f83 1632259 1 2024-09-17T01:41:31.810 INFO:tasks.workunit.client.0.smithi082.stdout:8/276: creat d3/dd/f56 x:0 0 0 2024-09-17T01:41:31.811 INFO:tasks.workunit.client.1.smithi167.stdout:4/659: symlink d0/d4/d7/d6/ld6 0 2024-09-17T01:41:31.812 INFO:tasks.workunit.client.0.smithi082.stdout:4/343: dread d9/d15/d16/d3e/f50 [0,4194304] 0 2024-09-17T01:41:31.813 INFO:tasks.workunit.client.0.smithi082.stdout:9/279: mknod d4/d27/d2d/c5b 0 2024-09-17T01:41:31.813 INFO:tasks.workunit.client.1.smithi167.stdout:2/648: rmdir d5/d6d 39 2024-09-17T01:41:31.814 INFO:tasks.workunit.client.1.smithi167.stdout:5/604: dwrite d0/d24/d2b/d49/d4b/dac/f87 [0,4194304] 0 2024-09-17T01:41:31.816 INFO:tasks.workunit.client.0.smithi082.stdout:5/390: dread db/d56/d29/d4f/f53 [0,4194304] 0 2024-09-17T01:41:31.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/264: creat da/d1b/d23/d42/d43/f5f x:0 0 0 2024-09-17T01:41:31.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/265: readlink l5 0 2024-09-17T01:41:31.819 INFO:tasks.workunit.client.1.smithi167.stdout:8/749: rename f7 to dc/d56/d57/da0/da7/ff2 0 2024-09-17T01:41:31.819 INFO:tasks.workunit.client.1.smithi167.stdout:9/734: rename d4 to d4/d9/d21/d2d/dae/de5 22 2024-09-17T01:41:31.823 INFO:tasks.workunit.client.0.smithi082.stdout:7/327: rename d0/d3/db/d10/f1e to d0/d3/db/d10/d47/f6c 0 2024-09-17T01:41:31.825 INFO:tasks.workunit.client.1.smithi167.stdout:3/687: rmdir d7/d8/d10/d14/d2c/d6f 39 2024-09-17T01:41:31.826 INFO:tasks.workunit.client.1.smithi167.stdout:3/688: write d7/d8/d10/d29/fa4 [1308822,117191] 0 2024-09-17T01:41:31.828 INFO:tasks.workunit.client.0.smithi082.stdout:3/231: mkdir d9/db/d26/d4f 0 2024-09-17T01:41:31.828 INFO:tasks.workunit.client.0.smithi082.stdout:1/415: dwrite d2/d3f/f5a [0,4194304] 0 2024-09-17T01:41:31.831 INFO:tasks.workunit.client.1.smithi167.stdout:7/631: rmdir d0/d2/d14/d19/d7f 39 2024-09-17T01:41:31.832 INFO:tasks.workunit.client.1.smithi167.stdout:7/632: chown d0/f74 3 1 2024-09-17T01:41:31.832 INFO:tasks.workunit.client.0.smithi082.stdout:8/277: readlink d3/dd/d18/d2d/d3e/d4a/l4c 0 2024-09-17T01:41:31.834 INFO:tasks.workunit.client.0.smithi082.stdout:4/344: rmdir d9/d15/d37/d4c 39 2024-09-17T01:41:31.838 INFO:tasks.workunit.client.0.smithi082.stdout:9/280: creat d4/d27/d2d/d3d/f5c x:0 0 0 2024-09-17T01:41:31.840 INFO:tasks.workunit.client.0.smithi082.stdout:5/391: symlink db/d2b/l7d 0 2024-09-17T01:41:31.842 INFO:tasks.workunit.client.1.smithi167.stdout:2/649: dread d5/d3c/d4c/de2/d45/d6b/f6f [0,4194304] 0 2024-09-17T01:41:31.842 INFO:tasks.workunit.client.0.smithi082.stdout:0/266: mkdir da/d1b/d23/d60 0 2024-09-17T01:41:31.843 INFO:tasks.workunit.client.1.smithi167.stdout:0/616: rename d5/d6b/d77/d37/d45/f4b to d5/d8/d9/fc6 0 2024-09-17T01:41:31.845 INFO:tasks.workunit.client.1.smithi167.stdout:9/735: creat d4/d9/d21/d2d/d33/d3a/d74/fe6 x:0 0 0 2024-09-17T01:41:31.847 INFO:tasks.workunit.client.0.smithi082.stdout:6/408: creat d1/f96 x:0 0 0 2024-09-17T01:41:31.847 INFO:tasks.workunit.client.1.smithi167.stdout:9/736: read d4/d9/f25 [2698762,89035] 0 2024-09-17T01:41:31.847 INFO:tasks.workunit.client.1.smithi167.stdout:9/737: stat d4/d9/d97/dd6/fd7 0 2024-09-17T01:41:31.848 INFO:tasks.workunit.client.1.smithi167.stdout:1/685: truncate d0/d9/d16/d48/d54/f64 10002342 0 2024-09-17T01:41:31.849 INFO:tasks.workunit.client.1.smithi167.stdout:9/738: write d4/d9/d21/d2d/d33/d3a/f67 [336496,99612] 0 2024-09-17T01:41:31.849 INFO:tasks.workunit.client.0.smithi082.stdout:7/328: rename d0/d3/db/d10/c49 to d0/dd/d2c/d55/c6d 0 2024-09-17T01:41:31.850 INFO:tasks.workunit.client.1.smithi167.stdout:9/739: fdatasync d4/d4a/fb3 0 2024-09-17T01:41:31.852 INFO:tasks.workunit.client.0.smithi082.stdout:6/409: dread d1/f83 [0,4194304] 0 2024-09-17T01:41:31.853 INFO:tasks.workunit.client.0.smithi082.stdout:2/327: getdents d1/d17 0 2024-09-17T01:41:31.854 INFO:tasks.workunit.client.0.smithi082.stdout:7/329: dread d0/f23 [4194304,4194304] 0 2024-09-17T01:41:31.854 INFO:tasks.workunit.client.0.smithi082.stdout:6/410: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/f73 zero size 2024-09-17T01:41:31.855 INFO:tasks.workunit.client.0.smithi082.stdout:1/416: fdatasync d2/da/f37 0 2024-09-17T01:41:31.856 INFO:tasks.workunit.client.1.smithi167.stdout:6/817: getdents d7/d42 0 2024-09-17T01:41:31.857 INFO:tasks.workunit.client.0.smithi082.stdout:1/417: read d2/d3f/d24/f68 [590386,37531] 0 2024-09-17T01:41:31.858 INFO:tasks.workunit.client.1.smithi167.stdout:0/617: dread d5/d8/f20 [4194304,4194304] 0 2024-09-17T01:41:31.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/330: dread d0/f32 [0,4194304] 0 2024-09-17T01:41:31.859 INFO:tasks.workunit.client.1.smithi167.stdout:7/633: read d0/d2/d14/d19/d26/d83/da5/d70/f7e [1081069,73946] 0 2024-09-17T01:41:31.861 INFO:tasks.workunit.client.0.smithi082.stdout:9/281: symlink d4/d27/l5d 0 2024-09-17T01:41:31.862 INFO:tasks.workunit.client.0.smithi082.stdout:9/282: chown d4/d27/d21/d2e/d11/d39/d44 26912458 1 2024-09-17T01:41:31.863 INFO:tasks.workunit.client.0.smithi082.stdout:5/392: creat db/d56/d29/f7e x:0 0 0 2024-09-17T01:41:31.868 INFO:tasks.workunit.client.1.smithi167.stdout:2/650: dread - d5/d33/d48/f7b zero size 2024-09-17T01:41:31.869 INFO:tasks.workunit.client.1.smithi167.stdout:8/750: rename dc/d21/d6b/d74/d83 to dc/d56/d59/d82/d8f/de5/dba/dd3/df3 0 2024-09-17T01:41:31.869 INFO:tasks.workunit.client.0.smithi082.stdout:2/328: fsync d1/f16 0 2024-09-17T01:41:31.870 INFO:tasks.workunit.client.0.smithi082.stdout:2/329: chown d1/d10/l3e 103792 1 2024-09-17T01:41:31.873 INFO:tasks.workunit.client.1.smithi167.stdout:1/686: rmdir d0/d9/d16/d48/d54/d78 39 2024-09-17T01:41:31.874 INFO:tasks.workunit.client.1.smithi167.stdout:1/687: write d0/d9/d16/d48/d54/f60 [1546355,18256] 0 2024-09-17T01:41:31.874 INFO:tasks.workunit.client.0.smithi082.stdout:6/411: creat d1/d7/d10/d4f/d32/f97 x:0 0 0 2024-09-17T01:41:31.875 INFO:tasks.workunit.client.0.smithi082.stdout:3/232: creat d9/db/d49/d4e/f50 x:0 0 0 2024-09-17T01:41:31.876 INFO:tasks.workunit.client.1.smithi167.stdout:3/689: symlink d7/d8/d1f/le4 0 2024-09-17T01:41:31.877 INFO:tasks.workunit.client.1.smithi167.stdout:6/818: mkdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/d120 0 2024-09-17T01:41:31.878 INFO:tasks.workunit.client.1.smithi167.stdout:6/819: write d7/d52/db7/fe0 [2445136,118848] 0 2024-09-17T01:41:31.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/331: mkdir d0/dd/d34/d58/d6e 0 2024-09-17T01:41:31.886 INFO:tasks.workunit.client.1.smithi167.stdout:5/605: link d0/d24/d2b/d49/d4b/dac/f37 d0/d24/d2b/d3d/d6d/fba 0 2024-09-17T01:41:31.887 INFO:tasks.workunit.client.0.smithi082.stdout:5/393: creat db/d2b/f7f x:0 0 0 2024-09-17T01:41:31.888 INFO:tasks.workunit.client.0.smithi082.stdout:7/332: dwrite d0/d3/db/d10/d47/f5c [0,4194304] 0 2024-09-17T01:41:31.889 INFO:tasks.workunit.client.1.smithi167.stdout:2/651: mkdir d5/d33/d48/d72/d94/de3 0 2024-09-17T01:41:31.889 INFO:tasks.workunit.client.1.smithi167.stdout:5/606: dread d0/d24/d2b/fa9 [0,4194304] 0 2024-09-17T01:41:31.891 INFO:tasks.workunit.client.1.smithi167.stdout:2/652: truncate d5/d3c/d4c/de2/db8/da3/fb4 234793 0 2024-09-17T01:41:31.891 INFO:tasks.workunit.client.1.smithi167.stdout:8/751: truncate dc/d21/f5a 4408948 0 2024-09-17T01:41:31.894 INFO:tasks.workunit.client.0.smithi082.stdout:8/278: truncate d3/dd/d18/d2d/d3e/d43/f44 1437333 0 2024-09-17T01:41:31.896 INFO:tasks.workunit.client.1.smithi167.stdout:4/660: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f/f79 [257427,68711] 0 2024-09-17T01:41:31.897 INFO:tasks.workunit.client.1.smithi167.stdout:9/740: mkdir d4/d9/d21/d2d/de4/de7 0 2024-09-17T01:41:31.898 INFO:tasks.workunit.client.1.smithi167.stdout:1/688: mkdir d0/d5/d34/d8a/de7 0 2024-09-17T01:41:31.899 INFO:tasks.workunit.client.1.smithi167.stdout:1/689: write d0/d5/f73 [36206,59662] 0 2024-09-17T01:41:31.903 INFO:tasks.workunit.client.0.smithi082.stdout:0/267: truncate da/d1b/d23/d42/f4e 29467 0 2024-09-17T01:41:31.904 INFO:tasks.workunit.client.0.smithi082.stdout:3/233: creat d9/db/d26/f51 x:0 0 0 2024-09-17T01:41:31.905 INFO:tasks.workunit.client.0.smithi082.stdout:9/283: mknod d4/d27/d36/d3b/c5e 0 2024-09-17T01:41:31.906 INFO:tasks.workunit.client.0.smithi082.stdout:9/284: chown d4/d27/d2d 574400 1 2024-09-17T01:41:31.906 INFO:tasks.workunit.client.1.smithi167.stdout:4/661: dwrite d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/fb0 [0,4194304] 0 2024-09-17T01:41:31.907 INFO:tasks.workunit.client.0.smithi082.stdout:9/285: fsync d4/d27/d36/f4e 0 2024-09-17T01:41:31.907 INFO:tasks.workunit.client.1.smithi167.stdout:1/690: dwrite d0/d5/d34/d6d/fe0 [0,4194304] 0 2024-09-17T01:41:31.911 INFO:tasks.workunit.client.1.smithi167.stdout:0/618: mkdir d5/d6b/d77/d6d/d90/dc4/dc7 0 2024-09-17T01:41:31.913 INFO:tasks.workunit.client.1.smithi167.stdout:1/691: dread d0/d5/d34/f70 [0,4194304] 0 2024-09-17T01:41:31.915 INFO:tasks.workunit.client.0.smithi082.stdout:2/330: mkdir d1/d66 0 2024-09-17T01:41:31.915 INFO:tasks.workunit.client.0.smithi082.stdout:2/331: chown d1/d35 22 1 2024-09-17T01:41:31.917 INFO:tasks.workunit.client.0.smithi082.stdout:8/279: unlink d3/dd/c1d 0 2024-09-17T01:41:31.921 INFO:tasks.workunit.client.1.smithi167.stdout:8/752: mknod dc/d56/cf4 0 2024-09-17T01:41:31.922 INFO:tasks.workunit.client.0.smithi082.stdout:6/412: dwrite d1/d7/d10/d4f/dc/d1d/d36/f67 [0,4194304] 0 2024-09-17T01:41:31.922 INFO:tasks.workunit.client.1.smithi167.stdout:3/690: dwrite d7/f3e [0,4194304] 0 2024-09-17T01:41:31.923 INFO:tasks.workunit.client.0.smithi082.stdout:0/268: mknod da/d1b/d23/c61 0 2024-09-17T01:41:31.923 INFO:tasks.workunit.client.0.smithi082.stdout:6/413: chown d1/d7/d10/d4f/dc/c54 46323 1 2024-09-17T01:41:31.924 INFO:tasks.workunit.client.0.smithi082.stdout:6/414: readlink d1/d7/ld 0 2024-09-17T01:41:31.925 INFO:tasks.workunit.client.1.smithi167.stdout:2/653: truncate d5/d10/d16/f2d 1204451 0 2024-09-17T01:41:31.926 INFO:tasks.workunit.client.0.smithi082.stdout:3/234: creat d9/db/d26/f52 x:0 0 0 2024-09-17T01:41:31.928 INFO:tasks.workunit.client.1.smithi167.stdout:9/741: read d4/d9/d21/d2d/d33/d90/dac/f68 [53272,83384] 0 2024-09-17T01:41:31.930 INFO:tasks.workunit.client.0.smithi082.stdout:5/394: creat db/d56/d78/f80 x:0 0 0 2024-09-17T01:41:31.931 INFO:tasks.workunit.client.0.smithi082.stdout:5/395: read - db/d56/d18/f70 zero size 2024-09-17T01:41:31.933 INFO:tasks.workunit.client.1.smithi167.stdout:6/820: dread d7/d54/d90/d13/d2f/d7f/d98/f2b [0,4194304] 0 2024-09-17T01:41:31.935 INFO:tasks.workunit.client.0.smithi082.stdout:2/332: mkdir d1/d17/d67 0 2024-09-17T01:41:31.940 INFO:tasks.workunit.client.0.smithi082.stdout:0/269: stat f0 0 2024-09-17T01:41:31.940 INFO:tasks.workunit.client.0.smithi082.stdout:0/270: stat f0 0 2024-09-17T01:41:31.942 INFO:tasks.workunit.client.1.smithi167.stdout:4/662: rename d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/f46 to d0/d4/d69/fd7 0 2024-09-17T01:41:31.942 INFO:tasks.workunit.client.1.smithi167.stdout:2/654: rename d5/d71 to d5/d71/de4 22 2024-09-17T01:41:31.942 INFO:tasks.workunit.client.0.smithi082.stdout:3/235: mkdir d9/db/d49/d4e/d53 0 2024-09-17T01:41:31.943 INFO:tasks.workunit.client.1.smithi167.stdout:2/655: write d5/d10/d16/fdd [610007,17819] 0 2024-09-17T01:41:31.944 INFO:tasks.workunit.client.1.smithi167.stdout:2/656: readlink d5/d3c/d4c/de2/d45/l86 0 2024-09-17T01:41:31.945 INFO:tasks.workunit.client.1.smithi167.stdout:1/692: creat d0/d5/d61/da2/fe8 x:0 0 0 2024-09-17T01:41:31.947 INFO:tasks.workunit.client.1.smithi167.stdout:3/691: mkdir d7/d8/d10/d14/d25/d9e/de5 0 2024-09-17T01:41:31.948 INFO:tasks.workunit.client.1.smithi167.stdout:8/753: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/ff5 x:0 0 0 2024-09-17T01:41:31.950 INFO:tasks.workunit.client.0.smithi082.stdout:3/236: write d9/db/f18 [552074,37665] 0 2024-09-17T01:41:31.952 INFO:tasks.workunit.client.1.smithi167.stdout:1/693: dwrite d0/d9/d16/d48/d54/f60 [0,4194304] 0 2024-09-17T01:41:31.952 INFO:tasks.workunit.client.0.smithi082.stdout:9/286: link d4/d27/d21/d2e/f34 d4/f5f 0 2024-09-17T01:41:31.953 INFO:tasks.workunit.client.0.smithi082.stdout:9/287: dread - d4/f4c zero size 2024-09-17T01:41:31.954 INFO:tasks.workunit.client.0.smithi082.stdout:8/280: dread d3/f25 [0,4194304] 0 2024-09-17T01:41:31.954 INFO:tasks.workunit.client.0.smithi082.stdout:5/396: symlink db/d1e/l81 0 2024-09-17T01:41:31.955 INFO:tasks.workunit.client.0.smithi082.stdout:5/397: readlink db/d56/l13 0 2024-09-17T01:41:31.957 INFO:tasks.workunit.client.0.smithi082.stdout:7/333: getdents d0/dd/d2c 0 2024-09-17T01:41:31.960 INFO:tasks.workunit.client.1.smithi167.stdout:2/657: dread d5/d10/d16/f65 [0,4194304] 0 2024-09-17T01:41:31.998 INFO:tasks.workunit.client.0.smithi082.stdout:8/281: dread d3/f10 [0,4194304] 0 2024-09-17T01:41:32.024 INFO:tasks.workunit.client.1.smithi167.stdout:5/607: sync 2024-09-17T01:41:32.025 INFO:tasks.workunit.client.1.smithi167.stdout:5/608: read - d0/d24/d2b/d3d/d3b/d5f/fa4 zero size 2024-09-17T01:41:32.026 INFO:tasks.workunit.client.1.smithi167.stdout:5/609: truncate d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae 793841 0 2024-09-17T01:41:32.048 INFO:tasks.workunit.client.0.smithi082.stdout:5/398: unlink db/d56/l34 0 2024-09-17T01:41:32.048 INFO:tasks.workunit.client.0.smithi082.stdout:5/399: chown db/d56/d18/c41 3156 1 2024-09-17T01:41:32.049 INFO:tasks.workunit.client.0.smithi082.stdout:5/400: truncate fa 2094168 0 2024-09-17T01:41:32.055 INFO:tasks.workunit.client.0.smithi082.stdout:5/401: dwrite db/d56/f15 [4194304,4194304] 0 2024-09-17T01:41:32.056 INFO:tasks.workunit.client.0.smithi082.stdout:5/402: dread - db/d2b/f7f zero size 2024-09-17T01:41:32.060 INFO:tasks.workunit.client.0.smithi082.stdout:8/282: fdatasync d3/dd/d18/d2d/d3e/d43/f45 0 2024-09-17T01:41:32.063 INFO:tasks.workunit.client.0.smithi082.stdout:2/333: rename d1/f3d to d1/d35/f68 0 2024-09-17T01:41:32.066 INFO:tasks.workunit.client.0.smithi082.stdout:7/334: write d0/d3/db/f1b [2590044,65040] 0 2024-09-17T01:41:32.067 INFO:tasks.workunit.client.0.smithi082.stdout:0/271: getdents da/d1b/d23/d42 0 2024-09-17T01:41:32.069 INFO:tasks.workunit.client.0.smithi082.stdout:0/272: truncate da/d1b/d23/d42/f58 940653 0 2024-09-17T01:41:32.072 INFO:tasks.workunit.client.0.smithi082.stdout:7/335: dread d0/dd/f3d [0,4194304] 0 2024-09-17T01:41:32.072 INFO:tasks.workunit.client.0.smithi082.stdout:7/336: dread - d0/dd/d2c/d54/f69 zero size 2024-09-17T01:41:32.073 INFO:tasks.workunit.client.0.smithi082.stdout:7/337: read d0/d3/db/d10/d47/f5c [1389180,1903] 0 2024-09-17T01:41:32.075 INFO:tasks.workunit.client.0.smithi082.stdout:9/288: rename d4/d27/d21/d2e to d4/d27/d2d/d60 0 2024-09-17T01:41:32.080 INFO:tasks.workunit.client.0.smithi082.stdout:3/237: getdents d9/db 0 2024-09-17T01:41:32.081 INFO:tasks.workunit.client.0.smithi082.stdout:8/283: write d3/fb [5058648,35321] 0 2024-09-17T01:41:32.083 INFO:tasks.workunit.client.0.smithi082.stdout:2/334: dwrite d1/d17/f53 [0,4194304] 0 2024-09-17T01:41:32.083 INFO:tasks.workunit.client.0.smithi082.stdout:2/335: chown d1 52387717 1 2024-09-17T01:41:32.085 INFO:tasks.workunit.client.0.smithi082.stdout:7/338: mknod d0/dd/d2c/d55/c6f 0 2024-09-17T01:41:32.085 INFO:tasks.workunit.client.0.smithi082.stdout:8/284: dread - d3/dd/d18/d2d/d2e/f42 zero size 2024-09-17T01:41:32.087 INFO:tasks.workunit.client.0.smithi082.stdout:0/273: rename da/d1b/d23/d60 to da/d1b/d23/d42/d62 0 2024-09-17T01:41:32.093 INFO:tasks.workunit.client.0.smithi082.stdout:0/274: dwrite da/d1b/f52 [0,4194304] 0 2024-09-17T01:41:32.096 INFO:tasks.workunit.client.0.smithi082.stdout:2/336: creat d1/d17/d38/d42/f69 x:0 0 0 2024-09-17T01:41:32.133 INFO:tasks.workunit.client.0.smithi082.stdout:8/285: stat d3/dd/d18/c55 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:7/339: truncate d0/d3/db/fe 1727915 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:9/289: creat d4/d27/d2d/d60/d11/d39/d29/d35/f61 x:0 0 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/286: dread d3/dd/d18/f24 [0,4194304] 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/287: stat d3/dd/d18/d2d/d3b/f48 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/238: creat d9/db/d49/d4e/d53/f54 x:0 0 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/239: write d9/db/f2f [204412,73588] 0 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/288: rmdir d3/dd 39 2024-09-17T01:41:32.134 INFO:tasks.workunit.client.0.smithi082.stdout:0/275: link da/df/d27/f3c da/d1b/d23/f63 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.0.smithi082.stdout:2/337: mknod d1/d17/d60/c6a 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.0.smithi082.stdout:3/240: symlink d9/l55 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.1.smithi167.stdout:6/821: symlink d7/d54/d90/l121 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.1.smithi167.stdout:0/619: creat d5/d6b/d77/d4d/fc8 x:0 0 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.1.smithi167.stdout:7/634: link d0/ca d0/d2/d14/d6f/d75/cd9 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.1.smithi167.stdout:4/663: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/dc3/dd8 0 2024-09-17T01:41:32.135 INFO:tasks.workunit.client.1.smithi167.stdout:0/620: dwrite d5/d8/f96 [0,4194304] 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:5/610: write d0/d24/d2b/d49/d4b/dac/d3a/d44/fa5 [1034197,11553] 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:8/754: creat dc/d21/d61/dea/ff6 x:0 0 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:5/611: fdatasync d0/d24/d2b/fb2 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:3/692: rename d7/d8/d10/d14/d2c/f71 to d7/d8/d10/d14/d2c/d74/dbb/fe6 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:4/664: read d0/d4/d7/da/f2c [3192485,104793] 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:1/694: truncate d0/f46 2315699 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:9/742: creat d4/d9/d21/d43/fe8 x:0 0 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:6/822: creat d7/d54/d90/d13/d2f/d30/d88/da2/f122 x:0 0 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:0/621: creat d5/d6b/d77/daa/fc9 x:0 0 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:8/755: mknod dc/d56/d59/d82/d8f/cf7 0 2024-09-17T01:41:32.136 INFO:tasks.workunit.client.1.smithi167.stdout:5/612: truncate d0/f21 2233007 0 2024-09-17T01:41:32.137 INFO:tasks.workunit.client.1.smithi167.stdout:3/693: symlink d7/d8/d2a/d7a/le7 0 2024-09-17T01:41:32.137 INFO:tasks.workunit.client.0.smithi082.stdout:9/290: rmdir d4/d27/d2d/d60/d11/d39/d4f 0 2024-09-17T01:41:32.138 INFO:tasks.workunit.client.1.smithi167.stdout:8/756: dwrite dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/ff5 [0,4194304] 0 2024-09-17T01:41:32.141 INFO:tasks.workunit.client.1.smithi167.stdout:4/665: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/ld9 0 2024-09-17T01:41:32.142 INFO:tasks.workunit.client.0.smithi082.stdout:9/291: dwrite d4/d27/d2d/d60/d11/d37/f52 [0,4194304] 0 2024-09-17T01:41:32.144 INFO:tasks.workunit.client.1.smithi167.stdout:9/743: rename d4/d9/d21/d81/fe1 to d4/d9/d2b/fe9 0 2024-09-17T01:41:32.144 INFO:tasks.workunit.client.0.smithi082.stdout:7/340: getdents d0/dd 0 2024-09-17T01:41:32.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/292: read d4/f57 [3362656,63870] 0 2024-09-17T01:41:32.146 INFO:tasks.workunit.client.1.smithi167.stdout:6/823: creat d7/d54/d90/d13/d2f/d96/f123 x:0 0 0 2024-09-17T01:41:32.148 INFO:tasks.workunit.client.1.smithi167.stdout:2/658: creat d5/d3c/d4c/de2/d2e/fe5 x:0 0 0 2024-09-17T01:41:32.149 INFO:tasks.workunit.client.0.smithi082.stdout:8/289: creat d3/dd/d18/d3a/f57 x:0 0 0 2024-09-17T01:41:32.150 INFO:tasks.workunit.client.0.smithi082.stdout:3/241: dread d9/f47 [4194304,4194304] 0 2024-09-17T01:41:32.151 INFO:tasks.workunit.client.1.smithi167.stdout:9/744: dwrite d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:32.151 INFO:tasks.workunit.client.0.smithi082.stdout:8/290: read d3/dd/d18/d3a/f4b [655895,57987] 0 2024-09-17T01:41:32.160 INFO:tasks.workunit.client.0.smithi082.stdout:7/341: rename d0/d3/db/l63 to d0/d50/l70 0 2024-09-17T01:41:32.162 INFO:tasks.workunit.client.0.smithi082.stdout:9/293: symlink d4/d27/d21/l62 0 2024-09-17T01:41:32.163 INFO:tasks.workunit.client.1.smithi167.stdout:1/695: mkdir d0/d5/dbf/ddb/de9 0 2024-09-17T01:41:32.164 INFO:tasks.workunit.client.1.smithi167.stdout:3/694: mkdir d7/d8/d10/d14/d2c/d74/de8 0 2024-09-17T01:41:32.165 INFO:tasks.workunit.client.1.smithi167.stdout:8/757: creat dc/d56/d59/ff8 x:0 0 0 2024-09-17T01:41:32.166 INFO:tasks.workunit.client.0.smithi082.stdout:3/242: symlink d9/d35/l56 0 2024-09-17T01:41:32.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/338: dwrite d1/d35/f37 [4194304,4194304] 0 2024-09-17T01:41:32.169 INFO:tasks.workunit.client.0.smithi082.stdout:3/243: readlink d9/db/l25 0 2024-09-17T01:41:32.169 INFO:tasks.workunit.client.1.smithi167.stdout:3/695: dwrite d7/d8/d10/d29/d75/fa0 [0,4194304] 0 2024-09-17T01:41:32.171 INFO:tasks.workunit.client.0.smithi082.stdout:8/291: mkdir d3/dd/d18/d2d/d58 0 2024-09-17T01:41:32.171 INFO:tasks.workunit.client.0.smithi082.stdout:2/339: chown d1/d10/f12 175 1 2024-09-17T01:41:32.172 INFO:tasks.workunit.client.0.smithi082.stdout:7/342: dwrite d0/d3/db/f33 [0,4194304] 0 2024-09-17T01:41:32.178 INFO:tasks.workunit.client.0.smithi082.stdout:3/244: dread d9/d35/f4b [0,4194304] 0 2024-09-17T01:41:32.180 INFO:tasks.workunit.client.1.smithi167.stdout:6/824: truncate d7/d54/d90/d13/d2f/d64/fbe 240695 0 2024-09-17T01:41:32.183 INFO:tasks.workunit.client.0.smithi082.stdout:2/340: dwrite d1/d35/f65 [0,4194304] 0 2024-09-17T01:41:32.184 INFO:tasks.workunit.client.1.smithi167.stdout:0/622: dwrite d5/d8/d9/f7f [0,4194304] 0 2024-09-17T01:41:32.189 INFO:tasks.workunit.client.0.smithi082.stdout:7/343: mkdir d0/d3/d36/d37/d71 0 2024-09-17T01:41:32.189 INFO:tasks.workunit.client.0.smithi082.stdout:8/292: write d3/dd/d18/d3a/f4b [1391279,1172] 0 2024-09-17T01:41:32.190 INFO:tasks.workunit.client.0.smithi082.stdout:9/294: mkdir d4/d59/d63 0 2024-09-17T01:41:32.192 INFO:tasks.workunit.client.1.smithi167.stdout:1/696: unlink d0/d5/d34/d83/fde 0 2024-09-17T01:41:32.195 INFO:tasks.workunit.client.1.smithi167.stdout:8/758: truncate dc/d56/d57/d7e/f93 1043769 0 2024-09-17T01:41:32.196 INFO:tasks.workunit.client.0.smithi082.stdout:7/344: symlink d0/d3/db/d10/d3f/l72 0 2024-09-17T01:41:32.202 INFO:tasks.workunit.client.0.smithi082.stdout:8/293: write d3/f25 [3176640,95669] 0 2024-09-17T01:41:32.203 INFO:tasks.workunit.client.1.smithi167.stdout:6/825: mkdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d124 0 2024-09-17T01:41:32.204 INFO:tasks.workunit.client.0.smithi082.stdout:7/345: symlink d0/d50/l73 0 2024-09-17T01:41:32.205 INFO:tasks.workunit.client.1.smithi167.stdout:7/635: getdents d0 0 2024-09-17T01:41:32.208 INFO:tasks.workunit.client.1.smithi167.stdout:0/623: rename d5/d8/da4 to d5/d6b/dca 0 2024-09-17T01:41:32.209 INFO:tasks.workunit.client.1.smithi167.stdout:9/745: creat d4/d9/d21/d81/db9/fea x:0 0 0 2024-09-17T01:41:32.212 INFO:tasks.workunit.client.0.smithi082.stdout:8/294: creat d3/dd/d18/d2d/d3e/d43/f59 x:0 0 0 2024-09-17T01:41:32.213 INFO:tasks.workunit.client.0.smithi082.stdout:8/295: write d3/dd/d18/d3a/f4b [46276,95122] 0 2024-09-17T01:41:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:31 smithi082 ceph-mon[28077]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 281 MiB/s wr, 477 op/s 2024-09-17T01:41:32.215 INFO:tasks.workunit.client.1.smithi167.stdout:1/697: unlink d0/d5/d34/d3c/d85/fdc 0 2024-09-17T01:41:32.216 INFO:tasks.workunit.client.0.smithi082.stdout:9/295: link d4/c4d d4/d27/d2d/d60/d11/d39/d44/c64 0 2024-09-17T01:41:32.216 INFO:tasks.workunit.client.1.smithi167.stdout:8/759: mkdir dc/d56/d59/d65/df9 0 2024-09-17T01:41:32.220 INFO:tasks.workunit.client.1.smithi167.stdout:1/698: dread d0/d5/d34/d6d/fa6 [0,4194304] 0 2024-09-17T01:41:32.220 INFO:tasks.workunit.client.1.smithi167.stdout:1/699: readlink d0/d9/d16/d48/d54/la9 0 2024-09-17T01:41:32.221 INFO:tasks.workunit.client.1.smithi167.stdout:4/666: creat d0/d4/d7/d6/fda x:0 0 0 2024-09-17T01:41:32.222 INFO:tasks.workunit.client.0.smithi082.stdout:8/296: rmdir d3/dd/d18/d3a 39 2024-09-17T01:41:32.222 INFO:tasks.workunit.client.1.smithi167.stdout:1/700: write d0/d5/d34/d3c/f2b [7614305,35874] 0 2024-09-17T01:41:32.223 INFO:tasks.workunit.client.1.smithi167.stdout:2/659: creat d5/d3c/d4c/de2/fe6 x:0 0 0 2024-09-17T01:41:32.225 INFO:tasks.workunit.client.1.smithi167.stdout:6/826: readlink d7/d52/d79/d109/l118 0 2024-09-17T01:41:32.226 INFO:tasks.workunit.client.1.smithi167.stdout:6/827: chown d7/d54/d90/d13/d2f/d30/d88 188313612 1 2024-09-17T01:41:32.227 INFO:tasks.workunit.client.0.smithi082.stdout:8/297: chown d3/f7 183 1 2024-09-17T01:41:32.227 INFO:tasks.workunit.client.1.smithi167.stdout:1/701: dwrite d0/d5/d34/f49 [0,4194304] 0 2024-09-17T01:41:32.227 INFO:tasks.workunit.client.1.smithi167.stdout:7/636: chown d0/d2/c3 47 1 2024-09-17T01:41:32.229 INFO:tasks.workunit.client.0.smithi082.stdout:9/296: mknod d4/c65 0 2024-09-17T01:41:32.229 INFO:tasks.workunit.client.1.smithi167.stdout:6/828: dread - d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fe4 zero size 2024-09-17T01:41:32.232 INFO:tasks.workunit.client.0.smithi082.stdout:8/298: symlink d3/dd/d18/d34/l5a 0 2024-09-17T01:41:32.235 INFO:tasks.workunit.client.1.smithi167.stdout:7/637: dwrite d0/d2/d14/d19/d22/fc6 [0,4194304] 0 2024-09-17T01:41:32.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/297: symlink d4/d27/d2d/d60/d11/d39/d44/l66 0 2024-09-17T01:41:32.238 INFO:tasks.workunit.client.0.smithi082.stdout:8/299: symlink d3/dd/l5b 0 2024-09-17T01:41:32.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/300: write d3/dd/d18/d2d/d2e/f42 [1045846,38410] 0 2024-09-17T01:41:32.241 INFO:tasks.workunit.client.0.smithi082.stdout:8/301: chown d3/dd 1 1 2024-09-17T01:41:32.241 INFO:tasks.workunit.client.1.smithi167.stdout:5/613: truncate d0/d24/d2b/d49/d4b/f55 372635 0 2024-09-17T01:41:32.242 INFO:tasks.workunit.client.1.smithi167.stdout:5/614: chown d0/c4 24848617 1 2024-09-17T01:41:32.243 INFO:tasks.workunit.client.1.smithi167.stdout:5/615: write d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/f85 [1172591,79433] 0 2024-09-17T01:41:32.245 INFO:tasks.workunit.client.0.smithi082.stdout:9/298: creat d4/d59/d63/f67 x:0 0 0 2024-09-17T01:41:32.247 INFO:tasks.workunit.client.1.smithi167.stdout:4/667: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/ddb 0 2024-09-17T01:41:32.248 INFO:tasks.workunit.client.0.smithi082.stdout:8/302: rename d3/dd/d18/d34/f47 to d3/dd/d18/d34/f5c 0 2024-09-17T01:41:32.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:31 smithi167 ceph-mon[35643]: pgmap v19: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 67 MiB/s rd, 281 MiB/s wr, 477 op/s 2024-09-17T01:41:32.267 INFO:tasks.workunit.client.0.smithi082.stdout:3/245: truncate f0 1233974 0 2024-09-17T01:41:32.269 INFO:tasks.workunit.client.0.smithi082.stdout:9/299: unlink d4/d27/d2d/d60/d11/d37/f52 0 2024-09-17T01:41:32.271 INFO:tasks.workunit.client.1.smithi167.stdout:1/702: rmdir d0/d9/d16 39 2024-09-17T01:41:32.276 INFO:tasks.workunit.client.0.smithi082.stdout:2/341: dwrite d1/d10/f2f [0,4194304] 0 2024-09-17T01:41:32.276 INFO:tasks.workunit.client.0.smithi082.stdout:2/342: write d1/d17/f53 [3600923,109167] 0 2024-09-17T01:41:32.277 INFO:tasks.workunit.client.1.smithi167.stdout:0/624: symlink d5/d6b/d77/d4d/d56/d7b/lcb 0 2024-09-17T01:41:32.280 INFO:tasks.workunit.client.1.smithi167.stdout:6/829: dread d7/f5c [0,4194304] 0 2024-09-17T01:41:32.280 INFO:tasks.workunit.client.0.smithi082.stdout:3/246: unlink d9/f24 0 2024-09-17T01:41:32.282 INFO:tasks.workunit.client.0.smithi082.stdout:7/346: write d0/d3/db/f4f [128494,125239] 0 2024-09-17T01:41:32.286 INFO:tasks.workunit.client.0.smithi082.stdout:8/303: mknod d3/dd/d18/d2d/d58/c5d 0 2024-09-17T01:41:32.286 INFO:tasks.workunit.client.0.smithi082.stdout:7/347: dread d0/dd/d2c/f40 [0,4194304] 0 2024-09-17T01:41:32.288 INFO:tasks.workunit.client.0.smithi082.stdout:2/343: truncate d1/d10/f14 499622 0 2024-09-17T01:41:32.289 INFO:tasks.workunit.client.1.smithi167.stdout:3/696: dwrite d7/d8/f4c [0,4194304] 0 2024-09-17T01:41:32.289 INFO:tasks.workunit.client.0.smithi082.stdout:2/344: readlink d1/d17/d38/l56 0 2024-09-17T01:41:32.290 INFO:tasks.workunit.client.1.smithi167.stdout:8/760: mknod dc/d56/d57/dc2/cfa 0 2024-09-17T01:41:32.290 INFO:tasks.workunit.client.0.smithi082.stdout:2/345: dread - d1/d35/f57 zero size 2024-09-17T01:41:32.290 INFO:tasks.workunit.client.0.smithi082.stdout:2/346: chown d1/d17/c5e 0 1 2024-09-17T01:41:32.292 INFO:tasks.workunit.client.0.smithi082.stdout:2/347: truncate d1/d35/f68 4472924 0 2024-09-17T01:41:32.293 INFO:tasks.workunit.client.0.smithi082.stdout:2/348: chown d1/d17/d38/l56 506 1 2024-09-17T01:41:32.293 INFO:tasks.workunit.client.0.smithi082.stdout:3/247: creat d9/db/d49/d4e/f57 x:0 0 0 2024-09-17T01:41:32.294 INFO:tasks.workunit.client.1.smithi167.stdout:5/616: rmdir d0/d24/d2b/d3d/d3b 39 2024-09-17T01:41:32.297 INFO:tasks.workunit.client.1.smithi167.stdout:4/668: rename d0/d4/cb2 to d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8/cdc 0 2024-09-17T01:41:32.299 INFO:tasks.workunit.client.1.smithi167.stdout:9/746: write d4/d9/d21/d2d/dae/fe2 [1192008,19155] 0 2024-09-17T01:41:32.300 INFO:tasks.workunit.client.0.smithi082.stdout:8/304: symlink d3/dd/l5e 0 2024-09-17T01:41:32.302 INFO:tasks.workunit.client.0.smithi082.stdout:7/348: mknod d0/dd/d2c/d54/c74 0 2024-09-17T01:41:32.304 INFO:tasks.workunit.client.1.smithi167.stdout:0/625: rename d5/d8/d9/c15 to d5/d8/d9/ccc 0 2024-09-17T01:41:32.305 INFO:tasks.workunit.client.1.smithi167.stdout:0/626: write d5/d6b/d77/d37/d45/f8c [736052,68026] 0 2024-09-17T01:41:32.306 INFO:tasks.workunit.client.0.smithi082.stdout:2/349: creat d1/d10/f6b x:0 0 0 2024-09-17T01:41:32.308 INFO:tasks.workunit.client.0.smithi082.stdout:3/248: creat d9/db/d49/d4e/d53/f58 x:0 0 0 2024-09-17T01:41:32.314 INFO:tasks.workunit.client.1.smithi167.stdout:7/638: unlink d0/d2/d14/d6f/d8b/cc4 0 2024-09-17T01:41:32.315 INFO:tasks.workunit.client.1.smithi167.stdout:7/639: chown d0/d2/d14/d23/f7b 1351192 1 2024-09-17T01:41:32.317 INFO:tasks.workunit.client.1.smithi167.stdout:3/697: creat d7/d8/d1f/fe9 x:0 0 0 2024-09-17T01:41:32.317 INFO:tasks.workunit.client.1.smithi167.stdout:2/660: dwrite d5/d3c/d4c/de2/db8/da3/f20 [0,4194304] 0 2024-09-17T01:41:32.317 INFO:tasks.workunit.client.0.smithi082.stdout:7/349: symlink d0/dd/d34/d58/l75 0 2024-09-17T01:41:32.320 INFO:tasks.workunit.client.0.smithi082.stdout:3/249: mknod d9/db/d49/c59 0 2024-09-17T01:41:32.321 INFO:tasks.workunit.client.0.smithi082.stdout:3/250: write d9/db/d26/f3b [627463,90363] 0 2024-09-17T01:41:32.322 INFO:tasks.workunit.client.1.smithi167.stdout:4/669: mknod d0/d4/cdd 0 2024-09-17T01:41:32.322 INFO:tasks.workunit.client.0.smithi082.stdout:9/300: getdents d4/d59/d63 0 2024-09-17T01:41:32.325 INFO:tasks.workunit.client.1.smithi167.stdout:9/747: mkdir d4/d9/d97/dd6/deb 0 2024-09-17T01:41:32.326 INFO:tasks.workunit.client.1.smithi167.stdout:9/748: write d4/d9/d21/d2d/d33/d3a/d74/fe6 [952784,104601] 0 2024-09-17T01:41:32.326 INFO:tasks.workunit.client.0.smithi082.stdout:8/305: unlink d3/f9 0 2024-09-17T01:41:32.327 INFO:tasks.workunit.client.0.smithi082.stdout:8/306: readlink d3/dd/d18/l28 0 2024-09-17T01:41:32.327 INFO:tasks.workunit.client.1.smithi167.stdout:1/703: symlink d0/d5/dbf/ddb/de9/lea 0 2024-09-17T01:41:32.329 INFO:tasks.workunit.client.0.smithi082.stdout:7/350: creat d0/d3/d36/f76 x:0 0 0 2024-09-17T01:41:32.330 INFO:tasks.workunit.client.0.smithi082.stdout:7/351: chown d0/d3/db/d10/d47/c5f 3 1 2024-09-17T01:41:32.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/350: creat d1/d17/d29/d50/f6c x:0 0 0 2024-09-17T01:41:32.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/351: fsync d1/d35/f37 0 2024-09-17T01:41:32.333 INFO:tasks.workunit.client.0.smithi082.stdout:2/352: stat d1/d17/d29/c32 0 2024-09-17T01:41:32.333 INFO:tasks.workunit.client.1.smithi167.stdout:0/627: unlink d5/f84 0 2024-09-17T01:41:32.334 INFO:tasks.workunit.client.0.smithi082.stdout:2/353: dread - d1/d17/d29/d50/f6c zero size 2024-09-17T01:41:32.334 INFO:tasks.workunit.client.0.smithi082.stdout:9/301: rmdir d4/d27/d2d 39 2024-09-17T01:41:32.335 INFO:tasks.workunit.client.1.smithi167.stdout:6/830: getdents d7/d54/d90/dfc/d105 0 2024-09-17T01:41:32.336 INFO:tasks.workunit.client.1.smithi167.stdout:6/831: write d7/d42/f71 [933976,36412] 0 2024-09-17T01:41:32.340 INFO:tasks.workunit.client.0.smithi082.stdout:7/352: mkdir d0/dd/d2c/d42/d77 0 2024-09-17T01:41:32.341 INFO:tasks.workunit.client.0.smithi082.stdout:3/251: dread d9/f29 [0,4194304] 0 2024-09-17T01:41:32.343 INFO:tasks.workunit.client.1.smithi167.stdout:2/661: creat d5/d10/d16/fe7 x:0 0 0 2024-09-17T01:41:32.343 INFO:tasks.workunit.client.0.smithi082.stdout:2/354: mkdir d1/d5a/d6d 0 2024-09-17T01:41:32.345 INFO:tasks.workunit.client.1.smithi167.stdout:3/698: mkdir d7/d8/d10/d14/d24/d62/d92/dea 0 2024-09-17T01:41:32.346 INFO:tasks.workunit.client.1.smithi167.stdout:3/699: chown d7/d8/d10/d14/d25/dc7/dd1 1688 1 2024-09-17T01:41:32.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/302: write d4/d27/d2d/d60/f16 [3287828,2300] 0 2024-09-17T01:41:32.348 INFO:tasks.workunit.client.1.smithi167.stdout:8/761: link dc/d21/f44 dc/d56/d59/d65/df9/ffb 0 2024-09-17T01:41:32.348 INFO:tasks.workunit.client.1.smithi167.stdout:2/662: dwrite d5/d3c/d4c/de2/d45/d3f/f4a [4194304,4194304] 0 2024-09-17T01:41:32.350 INFO:tasks.workunit.client.0.smithi082.stdout:8/307: rename d3/dd/l40 to d3/dd/d18/d2d/d58/l5f 0 2024-09-17T01:41:32.351 INFO:tasks.workunit.client.0.smithi082.stdout:2/355: dwrite d1/d17/d38/d42/f69 [0,4194304] 0 2024-09-17T01:41:32.352 INFO:tasks.workunit.client.0.smithi082.stdout:2/356: readlink d1/d10/l44 0 2024-09-17T01:41:32.352 INFO:tasks.workunit.client.0.smithi082.stdout:7/353: symlink d0/d50/l78 0 2024-09-17T01:41:32.355 INFO:tasks.workunit.client.1.smithi167.stdout:4/670: rename d0/d4/d7/d6/f29 to d0/d4/d7/d6/d2b/d6d/d7e/fde 0 2024-09-17T01:41:32.365 INFO:tasks.workunit.client.0.smithi082.stdout:9/303: creat d4/d27/d2d/d60/d11/d39/d29/d35/f68 x:0 0 0 2024-09-17T01:41:32.367 INFO:tasks.workunit.client.0.smithi082.stdout:8/308: read - d3/dd/d18/d3a/f57 zero size 2024-09-17T01:41:32.371 INFO:tasks.workunit.client.1.smithi167.stdout:7/640: unlink d0/d2/d14/f72 0 2024-09-17T01:41:32.373 INFO:tasks.workunit.client.0.smithi082.stdout:9/304: dwrite d4/d27/d2d/d60/f16 [0,4194304] 0 2024-09-17T01:41:32.373 INFO:tasks.workunit.client.1.smithi167.stdout:3/700: mknod d7/d8/d10/d14/d66/ceb 0 2024-09-17T01:41:32.374 INFO:tasks.workunit.client.1.smithi167.stdout:3/701: stat d7/d8/d10/d14/d25/fbd 0 2024-09-17T01:41:32.375 INFO:tasks.workunit.client.0.smithi082.stdout:9/305: fdatasync d4/d27/d2d/d60/d11/d39/d29/d35/f61 0 2024-09-17T01:41:32.375 INFO:tasks.workunit.client.1.smithi167.stdout:8/762: chown dc/dae 12228 1 2024-09-17T01:41:32.377 INFO:tasks.workunit.client.1.smithi167.stdout:5/617: creat d0/d24/d93/d99/fbb x:0 0 0 2024-09-17T01:41:32.378 INFO:tasks.workunit.client.0.smithi082.stdout:8/309: mkdir d3/dd/d18/d2d/d60 0 2024-09-17T01:41:32.379 INFO:tasks.workunit.client.0.smithi082.stdout:2/357: dread d1/d10/f41 [0,4194304] 0 2024-09-17T01:41:32.380 INFO:tasks.workunit.client.1.smithi167.stdout:8/763: dread dc/d56/d57/dc2/fd6 [0,4194304] 0 2024-09-17T01:41:32.381 INFO:tasks.workunit.client.1.smithi167.stdout:4/671: mkdir d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf 0 2024-09-17T01:41:32.382 INFO:tasks.workunit.client.1.smithi167.stdout:4/672: readlink d0/l15 0 2024-09-17T01:41:32.386 INFO:tasks.workunit.client.0.smithi082.stdout:7/354: link d0/dd/c1a d0/dd/d2c/d42/c79 0 2024-09-17T01:41:32.389 INFO:tasks.workunit.client.0.smithi082.stdout:9/306: symlink d4/d27/d2d/d60/d11/d39/l69 0 2024-09-17T01:41:32.391 INFO:tasks.workunit.client.1.smithi167.stdout:1/704: dwrite d0/d9/d16/d48/d54/d78/f92 [0,4194304] 0 2024-09-17T01:41:32.391 INFO:tasks.workunit.client.1.smithi167.stdout:1/705: fdatasync d0/d9/fc2 0 2024-09-17T01:41:32.392 INFO:tasks.workunit.client.1.smithi167.stdout:1/706: fsync d0/d5/d34/d3c/d74/fca 0 2024-09-17T01:41:32.393 INFO:tasks.workunit.client.1.smithi167.stdout:7/641: symlink d0/d2/d14/d6f/d87/dae/lda 0 2024-09-17T01:41:32.394 INFO:tasks.workunit.client.0.smithi082.stdout:2/358: truncate d1/d17/d29/f33 2310809 0 2024-09-17T01:41:32.398 INFO:tasks.workunit.client.1.smithi167.stdout:6/832: dwrite d7/f5c [0,4194304] 0 2024-09-17T01:41:32.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/252: truncate d9/f29 2420979 0 2024-09-17T01:41:32.400 INFO:tasks.workunit.client.0.smithi082.stdout:3/253: readlink d9/db/d49/l48 0 2024-09-17T01:41:32.400 INFO:tasks.workunit.client.0.smithi082.stdout:3/254: fdatasync d9/db/f17 0 2024-09-17T01:41:32.404 INFO:tasks.workunit.client.0.smithi082.stdout:9/307: mknod d4/d27/d2d/d60/d11/d39/d31/c6a 0 2024-09-17T01:41:32.408 INFO:tasks.workunit.client.0.smithi082.stdout:8/310: write d3/dd/f31 [984184,23573] 0 2024-09-17T01:41:32.409 INFO:tasks.workunit.client.1.smithi167.stdout:9/749: creat d4/d9/fec x:0 0 0 2024-09-17T01:41:32.410 INFO:tasks.workunit.client.1.smithi167.stdout:0/628: truncate d5/d8/f96 3846151 0 2024-09-17T01:41:32.411 INFO:tasks.workunit.client.0.smithi082.stdout:9/308: rmdir d4/d27/d2d/d60/d11/d39 39 2024-09-17T01:41:32.412 INFO:tasks.workunit.client.1.smithi167.stdout:9/750: truncate d4/d9/d21/d2d/d33/d3a/d74/f89 561319 0 2024-09-17T01:41:32.414 INFO:tasks.workunit.client.0.smithi082.stdout:3/255: fdatasync f0 0 2024-09-17T01:41:32.418 INFO:tasks.workunit.client.1.smithi167.stdout:1/707: mknod d0/ceb 0 2024-09-17T01:41:32.420 INFO:tasks.workunit.client.1.smithi167.stdout:7/642: creat d0/fdb x:0 0 0 2024-09-17T01:41:32.421 INFO:tasks.workunit.client.0.smithi082.stdout:2/359: write d1/d35/f24 [2244960,2130] 0 2024-09-17T01:41:32.422 INFO:tasks.workunit.client.1.smithi167.stdout:8/764: write dc/d21/d61/faf [163307,3230] 0 2024-09-17T01:41:32.422 INFO:tasks.workunit.client.1.smithi167.stdout:5/618: dwrite d0/d9/f12 [0,4194304] 0 2024-09-17T01:41:32.427 INFO:tasks.workunit.client.0.smithi082.stdout:9/309: symlink d4/d27/d2d/d60/d11/d39/d31/l6b 0 2024-09-17T01:41:32.428 INFO:tasks.workunit.client.0.smithi082.stdout:9/310: fdatasync d4/d27/d2d/d60/d11/d37/f3c 0 2024-09-17T01:41:32.429 INFO:tasks.workunit.client.0.smithi082.stdout:2/360: dread - d1/ff zero size 2024-09-17T01:41:32.432 INFO:tasks.workunit.client.1.smithi167.stdout:2/663: rename d5/d10/c85 to d5/ce8 0 2024-09-17T01:41:32.434 INFO:tasks.workunit.client.1.smithi167.stdout:4/673: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/dac/ce0 0 2024-09-17T01:41:32.436 INFO:tasks.workunit.client.1.smithi167.stdout:9/751: rmdir d4/d9/d21/d2d/d33/d3a/d9c 39 2024-09-17T01:41:32.438 INFO:tasks.workunit.client.1.smithi167.stdout:1/708: chown d0/d5/d34/d3c/f9e 857149403 1 2024-09-17T01:41:32.438 INFO:tasks.workunit.client.0.smithi082.stdout:8/311: getdents d3/dd/d18 0 2024-09-17T01:41:32.439 INFO:tasks.workunit.client.1.smithi167.stdout:6/833: dread d7/d54/d90/d13/d2f/d7f/d98/d27/f26 [0,4194304] 0 2024-09-17T01:41:32.440 INFO:tasks.workunit.client.1.smithi167.stdout:3/702: creat d7/fec x:0 0 0 2024-09-17T01:41:32.440 INFO:tasks.workunit.client.1.smithi167.stdout:8/765: readlink dc/l1e 0 2024-09-17T01:41:32.442 INFO:tasks.workunit.client.0.smithi082.stdout:8/312: unlink d3/dd/d18/l29 0 2024-09-17T01:41:32.443 INFO:tasks.workunit.client.1.smithi167.stdout:2/664: rename d5/d33/d48/fcd to d5/d33/d48/d72/d94/de3/fe9 0 2024-09-17T01:41:32.447 INFO:tasks.workunit.client.1.smithi167.stdout:0/629: link d5/d6b/d77/d37/d45/f8c d5/d8/d5c/fcd 0 2024-09-17T01:41:32.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/311: dread d4/d27/d2d/d60/f34 [0,4194304] 0 2024-09-17T01:41:32.452 INFO:tasks.workunit.client.0.smithi082.stdout:2/361: truncate d1/d10/f41 1426018 0 2024-09-17T01:41:32.456 INFO:tasks.workunit.client.1.smithi167.stdout:8/766: mkdir dc/d56/d57/dc2/dfc 0 2024-09-17T01:41:32.462 INFO:tasks.workunit.client.1.smithi167.stdout:3/703: write d7/d8/d2a/d4e/f67 [704684,51444] 0 2024-09-17T01:41:32.465 INFO:tasks.workunit.client.1.smithi167.stdout:4/674: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1 0 2024-09-17T01:41:32.465 INFO:tasks.workunit.client.1.smithi167.stdout:7/643: dread d0/d2/d88/f7c [0,4194304] 0 2024-09-17T01:41:32.467 INFO:tasks.workunit.client.0.smithi082.stdout:9/312: getdents d4/d27/d2d/d60/d11/d39/d44 0 2024-09-17T01:41:32.468 INFO:tasks.workunit.client.1.smithi167.stdout:1/709: write d0/d5/d61/fac [356963,30946] 0 2024-09-17T01:41:32.469 INFO:tasks.workunit.client.0.smithi082.stdout:2/362: dwrite d1/ff [0,4194304] 0 2024-09-17T01:41:32.469 INFO:tasks.workunit.client.0.smithi082.stdout:8/313: getdents d3/dd/d18/d2d/d3e/d4a 0 2024-09-17T01:41:32.473 INFO:tasks.workunit.client.0.smithi082.stdout:2/363: write d1/f4d [373813,85029] 0 2024-09-17T01:41:32.474 INFO:tasks.workunit.client.0.smithi082.stdout:9/313: symlink d4/d27/d2d/d60/d11/d39/d29/l6c 0 2024-09-17T01:41:32.476 INFO:tasks.workunit.client.0.smithi082.stdout:8/314: mknod d3/dd/d18/d2d/d3e/d4a/c61 0 2024-09-17T01:41:32.477 INFO:tasks.workunit.client.1.smithi167.stdout:5/619: link d0/d24/d2b/d49/d4b/dac/d3a/d44/f5e d0/d24/d2b/d3d/fbc 0 2024-09-17T01:41:32.480 INFO:tasks.workunit.client.1.smithi167.stdout:9/752: truncate d4/d9/d21/d43/d6c/f8b 1809842 0 2024-09-17T01:41:32.480 INFO:tasks.workunit.client.1.smithi167.stdout:2/665: mkdir d5/d3c/d4c/de2/db8/da3/dc8/dea 0 2024-09-17T01:41:32.480 INFO:tasks.workunit.client.0.smithi082.stdout:2/364: creat d1/d17/d29/f6e x:0 0 0 2024-09-17T01:41:32.481 INFO:tasks.workunit.client.1.smithi167.stdout:6/834: write d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f8f [940112,90047] 0 2024-09-17T01:41:32.484 INFO:tasks.workunit.client.1.smithi167.stdout:7/644: creat d0/d2/d14/d6f/fdc x:0 0 0 2024-09-17T01:41:32.486 INFO:tasks.workunit.client.0.smithi082.stdout:2/365: creat d1/d17/d60/f6f x:0 0 0 2024-09-17T01:41:32.486 INFO:tasks.workunit.client.1.smithi167.stdout:9/753: dwrite d4/d4a/fb3 [0,4194304] 0 2024-09-17T01:41:32.487 INFO:tasks.workunit.client.0.smithi082.stdout:2/366: read d1/d10/f2f [2798749,27258] 0 2024-09-17T01:41:32.488 INFO:tasks.workunit.client.1.smithi167.stdout:1/710: creat d0/d9/d16/d48/d54/d78/fec x:0 0 0 2024-09-17T01:41:32.489 INFO:tasks.workunit.client.1.smithi167.stdout:8/767: dwrite dc/f15 [0,4194304] 0 2024-09-17T01:41:32.491 INFO:tasks.workunit.client.1.smithi167.stdout:5/620: mknod d0/d24/d2b/d49/d4b/dac/d80/cbd 0 2024-09-17T01:41:32.495 INFO:tasks.workunit.client.1.smithi167.stdout:3/704: creat d7/d8/d10/d14/d66/d6c/dab/dcf/fed x:0 0 0 2024-09-17T01:41:32.496 INFO:tasks.workunit.client.0.smithi082.stdout:8/315: link d3/l3c d3/dd/d18/d2d/d3b/l62 0 2024-09-17T01:41:32.497 INFO:tasks.workunit.client.1.smithi167.stdout:7/645: dwrite d0/d2/faa [0,4194304] 0 2024-09-17T01:41:32.499 INFO:tasks.workunit.client.1.smithi167.stdout:3/705: dread - d7/d8/d10/d14/d25/dc7/dd1/dc2/fd8 zero size 2024-09-17T01:41:32.501 INFO:tasks.workunit.client.0.smithi082.stdout:9/314: write d4/f30 [989829,31419] 0 2024-09-17T01:41:32.502 INFO:tasks.workunit.client.1.smithi167.stdout:8/768: dwrite dc/d56/d57/d7e/dad/fcb [0,4194304] 0 2024-09-17T01:41:32.502 INFO:tasks.workunit.client.1.smithi167.stdout:3/706: truncate d7/d8/d10/d29/fa4 2320394 0 2024-09-17T01:41:32.503 INFO:tasks.workunit.client.0.smithi082.stdout:8/316: truncate d3/dd/f30 5171948 0 2024-09-17T01:41:32.504 INFO:tasks.workunit.client.1.smithi167.stdout:8/769: chown dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/fce 212765 1 2024-09-17T01:41:32.504 INFO:tasks.workunit.client.1.smithi167.stdout:4/675: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/fa1 [135791,34929] 0 2024-09-17T01:41:32.508 INFO:tasks.workunit.client.1.smithi167.stdout:1/711: chown d0/d5/d61/da2 36270 1 2024-09-17T01:41:32.512 INFO:tasks.workunit.client.0.smithi082.stdout:8/317: rmdir d3/dd/d18/d2d 39 2024-09-17T01:41:32.513 INFO:tasks.workunit.client.1.smithi167.stdout:9/754: symlink d4/d9/d21/d2d/d33/d90/dac/led 0 2024-09-17T01:41:32.513 INFO:tasks.workunit.client.1.smithi167.stdout:9/755: dread - d4/d9/d2b/f7a zero size 2024-09-17T01:41:32.522 INFO:tasks.workunit.client.1.smithi167.stdout:6/835: getdents d7/d54/d90/db3 0 2024-09-17T01:41:32.522 INFO:tasks.workunit.client.0.smithi082.stdout:2/367: dwrite d1/d10/f28 [0,4194304] 0 2024-09-17T01:41:32.523 INFO:tasks.workunit.client.1.smithi167.stdout:7/646: mknod d0/d2/d88/d6e/da3/cdd 0 2024-09-17T01:41:32.524 INFO:tasks.workunit.client.1.smithi167.stdout:3/707: mknod d7/d8/d10/d14/d25/dc7/dd1/dc2/cee 0 2024-09-17T01:41:32.525 INFO:tasks.workunit.client.0.smithi082.stdout:8/318: creat d3/dd/d18/d34/f63 x:0 0 0 2024-09-17T01:41:32.526 INFO:tasks.workunit.client.0.smithi082.stdout:9/315: dread d4/f57 [0,4194304] 0 2024-09-17T01:41:32.527 INFO:tasks.workunit.client.1.smithi167.stdout:0/630: link d5/d6b/l9f d5/d6b/d77/d6d/lce 0 2024-09-17T01:41:32.529 INFO:tasks.workunit.client.0.smithi082.stdout:8/319: chown d3/dd/d18/d2d/d3e/d4a/l4c 74070 1 2024-09-17T01:41:32.531 INFO:tasks.workunit.client.1.smithi167.stdout:2/666: creat d5/feb x:0 0 0 2024-09-17T01:41:32.532 INFO:tasks.workunit.client.0.smithi082.stdout:8/320: chown d3/dd/d18/d3a/f4b 954368524 1 2024-09-17T01:41:32.535 INFO:tasks.workunit.client.1.smithi167.stdout:6/836: creat d7/d54/d90/d13/d2f/d7f/f125 x:0 0 0 2024-09-17T01:41:32.537 INFO:tasks.workunit.client.1.smithi167.stdout:7/647: stat d0/d2/d14/c3a 0 2024-09-17T01:41:32.539 INFO:tasks.workunit.client.0.smithi082.stdout:2/368: link d1/d35/f30 d1/d17/d38/d42/d52/f70 0 2024-09-17T01:41:32.544 INFO:tasks.workunit.client.1.smithi167.stdout:4/676: mkdir d0/d4/d7/de2 0 2024-09-17T01:41:32.544 INFO:tasks.workunit.client.1.smithi167.stdout:5/621: dwrite d0/d9/d1c/f60 [0,4194304] 0 2024-09-17T01:41:32.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/369: dwrite d1/d17/d29/f4c [0,4194304] 0 2024-09-17T01:41:32.546 INFO:tasks.workunit.client.1.smithi167.stdout:0/631: mknod d5/d6b/d77/d6d/d90/dc4/ccf 0 2024-09-17T01:41:32.550 INFO:tasks.workunit.client.1.smithi167.stdout:1/712: rename d0/d9/c39 to d0/d5/d34/d3c/d85/db5/dc1/ced 0 2024-09-17T01:41:32.551 INFO:tasks.workunit.client.0.smithi082.stdout:8/321: rename d3/f10 to d3/f64 0 2024-09-17T01:41:32.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/322: fdatasync d3/f25 0 2024-09-17T01:41:32.554 INFO:tasks.workunit.client.1.smithi167.stdout:3/708: dread d7/d8/d10/d14/f5a [0,4194304] 0 2024-09-17T01:41:32.554 INFO:tasks.workunit.client.0.smithi082.stdout:9/316: dread d4/d27/d2d/d60/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:32.555 INFO:tasks.workunit.client.1.smithi167.stdout:5/622: dwrite d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad [4194304,4194304] 0 2024-09-17T01:41:32.557 INFO:tasks.workunit.client.1.smithi167.stdout:5/623: truncate d0/d24/d93/d99/fbb 237283 0 2024-09-17T01:41:32.559 INFO:tasks.workunit.client.1.smithi167.stdout:6/837: creat d7/d54/d90/d13/d2f/d30/d32/f126 x:0 0 0 2024-09-17T01:41:32.559 INFO:tasks.workunit.client.0.smithi082.stdout:8/323: unlink d3/dd/f31 0 2024-09-17T01:41:32.561 INFO:tasks.workunit.client.1.smithi167.stdout:6/838: readlink d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/la9 0 2024-09-17T01:41:32.562 INFO:tasks.workunit.client.0.smithi082.stdout:2/370: rename d1/c31 to d1/d17/d38/d42/c71 0 2024-09-17T01:41:32.564 INFO:tasks.workunit.client.0.smithi082.stdout:9/317: rmdir d4/d27 39 2024-09-17T01:41:32.566 INFO:tasks.workunit.client.0.smithi082.stdout:4/345: sync 2024-09-17T01:41:32.566 INFO:tasks.workunit.client.1.smithi167.stdout:8/770: dwrite dc/f3c [0,4194304] 0 2024-09-17T01:41:32.567 INFO:tasks.workunit.client.0.smithi082.stdout:8/324: rename d3/dd/d18/d2d/d3e/d4a/c61 to d3/dd/d18/d3a/c65 0 2024-09-17T01:41:32.568 INFO:tasks.workunit.client.0.smithi082.stdout:2/371: rmdir d1/d17/d29 39 2024-09-17T01:41:32.571 INFO:tasks.workunit.client.0.smithi082.stdout:9/318: write d4/d27/d2d/d60/d11/d39/d29/d35/f61 [859212,113377] 0 2024-09-17T01:41:32.572 INFO:tasks.workunit.client.1.smithi167.stdout:1/713: dread - d0/d5/d34/d3c/f89 zero size 2024-09-17T01:41:32.572 INFO:tasks.workunit.client.1.smithi167.stdout:1/714: fdatasync d0/d5/dd7/fda 0 2024-09-17T01:41:32.579 INFO:tasks.workunit.client.1.smithi167.stdout:5/624: symlink d0/d24/d2b/d49/d4b/dac/d3a/lbe 0 2024-09-17T01:41:32.582 INFO:tasks.workunit.client.0.smithi082.stdout:9/319: mkdir d4/d27/d2d/d60/d11/d39/d29/d6d 0 2024-09-17T01:41:32.583 INFO:tasks.workunit.client.1.smithi167.stdout:6/839: creat d7/d42/f127 x:0 0 0 2024-09-17T01:41:32.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/346: link d9/d15/f6b d9/d15/d37/f71 0 2024-09-17T01:41:32.586 INFO:tasks.workunit.client.1.smithi167.stdout:7/648: dwrite d0/d2/f7a [4194304,4194304] 0 2024-09-17T01:41:32.588 INFO:tasks.workunit.client.0.smithi082.stdout:9/320: dwrite d4/f1d [0,4194304] 0 2024-09-17T01:41:32.589 INFO:tasks.workunit.client.1.smithi167.stdout:4/677: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1/le3 0 2024-09-17T01:41:32.591 INFO:tasks.workunit.client.0.smithi082.stdout:2/372: rmdir d1/d5a/d61 0 2024-09-17T01:41:32.592 INFO:tasks.workunit.client.1.smithi167.stdout:2/667: write d5/d33/d48/f80 [628942,57277] 0 2024-09-17T01:41:32.592 INFO:tasks.workunit.client.0.smithi082.stdout:8/325: write d3/f33 [5019385,120472] 0 2024-09-17T01:41:32.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/756: getdents d4/d9/d21/d81/dbf 0 2024-09-17T01:41:32.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/321: dwrite d4/d27/d2d/d60/fb [0,4194304] 0 2024-09-17T01:41:32.601 INFO:tasks.workunit.client.1.smithi167.stdout:0/632: dwrite d5/d6b/d77/d4d/f22 [4194304,4194304] 0 2024-09-17T01:41:32.601 INFO:tasks.workunit.client.1.smithi167.stdout:5/625: dread d0/d24/d2b/f81 [0,4194304] 0 2024-09-17T01:41:32.601 INFO:tasks.workunit.client.1.smithi167.stdout:0/633: dread - d5/d8/d5c/fb6 zero size 2024-09-17T01:41:32.603 INFO:tasks.workunit.client.1.smithi167.stdout:9/757: read d4/d9/d21/f3b [936461,48277] 0 2024-09-17T01:41:32.603 INFO:tasks.workunit.client.1.smithi167.stdout:1/715: unlink d0/d5/dbf/fc5 0 2024-09-17T01:41:32.604 INFO:tasks.workunit.client.0.smithi082.stdout:2/373: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:41:32.605 INFO:tasks.workunit.client.0.smithi082.stdout:4/347: symlink d9/d15/d37/l72 0 2024-09-17T01:41:32.608 INFO:tasks.workunit.client.1.smithi167.stdout:3/709: rename d7/f41 to d7/d8/d10/fef 0 2024-09-17T01:41:32.610 INFO:tasks.workunit.client.0.smithi082.stdout:8/326: fsync d3/fb 0 2024-09-17T01:41:32.613 INFO:tasks.workunit.client.0.smithi082.stdout:4/348: dread d9/d15/d16/d3e/f3f [0,4194304] 0 2024-09-17T01:41:32.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/634: dwrite d5/f1d [0,4194304] 0 2024-09-17T01:41:32.615 INFO:tasks.workunit.client.1.smithi167.stdout:8/771: creat dc/d56/d59/d82/dbe/ffd x:0 0 0 2024-09-17T01:41:32.619 INFO:tasks.workunit.client.1.smithi167.stdout:2/668: unlink d5/l6a 0 2024-09-17T01:41:32.620 INFO:tasks.workunit.client.1.smithi167.stdout:5/626: dwrite d0/d24/faa [0,4194304] 0 2024-09-17T01:41:32.624 INFO:tasks.workunit.client.1.smithi167.stdout:9/758: symlink d4/d9/d21/d43/d6c/lee 0 2024-09-17T01:41:32.624 INFO:tasks.workunit.client.1.smithi167.stdout:8/772: dwrite dc/d21/f34 [4194304,4194304] 0 2024-09-17T01:41:32.625 INFO:tasks.workunit.client.1.smithi167.stdout:9/759: write d4/f83 [5771539,23534] 0 2024-09-17T01:41:32.626 INFO:tasks.workunit.client.1.smithi167.stdout:8/773: truncate dc/d56/d59/fda 910565 0 2024-09-17T01:41:32.627 INFO:tasks.workunit.client.0.smithi082.stdout:9/322: symlink d4/d27/d2d/l6e 0 2024-09-17T01:41:32.628 INFO:tasks.workunit.client.0.smithi082.stdout:9/323: chown d4/d59/d63/f67 239 1 2024-09-17T01:41:32.629 INFO:tasks.workunit.client.1.smithi167.stdout:6/840: symlink d7/d54/d90/dfc/d10c/l128 0 2024-09-17T01:41:32.629 INFO:tasks.workunit.client.0.smithi082.stdout:9/324: readlink d4/d27/l5d 0 2024-09-17T01:41:32.629 INFO:tasks.workunit.client.0.smithi082.stdout:2/374: mknod d1/d17/d38/d42/d52/c72 0 2024-09-17T01:41:32.631 INFO:tasks.workunit.client.0.smithi082.stdout:9/325: truncate d4/f4c 277863 0 2024-09-17T01:41:32.631 INFO:tasks.workunit.client.1.smithi167.stdout:6/841: dread - d7/d42/f117 zero size 2024-09-17T01:41:32.634 INFO:tasks.workunit.client.0.smithi082.stdout:8/327: chown d3/c8 124248921 1 2024-09-17T01:41:32.635 INFO:tasks.workunit.client.1.smithi167.stdout:0/635: creat d5/d8/d5c/fd0 x:0 0 0 2024-09-17T01:41:32.636 INFO:tasks.workunit.client.1.smithi167.stdout:6/842: write d7/d54/d90/d13/d2f/d64/d6b/d95/db1/ffd [475620,19108] 0 2024-09-17T01:41:32.637 INFO:tasks.workunit.client.1.smithi167.stdout:5/627: rmdir d0/d24/d2b/d49 39 2024-09-17T01:41:32.638 INFO:tasks.workunit.client.1.smithi167.stdout:8/774: dwrite dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/fce [0,4194304] 0 2024-09-17T01:41:32.638 INFO:tasks.workunit.client.1.smithi167.stdout:4/678: dread d0/d4/d7/d6/d2b/d6d/d7e/fde [0,4194304] 0 2024-09-17T01:41:32.639 INFO:tasks.workunit.client.1.smithi167.stdout:2/669: mknod d5/d3c/d4c/de2/db8/da3/dc8/cec 0 2024-09-17T01:41:32.639 INFO:tasks.workunit.client.1.smithi167.stdout:5/628: chown d0/d9/fb 7446 1 2024-09-17T01:41:32.641 INFO:tasks.workunit.client.0.smithi082.stdout:2/375: dwrite d1/d35/f65 [4194304,4194304] 0 2024-09-17T01:41:32.641 INFO:tasks.workunit.client.0.smithi082.stdout:9/326: dwrite d4/f17 [4194304,4194304] 0 2024-09-17T01:41:32.641 INFO:tasks.workunit.client.0.smithi082.stdout:8/328: dread d3/dd/f26 [0,4194304] 0 2024-09-17T01:41:32.641 INFO:tasks.workunit.client.0.smithi082.stdout:4/349: truncate d9/fd 4287109 0 2024-09-17T01:41:32.642 INFO:tasks.workunit.client.1.smithi167.stdout:9/760: symlink d4/d9/d21/d81/dbf/lef 0 2024-09-17T01:41:32.644 INFO:tasks.workunit.client.1.smithi167.stdout:0/636: unlink d5/d6b/d77/d4d/la5 0 2024-09-17T01:41:32.645 INFO:tasks.workunit.client.1.smithi167.stdout:0/637: stat d5/d8/f46 0 2024-09-17T01:41:32.648 INFO:tasks.workunit.client.1.smithi167.stdout:8/775: fdatasync dc/f7a 0 2024-09-17T01:41:32.650 INFO:tasks.workunit.client.1.smithi167.stdout:2/670: symlink d5/d3c/d4c/de2/db8/d5e/led 0 2024-09-17T01:41:32.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/327: dwrite d4/f1d [4194304,4194304] 0 2024-09-17T01:41:32.654 INFO:tasks.workunit.client.1.smithi167.stdout:4/679: rename d0/d4/cdd to d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d4f/ce4 0 2024-09-17T01:41:32.655 INFO:tasks.workunit.client.1.smithi167.stdout:2/671: dread d5/d10/d16/f65 [0,4194304] 0 2024-09-17T01:41:32.658 INFO:tasks.workunit.client.0.smithi082.stdout:8/329: unlink d3/f1f 0 2024-09-17T01:41:32.659 INFO:tasks.workunit.client.1.smithi167.stdout:7/649: getdents d0/d2/d14/d6f/d87 0 2024-09-17T01:41:32.661 INFO:tasks.workunit.client.0.smithi082.stdout:9/328: dwrite d4/d27/d2d/d60/fb [0,4194304] 0 2024-09-17T01:41:32.662 INFO:tasks.workunit.client.1.smithi167.stdout:9/761: truncate d4/d9/d21/d43/f77 7027186 0 2024-09-17T01:41:32.662 INFO:tasks.workunit.client.0.smithi082.stdout:9/329: chown d4/d27/d2d/d60/d11 1 1 2024-09-17T01:41:32.662 INFO:tasks.workunit.client.0.smithi082.stdout:2/376: dread d1/d10/f14 [0,4194304] 0 2024-09-17T01:41:32.664 INFO:tasks.workunit.client.0.smithi082.stdout:9/330: dread d4/f4c [0,4194304] 0 2024-09-17T01:41:32.665 INFO:tasks.workunit.client.1.smithi167.stdout:0/638: mkdir d5/d6b/dd1 0 2024-09-17T01:41:32.665 INFO:tasks.workunit.client.0.smithi082.stdout:8/330: mkdir d3/dd/d18/d2d/d3e/d4a/d66 0 2024-09-17T01:41:32.666 INFO:tasks.workunit.client.1.smithi167.stdout:7/650: dread d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:32.667 INFO:tasks.workunit.client.1.smithi167.stdout:0/639: write d5/d6b/d77/d6d/f8e [556628,129422] 0 2024-09-17T01:41:32.667 INFO:tasks.workunit.client.1.smithi167.stdout:4/680: dread d0/d4/d7/d6/d5d/f68 [0,4194304] 0 2024-09-17T01:41:32.669 INFO:tasks.workunit.client.1.smithi167.stdout:4/681: stat d0/d4/d7/da/c49 0 2024-09-17T01:41:32.670 INFO:tasks.workunit.client.1.smithi167.stdout:4/682: fsync d0/d4/db4/fb5 0 2024-09-17T01:41:32.671 INFO:tasks.workunit.client.1.smithi167.stdout:8/776: truncate dc/d56/f62 4109261 0 2024-09-17T01:41:32.673 INFO:tasks.workunit.client.1.smithi167.stdout:0/640: fsync d5/f1d 0 2024-09-17T01:41:32.675 INFO:tasks.workunit.client.1.smithi167.stdout:6/843: dread d7/d54/d90/d13/f2d [0,4194304] 0 2024-09-17T01:41:32.675 INFO:tasks.workunit.client.1.smithi167.stdout:2/672: rmdir d5/d3c/d4c/de2/d45/d8e 39 2024-09-17T01:41:32.675 INFO:tasks.workunit.client.0.smithi082.stdout:8/331: dread d3/f7 [0,4194304] 0 2024-09-17T01:41:32.677 INFO:tasks.workunit.client.0.smithi082.stdout:8/332: chown d3/dd/d18/d34/f4f 2000 1 2024-09-17T01:41:32.677 INFO:tasks.workunit.client.1.smithi167.stdout:2/673: write d5/d3c/d4c/de2/db8/da3/db0/fd8 [356430,24590] 0 2024-09-17T01:41:32.679 INFO:tasks.workunit.client.1.smithi167.stdout:7/651: creat d0/d2/d88/fde x:0 0 0 2024-09-17T01:41:32.682 INFO:tasks.workunit.client.1.smithi167.stdout:3/710: dread - d7/d8/d10/d14/d66/d6c/d7c/dc8/fdd zero size 2024-09-17T01:41:32.684 INFO:tasks.workunit.client.0.smithi082.stdout:2/377: link d1/d17/l27 d1/d17/d38/d42/l73 0 2024-09-17T01:41:32.689 INFO:tasks.workunit.client.1.smithi167.stdout:0/641: creat d5/d8/d5c/fd2 x:0 0 0 2024-09-17T01:41:32.689 INFO:tasks.workunit.client.0.smithi082.stdout:8/333: symlink d3/dd/d18/l67 0 2024-09-17T01:41:32.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/331: link d4/d27/d2d/d60/d11/d39/l69 d4/d27/d2d/d60/d11/d39/l6f 0 2024-09-17T01:41:32.694 INFO:tasks.workunit.client.0.smithi082.stdout:1/418: sync 2024-09-17T01:41:32.694 INFO:tasks.workunit.client.0.smithi082.stdout:8/334: readlink d3/dd/d18/l28 0 2024-09-17T01:41:32.695 INFO:tasks.workunit.client.0.smithi082.stdout:2/378: symlink d1/d17/d29/d50/l74 0 2024-09-17T01:41:32.697 INFO:tasks.workunit.client.1.smithi167.stdout:7/652: creat d0/d2/d14/d6f/d75/fdf x:0 0 0 2024-09-17T01:41:32.697 INFO:tasks.workunit.client.1.smithi167.stdout:3/711: read d7/f65 [412935,50580] 0 2024-09-17T01:41:32.698 INFO:tasks.workunit.client.1.smithi167.stdout:3/712: chown d7/d8/d1f/l79 1377518 1 2024-09-17T01:41:32.703 INFO:tasks.workunit.client.0.smithi082.stdout:8/335: dwrite d3/dd/f56 [0,4194304] 0 2024-09-17T01:41:32.704 INFO:tasks.workunit.client.1.smithi167.stdout:4/683: creat d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/fe5 x:0 0 0 2024-09-17T01:41:32.708 INFO:tasks.workunit.client.0.smithi082.stdout:2/379: dwrite d1/d10/f6b [0,4194304] 0 2024-09-17T01:41:32.710 INFO:tasks.workunit.client.0.smithi082.stdout:9/332: dwrite d4/d27/d2d/d60/f34 [4194304,4194304] 0 2024-09-17T01:41:32.716 INFO:tasks.workunit.client.0.smithi082.stdout:2/380: dwrite d1/d17/f21 [4194304,4194304] 0 2024-09-17T01:41:32.740 INFO:tasks.workunit.client.1.smithi167.stdout:1/716: sync 2024-09-17T01:41:32.751 INFO:tasks.workunit.client.1.smithi167.stdout:5/629: dwrite d0/f18 [4194304,4194304] 0 2024-09-17T01:41:32.754 INFO:tasks.workunit.client.0.smithi082.stdout:4/350: write d9/d15/d16/d18/f32 [905617,16620] 0 2024-09-17T01:41:32.754 INFO:tasks.workunit.client.0.smithi082.stdout:4/351: readlink d9/l1b 0 2024-09-17T01:41:32.761 INFO:tasks.workunit.client.1.smithi167.stdout:4/684: creat d0/d4/d7/d6/d2b/d6d/d7e/da8/fe6 x:0 0 0 2024-09-17T01:41:32.764 INFO:tasks.workunit.client.1.smithi167.stdout:0/642: creat d5/d6b/d77/d6d/d90/dc4/dc7/fd3 x:0 0 0 2024-09-17T01:41:32.764 INFO:tasks.workunit.client.1.smithi167.stdout:5/630: dread d0/f1d [0,4194304] 0 2024-09-17T01:41:32.766 INFO:tasks.workunit.client.1.smithi167.stdout:0/643: write d5/d8/f46 [5085152,25196] 0 2024-09-17T01:41:32.774 INFO:tasks.workunit.client.0.smithi082.stdout:2/381: rename d1/c2 to d1/d17/d60/c75 0 2024-09-17T01:41:32.775 INFO:tasks.workunit.client.0.smithi082.stdout:2/382: write d1/f16 [3317120,106076] 0 2024-09-17T01:41:32.778 INFO:tasks.workunit.client.0.smithi082.stdout:4/352: dread d9/d15/d16/d18/f21 [0,4194304] 0 2024-09-17T01:41:32.779 INFO:tasks.workunit.client.0.smithi082.stdout:1/419: getdents d2/da/d2d 0 2024-09-17T01:41:32.784 INFO:tasks.workunit.client.0.smithi082.stdout:2/383: truncate d1/d17/f3b 180564 0 2024-09-17T01:41:32.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/353: mkdir d9/d15/d16/d3e/d73 0 2024-09-17T01:41:32.788 INFO:tasks.workunit.client.0.smithi082.stdout:4/354: stat d9/d15/d16/d3e/d73 0 2024-09-17T01:41:32.788 INFO:tasks.workunit.client.1.smithi167.stdout:6/844: dwrite d7/d54/d90/d13/d2f/d64/d6b/f82 [0,4194304] 0 2024-09-17T01:41:32.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/355: write d9/d15/f62 [445230,129294] 0 2024-09-17T01:41:32.790 INFO:tasks.workunit.client.0.smithi082.stdout:4/356: chown d9/d15/d16/d18/f38 4004835 1 2024-09-17T01:41:32.796 INFO:tasks.workunit.client.0.smithi082.stdout:1/420: chown d2/da/d16/c7a 1 1 2024-09-17T01:41:32.800 INFO:tasks.workunit.client.0.smithi082.stdout:2/384: creat d1/d17/d38/d42/d52/f76 x:0 0 0 2024-09-17T01:41:32.801 INFO:tasks.workunit.client.1.smithi167.stdout:4/685: chown d0/d4/d7/d6/c58 217472214 1 2024-09-17T01:41:32.803 INFO:tasks.workunit.client.0.smithi082.stdout:4/357: creat d9/d15/d16/d18/d4a/d52/d55/d48/f74 x:0 0 0 2024-09-17T01:41:32.803 INFO:tasks.workunit.client.0.smithi082.stdout:4/358: chown d9/d47 366 1 2024-09-17T01:41:32.813 INFO:tasks.workunit.client.1.smithi167.stdout:5/631: dread d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae [0,4194304] 0 2024-09-17T01:41:32.813 INFO:tasks.workunit.client.0.smithi082.stdout:4/359: mknod d9/d15/d16/d3e/c75 0 2024-09-17T01:41:32.816 INFO:tasks.workunit.client.0.smithi082.stdout:1/421: creat d2/da/d2f/d47/f84 x:0 0 0 2024-09-17T01:41:32.817 INFO:tasks.workunit.client.1.smithi167.stdout:6/845: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/c129 0 2024-09-17T01:41:32.823 INFO:tasks.workunit.client.0.smithi082.stdout:1/422: chown d2/l2b 16873736 1 2024-09-17T01:41:32.825 INFO:tasks.workunit.client.1.smithi167.stdout:9/762: rename d4/d4a to d4/d9/d21/df0 0 2024-09-17T01:41:32.831 INFO:tasks.workunit.client.0.smithi082.stdout:2/385: link d1/d17/d29/f33 d1/d17/d29/d50/f77 0 2024-09-17T01:41:32.832 INFO:tasks.workunit.client.1.smithi167.stdout:3/713: getdents d7/d8/d2a/d7a 0 2024-09-17T01:41:32.833 INFO:tasks.workunit.client.0.smithi082.stdout:1/423: symlink d2/da/d16/l85 0 2024-09-17T01:41:32.834 INFO:tasks.workunit.client.1.smithi167.stdout:4/686: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/le7 0 2024-09-17T01:41:32.835 INFO:tasks.workunit.client.0.smithi082.stdout:2/386: mkdir d1/d17/d38/d42/d52/d78 0 2024-09-17T01:41:32.838 INFO:tasks.workunit.client.1.smithi167.stdout:8/777: rename dc/d56/d59/d82/d8f/de5/fc8 to dc/d56/d59/d82/d8f/de5/dba/dd3/df3/ffe 0 2024-09-17T01:41:32.839 INFO:tasks.workunit.client.0.smithi082.stdout:1/424: write d2/f4 [6193858,45795] 0 2024-09-17T01:41:32.842 INFO:tasks.workunit.client.0.smithi082.stdout:2/387: creat d1/d17/d38/d5c/f79 x:0 0 0 2024-09-17T01:41:32.844 INFO:tasks.workunit.client.1.smithi167.stdout:5/632: mknod d0/d24/d2b/d3d/d3b/db0/cbf 0 2024-09-17T01:41:32.850 INFO:tasks.workunit.client.1.smithi167.stdout:3/714: stat d7/d8/d10/d29/c33 0 2024-09-17T01:41:32.853 INFO:tasks.workunit.client.0.smithi082.stdout:1/425: dread d2/da/d2d/f41 [0,4194304] 0 2024-09-17T01:41:32.855 INFO:tasks.workunit.client.0.smithi082.stdout:1/426: write d2/d3f/d24/d54/f74 [496383,130303] 0 2024-09-17T01:41:32.857 INFO:tasks.workunit.client.1.smithi167.stdout:0/644: rename d5/d6b/d7e/fc1 to d5/d6b/dca/fd4 0 2024-09-17T01:41:32.859 INFO:tasks.workunit.client.1.smithi167.stdout:9/763: symlink d4/d9/d21/d81/lf1 0 2024-09-17T01:41:32.861 INFO:tasks.workunit.client.0.smithi082.stdout:1/427: rename d2/df/d46/f7b to d2/d3f/d24/f86 0 2024-09-17T01:41:32.862 INFO:tasks.workunit.client.0.smithi082.stdout:1/428: rename d2/da to d2/da/d2f/d47/d87 22 2024-09-17T01:41:32.866 INFO:tasks.workunit.client.1.smithi167.stdout:4/687: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/ce8 0 2024-09-17T01:41:32.869 INFO:tasks.workunit.client.1.smithi167.stdout:3/715: dread d7/d8/d10/d14/d24/d62/f77 [0,4194304] 0 2024-09-17T01:41:32.872 INFO:tasks.workunit.client.0.smithi082.stdout:1/429: creat d2/d3f/f88 x:0 0 0 2024-09-17T01:41:32.872 INFO:tasks.workunit.client.0.smithi082.stdout:1/430: chown d2/da 259272036 1 2024-09-17T01:41:32.873 INFO:tasks.workunit.client.1.smithi167.stdout:8/778: link dc/d21/d6b/f6c dc/d21/d6b/d74/fff 0 2024-09-17T01:41:32.873 INFO:tasks.workunit.client.1.smithi167.stdout:0/645: dread d5/d8/d9/f62 [0,4194304] 0 2024-09-17T01:41:32.883 INFO:tasks.workunit.client.0.smithi082.stdout:3/256: sync 2024-09-17T01:41:32.884 INFO:tasks.workunit.client.0.smithi082.stdout:5/403: sync 2024-09-17T01:41:32.884 INFO:tasks.workunit.client.0.smithi082.stdout:7/355: sync 2024-09-17T01:41:32.884 INFO:tasks.workunit.client.0.smithi082.stdout:6/415: sync 2024-09-17T01:41:32.884 INFO:tasks.workunit.client.0.smithi082.stdout:0/276: sync 2024-09-17T01:41:32.884 INFO:tasks.workunit.client.0.smithi082.stdout:4/360: mknod d9/d15/d37/c76 0 2024-09-17T01:41:32.885 INFO:tasks.workunit.client.1.smithi167.stdout:8/779: mkdir dc/d56/d57/dc2/d100 0 2024-09-17T01:41:32.886 INFO:tasks.workunit.client.0.smithi082.stdout:5/404: chown db/d1e/c75 3804032 1 2024-09-17T01:41:32.889 INFO:tasks.workunit.client.0.smithi082.stdout:1/431: dread d2/d3f/f13 [0,4194304] 0 2024-09-17T01:41:32.892 INFO:tasks.workunit.client.1.smithi167.stdout:5/633: rename d0/d9/f34 to d0/d54/fc0 0 2024-09-17T01:41:32.894 INFO:tasks.workunit.client.1.smithi167.stdout:8/780: mkdir dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/d101 0 2024-09-17T01:41:32.896 INFO:tasks.workunit.client.0.smithi082.stdout:8/336: write d3/dd/d18/d2d/d3e/d43/f45 [5074284,1952] 0 2024-09-17T01:41:32.897 INFO:tasks.workunit.client.0.smithi082.stdout:4/361: mknod d9/d15/d16/c77 0 2024-09-17T01:41:32.897 INFO:tasks.workunit.client.0.smithi082.stdout:8/337: readlink d3/dd/d18/d2d/d3e/d4a/l4c 0 2024-09-17T01:41:32.898 INFO:tasks.workunit.client.0.smithi082.stdout:8/338: chown d3/dd 762343202 1 2024-09-17T01:41:32.898 INFO:tasks.workunit.client.1.smithi167.stdout:5/634: chown d0/d24/d2b/d3d/c50 213524969 1 2024-09-17T01:41:32.900 INFO:tasks.workunit.client.0.smithi082.stdout:8/339: read d3/dd/f27 [2067334,128686] 0 2024-09-17T01:41:32.900 INFO:tasks.workunit.client.0.smithi082.stdout:4/362: truncate d9/d15/d37/d45/f69 737338 0 2024-09-17T01:41:32.904 INFO:tasks.workunit.client.1.smithi167.stdout:5/635: symlink d0/d24/d2b/d3d/d3b/lc1 0 2024-09-17T01:41:32.911 INFO:tasks.workunit.client.1.smithi167.stdout:5/636: symlink d0/d24/d2b/d49/d4b/lc2 0 2024-09-17T01:41:32.911 INFO:tasks.workunit.client.1.smithi167.stdout:2/674: truncate d5/d3c/d4c/f90 1854971 0 2024-09-17T01:41:32.912 INFO:tasks.workunit.client.1.smithi167.stdout:8/781: dread dc/d56/d57/d5c/f5d [0,4194304] 0 2024-09-17T01:41:32.913 INFO:tasks.workunit.client.1.smithi167.stdout:2/675: chown d5/d3c/d4c/de2/d45/d6b/caa 1 1 2024-09-17T01:41:32.913 INFO:tasks.workunit.client.1.smithi167.stdout:2/676: fsync d5/d33/d48/fa8 0 2024-09-17T01:41:32.917 INFO:tasks.workunit.client.1.smithi167.stdout:5/637: symlink d0/d9/d64/d95/lc3 0 2024-09-17T01:41:32.921 INFO:tasks.workunit.client.0.smithi082.stdout:8/340: fdatasync d3/dd/d18/d34/f5c 0 2024-09-17T01:41:32.922 INFO:tasks.workunit.client.1.smithi167.stdout:5/638: mkdir d0/d9/d64/dc4 0 2024-09-17T01:41:32.923 INFO:tasks.workunit.client.1.smithi167.stdout:5/639: write d0/d24/d2b/d49/d4b/fa2 [53170,87248] 0 2024-09-17T01:41:32.925 INFO:tasks.workunit.client.0.smithi082.stdout:7/356: creat d0/f7a x:0 0 0 2024-09-17T01:41:32.927 INFO:tasks.workunit.client.1.smithi167.stdout:2/677: rmdir d5/d3c/d4c/de2/d45/d8e/d98 39 2024-09-17T01:41:32.929 INFO:tasks.workunit.client.1.smithi167.stdout:5/640: unlink d0/d24/d2b/d3d/d3b/db0/db5/fb6 0 2024-09-17T01:41:32.930 INFO:tasks.workunit.client.1.smithi167.stdout:5/641: write d0/d24/d2b/fb2 [1030702,49849] 0 2024-09-17T01:41:32.934 INFO:tasks.workunit.client.0.smithi082.stdout:3/257: rmdir d9/db/d49/d4a 0 2024-09-17T01:41:32.937 INFO:tasks.workunit.client.1.smithi167.stdout:5/642: creat d0/d9/d64/fc5 x:0 0 0 2024-09-17T01:41:32.938 INFO:tasks.workunit.client.0.smithi082.stdout:8/341: mkdir d3/dd/d18/d2d/d3e/d4a/d68 0 2024-09-17T01:41:32.939 INFO:tasks.workunit.client.0.smithi082.stdout:4/363: chown d9/fd 694875 1 2024-09-17T01:41:32.940 INFO:tasks.workunit.client.0.smithi082.stdout:4/364: stat d9/d15/d16/d18/c24 0 2024-09-17T01:41:32.941 INFO:tasks.workunit.client.1.smithi167.stdout:7/653: link d0/d2/d14/f8a d0/d2/d14/d6f/fe0 0 2024-09-17T01:41:32.942 INFO:tasks.workunit.client.1.smithi167.stdout:5/643: mknod d0/d24/d2b/d3d/d3b/cc6 0 2024-09-17T01:41:32.943 INFO:tasks.workunit.client.1.smithi167.stdout:7/654: readlink d0/d2/d14/d19/d32/d62/lbd 0 2024-09-17T01:41:32.943 INFO:tasks.workunit.client.1.smithi167.stdout:1/717: dwrite d0/d5/d34/d3c/f4e [4194304,4194304] 0 2024-09-17T01:41:32.944 INFO:tasks.workunit.client.0.smithi082.stdout:0/277: link da/df/d2b/l41 da/d1b/d23/d4d/d5d/l64 0 2024-09-17T01:41:32.945 INFO:tasks.workunit.client.1.smithi167.stdout:5/644: write d0/d24/d2b/d4e/f9e [882884,110828] 0 2024-09-17T01:41:32.945 INFO:tasks.workunit.client.1.smithi167.stdout:7/655: dread - d0/d2/d88/fde zero size 2024-09-17T01:41:32.946 INFO:tasks.workunit.client.0.smithi082.stdout:3/258: dread - d9/db/d49/f32 zero size 2024-09-17T01:41:32.947 INFO:tasks.workunit.client.0.smithi082.stdout:3/259: truncate d9/db/d26/f46 92406 0 2024-09-17T01:41:32.948 INFO:tasks.workunit.client.1.smithi167.stdout:2/678: getdents d5/d3c/d4c/de2/d45 0 2024-09-17T01:41:32.949 INFO:tasks.workunit.client.0.smithi082.stdout:6/416: getdents d1/d7/d10/d4f/dc/d1d 0 2024-09-17T01:41:32.953 INFO:tasks.workunit.client.1.smithi167.stdout:7/656: write d0/fc8 [926589,114187] 0 2024-09-17T01:41:32.954 INFO:tasks.workunit.client.1.smithi167.stdout:7/657: dread - d0/d2/d14/d6f/d87/fcb zero size 2024-09-17T01:41:32.959 INFO:tasks.workunit.client.0.smithi082.stdout:3/260: truncate d9/db/f13 2148812 0 2024-09-17T01:41:32.960 INFO:tasks.workunit.client.0.smithi082.stdout:3/261: stat d9/db/d26/f52 0 2024-09-17T01:41:32.965 INFO:tasks.workunit.client.0.smithi082.stdout:8/342: link d3/dd/d18/d2d/d3e/d43/f45 d3/dd/d18/d2d/d3b/f69 0 2024-09-17T01:41:32.966 INFO:tasks.workunit.client.0.smithi082.stdout:8/343: truncate d3/dd/f2b 625505 0 2024-09-17T01:41:32.970 INFO:tasks.workunit.client.1.smithi167.stdout:2/679: creat d5/d3c/d4c/de2/db8/da3/dc8/dea/fee x:0 0 0 2024-09-17T01:41:32.970 INFO:tasks.workunit.client.1.smithi167.stdout:5/645: dread d0/d24/d2b/f39 [0,4194304] 0 2024-09-17T01:41:32.971 INFO:tasks.workunit.client.0.smithi082.stdout:6/417: getdents d1/d7/d10/d4f/dc/d1d/d36/d7a/d87 0 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 -- 172.21.15.82:0/3819791294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878101550 msgr2=0x7f38780ff6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 --2- 172.21.15.82:0/3819791294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878101550 0x7f38780ff6e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3860009880 tx=0x7f386002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 -- 172.21.15.82:0/3819791294 shutdown_connections 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 --2- 172.21.15.82:0/3819791294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878101550 0x7f38780ff6e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 --2- 172.21.15.82:0/3819791294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878100b80 0x7f3878100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 -- 172.21.15.82:0/3819791294 >> 172.21.15.82:0/3819791294 conn(0x7f38780fb350 msgr2=0x7f38780fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 -- 172.21.15.82:0/3819791294 shutdown_connections 2024-09-17T01:41:32.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.972+0000 7f387eeb3640 1 -- 172.21.15.82:0/3819791294 wait complete. 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 Processor -- start 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 -- start start 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 0x7f3878199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f387810c930 con 0x7f3878100b80 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.973+0000 7f387eeb3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f387810c7b0 con 0x7f3878101550 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:50228/0 (socket says 172.21.15.82:50228) 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 -- 172.21.15.82:0/2477845938 learned_addr learned my addr 172.21.15.82:0/2477845938 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f387cc4f640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 0x7f3878199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 -- 172.21.15.82:0/2477845938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 msgr2=0x7f3878199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 0x7f3878199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f3877fff640 1 -- 172.21.15.82:0/2477845938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387819a2d0 con 0x7f3878101550 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.974+0000 7f387cc4f640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 0x7f3878199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f3877fff640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3860006010 tx=0x7f38600045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f386003f070 con 0x7f3878101550 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38600049d0 con 0x7f3878101550 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387819ecb0 con 0x7f3878101550 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3860035030 con 0x7f3878101550 2024-09-17T01:41:32.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.975+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387819f1e0 con 0x7f3878101550 2024-09-17T01:41:32.976 INFO:tasks.workunit.client.1.smithi167.stdout:2/680: read d5/d3c/d4c/de2/d2e/f36 [3830688,47816] 0 2024-09-17T01:41:32.976 INFO:tasks.workunit.client.1.smithi167.stdout:5/646: truncate d0/d24/d2b/d3d/d3b/f98 486186 0 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.976+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878100f80 con 0x7f3878101550 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.978+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f3860042070 con 0x7f3878101550 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.978+0000 7f3875ffb640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 0x7f3864076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.978+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f38600b6da0 con 0x7f3878101550 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.978+0000 7f387cc4f640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 0x7f3864076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:32.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.979+0000 7f387cc4f640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 0x7f3864076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3870009fc0 tx=0x7f3870005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:32.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:32.983+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3860082310 con 0x7f3878101550 2024-09-17T01:41:32.983 INFO:tasks.workunit.client.0.smithi082.stdout:6/418: link d1/d7/f86 d1/f98 0 2024-09-17T01:41:32.984 INFO:tasks.workunit.client.1.smithi167.stdout:6/846: write d7/d54/d90/d13/d2f/d64/d6b/f11f [2743320,40303] 0 2024-09-17T01:41:32.985 INFO:tasks.workunit.client.0.smithi082.stdout:6/419: readlink d1/l2 0 2024-09-17T01:41:32.991 INFO:tasks.workunit.client.0.smithi082.stdout:2/388: dwrite d1/d17/d29/f33 [0,4194304] 0 2024-09-17T01:41:32.993 INFO:tasks.workunit.client.0.smithi082.stdout:6/420: dwrite d1/d3/f72 [0,4194304] 0 2024-09-17T01:41:33.003 INFO:tasks.workunit.client.0.smithi082.stdout:6/421: mkdir d1/d7/d10/d4f/dc/d99 0 2024-09-17T01:41:33.004 INFO:tasks.workunit.client.1.smithi167.stdout:9/764: truncate d4/d9/d21/d43/d6c/d9e/da1/dbc/fc1 24100 0 2024-09-17T01:41:33.005 INFO:tasks.workunit.client.1.smithi167.stdout:3/716: write d7/d8/d10/d14/d24/f97 [1972787,79604] 0 2024-09-17T01:41:33.005 INFO:tasks.workunit.client.0.smithi082.stdout:6/422: dread - d1/d7/d10/d4f/dc/d1d/d36/f91 zero size 2024-09-17T01:41:33.005 INFO:tasks.workunit.client.0.smithi082.stdout:6/423: dread - d1/d3/f75 zero size 2024-09-17T01:41:33.008 INFO:tasks.workunit.client.0.smithi082.stdout:1/432: rename d2/da/d2f/c62 to d2/c89 0 2024-09-17T01:41:33.009 INFO:tasks.workunit.client.1.smithi167.stdout:4/688: truncate d0/d4/d7/d6/d2b/d6d/d7e/f94 13040 0 2024-09-17T01:41:33.015 INFO:tasks.workunit.client.0.smithi082.stdout:7/357: rename d0/d3/db/f1b to d0/d3/d36/d37/d71/f7b 0 2024-09-17T01:41:33.016 INFO:tasks.workunit.client.0.smithi082.stdout:7/358: readlink d0/d3/d36/d37/l4a 0 2024-09-17T01:41:33.020 INFO:tasks.workunit.client.1.smithi167.stdout:0/646: dwrite d5/d8/d9/f3f [0,4194304] 0 2024-09-17T01:41:33.023 INFO:tasks.workunit.client.0.smithi082.stdout:0/278: rename da/df/c38 to da/d1b/d23/d4d/d5d/c65 0 2024-09-17T01:41:33.027 INFO:tasks.workunit.client.1.smithi167.stdout:0/647: dwrite d5/d6b/d77/d6d/d90/f9d [0,4194304] 0 2024-09-17T01:41:33.027 INFO:tasks.workunit.client.0.smithi082.stdout:1/433: creat d2/f8a x:0 0 0 2024-09-17T01:41:33.027 INFO:tasks.workunit.client.1.smithi167.stdout:7/658: readlink d0/d2/d14/d19/d7f/lc2 0 2024-09-17T01:41:33.028 INFO:tasks.workunit.client.0.smithi082.stdout:7/359: creat d0/dd/f7c x:0 0 0 2024-09-17T01:41:33.032 INFO:tasks.workunit.client.1.smithi167.stdout:5/647: write d0/d9/d64/f89 [3263867,34635] 0 2024-09-17T01:41:33.036 INFO:tasks.workunit.client.0.smithi082.stdout:7/360: mkdir d0/d3/db/d7d 0 2024-09-17T01:41:33.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/434: mknod d2/da/d2f/c8b 0 2024-09-17T01:41:33.039 INFO:tasks.workunit.client.1.smithi167.stdout:9/765: readlink d4/d9/d21/d2d/d33/d3a/d74/l92 0 2024-09-17T01:41:33.040 INFO:tasks.workunit.client.1.smithi167.stdout:2/681: dwrite d5/d3c/d4c/de2/fa7 [0,4194304] 0 2024-09-17T01:41:33.042 INFO:tasks.workunit.client.0.smithi082.stdout:9/333: unlink d4/d27/d2d/d60/d11/l32 0 2024-09-17T01:41:33.043 INFO:tasks.workunit.client.1.smithi167.stdout:8/782: write dc/d56/d59/d65/f69 [595480,84084] 0 2024-09-17T01:41:33.043 INFO:tasks.workunit.client.1.smithi167.stdout:3/717: mknod d7/d8/d10/d14/d66/d6c/d7c/cf0 0 2024-09-17T01:41:33.044 INFO:tasks.workunit.client.0.smithi082.stdout:1/435: dwrite d2/d3f/d24/f69 [0,4194304] 0 2024-09-17T01:41:33.045 INFO:tasks.workunit.client.1.smithi167.stdout:4/689: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/dac/de9 0 2024-09-17T01:41:33.046 INFO:tasks.workunit.client.0.smithi082.stdout:7/361: mkdir d0/d62/d7e 0 2024-09-17T01:41:33.047 INFO:tasks.workunit.client.0.smithi082.stdout:5/405: write db/d56/d18/f4a [1162457,49209] 0 2024-09-17T01:41:33.048 INFO:tasks.workunit.client.1.smithi167.stdout:2/682: dwrite d5/d3c/d4c/de2/d2e/f59 [0,4194304] 0 2024-09-17T01:41:33.050 INFO:tasks.workunit.client.1.smithi167.stdout:2/683: read - d5/d3c/d4c/fb5 zero size 2024-09-17T01:41:33.056 INFO:tasks.workunit.client.1.smithi167.stdout:1/718: link d0/d5/c52 d0/d5/d34/d8a/de7/cee 0 2024-09-17T01:41:33.056 INFO:tasks.workunit.client.1.smithi167.stdout:1/719: read - d0/d5/d61/da2/fd6 zero size 2024-09-17T01:41:33.057 INFO:tasks.workunit.client.1.smithi167.stdout:1/720: chown d0/d9/d16/d36 2849122 1 2024-09-17T01:41:33.058 INFO:tasks.workunit.client.1.smithi167.stdout:1/721: read d0/d5/d34/d3c/d74/fca [386291,88197] 0 2024-09-17T01:41:33.062 INFO:tasks.workunit.client.0.smithi082.stdout:7/362: dwrite d0/d3/d36/d37/d71/f7b [0,4194304] 0 2024-09-17T01:41:33.062 INFO:tasks.workunit.client.0.smithi082.stdout:0/279: dread da/d16/f51 [0,4194304] 0 2024-09-17T01:41:33.062 INFO:tasks.workunit.client.1.smithi167.stdout:7/659: creat d0/d2/d14/d19/d32/d62/fe1 x:0 0 0 2024-09-17T01:41:33.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/280: dread - da/d1b/d23/d42/d43/f57 zero size 2024-09-17T01:41:33.069 INFO:tasks.workunit.client.0.smithi082.stdout:7/363: mknod d0/d50/c7f 0 2024-09-17T01:41:33.070 INFO:tasks.workunit.client.0.smithi082.stdout:7/364: dread - d0/dd/d2c/d54/f69 zero size 2024-09-17T01:41:33.072 INFO:tasks.workunit.client.0.smithi082.stdout:0/281: rmdir da/d1b/d23/d42 39 2024-09-17T01:41:33.074 INFO:tasks.workunit.client.0.smithi082.stdout:7/365: unlink d0/d3/f21 0 2024-09-17T01:41:33.075 INFO:tasks.workunit.client.0.smithi082.stdout:4/365: write d9/d15/d16/d3e/f4e [748373,130755] 0 2024-09-17T01:41:33.079 INFO:tasks.workunit.client.0.smithi082.stdout:0/282: dwrite da/fe [0,4194304] 0 2024-09-17T01:41:33.080 INFO:tasks.workunit.client.1.smithi167.stdout:5/648: creat d0/d24/d2b/d49/fc7 x:0 0 0 2024-09-17T01:41:33.080 INFO:tasks.workunit.client.0.smithi082.stdout:0/283: chown da/df/d27/f3c 6664 1 2024-09-17T01:41:33.081 INFO:tasks.workunit.client.1.smithi167.stdout:3/718: mkdir d7/d8/d1f/df1 0 2024-09-17T01:41:33.082 INFO:tasks.workunit.client.0.smithi082.stdout:7/366: fdatasync d0/d3/f5e 0 2024-09-17T01:41:33.083 INFO:tasks.workunit.client.1.smithi167.stdout:3/719: write d7/d8/d10/d14/d2c/f2d [9610650,110067] 0 2024-09-17T01:41:33.084 INFO:tasks.workunit.client.0.smithi082.stdout:4/366: rmdir d9/d15/d16/d18/d4a/d52 39 2024-09-17T01:41:33.085 INFO:tasks.workunit.client.0.smithi082.stdout:4/367: dread - d9/d15/d16/f4b zero size 2024-09-17T01:41:33.087 INFO:tasks.workunit.client.1.smithi167.stdout:4/690: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/dc3/fea x:0 0 0 2024-09-17T01:41:33.088 INFO:tasks.workunit.client.1.smithi167.stdout:2/684: fdatasync d5/d3c/d4c/de2/d45/f68 0 2024-09-17T01:41:33.089 INFO:tasks.workunit.client.0.smithi082.stdout:0/284: creat da/d1b/d23/d4d/d5d/f66 x:0 0 0 2024-09-17T01:41:33.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/344: write d3/dd/f30 [731047,84461] 0 2024-09-17T01:41:33.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/345: chown d3/dd/f2b 29800281 1 2024-09-17T01:41:33.093 INFO:tasks.workunit.client.1.smithi167.stdout:0/648: rename d5/d6b/d77/d92/db8/cbf to d5/d6b/d77/d6d/cd5 0 2024-09-17T01:41:33.093 INFO:tasks.workunit.client.1.smithi167.stdout:0/649: write d5/d6b/d77/daa/fc3 [910236,59210] 0 2024-09-17T01:41:33.093 INFO:tasks.workunit.client.0.smithi082.stdout:8/346: chown d3/dd/d18/d2d 119384453 1 2024-09-17T01:41:33.093 INFO:tasks.workunit.client.1.smithi167.stdout:6/847: symlink d7/d54/d90/d13/d2f/d96/dab/l12a 0 2024-09-17T01:41:33.094 INFO:tasks.workunit.client.1.smithi167.stdout:6/848: truncate d7/d54/d90/d34/dc8/fee 4645457 0 2024-09-17T01:41:33.095 INFO:tasks.workunit.client.0.smithi082.stdout:4/368: rename d9/d15/d37/l3d to d9/d15/d16/d3e/d54/l78 0 2024-09-17T01:41:33.095 INFO:tasks.workunit.client.0.smithi082.stdout:7/367: dread d0/d3/db/d10/d47/f5c [0,4194304] 0 2024-09-17T01:41:33.095 INFO:tasks.workunit.client.0.smithi082.stdout:8/347: write d3/dd/d18/d2d/d3b/f48 [40948,50727] 0 2024-09-17T01:41:33.096 INFO:tasks.workunit.client.1.smithi167.stdout:9/766: mkdir d4/d9/d21/d43/df2 0 2024-09-17T01:41:33.097 INFO:tasks.workunit.client.0.smithi082.stdout:4/369: dread d9/d15/d37/d45/f69 [0,4194304] 0 2024-09-17T01:41:33.097 INFO:tasks.workunit.client.0.smithi082.stdout:0/285: symlink da/d1b/d23/d4d/d5d/l67 0 2024-09-17T01:41:33.098 INFO:tasks.workunit.client.0.smithi082.stdout:7/368: truncate d0/d3/f5e 557880 0 2024-09-17T01:41:33.099 INFO:tasks.workunit.client.1.smithi167.stdout:5/649: symlink d0/d24/d93/d99/lc8 0 2024-09-17T01:41:33.102 INFO:tasks.workunit.client.1.smithi167.stdout:9/767: dwrite d4/d9/d21/d2d/dae/fe2 [4194304,4194304] 0 2024-09-17T01:41:33.104 INFO:tasks.workunit.client.1.smithi167.stdout:4/691: fdatasync d0/d4/d7/d6/d2b/d6d/d7e/fde 0 2024-09-17T01:41:33.105 INFO:tasks.workunit.client.1.smithi167.stdout:4/692: chown d0/d4/d7/d6/f66 7 1 2024-09-17T01:41:33.105 INFO:tasks.workunit.client.0.smithi082.stdout:0/286: mknod da/d1b/d23/d4d/d5d/c68 0 2024-09-17T01:41:33.106 INFO:tasks.workunit.client.0.smithi082.stdout:0/287: stat da/d16/l1a 0 2024-09-17T01:41:33.106 INFO:tasks.workunit.client.1.smithi167.stdout:2/685: creat d5/d3c/d4c/de2/db8/d5e/fef x:0 0 0 2024-09-17T01:41:33.108 INFO:tasks.workunit.client.1.smithi167.stdout:7/660: rename d0 to d0/de2 22 2024-09-17T01:41:33.115 INFO:tasks.workunit.client.1.smithi167.stdout:5/650: unlink d0/d24/d2b/d3d/d3b/d92/lb8 0 2024-09-17T01:41:33.116 INFO:tasks.workunit.client.0.smithi082.stdout:2/389: truncate d1/d35/f65 1659242 0 2024-09-17T01:41:33.118 INFO:tasks.workunit.client.0.smithi082.stdout:0/288: rename da/d1b/d23/d42/d62 to da/d1e/d69 0 2024-09-17T01:41:33.118 INFO:tasks.workunit.client.0.smithi082.stdout:0/289: chown da/df/d2b/d59 57 1 2024-09-17T01:41:33.119 INFO:tasks.workunit.client.1.smithi167.stdout:3/720: symlink d7/d8/d10/lf2 0 2024-09-17T01:41:33.121 INFO:tasks.workunit.client.0.smithi082.stdout:4/370: getdents d9/d15/d16/d18 0 2024-09-17T01:41:33.122 INFO:tasks.workunit.client.0.smithi082.stdout:4/371: read - d9/d15/d16/d18/d4f/f6e zero size 2024-09-17T01:41:33.125 INFO:tasks.workunit.client.0.smithi082.stdout:0/290: mknod da/d1b/d23/d4d/c6a 0 2024-09-17T01:41:33.127 INFO:tasks.workunit.client.0.smithi082.stdout:0/291: read da/d1b/d23/d42/f4e [4286,27418] 0 2024-09-17T01:41:33.127 INFO:tasks.workunit.client.0.smithi082.stdout:4/372: creat d9/d47/f79 x:0 0 0 2024-09-17T01:41:33.128 INFO:tasks.workunit.client.1.smithi167.stdout:2/686: write d5/d3c/d4c/de2/d46/fb6 [3970363,101582] 0 2024-09-17T01:41:33.133 INFO:tasks.workunit.client.0.smithi082.stdout:0/292: mkdir da/d1b/d23/d42/d43/d6b 0 2024-09-17T01:41:33.134 INFO:tasks.workunit.client.0.smithi082.stdout:0/293: chown da 449 1 2024-09-17T01:41:33.135 INFO:tasks.workunit.client.1.smithi167.stdout:2/687: dwrite d5/d3c/d4c/de2/d45/d3f/fcb [0,4194304] 0 2024-09-17T01:41:33.143 INFO:tasks.workunit.client.0.smithi082.stdout:0/294: creat da/d1b/d23/d42/d43/d6b/f6c x:0 0 0 2024-09-17T01:41:33.147 INFO:tasks.workunit.client.0.smithi082.stdout:4/373: creat d9/d15/f7a x:0 0 0 2024-09-17T01:41:33.149 INFO:tasks.workunit.client.1.smithi167.stdout:3/721: dread d7/d8/d10/d14/d2c/f2d [0,4194304] 0 2024-09-17T01:41:33.150 INFO:tasks.workunit.client.0.smithi082.stdout:0/295: unlink da/d1e/f45 0 2024-09-17T01:41:33.151 INFO:tasks.workunit.client.1.smithi167.stdout:7/661: dread d0/d2/d14/d6f/d8b/fd1 [0,4194304] 0 2024-09-17T01:41:33.151 INFO:tasks.workunit.client.0.smithi082.stdout:0/296: write da/d1b/d23/d4d/d5d/f66 [1011540,69450] 0 2024-09-17T01:41:33.152 INFO:tasks.workunit.client.1.smithi167.stdout:7/662: dread - d0/d2/d14/d6f/fa0 zero size 2024-09-17T01:41:33.152 INFO:tasks.workunit.client.0.smithi082.stdout:4/374: creat d9/d2b/f7b x:0 0 0 2024-09-17T01:41:33.153 INFO:tasks.workunit.client.1.smithi167.stdout:7/663: dread - d0/d2/d14/d19/f82 zero size 2024-09-17T01:41:33.154 INFO:tasks.workunit.client.0.smithi082.stdout:5/406: truncate db/d56/d18/d23/f65 2279501 0 2024-09-17T01:41:33.156 INFO:tasks.workunit.client.1.smithi167.stdout:6/849: getdents d7/d54/d90/dfc/d10c 0 2024-09-17T01:41:33.157 INFO:tasks.workunit.client.0.smithi082.stdout:0/297: creat da/d1e/f6d x:0 0 0 2024-09-17T01:41:33.159 INFO:tasks.workunit.client.1.smithi167.stdout:7/664: dwrite d0/d2/d14/d19/d32/d62/f64 [0,4194304] 0 2024-09-17T01:41:33.161 INFO:tasks.workunit.client.1.smithi167.stdout:9/768: link d4/d9/d21/d81/c8d d4/d9/d2b/cf3 0 2024-09-17T01:41:33.161 INFO:tasks.workunit.client.0.smithi082.stdout:0/298: chown da/d1b/d23/d42/f58 2069368 1 2024-09-17T01:41:33.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/334: dwrite d4/f4c [0,4194304] 0 2024-09-17T01:41:33.166 INFO:tasks.workunit.client.1.smithi167.stdout:9/769: dwrite d4/d9/f4c [0,4194304] 0 2024-09-17T01:41:33.167 INFO:tasks.workunit.client.1.smithi167.stdout:5/651: rename d0/f20 to d0/d24/d2b/d49/d4b/dac/fc9 0 2024-09-17T01:41:33.169 INFO:tasks.workunit.client.1.smithi167.stdout:2/688: rename d5/d10 to d5/d10/d16/df0 22 2024-09-17T01:41:33.171 INFO:tasks.workunit.client.0.smithi082.stdout:0/299: dread - da/d1b/d23/d42/d43/d6b/f6c zero size 2024-09-17T01:41:33.173 INFO:tasks.workunit.client.0.smithi082.stdout:5/407: dwrite db/d56/d78/f80 [0,4194304] 0 2024-09-17T01:41:33.173 INFO:tasks.workunit.client.0.smithi082.stdout:4/375: dwrite d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:33.174 INFO:tasks.workunit.client.1.smithi167.stdout:8/783: dwrite dc/d21/d61/fb1 [0,4194304] 0 2024-09-17T01:41:33.178 INFO:tasks.workunit.client.0.smithi082.stdout:3/262: dwrite d9/db/f13 [0,4194304] 0 2024-09-17T01:41:33.181 INFO:tasks.workunit.client.0.smithi082.stdout:0/300: dread f8 [0,4194304] 0 2024-09-17T01:41:33.183 INFO:tasks.workunit.client.0.smithi082.stdout:0/301: fsync da/fe 0 2024-09-17T01:41:33.183 INFO:tasks.workunit.client.1.smithi167.stdout:7/665: symlink d0/d2/d14/d6f/d87/le3 0 2024-09-17T01:41:33.184 INFO:tasks.workunit.client.1.smithi167.stdout:7/666: stat d0/d2/d14/d6f 0 2024-09-17T01:41:33.187 INFO:tasks.workunit.client.0.smithi082.stdout:5/408: dwrite db/d56/d29/f6a [0,4194304] 0 2024-09-17T01:41:33.198 INFO:tasks.workunit.client.1.smithi167.stdout:2/689: write d5/d3c/d4c/de2/d45/d8e/d98/dca/fd6 [636463,84020] 0 2024-09-17T01:41:33.200 INFO:tasks.workunit.client.1.smithi167.stdout:2/690: fdatasync d5/d33/d48/d72/d94/fb7 0 2024-09-17T01:41:33.205 INFO:tasks.workunit.client.1.smithi167.stdout:9/770: creat d4/d9/d97/dd6/deb/ff4 x:0 0 0 2024-09-17T01:41:33.207 INFO:tasks.workunit.client.0.smithi082.stdout:5/409: write db/d2b/f36 [2418784,110760] 0 2024-09-17T01:41:33.207 INFO:tasks.workunit.client.0.smithi082.stdout:0/302: dwrite da/df/f4a [0,4194304] 0 2024-09-17T01:41:33.209 INFO:tasks.workunit.client.0.smithi082.stdout:3/263: symlink d9/l5a 0 2024-09-17T01:41:33.209 INFO:tasks.workunit.client.1.smithi167.stdout:9/771: dwrite d4/f16 [0,4194304] 0 2024-09-17T01:41:33.210 INFO:tasks.workunit.client.0.smithi082.stdout:3/264: write d9/db/d26/f46 [924705,50723] 0 2024-09-17T01:41:33.220 INFO:tasks.workunit.client.0.smithi082.stdout:0/303: rmdir da/d1b/d23/d4d/d5d 39 2024-09-17T01:41:33.221 INFO:tasks.workunit.client.0.smithi082.stdout:3/265: dwrite d9/db/d49/d4e/f50 [0,4194304] 0 2024-09-17T01:41:33.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/304: write da/d16/f48 [1836459,24995] 0 2024-09-17T01:41:33.222 INFO:tasks.workunit.client.1.smithi167.stdout:7/667: read d0/d2/d14/d23/f38 [3548799,47771] 0 2024-09-17T01:41:33.226 INFO:tasks.workunit.client.0.smithi082.stdout:5/410: creat db/d56/d29/d4f/f82 x:0 0 0 2024-09-17T01:41:33.228 INFO:tasks.workunit.client.1.smithi167.stdout:5/652: dread d0/d9/f8c [0,4194304] 0 2024-09-17T01:41:33.228 INFO:tasks.workunit.client.0.smithi082.stdout:2/390: dwrite d1/d10/f19 [0,4194304] 0 2024-09-17T01:41:33.229 INFO:tasks.workunit.client.1.smithi167.stdout:5/653: chown d0/l1e 28 1 2024-09-17T01:41:33.231 INFO:tasks.workunit.client.1.smithi167.stdout:9/772: read d4/d9/d21/d2d/d33/d3a/d9c/fb1 [223,82235] 0 2024-09-17T01:41:33.234 INFO:tasks.workunit.client.0.smithi082.stdout:4/376: fsync d9/d15/f7a 0 2024-09-17T01:41:33.234 INFO:tasks.workunit.client.1.smithi167.stdout:4/693: dwrite d0/d4/d7/f77 [0,4194304] 0 2024-09-17T01:41:33.239 INFO:tasks.workunit.client.1.smithi167.stdout:2/691: symlink d5/d3c/d4c/de2/db8/lf1 0 2024-09-17T01:41:33.241 INFO:tasks.workunit.client.1.smithi167.stdout:2/692: chown d5/d3c/d4c/de2/d2e/fe5 11442305 1 2024-09-17T01:41:33.242 INFO:tasks.workunit.client.1.smithi167.stdout:2/693: readlink d5/d3c/d4c/de2/db8/d5e/led 0 2024-09-17T01:41:33.242 INFO:tasks.workunit.client.0.smithi082.stdout:5/411: mkdir db/d1e/d5b/d83 0 2024-09-17T01:41:33.244 INFO:tasks.workunit.client.1.smithi167.stdout:7/668: mkdir d0/d2/d88/d6e/da3/dd0/de4 0 2024-09-17T01:41:33.245 INFO:tasks.workunit.client.1.smithi167.stdout:7/669: chown d0/d2/c3 14794 1 2024-09-17T01:41:33.245 INFO:tasks.workunit.client.0.smithi082.stdout:2/391: stat d1/d35/f30 0 2024-09-17T01:41:33.246 INFO:tasks.workunit.client.0.smithi082.stdout:2/392: chown d1/d17/d38/l56 4 1 2024-09-17T01:41:33.253 INFO:tasks.workunit.client.1.smithi167.stdout:1/722: sync 2024-09-17T01:41:33.254 INFO:tasks.workunit.client.0.smithi082.stdout:5/412: symlink db/d1e/d5b/l84 0 2024-09-17T01:41:33.254 INFO:tasks.workunit.client.0.smithi082.stdout:7/369: write d0/dd/f1f [4672803,90456] 0 2024-09-17T01:41:33.256 INFO:tasks.workunit.client.0.smithi082.stdout:7/370: chown d0/d62/d7e 6692048 1 2024-09-17T01:41:33.257 INFO:tasks.workunit.client.1.smithi167.stdout:6/850: truncate d7/d54/d90/d13/f99 3324675 0 2024-09-17T01:41:33.260 INFO:tasks.workunit.client.1.smithi167.stdout:3/722: dwrite d7/d8/d10/d14/d25/f6b [0,4194304] 0 2024-09-17T01:41:33.260 INFO:tasks.workunit.client.1.smithi167.stdout:5/654: dread d0/d24/d2b/d49/d4b/dac/fc9 [0,4194304] 0 2024-09-17T01:41:33.264 INFO:tasks.workunit.client.1.smithi167.stdout:4/694: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/ddb/feb x:0 0 0 2024-09-17T01:41:33.266 INFO:tasks.workunit.client.1.smithi167.stdout:4/695: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d74 105768 1 2024-09-17T01:41:33.266 INFO:tasks.workunit.client.1.smithi167.stdout:1/723: symlink d0/d5/d34/d3c/d85/db5/lef 0 2024-09-17T01:41:33.267 INFO:tasks.workunit.client.1.smithi167.stdout:2/694: dread d5/d3c/d4c/de2/d45/d8e/f64 [0,4194304] 0 2024-09-17T01:41:33.268 INFO:tasks.workunit.client.1.smithi167.stdout:1/724: truncate d0/d5/d34/fa7 1175946 0 2024-09-17T01:41:33.277 INFO:tasks.workunit.client.0.smithi082.stdout:2/393: creat d1/d17/f7a x:0 0 0 2024-09-17T01:41:33.278 INFO:tasks.workunit.client.1.smithi167.stdout:3/723: fsync d7/d8/d10/d29/fa4 0 2024-09-17T01:41:33.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/377: link d9/d15/l30 d9/d15/d16/d18/d4f/l7c 0 2024-09-17T01:41:33.285 INFO:tasks.workunit.client.0.smithi082.stdout:3/266: dwrite f7 [0,4194304] 0 2024-09-17T01:41:33.286 INFO:tasks.workunit.client.0.smithi082.stdout:4/378: chown d9/d15/d37/f71 2800 1 2024-09-17T01:41:33.288 INFO:tasks.workunit.client.1.smithi167.stdout:1/725: dread d0/d5/d34/d6d/fe0 [0,4194304] 0 2024-09-17T01:41:33.288 INFO:tasks.workunit.client.0.smithi082.stdout:5/413: rmdir db/d1e/d20/d30/d47/d7b 0 2024-09-17T01:41:33.289 INFO:tasks.workunit.client.1.smithi167.stdout:4/696: dwrite d0/d4/d7/da/f2c [4194304,4194304] 0 2024-09-17T01:41:33.289 INFO:tasks.workunit.client.0.smithi082.stdout:4/379: chown d9/d47 5752 1 2024-09-17T01:41:33.291 INFO:tasks.workunit.client.1.smithi167.stdout:4/697: readlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f/l88 0 2024-09-17T01:41:33.292 INFO:tasks.workunit.client.0.smithi082.stdout:0/305: dwrite f8 [4194304,4194304] 0 2024-09-17T01:41:33.294 INFO:tasks.workunit.client.0.smithi082.stdout:5/414: chown db/d1e/d20/f73 974 1 2024-09-17T01:41:33.297 INFO:tasks.workunit.client.1.smithi167.stdout:7/670: creat d0/d2/d14/d19/d32/fe5 x:0 0 0 2024-09-17T01:41:33.299 INFO:tasks.workunit.client.1.smithi167.stdout:6/851: dread d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [0,4194304] 0 2024-09-17T01:41:33.299 INFO:tasks.workunit.client.1.smithi167.stdout:6/852: chown d7/c78 11626943 1 2024-09-17T01:41:33.301 INFO:tasks.workunit.client.1.smithi167.stdout:8/784: sync 2024-09-17T01:41:33.301 INFO:tasks.workunit.client.1.smithi167.stdout:0/650: sync 2024-09-17T01:41:33.302 INFO:tasks.workunit.client.1.smithi167.stdout:9/773: truncate d4/d9/d21/d43/f69 8104071 0 2024-09-17T01:41:33.304 INFO:tasks.workunit.client.0.smithi082.stdout:3/267: mkdir d9/db/d49/d4e/d53/d5b 0 2024-09-17T01:41:33.306 INFO:tasks.workunit.client.1.smithi167.stdout:3/724: mknod d7/d8/d10/d14/d25/d9e/cf3 0 2024-09-17T01:41:33.309 INFO:tasks.workunit.client.1.smithi167.stdout:6/853: dwrite f0 [0,4194304] 0 2024-09-17T01:41:33.314 INFO:tasks.workunit.client.0.smithi082.stdout:5/415: unlink db/l77 0 2024-09-17T01:41:33.317 INFO:tasks.workunit.client.0.smithi082.stdout:7/371: getdents d0/d3/d36 0 2024-09-17T01:41:33.320 INFO:tasks.workunit.client.1.smithi167.stdout:7/671: chown d0/d2/l8f 247398359 1 2024-09-17T01:41:33.324 INFO:tasks.workunit.client.0.smithi082.stdout:2/394: write d1/d10/f14 [1230014,72074] 0 2024-09-17T01:41:33.326 INFO:tasks.workunit.client.1.smithi167.stdout:5/655: dwrite d0/d24/d2b/d49/d4b/f55 [0,4194304] 0 2024-09-17T01:41:33.326 INFO:tasks.workunit.client.0.smithi082.stdout:5/416: rename db/d1e/d20/l39 to db/d56/d29/d4f/l85 0 2024-09-17T01:41:33.326 INFO:tasks.workunit.client.1.smithi167.stdout:2/695: dwrite d5/d3c/d4c/de2/db8/d5e/fb1 [0,4194304] 0 2024-09-17T01:41:33.328 INFO:tasks.workunit.client.1.smithi167.stdout:5/656: dread - d0/d24/d2b/d3d/fbc zero size 2024-09-17T01:41:33.330 INFO:tasks.workunit.client.0.smithi082.stdout:3/268: symlink d9/db/d26/d4f/l5c 0 2024-09-17T01:41:33.331 INFO:tasks.workunit.client.0.smithi082.stdout:3/269: dread - d9/d35/f43 zero size 2024-09-17T01:41:33.334 INFO:tasks.workunit.client.0.smithi082.stdout:7/372: creat d0/dd/d2c/d55/f80 x:0 0 0 2024-09-17T01:41:33.337 INFO:tasks.workunit.client.1.smithi167.stdout:9/774: rename d4/d9/d21/d43/fe8 to d4/d9/d21/d2d/d33/d90/ff5 0 2024-09-17T01:41:33.343 INFO:tasks.workunit.client.0.smithi082.stdout:7/373: symlink d0/d3/d36/d37/l81 0 2024-09-17T01:41:33.344 INFO:tasks.workunit.client.0.smithi082.stdout:7/374: chown d0/d3/db/f2e 124 1 2024-09-17T01:41:33.344 INFO:tasks.workunit.client.1.smithi167.stdout:7/672: creat d0/d2/d14/d6f/d8b/fe6 x:0 0 0 2024-09-17T01:41:33.345 INFO:tasks.workunit.client.0.smithi082.stdout:0/306: getdents da/df/d2b/d59 0 2024-09-17T01:41:33.348 INFO:tasks.workunit.client.0.smithi082.stdout:3/270: symlink d9/db/d49/d4e/d53/d5b/l5d 0 2024-09-17T01:41:33.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.352+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f38780626f0 con 0x7f3864074a80 2024-09-17T01:41:33.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/375: dwrite d0/d3/db/f2e [0,4194304] 0 2024-09-17T01:41:33.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.354+0000 7f3875ffb640 1 -- 172.21.15.82:0/2477845938 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f38780626f0 con 0x7f3864074a80 2024-09-17T01:41:33.356 INFO:tasks.workunit.client.1.smithi167.stdout:5/657: mknod d0/d24/d2b/d3d/d3b/db0/cca 0 2024-09-17T01:41:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.360+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 msgr2=0x7f3864076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.360+0000 7f387eeb3640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 0x7f3864076f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3870009fc0 tx=0x7f3870005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.360+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 msgr2=0x7f3878199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3860006010 tx=0x7f38600045e0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 shutdown_connections 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3878101550 0x7f3878199c50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3864074a80 0x7f3864076f40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 --2- 172.21.15.82:0/2477845938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3878100b80 0x7f3878199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 >> 172.21.15.82:0/2477845938 conn(0x7f38780fb350 msgr2=0x7f38781097d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 shutdown_connections 2024-09-17T01:41:33.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.361+0000 7f387eeb3640 1 -- 172.21.15.82:0/2477845938 wait complete. 2024-09-17T01:41:33.360 INFO:tasks.workunit.client.0.smithi082.stdout:7/376: dwrite d0/d3/db/f33 [4194304,4194304] 0 2024-09-17T01:41:33.361 INFO:tasks.workunit.client.0.smithi082.stdout:7/377: dread - d0/dd/f7c zero size 2024-09-17T01:41:33.362 INFO:tasks.workunit.client.1.smithi167.stdout:1/726: truncate d0/d9/d16/d48/d54/d6e/d7e/fd8 7815709 0 2024-09-17T01:41:33.366 INFO:tasks.workunit.client.0.smithi082.stdout:5/417: getdents db/d1e/d20 0 2024-09-17T01:41:33.370 INFO:tasks.workunit.client.0.smithi082.stdout:3/271: rename d9/db/d49/c30 to d9/d35/c5e 0 2024-09-17T01:41:33.372 INFO:tasks.workunit.client.1.smithi167.stdout:2/696: write d5/d3c/d4c/de2/d2e/f36 [3135815,56466] 0 2024-09-17T01:41:33.373 INFO:tasks.workunit.client.1.smithi167.stdout:2/697: write d5/d10/d16/f73 [2687263,32574] 0 2024-09-17T01:41:33.374 INFO:tasks.workunit.client.1.smithi167.stdout:3/725: rename d7/d8/d1f/fe9 to d7/d8/d10/d14/d24/ff4 0 2024-09-17T01:41:33.376 INFO:tasks.workunit.client.1.smithi167.stdout:9/775: fdatasync d4/d9/d21/d2d/d33/d90/dac/f68 0 2024-09-17T01:41:33.377 INFO:tasks.workunit.client.0.smithi082.stdout:0/307: dread da/fc [0,4194304] 0 2024-09-17T01:41:33.378 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:41:33.379 INFO:tasks.workunit.client.0.smithi082.stdout:0/308: chown f0 30003540 1 2024-09-17T01:41:33.379 INFO:tasks.workunit.client.1.smithi167.stdout:4/698: creat d0/d4/d7/fec x:0 0 0 2024-09-17T01:41:33.379 INFO:tasks.workunit.client.1.smithi167.stdout:7/673: fsync d0/d2/d14/d19/f77 0 2024-09-17T01:41:33.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/785: link dc/d1a/l87 dc/d56/d57/da0/l102 0 2024-09-17T01:41:33.382 INFO:tasks.workunit.client.0.smithi082.stdout:0/309: symlink da/d1b/l6e 0 2024-09-17T01:41:33.382 INFO:tasks.workunit.client.1.smithi167.stdout:1/727: rmdir d0/d5/d34 39 2024-09-17T01:41:33.384 INFO:tasks.workunit.client.1.smithi167.stdout:0/651: link d5/d6b/d77/d4d/d56/lb0 d5/d8/d5c/ld6 0 2024-09-17T01:41:33.385 INFO:tasks.workunit.client.0.smithi082.stdout:7/378: dread d0/d3/db/fe [0,4194304] 0 2024-09-17T01:41:33.386 INFO:tasks.workunit.client.0.smithi082.stdout:0/310: truncate da/fc 1573398 0 2024-09-17T01:41:33.387 INFO:tasks.workunit.client.0.smithi082.stdout:7/379: write d0/d3/db/d10/d3f/f5d [396943,65690] 0 2024-09-17T01:41:33.388 INFO:tasks.workunit.client.1.smithi167.stdout:1/728: dwrite d0/d9/d16/d36/daf/fd3 [0,4194304] 0 2024-09-17T01:41:33.389 INFO:tasks.workunit.client.0.smithi082.stdout:3/272: getdents d9/d35 0 2024-09-17T01:41:33.392 INFO:tasks.workunit.client.0.smithi082.stdout:0/311: mkdir da/df/d2b/d59/d6f 0 2024-09-17T01:41:33.395 INFO:tasks.workunit.client.1.smithi167.stdout:6/854: rename d7/d54/d90/d13/d2f/d30/c93 to d7/d52/db7/c12b 0 2024-09-17T01:41:33.396 INFO:tasks.workunit.client.1.smithi167.stdout:6/855: chown d7/d52/d79/da4/l111 34350967 1 2024-09-17T01:41:33.397 INFO:tasks.workunit.client.0.smithi082.stdout:7/380: mknod d0/dd/d2c/c82 0 2024-09-17T01:41:33.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/273: symlink d9/db/d26/l5f 0 2024-09-17T01:41:33.399 INFO:tasks.workunit.client.0.smithi082.stdout:5/418: dread db/d56/d18/f1d [0,4194304] 0 2024-09-17T01:41:33.403 INFO:tasks.workunit.client.0.smithi082.stdout:7/381: creat d0/d3/db/f83 x:0 0 0 2024-09-17T01:41:33.405 INFO:tasks.workunit.client.0.smithi082.stdout:7/382: write d0/d3/db/f4f [648519,114039] 0 2024-09-17T01:41:33.405 INFO:tasks.workunit.client.0.smithi082.stdout:7/383: readlink d0/dd/l26 0 2024-09-17T01:41:33.405 INFO:tasks.workunit.client.1.smithi167.stdout:4/699: rmdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51 39 2024-09-17T01:41:33.406 INFO:tasks.workunit.client.0.smithi082.stdout:7/384: write d0/dd/f7c [603145,108238] 0 2024-09-17T01:41:33.406 INFO:tasks.workunit.client.0.smithi082.stdout:0/312: truncate da/fe 3359313 0 2024-09-17T01:41:33.408 INFO:tasks.workunit.client.0.smithi082.stdout:3/274: rename d9/db/d49/l42 to d9/d35/l60 0 2024-09-17T01:41:33.409 INFO:tasks.workunit.client.1.smithi167.stdout:5/658: symlink d0/d24/d2b/d3d/lcb 0 2024-09-17T01:41:33.410 INFO:tasks.workunit.client.0.smithi082.stdout:5/419: rmdir db/d56/d29/d4f 39 2024-09-17T01:41:33.421 INFO:tasks.workunit.client.0.smithi082.stdout:5/420: dread db/d56/d29/f2c [0,4194304] 0 2024-09-17T01:41:33.421 INFO:tasks.workunit.client.0.smithi082.stdout:5/421: chown db/d1e/d20/d4d 137 1 2024-09-17T01:41:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- 172.21.15.82:0/2223274076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 msgr2=0x7f9a6c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2223274076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c1047e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9a680098b0 tx=0x7f9a6802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- 172.21.15.82:0/2223274076 shutdown_connections 2024-09-17T01:41:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2223274076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 0x7f9a6c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2223274076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c1047e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- 172.21.15.82:0/2223274076 >> 172.21.15.82:0/2223274076 conn(0x7f9a6c0fc010 msgr2=0x7f9a6c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- 172.21.15.82:0/2223274076 shutdown_connections 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- 172.21.15.82:0/2223274076 wait complete. 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 Processor -- start 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.470+0000 7f9a740e1640 1 -- start start 2024-09-17T01:41:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a740e1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a740e1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 0x7f9a6c197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a740e1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c10a7e0 con 0x7f9a6c1023f0 2024-09-17T01:41:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a740e1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c10a660 con 0x7f9a6c104d20 2024-09-17T01:41:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39098/0 (socket says 172.21.15.82:39098) 2024-09-17T01:41:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 -- 172.21.15.82:0/2603150142 learned_addr learned my addr 172.21.15.82:0/2603150142 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a7167c640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 0x7f9a6c197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 -- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 msgr2=0x7f9a6c197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 0x7f9a6c197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 -- 172.21.15.82:0/2603150142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c198130 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a71e7d640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9a680099d0 tx=0x7f9a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a6803f070 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a68004a40 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.471+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c19cb10 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.472+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a68035030 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.472+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6c19d0a0 con 0x7f9a6c1023f0 2024-09-17T01:41:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.473+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c1027d0 con 0x7f9a6c1023f0 2024-09-17T01:41:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.473+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9a68042070 con 0x7f9a6c1023f0 2024-09-17T01:41:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.474+0000 7f9a62ffd640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 0x7f9a58076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.474+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f9a680b6e80 con 0x7f9a6c1023f0 2024-09-17T01:41:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.474+0000 7f9a7167c640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 0x7f9a58076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.474+0000 7f9a7167c640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 0x7f9a58076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c198a20 tx=0x7f9a5c00b390 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.478+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9a68082410 con 0x7f9a6c1023f0 2024-09-17T01:41:33.497 INFO:tasks.workunit.client.1.smithi167.stdout:0/652: creat d5/d6b/dca/fd7 x:0 0 0 2024-09-17T01:41:33.500 INFO:tasks.workunit.client.1.smithi167.stdout:1/729: mknod d0/d5/dbf/ddb/cf0 0 2024-09-17T01:41:33.501 INFO:tasks.workunit.client.0.smithi082.stdout:7/385: mknod d0/dd/d2c/d55/c84 0 2024-09-17T01:41:33.503 INFO:tasks.workunit.client.0.smithi082.stdout:7/386: truncate d0/dd/d2c/d54/f69 70218 0 2024-09-17T01:41:33.507 INFO:tasks.workunit.client.1.smithi167.stdout:8/786: rename dc/d56/d59/d82/d85/ded to dc/d56/d57/dc2/d100/d103 0 2024-09-17T01:41:33.507 INFO:tasks.workunit.client.0.smithi082.stdout:7/387: dread d0/d3/d36/d37/d71/f7b [0,4194304] 0 2024-09-17T01:41:33.508 INFO:tasks.workunit.client.0.smithi082.stdout:7/388: chown d0/dd/f7c 222 1 2024-09-17T01:41:33.508 INFO:tasks.workunit.client.1.smithi167.stdout:8/787: write dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/fcc [501870,128291] 0 2024-09-17T01:41:33.511 INFO:tasks.workunit.client.1.smithi167.stdout:3/726: mkdir d7/d8/d10/d14/df5 0 2024-09-17T01:41:33.511 INFO:tasks.workunit.client.0.smithi082.stdout:0/313: mkdir da/df/d2b/d59/d6f/d70 0 2024-09-17T01:41:33.516 INFO:tasks.workunit.client.0.smithi082.stdout:3/275: write f0 [1946847,27572] 0 2024-09-17T01:41:33.523 INFO:tasks.workunit.client.0.smithi082.stdout:5/422: mknod db/d1e/c86 0 2024-09-17T01:41:33.524 INFO:tasks.workunit.client.0.smithi082.stdout:5/423: write db/d2b/f7f [162975,107665] 0 2024-09-17T01:41:33.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/389: getdents d0/d62/d7e 0 2024-09-17T01:41:33.530 INFO:tasks.workunit.client.1.smithi167.stdout:3/727: creat d7/d8/d10/d14/d24/d62/ff6 x:0 0 0 2024-09-17T01:41:33.533 INFO:tasks.workunit.client.1.smithi167.stdout:9/776: creat d4/d9/d21/d43/d6c/d9e/ff6 x:0 0 0 2024-09-17T01:41:33.533 INFO:tasks.workunit.client.0.smithi082.stdout:5/424: dwrite db/d56/d18/f70 [0,4194304] 0 2024-09-17T01:41:33.533 INFO:tasks.workunit.client.1.smithi167.stdout:9/777: stat d4/d9/d21/f3b 0 2024-09-17T01:41:33.534 INFO:tasks.workunit.client.0.smithi082.stdout:5/425: stat db/d56 0 2024-09-17T01:41:33.534 INFO:tasks.workunit.client.1.smithi167.stdout:9/778: chown d4/d9/c63 3 1 2024-09-17T01:41:33.535 INFO:tasks.workunit.client.1.smithi167.stdout:9/779: write d4/d9/d21/d43/d6c/f9d [2851891,92658] 0 2024-09-17T01:41:33.535 INFO:tasks.workunit.client.0.smithi082.stdout:3/276: dwrite d9/db/f18 [0,4194304] 0 2024-09-17T01:41:33.535 INFO:tasks.workunit.client.0.smithi082.stdout:0/314: rename da/d16 to da/df/d71 0 2024-09-17T01:41:33.536 INFO:tasks.workunit.client.1.smithi167.stdout:9/780: dread - d4/d9/d21/d43/d6c/d9e/fe3 zero size 2024-09-17T01:41:33.536 INFO:tasks.workunit.client.0.smithi082.stdout:3/277: readlink d9/db/d26/l5f 0 2024-09-17T01:41:33.540 INFO:tasks.workunit.client.0.smithi082.stdout:7/390: mknod d0/d3/db/d10/d47/c85 0 2024-09-17T01:41:33.541 INFO:tasks.workunit.client.0.smithi082.stdout:7/391: chown d0/dd/f16 45124006 1 2024-09-17T01:41:33.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/426: creat db/d2b/f87 x:0 0 0 2024-09-17T01:41:33.545 INFO:tasks.workunit.client.1.smithi167.stdout:6/856: dwrite d7/d54/d90/d13/f99 [0,4194304] 0 2024-09-17T01:41:33.546 INFO:tasks.workunit.client.0.smithi082.stdout:5/427: read db/d56/f15 [5853223,2309] 0 2024-09-17T01:41:33.546 INFO:tasks.workunit.client.1.smithi167.stdout:2/698: link d5/d6d/fa5 d5/d3c/d4c/de2/d45/d8e/d98/dca/ff2 0 2024-09-17T01:41:33.548 INFO:tasks.workunit.client.1.smithi167.stdout:5/659: rename d0/d9/ld to d0/d24/d2b/d3d/d3b/db0/db5/lcc 0 2024-09-17T01:41:33.549 INFO:tasks.workunit.client.0.smithi082.stdout:7/392: mkdir d0/d3/d36/d37/d86 0 2024-09-17T01:41:33.549 INFO:tasks.workunit.client.0.smithi082.stdout:7/393: stat d0/dd 0 2024-09-17T01:41:33.551 INFO:tasks.workunit.client.1.smithi167.stdout:8/788: truncate dc/d18/f3b 34248 0 2024-09-17T01:41:33.552 INFO:tasks.workunit.client.0.smithi082.stdout:0/315: rename da/c3e to da/df/d71/c72 0 2024-09-17T01:41:33.552 INFO:tasks.workunit.client.1.smithi167.stdout:8/789: stat dc/d21/d61/c8c 0 2024-09-17T01:41:33.553 INFO:tasks.workunit.client.0.smithi082.stdout:0/316: fdatasync da/df/d71/f50 0 2024-09-17T01:41:33.553 INFO:tasks.workunit.client.0.smithi082.stdout:5/428: read db/d2b/f36 [115214,96096] 0 2024-09-17T01:41:33.554 INFO:tasks.workunit.client.1.smithi167.stdout:6/857: dwrite d7/d54/d90/d13/d2f/d7f/d98/f1c [4194304,4194304] 0 2024-09-17T01:41:33.555 INFO:tasks.workunit.client.1.smithi167.stdout:7/674: link d0/fbe d0/d2/d14/d19/d22/fe7 0 2024-09-17T01:41:33.555 INFO:tasks.workunit.client.0.smithi082.stdout:3/278: truncate d9/f29 1808575 0 2024-09-17T01:41:33.558 INFO:tasks.workunit.client.1.smithi167.stdout:4/700: creat d0/d4/d7/d10/fed x:0 0 0 2024-09-17T01:41:33.562 INFO:tasks.workunit.client.0.smithi082.stdout:7/394: dread d0/dd/f3d [0,4194304] 0 2024-09-17T01:41:33.562 INFO:tasks.workunit.client.1.smithi167.stdout:1/730: write d0/d5/d34/f5a [381400,88822] 0 2024-09-17T01:41:33.563 INFO:tasks.workunit.client.1.smithi167.stdout:1/731: chown d0/d9/d16/d36/daf/fd3 6440448 1 2024-09-17T01:41:33.565 INFO:tasks.workunit.client.0.smithi082.stdout:0/317: unlink da/fb 0 2024-09-17T01:41:33.567 INFO:tasks.workunit.client.1.smithi167.stdout:0/653: rename d5/d6b/d77/d4d/c6e to d5/d6b/d77/d4d/d56/cd8 0 2024-09-17T01:41:33.569 INFO:tasks.workunit.client.1.smithi167.stdout:0/654: truncate d5/d8/d5c/fd2 511812 0 2024-09-17T01:41:33.569 INFO:tasks.workunit.client.0.smithi082.stdout:5/429: creat db/d1e/d20/f88 x:0 0 0 2024-09-17T01:41:33.569 INFO:tasks.workunit.client.1.smithi167.stdout:5/660: fdatasync d0/d24/d2b/d3d/f4f 0 2024-09-17T01:41:33.570 INFO:tasks.workunit.client.1.smithi167.stdout:5/661: fdatasync d0/d24/d2b/f6e 0 2024-09-17T01:41:33.570 INFO:tasks.workunit.client.0.smithi082.stdout:3/279: truncate d9/db/d26/f3a 219209 0 2024-09-17T01:41:33.570 INFO:tasks.workunit.client.0.smithi082.stdout:3/280: fdatasync d9/f4d 0 2024-09-17T01:41:33.571 INFO:tasks.workunit.client.1.smithi167.stdout:8/790: symlink dc/d1a/d45/l104 0 2024-09-17T01:41:33.572 INFO:tasks.workunit.client.1.smithi167.stdout:8/791: dread - dc/d56/d59/d82/dbe/ffd zero size 2024-09-17T01:41:33.573 INFO:tasks.workunit.client.0.smithi082.stdout:5/430: read db/d56/f1c [1624921,125329] 0 2024-09-17T01:41:33.573 INFO:tasks.workunit.client.0.smithi082.stdout:7/395: chown d0/d50/l70 50713834 1 2024-09-17T01:41:33.574 INFO:tasks.workunit.client.1.smithi167.stdout:7/675: rmdir d0 39 2024-09-17T01:41:33.577 INFO:tasks.workunit.client.0.smithi082.stdout:7/396: dread d0/d3/db/d10/d47/f5c [0,4194304] 0 2024-09-17T01:41:33.583 INFO:tasks.workunit.client.1.smithi167.stdout:3/728: rename d7/d8/d10/d14/d25/c11 to d7/d8/d10/d14/d24/d9c/da3/cf7 0 2024-09-17T01:41:33.584 INFO:tasks.workunit.client.1.smithi167.stdout:0/655: chown d5/d6b/l9f 1 1 2024-09-17T01:41:33.585 INFO:tasks.workunit.client.1.smithi167.stdout:0/656: write d5/d6b/d77/d4d/f22 [6724759,18991] 0 2024-09-17T01:41:33.587 INFO:tasks.workunit.client.0.smithi082.stdout:7/397: fsync d0/d3/d36/d37/d71/f7b 0 2024-09-17T01:41:33.589 INFO:tasks.workunit.client.1.smithi167.stdout:5/662: creat d0/d24/d2b/d49/d4b/fcd x:0 0 0 2024-09-17T01:41:33.590 INFO:tasks.workunit.client.1.smithi167.stdout:5/663: truncate d0/d9/d64/fc5 64967 0 2024-09-17T01:41:33.591 INFO:tasks.workunit.client.0.smithi082.stdout:5/431: creat db/d1e/d5b/d83/f89 x:0 0 0 2024-09-17T01:41:33.595 INFO:tasks.workunit.client.0.smithi082.stdout:7/398: dread d0/f2f [0,4194304] 0 2024-09-17T01:41:33.596 INFO:tasks.workunit.client.1.smithi167.stdout:7/676: chown d0/d2/d14/d19/d26/ff 803062610 1 2024-09-17T01:41:33.596 INFO:tasks.workunit.client.1.smithi167.stdout:7/677: chown d0/d2/d14/d19/d26/f59 113582 1 2024-09-17T01:41:33.597 INFO:tasks.workunit.client.0.smithi082.stdout:5/432: creat db/d56/d78/f8a x:0 0 0 2024-09-17T01:41:33.598 INFO:tasks.workunit.client.1.smithi167.stdout:9/781: creat d4/d9/d21/d2d/d33/d3a/ff7 x:0 0 0 2024-09-17T01:41:33.601 INFO:tasks.workunit.client.1.smithi167.stdout:4/701: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/cee 0 2024-09-17T01:41:33.601 INFO:tasks.workunit.client.0.smithi082.stdout:7/399: dwrite d0/d3/db/f2e [4194304,4194304] 0 2024-09-17T01:41:33.604 INFO:tasks.workunit.client.1.smithi167.stdout:1/732: mknod d0/d9/cf1 0 2024-09-17T01:41:33.604 INFO:tasks.workunit.client.1.smithi167.stdout:1/733: readlink d0/d9/l15 0 2024-09-17T01:41:33.605 INFO:tasks.workunit.client.1.smithi167.stdout:1/734: chown d0/d9/d16/d36/c9d 1748232 1 2024-09-17T01:41:33.606 INFO:tasks.workunit.client.1.smithi167.stdout:3/729: dread - d7/d8/d10/d14/f53 zero size 2024-09-17T01:41:33.608 INFO:tasks.workunit.client.1.smithi167.stdout:3/730: dread - d7/d8/d10/d14/d66/d6c/fb0 zero size 2024-09-17T01:41:33.608 INFO:tasks.workunit.client.0.smithi082.stdout:3/281: getdents d9 0 2024-09-17T01:41:33.609 INFO:tasks.workunit.client.0.smithi082.stdout:5/433: write db/d56/d18/f1d [4723685,34474] 0 2024-09-17T01:41:33.615 INFO:tasks.workunit.client.1.smithi167.stdout:6/858: rmdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/d120 0 2024-09-17T01:41:33.616 INFO:tasks.workunit.client.1.smithi167.stdout:6/859: write d7/fa [3438669,108718] 0 2024-09-17T01:41:33.619 INFO:tasks.workunit.client.1.smithi167.stdout:9/782: chown d4/d9/d2b/da3/lc6 1122305 1 2024-09-17T01:41:33.621 INFO:tasks.workunit.client.1.smithi167.stdout:9/783: write d4/d9/d21/d81/db9/fea [587268,112831] 0 2024-09-17T01:41:33.624 INFO:tasks.workunit.client.1.smithi167.stdout:1/735: stat d0/d5/d34/d8a/de7/cee 0 2024-09-17T01:41:33.624 INFO:tasks.workunit.client.1.smithi167.stdout:1/736: stat d0/d5/d34/d3c/d85/db5/fc9 0 2024-09-17T01:41:33.625 INFO:tasks.workunit.client.1.smithi167.stdout:3/731: fsync d7/d8/d10/d14/d24/f7d 0 2024-09-17T01:41:33.630 INFO:tasks.workunit.client.1.smithi167.stdout:5/664: truncate d0/d24/d2b/f6e 640357 0 2024-09-17T01:41:33.631 INFO:tasks.workunit.client.1.smithi167.stdout:5/665: write d0/d24/d2b/d3d/d3b/f98 [1500985,8681] 0 2024-09-17T01:41:33.634 INFO:tasks.workunit.client.1.smithi167.stdout:6/860: dread - d7/d54/d90/d13/d2f/d30/fa7 zero size 2024-09-17T01:41:33.635 INFO:tasks.workunit.client.1.smithi167.stdout:6/861: fsync d7/d54/d90/d13/f75 0 2024-09-17T01:41:33.637 INFO:tasks.workunit.client.1.smithi167.stdout:5/666: dwrite d0/f18 [4194304,4194304] 0 2024-09-17T01:41:33.642 INFO:tasks.workunit.client.1.smithi167.stdout:6/862: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fe4 [0,4194304] 0 2024-09-17T01:41:33.643 INFO:tasks.workunit.client.1.smithi167.stdout:2/699: rename d5/d3c/d4c/d4d/lcf to d5/d3c/d4c/de2/lf3 0 2024-09-17T01:41:33.647 INFO:tasks.workunit.client.1.smithi167.stdout:0/657: write d5/d6b/d77/daa/fad [3914754,105416] 0 2024-09-17T01:41:33.654 INFO:tasks.workunit.client.1.smithi167.stdout:0/658: dwrite d5/d8/d9/d2f/fa6 [0,4194304] 0 2024-09-17T01:41:33.656 INFO:tasks.workunit.client.1.smithi167.stdout:0/659: chown d5/d6b/d77/d37/f69 209 1 2024-09-17T01:41:33.657 INFO:tasks.workunit.client.1.smithi167.stdout:4/702: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/f65 [1905352,35003] 0 2024-09-17T01:41:33.658 INFO:tasks.workunit.client.0.smithi082.stdout:3/282: mknod d9/db/d49/d4e/d53/d5b/c61 0 2024-09-17T01:41:33.659 INFO:tasks.workunit.client.1.smithi167.stdout:7/678: creat d0/d2/d14/d19/d22/fe8 x:0 0 0 2024-09-17T01:41:33.660 INFO:tasks.workunit.client.1.smithi167.stdout:9/784: write d4/d9/d21/d43/d6c/fa2 [1508630,38395] 0 2024-09-17T01:41:33.661 INFO:tasks.workunit.client.1.smithi167.stdout:5/667: mknod d0/d9/d64/d95/cce 0 2024-09-17T01:41:33.665 INFO:tasks.workunit.client.0.smithi082.stdout:3/283: rename d9/f23 to d9/db/d49/d4e/d53/f62 0 2024-09-17T01:41:33.667 INFO:tasks.workunit.client.1.smithi167.stdout:6/863: creat d7/d42/f12c x:0 0 0 2024-09-17T01:41:33.668 INFO:tasks.workunit.client.1.smithi167.stdout:5/668: dwrite d0/d24/d2b/db1/fb9 [0,4194304] 0 2024-09-17T01:41:33.669 INFO:tasks.workunit.client.1.smithi167.stdout:6/864: chown d7/f5c 2 1 2024-09-17T01:41:33.669 INFO:tasks.workunit.client.1.smithi167.stdout:8/792: rename dc/d18/la3 to dc/d56/l105 0 2024-09-17T01:41:33.671 INFO:tasks.workunit.client.1.smithi167.stdout:6/865: write d7/d54/d90/d13/f75 [4753555,31577] 0 2024-09-17T01:41:33.671 INFO:tasks.workunit.client.1.smithi167.stdout:5/669: write d0/d24/d2b/d49/d4b/dac/d3a/d44/fa5 [1591957,60403] 0 2024-09-17T01:41:33.673 INFO:tasks.workunit.client.1.smithi167.stdout:6/866: chown d7/d54/d90/d34/ff6 31409623 1 2024-09-17T01:41:33.673 INFO:tasks.workunit.client.1.smithi167.stdout:2/700: unlink d5/d6d/fa5 0 2024-09-17T01:41:33.674 INFO:tasks.workunit.client.0.smithi082.stdout:5/434: creat db/d56/d29/f8b x:0 0 0 2024-09-17T01:41:33.675 INFO:tasks.workunit.client.1.smithi167.stdout:2/701: read - d5/d3c/d4c/de2/d45/d8e/fe0 zero size 2024-09-17T01:41:33.675 INFO:tasks.workunit.client.1.smithi167.stdout:6/867: dread - d7/d54/d90/d13/d2f/d30/d88/da2/f122 zero size 2024-09-17T01:41:33.679 INFO:tasks.workunit.client.0.smithi082.stdout:5/435: creat db/d2b/f8c x:0 0 0 2024-09-17T01:41:33.681 INFO:tasks.workunit.client.0.smithi082.stdout:5/436: write db/d56/d18/f1d [3503074,43170] 0 2024-09-17T01:41:33.681 INFO:tasks.workunit.client.1.smithi167.stdout:4/703: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/dac/fef x:0 0 0 2024-09-17T01:41:33.682 INFO:tasks.workunit.client.1.smithi167.stdout:7/679: creat d0/d2/d14/d19/d22/d40/fe9 x:0 0 0 2024-09-17T01:41:33.683 INFO:tasks.workunit.client.1.smithi167.stdout:6/868: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f8f [0,4194304] 0 2024-09-17T01:41:33.683 INFO:tasks.workunit.client.1.smithi167.stdout:3/732: dread d7/d8/d10/f42 [4194304,4194304] 0 2024-09-17T01:41:33.685 INFO:tasks.workunit.client.1.smithi167.stdout:3/733: read - d7/d8/d10/d14/d66/d6c/dab/dcf/fed zero size 2024-09-17T01:41:33.686 INFO:tasks.workunit.client.0.smithi082.stdout:5/437: readlink db/d56/d29/l5f 0 2024-09-17T01:41:33.688 INFO:tasks.workunit.client.1.smithi167.stdout:8/793: mknod dc/d56/d57/da0/c106 0 2024-09-17T01:41:33.689 INFO:tasks.workunit.client.0.smithi082.stdout:5/438: write db/d56/d29/f7e [240497,70455] 0 2024-09-17T01:41:33.690 INFO:tasks.workunit.client.0.smithi082.stdout:7/400: dwrite d0/dd/d2c/d42/f57 [0,4194304] 0 2024-09-17T01:41:33.698 INFO:tasks.workunit.client.0.smithi082.stdout:7/401: readlink d0/d3/d36/d37/l67 0 2024-09-17T01:41:33.704 INFO:tasks.workunit.client.0.smithi082.stdout:3/284: read - d9/db/d26/f51 zero size 2024-09-17T01:41:33.704 INFO:tasks.workunit.client.0.smithi082.stdout:7/402: rename d0/d3/d36/c66 to d0/dd/d34/c87 0 2024-09-17T01:41:33.705 INFO:tasks.workunit.client.1.smithi167.stdout:7/680: mknod d0/d2/d14/d19/d32/d9c/cea 0 2024-09-17T01:41:33.706 INFO:tasks.workunit.client.1.smithi167.stdout:6/869: unlink d7/d54/d90/d13/d2f/d7f/d98/le1 0 2024-09-17T01:41:33.709 INFO:tasks.workunit.client.0.smithi082.stdout:7/403: rename d0/d3/l31 to d0/d3/d36/d37/l88 0 2024-09-17T01:41:33.709 INFO:tasks.workunit.client.1.smithi167.stdout:8/794: creat dc/dae/f107 x:0 0 0 2024-09-17T01:41:33.714 INFO:tasks.workunit.client.0.smithi082.stdout:5/439: getdents db/d56/d78 0 2024-09-17T01:41:33.716 INFO:tasks.workunit.client.1.smithi167.stdout:2/702: mkdir d5/d3c/d4c/de2/d45/d8e/df4 0 2024-09-17T01:41:33.717 INFO:tasks.workunit.client.1.smithi167.stdout:0/660: link d5/d8/d9/l27 d5/d6b/d77/daa/db1/ld9 0 2024-09-17T01:41:33.717 INFO:tasks.workunit.client.1.smithi167.stdout:0/661: readlink d5/lb2 0 2024-09-17T01:41:33.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/662: dread - d5/d6b/d77/d4d/d56/d7b/f89 zero size 2024-09-17T01:41:33.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/663: chown d5/d6b/d77/d6d/f81 128042 1 2024-09-17T01:41:33.722 INFO:tasks.workunit.client.0.smithi082.stdout:5/440: dwrite db/d56/d29/f7e [0,4194304] 0 2024-09-17T01:41:33.723 INFO:tasks.workunit.client.1.smithi167.stdout:0/664: dwrite d5/d8/f46 [0,4194304] 0 2024-09-17T01:41:33.725 INFO:tasks.workunit.client.0.smithi082.stdout:7/404: link d0/d3/f2b d0/dd/d2c/f89 0 2024-09-17T01:41:33.725 INFO:tasks.workunit.client.1.smithi167.stdout:6/870: truncate d7/d54/d90/d13/fd3 1294103 0 2024-09-17T01:41:33.727 INFO:tasks.workunit.client.0.smithi082.stdout:5/441: dread db/d56/d18/f1d [0,4194304] 0 2024-09-17T01:41:33.727 INFO:tasks.workunit.client.0.smithi082.stdout:7/405: write d0/dd/d2c/d42/f57 [3179585,27077] 0 2024-09-17T01:41:33.731 INFO:tasks.workunit.client.1.smithi167.stdout:3/734: rename d7/d8/d1f/le4 to d7/d8/d10/d14/d2c/d6f/db6/lf8 0 2024-09-17T01:41:33.731 INFO:tasks.workunit.client.1.smithi167.stdout:5/670: truncate d0/d24/d2b/d49/d4b/dac/d3a/d44/fa5 1683262 0 2024-09-17T01:41:33.733 INFO:tasks.workunit.client.1.smithi167.stdout:8/795: fdatasync dc/d56/d59/d82/f95 0 2024-09-17T01:41:33.735 INFO:tasks.workunit.client.0.smithi082.stdout:3/285: dread d9/f4d [0,4194304] 0 2024-09-17T01:41:33.738 INFO:tasks.workunit.client.1.smithi167.stdout:2/703: unlink d5/d3c/d4c/de2/d2e/l95 0 2024-09-17T01:41:33.741 INFO:tasks.workunit.client.0.smithi082.stdout:5/442: mknod db/d1e/d5b/d83/c8d 0 2024-09-17T01:41:33.742 INFO:tasks.workunit.client.1.smithi167.stdout:4/704: creat d0/d4/d7/d10/ff0 x:0 0 0 2024-09-17T01:41:33.744 INFO:tasks.workunit.client.0.smithi082.stdout:7/406: dwrite d0/d3/f64 [4194304,4194304] 0 2024-09-17T01:41:33.744 INFO:tasks.workunit.client.1.smithi167.stdout:6/871: mkdir d7/d54/d90/d13/d2f/d30/d12d 0 2024-09-17T01:41:33.745 INFO:tasks.workunit.client.0.smithi082.stdout:7/407: stat d0/dd/lf 0 2024-09-17T01:41:33.747 INFO:tasks.workunit.client.0.smithi082.stdout:5/443: write db/d56/d29/d4f/f82 [238320,125674] 0 2024-09-17T01:41:33.749 INFO:tasks.workunit.client.0.smithi082.stdout:3/286: mkdir d9/d35/d63 0 2024-09-17T01:41:33.751 INFO:tasks.workunit.client.1.smithi167.stdout:8/796: rename dc/d56/d57/d5c/f5d to dc/d1a/f108 0 2024-09-17T01:41:33.752 INFO:tasks.workunit.client.1.smithi167.stdout:8/797: chown dc/dae/f107 1466710 1 2024-09-17T01:41:33.755 INFO:tasks.workunit.client.1.smithi167.stdout:4/705: symlink d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/lf1 0 2024-09-17T01:41:33.755 INFO:tasks.workunit.client.0.smithi082.stdout:3/287: symlink d9/db/d49/l64 0 2024-09-17T01:41:33.757 INFO:tasks.workunit.client.0.smithi082.stdout:7/408: mkdir d0/dd/d34/d58/d6e/d8a 0 2024-09-17T01:41:33.759 INFO:tasks.workunit.client.0.smithi082.stdout:3/288: fdatasync f6 0 2024-09-17T01:41:33.761 INFO:tasks.workunit.client.0.smithi082.stdout:7/409: mkdir d0/d3/db/d10/d8b 0 2024-09-17T01:41:33.763 INFO:tasks.workunit.client.0.smithi082.stdout:7/410: write d0/dd/f1f [5716704,115498] 0 2024-09-17T01:41:33.764 INFO:tasks.workunit.client.1.smithi167.stdout:3/735: dread d7/d8/f4c [0,4194304] 0 2024-09-17T01:41:33.764 INFO:tasks.workunit.client.1.smithi167.stdout:2/704: dread d5/d3c/d4c/de2/d45/d8e/d98/dca/fd6 [0,4194304] 0 2024-09-17T01:41:33.764 INFO:tasks.workunit.client.1.smithi167.stdout:6/872: creat d7/d52/d8c/d10d/f12e x:0 0 0 2024-09-17T01:41:33.765 INFO:tasks.workunit.client.0.smithi082.stdout:7/411: dread d0/f2f [0,4194304] 0 2024-09-17T01:41:33.767 INFO:tasks.workunit.client.1.smithi167.stdout:3/736: chown d7/d8/d10/d14/d66/d6c/d7c/ce2 15675329 1 2024-09-17T01:41:33.767 INFO:tasks.workunit.client.1.smithi167.stdout:4/706: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d4f/df2 0 2024-09-17T01:41:33.767 INFO:tasks.workunit.client.1.smithi167.stdout:4/707: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb 0 1 2024-09-17T01:41:33.768 INFO:tasks.workunit.client.0.smithi082.stdout:3/289: dwrite d9/db/f18 [0,4194304] 0 2024-09-17T01:41:33.768 INFO:tasks.workunit.client.1.smithi167.stdout:4/708: write d0/d4/d7/da/f6e [1758363,108485] 0 2024-09-17T01:41:33.769 INFO:tasks.workunit.client.0.smithi082.stdout:3/290: fsync d9/db/d49/d4e/f50 0 2024-09-17T01:41:33.769 INFO:tasks.workunit.client.1.smithi167.stdout:5/671: creat d0/d24/fcf x:0 0 0 2024-09-17T01:41:33.771 INFO:tasks.workunit.client.0.smithi082.stdout:3/291: truncate d9/db/f11 1758201 0 2024-09-17T01:41:33.773 INFO:tasks.workunit.client.1.smithi167.stdout:9/785: sync 2024-09-17T01:41:33.774 INFO:tasks.workunit.client.1.smithi167.stdout:1/737: sync 2024-09-17T01:41:33.774 INFO:tasks.workunit.client.0.smithi082.stdout:3/292: chown d9/db/l20 577691241 1 2024-09-17T01:41:33.774 INFO:tasks.workunit.client.0.smithi082.stdout:7/412: dwrite d0/fa [0,4194304] 0 2024-09-17T01:41:33.776 INFO:tasks.workunit.client.1.smithi167.stdout:8/798: link dc/d21/f34 dc/d56/d59/d82/f109 0 2024-09-17T01:41:33.779 INFO:tasks.workunit.client.0.smithi082.stdout:5/444: dread db/d56/f35 [0,4194304] 0 2024-09-17T01:41:33.781 INFO:tasks.workunit.client.0.smithi082.stdout:5/445: write db/d56/d29/f6a [3665454,62792] 0 2024-09-17T01:41:33.781 INFO:tasks.workunit.client.1.smithi167.stdout:1/738: dwrite d0/d5/d34/d3c/d74/fc8 [0,4194304] 0 2024-09-17T01:41:33.785 INFO:tasks.workunit.client.1.smithi167.stdout:3/737: fsync d7/d8/d10/d29/f98 0 2024-09-17T01:41:33.786 INFO:tasks.workunit.client.0.smithi082.stdout:7/413: symlink d0/dd/d2c/d55/l8c 0 2024-09-17T01:41:33.788 INFO:tasks.workunit.client.1.smithi167.stdout:3/738: chown d7/d8/d10/d14/d25/lb 18 1 2024-09-17T01:41:33.791 INFO:tasks.workunit.client.0.smithi082.stdout:5/446: mkdir db/d56/d29/d4f/d8e 0 2024-09-17T01:41:33.792 INFO:tasks.workunit.client.1.smithi167.stdout:5/672: creat d0/d24/d2b/d49/d4b/dac/d3a/d4d/fd0 x:0 0 0 2024-09-17T01:41:33.793 INFO:tasks.workunit.client.1.smithi167.stdout:5/673: write d0/f18 [656321,87035] 0 2024-09-17T01:41:33.795 INFO:tasks.workunit.client.0.smithi082.stdout:7/414: truncate d0/dd/f3d 1168919 0 2024-09-17T01:41:33.800 INFO:tasks.workunit.client.1.smithi167.stdout:8/799: rmdir dc/d56/d59/d82/d85 39 2024-09-17T01:41:33.801 INFO:tasks.workunit.client.1.smithi167.stdout:9/786: dwrite d4/d9/d21/d2d/d33/fde [0,4194304] 0 2024-09-17T01:41:33.802 INFO:tasks.workunit.client.1.smithi167.stdout:8/800: write dc/d1a/d45/fd0 [1469104,50319] 0 2024-09-17T01:41:33.803 INFO:tasks.workunit.client.0.smithi082.stdout:5/447: readlink db/d1e/d20/l24 0 2024-09-17T01:41:33.806 INFO:tasks.workunit.client.0.smithi082.stdout:3/293: getdents d9/db/d49 0 2024-09-17T01:41:33.809 INFO:tasks.workunit.client.1.smithi167.stdout:1/739: rename d0/d9/l15 to d0/d5/d34/d3c/d85/db5/dc1/lf2 0 2024-09-17T01:41:33.810 INFO:tasks.workunit.client.1.smithi167.stdout:9/787: dwrite d4/d9/d21/d43/f7d [0,4194304] 0 2024-09-17T01:41:33.811 INFO:tasks.workunit.client.1.smithi167.stdout:2/705: write d5/d33/d48/f7b [231111,42266] 0 2024-09-17T01:41:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.814+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a6c105700 con 0x7f9a58074a30 2024-09-17T01:41:33.813 INFO:tasks.workunit.client.0.smithi082.stdout:5/448: read - db/f5a zero size 2024-09-17T01:41:33.813 INFO:tasks.workunit.client.1.smithi167.stdout:2/706: stat d5/d3c/d4c/de2/d2e/f8c 0 2024-09-17T01:41:33.813 INFO:tasks.workunit.client.0.smithi082.stdout:7/415: dread d0/dd/f1f [0,4194304] 0 2024-09-17T01:41:33.814 INFO:tasks.workunit.client.0.smithi082.stdout:3/294: symlink d9/db/d26/d4f/l65 0 2024-09-17T01:41:33.814 INFO:tasks.workunit.client.0.smithi082.stdout:7/416: chown d0/d3/db/d7d 1969480 1 2024-09-17T01:41:33.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.817+0000 7f9a62ffd640 1 -- 172.21.15.82:0/2603150142 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f9a6c105700 con 0x7f9a58074a30 2024-09-17T01:41:33.816 INFO:tasks.workunit.client.1.smithi167.stdout:4/709: mknod d0/d4/d7/d6/d2b/d6d/cf3 0 2024-09-17T01:41:33.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.820+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 msgr2=0x7f9a58076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.820+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 0x7f9a58076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c198a20 tx=0x7f9a5c00b390 comp rx=0 tx=0).stop 2024-09-17T01:41:33.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 msgr2=0x7f9a6c197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9a680099d0 tx=0x7f9a680046c0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.819 INFO:tasks.workunit.client.0.smithi082.stdout:7/417: read d0/f48 [3049418,83203] 0 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 shutdown_connections 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a6c104d20 0x7f9a6c197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9a58074a30 0x7f9a58076ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 --2- 172.21.15.82:0/2603150142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c1023f0 0x7f9a6c197570 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 >> 172.21.15.82:0/2603150142 conn(0x7f9a6c0fc010 msgr2=0x7f9a6c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 shutdown_connections 2024-09-17T01:41:33.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.821+0000 7f9a740e1640 1 -- 172.21.15.82:0/2603150142 wait complete. 2024-09-17T01:41:33.823 INFO:tasks.workunit.client.1.smithi167.stdout:8/801: stat dc/d21/f5a 0 2024-09-17T01:41:33.825 INFO:tasks.workunit.client.0.smithi082.stdout:5/449: dwrite db/d56/f35 [4194304,4194304] 0 2024-09-17T01:41:33.827 INFO:tasks.workunit.client.0.smithi082.stdout:7/418: symlink d0/d3/d36/d37/d86/l8d 0 2024-09-17T01:41:33.828 INFO:tasks.workunit.client.1.smithi167.stdout:5/674: rename d0/d9/d1c to d0/d24/d2b/d49/d4b/dac/d3a/dd1 0 2024-09-17T01:41:33.829 INFO:tasks.workunit.client.0.smithi082.stdout:5/450: read db/d2b/f36 [970192,17047] 0 2024-09-17T01:41:33.831 INFO:tasks.workunit.client.1.smithi167.stdout:6/873: truncate d7/d54/d90/d13/f49 3024884 0 2024-09-17T01:41:33.831 INFO:tasks.workunit.client.1.smithi167.stdout:7/681: sync 2024-09-17T01:41:33.831 INFO:tasks.workunit.client.0.smithi082.stdout:5/451: read fa [1569963,85940] 0 2024-09-17T01:41:33.833 INFO:tasks.workunit.client.0.smithi082.stdout:5/452: chown db/d56/d29/d4f 49 1 2024-09-17T01:41:33.836 INFO:tasks.workunit.client.1.smithi167.stdout:7/682: dwrite d0/fc8 [0,4194304] 0 2024-09-17T01:41:33.839 INFO:tasks.workunit.client.1.smithi167.stdout:8/802: rename dc/f17 to dc/d56/d59/d82/d8f/de5/dba/f10a 0 2024-09-17T01:41:33.844 INFO:tasks.workunit.client.0.smithi082.stdout:7/419: rmdir d0/d3/db/d10/d8b 0 2024-09-17T01:41:33.845 INFO:tasks.workunit.client.0.smithi082.stdout:3/295: dwrite d9/db/d49/f32 [0,4194304] 0 2024-09-17T01:41:33.845 INFO:tasks.workunit.client.0.smithi082.stdout:7/420: readlink d0/l9 0 2024-09-17T01:41:33.850 INFO:tasks.workunit.client.0.smithi082.stdout:3/296: fdatasync d9/f21 0 2024-09-17T01:41:33.853 INFO:tasks.workunit.client.0.smithi082.stdout:7/421: read d0/d3/db/d10/f27 [866740,67659] 0 2024-09-17T01:41:33.854 INFO:tasks.workunit.client.0.smithi082.stdout:7/422: stat d0/dd/d2c/d55/c84 0 2024-09-17T01:41:33.855 INFO:tasks.workunit.client.0.smithi082.stdout:5/453: rename db/d56/d29/f8b to db/f8f 0 2024-09-17T01:41:33.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/423: creat d0/dd/d2c/f8e x:0 0 0 2024-09-17T01:41:33.862 INFO:tasks.workunit.client.0.smithi082.stdout:5/454: truncate db/d56/d29/d4f/f53 661453 0 2024-09-17T01:41:33.863 INFO:tasks.workunit.client.0.smithi082.stdout:7/424: chown d0/d3/d36/c3b 187123860 1 2024-09-17T01:41:33.864 INFO:tasks.workunit.client.0.smithi082.stdout:5/455: write db/d56/d18/f62 [126264,67880] 0 2024-09-17T01:41:33.865 INFO:tasks.workunit.client.0.smithi082.stdout:7/425: fdatasync d0/d3/d36/f6b 0 2024-09-17T01:41:33.866 INFO:tasks.workunit.client.0.smithi082.stdout:3/297: dwrite d9/d35/f4b [0,4194304] 0 2024-09-17T01:41:33.868 INFO:tasks.workunit.client.0.smithi082.stdout:3/298: dread - d9/d35/f43 zero size 2024-09-17T01:41:33.870 INFO:tasks.workunit.client.0.smithi082.stdout:3/299: chown d9/db/d49/d4e/d53/d5b/c61 1 1 2024-09-17T01:41:33.871 INFO:tasks.workunit.client.0.smithi082.stdout:7/426: dread d0/dd/f7c [0,4194304] 0 2024-09-17T01:41:33.872 INFO:tasks.workunit.client.0.smithi082.stdout:3/300: fsync d9/f2b 0 2024-09-17T01:41:33.877 INFO:tasks.workunit.client.0.smithi082.stdout:3/301: link d9/d35/c5e d9/c66 0 2024-09-17T01:41:33.880 INFO:tasks.workunit.client.0.smithi082.stdout:3/302: dread d9/f4d [0,4194304] 0 2024-09-17T01:41:33.883 INFO:tasks.workunit.client.0.smithi082.stdout:3/303: write d9/db/d49/d4e/f50 [4804325,50825] 0 2024-09-17T01:41:33.887 INFO:tasks.workunit.client.0.smithi082.stdout:3/304: link d9/l4c d9/db/d49/d4e/d53/d5b/l67 0 2024-09-17T01:41:33.890 INFO:tasks.workunit.client.0.smithi082.stdout:3/305: read d9/db/f2f [137666,85058] 0 2024-09-17T01:41:33.891 INFO:tasks.workunit.client.0.smithi082.stdout:5/456: dread f3 [0,4194304] 0 2024-09-17T01:41:33.892 INFO:tasks.workunit.client.0.smithi082.stdout:3/306: symlink d9/db/d26/d4f/l68 0 2024-09-17T01:41:33.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/457: unlink db/d56/l3d 0 2024-09-17T01:41:33.903 INFO:tasks.workunit.client.1.smithi167.stdout:2/707: link d5/d33/d48/d72/d94/de3/fe9 d5/d6d/ff5 0 2024-09-17T01:41:33.903 INFO:tasks.workunit.client.1.smithi167.stdout:3/739: write d7/d8/d2a/f3f [2165527,112391] 0 2024-09-17T01:41:33.903 INFO:tasks.workunit.client.1.smithi167.stdout:7/683: creat d0/d2/d14/d6f/feb x:0 0 0 2024-09-17T01:41:33.904 INFO:tasks.workunit.client.1.smithi167.stdout:9/788: truncate d4/d9/d21/d43/d6c/d9e/fbd 1153496 0 2024-09-17T01:41:33.905 INFO:tasks.workunit.client.0.smithi082.stdout:3/307: truncate d9/db/d26/f27 3749790 0 2024-09-17T01:41:33.906 INFO:tasks.workunit.client.1.smithi167.stdout:8/803: dwrite dc/d56/d57/d7e/dad/fcd [0,4194304] 0 2024-09-17T01:41:33.908 INFO:tasks.workunit.client.0.smithi082.stdout:3/308: mkdir d9/db/d26/d4f/d69 0 2024-09-17T01:41:33.911 INFO:tasks.workunit.client.1.smithi167.stdout:1/740: dwrite d0/d9/d16/d22/f4d [0,4194304] 0 2024-09-17T01:41:33.913 INFO:tasks.workunit.client.1.smithi167.stdout:2/708: creat d5/d3c/d4c/de2/d45/d8e/d98/ff6 x:0 0 0 2024-09-17T01:41:33.913 INFO:tasks.workunit.client.1.smithi167.stdout:5/675: getdents d0/d24/d2b/d49/d66 0 2024-09-17T01:41:33.914 INFO:tasks.workunit.client.1.smithi167.stdout:8/804: rmdir dc/d56/d59/d82/d8f/de5/dba/dd3/de4 39 2024-09-17T01:41:33.915 INFO:tasks.workunit.client.1.smithi167.stdout:5/676: dread - d0/d24/d2b/d49/d4b/fcd zero size 2024-09-17T01:41:33.916 INFO:tasks.workunit.client.0.smithi082.stdout:3/309: dwrite f7 [4194304,4194304] 0 2024-09-17T01:41:33.916 INFO:tasks.workunit.client.0.smithi082.stdout:5/458: dread db/f19 [0,4194304] 0 2024-09-17T01:41:33.917 INFO:tasks.workunit.client.0.smithi082.stdout:5/459: fsync f9 0 2024-09-17T01:41:33.917 INFO:tasks.workunit.client.1.smithi167.stdout:9/789: mknod d4/d9/d21/d43/cf8 0 2024-09-17T01:41:33.918 INFO:tasks.workunit.client.1.smithi167.stdout:1/741: write d0/f2e [5119573,55096] 0 2024-09-17T01:41:33.919 INFO:tasks.workunit.client.1.smithi167.stdout:9/790: write d4/d9/d21/fc8 [1558164,119515] 0 2024-09-17T01:41:33.921 INFO:tasks.workunit.client.1.smithi167.stdout:9/791: stat d4/d9/d21/d2d/d33/d3a/d9c 0 2024-09-17T01:41:33.921 INFO:tasks.workunit.client.0.smithi082.stdout:3/310: chown d9/c1c 193199 1 2024-09-17T01:41:33.922 INFO:tasks.workunit.client.1.smithi167.stdout:3/740: dread d7/d8/d10/f40 [0,4194304] 0 2024-09-17T01:41:33.922 INFO:tasks.workunit.client.1.smithi167.stdout:8/805: truncate dc/d18/f4f 307399 0 2024-09-17T01:41:33.922 INFO:tasks.workunit.client.0.smithi082.stdout:5/460: rmdir db 39 2024-09-17T01:41:33.922 INFO:tasks.workunit.client.1.smithi167.stdout:9/792: chown d4/d9/d21/d2d/dae/cda 890750 1 2024-09-17T01:41:33.924 INFO:tasks.workunit.client.1.smithi167.stdout:2/709: mknod d5/d3c/d4c/de2/cf7 0 2024-09-17T01:41:33.925 INFO:tasks.workunit.client.1.smithi167.stdout:2/710: fdatasync d5/d3c/d4c/de2/d45/d8e/fe0 0 2024-09-17T01:41:33.925 INFO:tasks.workunit.client.1.smithi167.stdout:1/742: mknod d0/d5/d34/d3c/d85/db5/dc1/cf3 0 2024-09-17T01:41:33.927 INFO:tasks.workunit.client.1.smithi167.stdout:8/806: symlink dc/d56/d59/d82/d8f/de5/l10b 0 2024-09-17T01:41:33.931 INFO:tasks.workunit.client.0.smithi082.stdout:5/461: symlink db/d1e/d20/d4d/l90 0 2024-09-17T01:41:33.933 INFO:tasks.workunit.client.0.smithi082.stdout:5/462: fsync db/d2b/f36 0 2024-09-17T01:41:33.934 INFO:tasks.workunit.client.1.smithi167.stdout:3/741: link d7/d8/d10/d14/d66/dc4/cd4 d7/d8/d10/d14/d25/dc7/dd1/cf9 0 2024-09-17T01:41:33.935 INFO:tasks.workunit.client.1.smithi167.stdout:3/742: truncate d7/d8/d10/d29/fa4 2448591 0 2024-09-17T01:41:33.936 INFO:tasks.workunit.client.0.smithi082.stdout:5/463: read db/d56/f1c [1147920,56205] 0 2024-09-17T01:41:33.936 INFO:tasks.workunit.client.1.smithi167.stdout:2/711: creat d5/ff8 x:0 0 0 2024-09-17T01:41:33.936 INFO:tasks.workunit.client.1.smithi167.stdout:3/743: chown d7/d8/d2a/c99 136 1 2024-09-17T01:41:33.937 INFO:tasks.workunit.client.1.smithi167.stdout:1/743: getdents d0/d9/d16/d48/d54/d78/d90 0 2024-09-17T01:41:33.938 INFO:tasks.workunit.client.1.smithi167.stdout:1/744: write d0/d5/d34/d3c/fbc [603408,15081] 0 2024-09-17T01:41:33.939 INFO:tasks.workunit.client.1.smithi167.stdout:1/745: fdatasync d0/d9/d16/d36/daf/fd3 0 2024-09-17T01:41:33.943 INFO:tasks.workunit.client.1.smithi167.stdout:8/807: rmdir dc/d56/d59/d82/d8f/de5/dba/dd3/de4/dec 0 2024-09-17T01:41:33.944 INFO:tasks.workunit.client.0.smithi082.stdout:5/464: dwrite db/d56/d18/f62 [0,4194304] 0 2024-09-17T01:41:33.944 INFO:tasks.workunit.client.1.smithi167.stdout:0/665: sync 2024-09-17T01:41:33.945 INFO:tasks.workunit.client.0.smithi082.stdout:3/311: dread d9/f47 [4194304,4194304] 0 2024-09-17T01:41:33.951 INFO:tasks.workunit.client.0.smithi082.stdout:5/465: read db/d1e/d20/f73 [2783734,51307] 0 2024-09-17T01:41:33.952 INFO:tasks.workunit.client.1.smithi167.stdout:8/808: rmdir dc/d56/d57/da0/da7 39 2024-09-17T01:41:33.952 INFO:tasks.workunit.client.1.smithi167.stdout:3/744: getdents d7/d8/d10/d14/d66/d6c/da2/dc3 0 2024-09-17T01:41:33.953 INFO:tasks.workunit.client.0.smithi082.stdout:5/466: truncate db/f5a 795427 0 2024-09-17T01:41:33.954 INFO:tasks.workunit.client.0.smithi082.stdout:5/467: readlink db/d1e/l81 0 2024-09-17T01:41:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.957+0000 7f894effd640 1 -- 172.21.15.82:0/2641321733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8944031740 con 0x7f8950100860 2024-09-17T01:41:33.955 INFO:tasks.workunit.client.0.smithi082.stdout:5/468: chown db/d56/d29 10035 1 2024-09-17T01:41:33.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/312: dwrite d9/db/d49/d4e/f57 [0,4194304] 0 2024-09-17T01:41:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.958+0000 7f89569fe640 1 -- 172.21.15.82:0/2641321733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 msgr2=0x7f8950100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.958+0000 7f89569fe640 1 --2- 172.21.15.82:0/2641321733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950100c60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8944009880 tx=0x7f894402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 -- 172.21.15.82:0/2641321733 shutdown_connections 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 --2- 172.21.15.82:0/2641321733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 --2- 172.21.15.82:0/2641321733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950100c60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 -- 172.21.15.82:0/2641321733 >> 172.21.15.82:0/2641321733 conn(0x7f89500fc010 msgr2=0x7f89500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 -- 172.21.15.82:0/2641321733 shutdown_connections 2024-09-17T01:41:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.959+0000 7f89569fe640 1 -- 172.21.15.82:0/2641321733 wait complete. 2024-09-17T01:41:33.958 INFO:tasks.workunit.client.1.smithi167.stdout:7/684: truncate d0/d2/faa 3426474 0 2024-09-17T01:41:33.959 INFO:tasks.workunit.client.1.smithi167.stdout:0/666: dread d5/d6b/d77/d37/d80/f82 [0,4194304] 0 2024-09-17T01:41:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.960+0000 7f89569fe640 1 Processor -- start 2024-09-17T01:41:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.960+0000 7f89569fe640 1 -- start start 2024-09-17T01:41:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f89569fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f89569fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f89569fe640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89501096a0 con 0x7f8950100860 2024-09-17T01:41:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f89569fe640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8950109520 con 0x7f8950101a60 2024-09-17T01:41:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f894f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f894f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:50274/0 (socket says 172.21.15.82:50274) 2024-09-17T01:41:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.961+0000 7f894f7fe640 1 -- 172.21.15.82:0/1311102812 learned_addr learned my addr 172.21.15.82:0/1311102812 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894ffff640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.960 INFO:tasks.workunit.client.1.smithi167.stdout:8/809: rename dc/dae/fb8 to dc/d56/d57/dc2/d100/d103/f10c 0 2024-09-17T01:41:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894f7fe640 1 -- 172.21.15.82:0/1311102812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 msgr2=0x7f8950104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894f7fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894f7fe640 1 -- 172.21.15.82:0/1311102812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950103380 con 0x7f8950101a60 2024-09-17T01:41:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894ffff640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.962+0000 7f894f7fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f894000d6f0 tx=0x7f894000dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.963+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8940017070 con 0x7f8950101a60 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.963+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f894000de00 con 0x7f8950101a60 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.963+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8940004bb0 con 0x7f8950101a60 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.963+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8950103670 con 0x7f8950101a60 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.963+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8950103c00 con 0x7f8950101a60 2024-09-17T01:41:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.964+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950100c60 con 0x7f8950101a60 2024-09-17T01:41:33.963 INFO:tasks.workunit.client.1.smithi167.stdout:3/745: creat d7/d1e/ffa x:0 0 0 2024-09-17T01:41:33.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.966+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8940009a30 con 0x7f8950101a60 2024-09-17T01:41:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.967+0000 7f894d7fa640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 0x7f8938076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.967+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f8940096200 con 0x7f8950101a60 2024-09-17T01:41:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.968+0000 7f894ffff640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 0x7f8938076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:33.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.969+0000 7f894ffff640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 0x7f8938076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8944009230 tx=0x7f89440058d0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:33.968 INFO:tasks.workunit.client.0.smithi082.stdout:3/313: creat d9/db/d26/d4f/d69/f6a x:0 0 0 2024-09-17T01:41:33.969 INFO:tasks.workunit.client.0.smithi082.stdout:3/314: chown d9/db/f18 136 1 2024-09-17T01:41:33.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:33.972+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f89400618b0 con 0x7f8950101a60 2024-09-17T01:41:33.970 INFO:tasks.workunit.client.1.smithi167.stdout:0/667: chown d5/d6b/d77/d37/lae 344268 1 2024-09-17T01:41:33.970 INFO:tasks.workunit.client.1.smithi167.stdout:8/810: readlink dc/d1a/l87 0 2024-09-17T01:41:33.971 INFO:tasks.workunit.client.0.smithi082.stdout:3/315: fsync f6 0 2024-09-17T01:41:33.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/316: write d9/db/d26/f46 [279672,96316] 0 2024-09-17T01:41:33.977 INFO:tasks.workunit.client.1.smithi167.stdout:1/746: dread d0/d5/d34/d3c/f42 [0,4194304] 0 2024-09-17T01:41:33.982 INFO:tasks.workunit.client.0.smithi082.stdout:5/469: write f3 [3130813,51729] 0 2024-09-17T01:41:33.983 INFO:tasks.workunit.client.0.smithi082.stdout:5/470: truncate db/d56/d78/f8a 901337 0 2024-09-17T01:41:33.989 INFO:tasks.workunit.client.0.smithi082.stdout:3/317: truncate d9/db/f22 416482 0 2024-09-17T01:41:33.990 INFO:tasks.workunit.client.0.smithi082.stdout:5/471: dwrite fa [0,4194304] 0 2024-09-17T01:41:33.995 INFO:tasks.workunit.client.0.smithi082.stdout:5/472: symlink db/d1e/l91 0 2024-09-17T01:41:33.995 INFO:tasks.workunit.client.0.smithi082.stdout:5/473: stat db/d56/c26 0 2024-09-17T01:41:33.998 INFO:tasks.workunit.client.0.smithi082.stdout:5/474: read db/d1e/f52 [3286386,69755] 0 2024-09-17T01:41:34.000 INFO:tasks.workunit.client.0.smithi082.stdout:5/475: truncate db/d56/d18/d23/f6c 260051 0 2024-09-17T01:41:34.001 INFO:tasks.workunit.client.0.smithi082.stdout:5/476: chown db/d2b/d59/c60 0 1 2024-09-17T01:41:34.002 INFO:tasks.workunit.client.0.smithi082.stdout:5/477: read db/d56/d78/f8a [809436,126690] 0 2024-09-17T01:41:34.003 INFO:tasks.workunit.client.0.smithi082.stdout:5/478: chown db/c67 4026 1 2024-09-17T01:41:34.004 INFO:tasks.workunit.client.0.smithi082.stdout:5/479: dread - db/d56/d18/d23/f66 zero size 2024-09-17T01:41:34.009 INFO:tasks.workunit.client.0.smithi082.stdout:3/318: write f6 [3229784,127681] 0 2024-09-17T01:41:34.017 INFO:tasks.workunit.client.0.smithi082.stdout:5/480: getdents db/d1e 0 2024-09-17T01:41:34.020 INFO:tasks.workunit.client.0.smithi082.stdout:3/319: link d9/db/c1d d9/d35/d63/c6b 0 2024-09-17T01:41:34.024 INFO:tasks.workunit.client.1.smithi167.stdout:4/710: sync 2024-09-17T01:41:34.026 INFO:tasks.workunit.client.1.smithi167.stdout:7/685: symlink d0/d2/d14/d19/d32/lec 0 2024-09-17T01:41:34.026 INFO:tasks.workunit.client.1.smithi167.stdout:4/711: readlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d74/lc5 0 2024-09-17T01:41:34.027 INFO:tasks.workunit.client.1.smithi167.stdout:4/712: fsync d0/d4/d7/f67 0 2024-09-17T01:41:34.027 INFO:tasks.workunit.client.1.smithi167.stdout:7/686: chown d0/d2/d14/d19/d22/fc6 9 1 2024-09-17T01:41:34.028 INFO:tasks.workunit.client.1.smithi167.stdout:4/713: chown d0/d4/d69/fd7 11 1 2024-09-17T01:41:34.028 INFO:tasks.workunit.client.0.smithi082.stdout:3/320: dwrite d9/db/d49/d4e/d53/f58 [0,4194304] 0 2024-09-17T01:41:34.028 INFO:tasks.workunit.client.1.smithi167.stdout:7/687: fdatasync d0/d2/d88/d6e/da3/dd0/fa4 0 2024-09-17T01:41:34.030 INFO:tasks.workunit.client.1.smithi167.stdout:8/811: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f10d x:0 0 0 2024-09-17T01:41:34.031 INFO:tasks.workunit.client.1.smithi167.stdout:1/747: creat d0/d5/d34/d8a/ff4 x:0 0 0 2024-09-17T01:41:34.033 INFO:tasks.workunit.client.0.smithi082.stdout:5/481: dread db/d56/d18/f40 [0,4194304] 0 2024-09-17T01:41:34.033 INFO:tasks.workunit.client.0.smithi082.stdout:5/482: readlink db/d2b/l6e 0 2024-09-17T01:41:34.035 INFO:tasks.workunit.client.0.smithi082.stdout:3/321: unlink d9/l5a 0 2024-09-17T01:41:34.039 INFO:tasks.workunit.client.0.smithi082.stdout:5/483: rename db/d56/d29/f2c to db/d1e/d5b/f92 0 2024-09-17T01:41:34.042 INFO:tasks.workunit.client.0.smithi082.stdout:3/322: rmdir d9/db/d49/d4e/d53 39 2024-09-17T01:41:34.045 INFO:tasks.workunit.client.1.smithi167.stdout:3/746: dread d7/d1e/f4f [0,4194304] 0 2024-09-17T01:41:34.045 INFO:tasks.workunit.client.1.smithi167.stdout:4/714: unlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/c71 0 2024-09-17T01:41:34.049 INFO:tasks.workunit.client.1.smithi167.stdout:1/748: fsync d0/d5/d34/d6d/fe0 0 2024-09-17T01:41:34.051 INFO:tasks.workunit.client.0.smithi082.stdout:3/323: rename d9/db/f3c to d9/db/d49/d4e/d53/d5b/f6c 0 2024-09-17T01:41:34.051 INFO:tasks.workunit.client.0.smithi082.stdout:6/424: sync 2024-09-17T01:41:34.052 INFO:tasks.workunit.client.1.smithi167.stdout:0/668: rename d5/d6b/d77/d4d/c42 to d5/d6b/d77/d4d/cda 0 2024-09-17T01:41:34.052 INFO:tasks.workunit.client.0.smithi082.stdout:5/484: link db/d1e/f31 db/d2b/f93 0 2024-09-17T01:41:34.053 INFO:tasks.workunit.client.0.smithi082.stdout:5/485: chown db/d1e/d5b 474253383 1 2024-09-17T01:41:34.057 INFO:tasks.workunit.client.1.smithi167.stdout:3/747: rename d7/d8/d10/d14/d66/d6c/d7c to d7/d8/d10/d14/d2c/d74/dbb/dfb 0 2024-09-17T01:41:34.059 INFO:tasks.workunit.client.1.smithi167.stdout:8/812: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/d101/f10e x:0 0 0 2024-09-17T01:41:34.061 INFO:tasks.workunit.client.1.smithi167.stdout:1/749: dread d0/d9/d16/d48/d54/f60 [0,4194304] 0 2024-09-17T01:41:34.063 INFO:tasks.workunit.client.1.smithi167.stdout:1/750: dread - d0/d5/d34/d8a/fcc zero size 2024-09-17T01:41:34.063 INFO:tasks.workunit.client.1.smithi167.stdout:7/688: dwrite d0/d2/d14/f8a [0,4194304] 0 2024-09-17T01:41:34.064 INFO:tasks.workunit.client.0.smithi082.stdout:5/486: truncate db/d2b/f93 956583 0 2024-09-17T01:41:34.069 INFO:tasks.workunit.client.0.smithi082.stdout:6/425: dwrite d1/d7/d10/d4f/dc/d1d/d2c/f60 [0,4194304] 0 2024-09-17T01:41:34.070 INFO:tasks.workunit.client.1.smithi167.stdout:0/669: dread d5/f83 [0,4194304] 0 2024-09-17T01:41:34.071 INFO:tasks.workunit.client.1.smithi167.stdout:0/670: dread - d5/d6b/d77/d37/d80/fbd zero size 2024-09-17T01:41:34.071 INFO:tasks.workunit.client.1.smithi167.stdout:1/751: unlink d0/d9/cf1 0 2024-09-17T01:41:34.072 INFO:tasks.workunit.client.1.smithi167.stdout:8/813: read dc/d56/d57/dc2/fd6 [475309,86608] 0 2024-09-17T01:41:34.075 INFO:tasks.workunit.client.1.smithi167.stdout:7/689: mkdir d0/d2/ded 0 2024-09-17T01:41:34.077 INFO:tasks.workunit.client.0.smithi082.stdout:6/426: symlink d1/d7/d10/d4f/dc/d2b/l9a 0 2024-09-17T01:41:34.077 INFO:tasks.workunit.client.0.smithi082.stdout:6/427: chown d1/d7/d10 952659141 1 2024-09-17T01:41:34.077 INFO:tasks.workunit.client.0.smithi082.stdout:5/487: getdents db/d1e/d20/d4d 0 2024-09-17T01:41:34.078 INFO:tasks.workunit.client.1.smithi167.stdout:0/671: dwrite d5/d6b/d77/d92/fc0 [0,4194304] 0 2024-09-17T01:41:34.078 INFO:tasks.workunit.client.0.smithi082.stdout:5/488: fdatasync f3 0 2024-09-17T01:41:34.079 INFO:tasks.workunit.client.1.smithi167.stdout:0/672: dread - d5/d6b/d77/d37/fbe zero size 2024-09-17T01:41:34.081 INFO:tasks.workunit.client.0.smithi082.stdout:6/428: creat d1/d7/d10/d4f/d32/f9b x:0 0 0 2024-09-17T01:41:34.082 INFO:tasks.workunit.client.0.smithi082.stdout:5/489: mkdir db/d1e/d5b/d83/d94 0 2024-09-17T01:41:34.083 INFO:tasks.workunit.client.1.smithi167.stdout:0/673: creat d5/d6b/d77/d4d/d56/d7b/fdb x:0 0 0 2024-09-17T01:41:34.085 INFO:tasks.workunit.client.1.smithi167.stdout:1/752: creat d0/d9/d16/ff5 x:0 0 0 2024-09-17T01:41:34.085 INFO:tasks.workunit.client.1.smithi167.stdout:0/674: read d5/d6b/d77/d6d/f8e [304259,72797] 0 2024-09-17T01:41:34.086 INFO:tasks.workunit.client.1.smithi167.stdout:1/753: write d0/d9/d16/d22/f4d [3687219,114854] 0 2024-09-17T01:41:34.086 INFO:tasks.workunit.client.1.smithi167.stdout:7/690: creat d0/d2/d14/d19/d22/fee x:0 0 0 2024-09-17T01:41:34.087 INFO:tasks.workunit.client.0.smithi082.stdout:6/429: dread d1/d7/d10/d4f/dc/d1d/d2c/f60 [0,4194304] 0 2024-09-17T01:41:34.087 INFO:tasks.workunit.client.1.smithi167.stdout:7/691: chown d0/d2/d14/d19/d26/f78 410 1 2024-09-17T01:41:34.088 INFO:tasks.workunit.client.1.smithi167.stdout:7/692: readlink d0/d2/d14/d19/d32/d62/lbd 0 2024-09-17T01:41:34.092 INFO:tasks.workunit.client.1.smithi167.stdout:0/675: fdatasync d5/d6b/d77/d4d/f40 0 2024-09-17T01:41:34.093 INFO:tasks.workunit.client.1.smithi167.stdout:0/676: fdatasync d5/d6b/d77/d6d/f81 0 2024-09-17T01:41:34.094 INFO:tasks.workunit.client.1.smithi167.stdout:1/754: fdatasync d0/d5/d61/fd0 0 2024-09-17T01:41:34.094 INFO:tasks.workunit.client.1.smithi167.stdout:3/748: truncate d7/d8/d10/d14/d25/f6b 2279070 0 2024-09-17T01:41:34.096 INFO:tasks.workunit.client.1.smithi167.stdout:7/693: rename d0/fc8 to d0/d2/d14/d23/fef 0 2024-09-17T01:41:34.098 INFO:tasks.workunit.client.1.smithi167.stdout:7/694: dread - d0/d2/d14/d19/d22/fe8 zero size 2024-09-17T01:41:34.102 INFO:tasks.workunit.client.1.smithi167.stdout:1/755: dwrite d0/d5/d34/d3c/d74/fc8 [0,4194304] 0 2024-09-17T01:41:34.105 INFO:tasks.workunit.client.1.smithi167.stdout:8/814: dwrite dc/d56/d59/d82/f109 [8388608,4194304] 0 2024-09-17T01:41:34.108 INFO:tasks.workunit.client.1.smithi167.stdout:1/756: mkdir d0/d5/d34/d3c/d85/df6 0 2024-09-17T01:41:34.112 INFO:tasks.workunit.client.1.smithi167.stdout:1/757: stat d0/d9/d16/d36 0 2024-09-17T01:41:34.113 INFO:tasks.workunit.client.1.smithi167.stdout:7/695: dwrite d0/d2/d14/d6f/d87/dae/fd4 [0,4194304] 0 2024-09-17T01:41:34.114 INFO:tasks.workunit.client.1.smithi167.stdout:8/815: dread - dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f10d zero size 2024-09-17T01:41:34.120 INFO:tasks.workunit.client.1.smithi167.stdout:1/758: creat d0/d9/d16/d36/ff7 x:0 0 0 2024-09-17T01:41:34.121 INFO:tasks.workunit.client.1.smithi167.stdout:8/816: mknod dc/dae/c10f 0 2024-09-17T01:41:34.122 INFO:tasks.workunit.client.1.smithi167.stdout:3/749: dwrite d7/d8/d10/d14/d24/d62/f90 [0,4194304] 0 2024-09-17T01:41:34.123 INFO:tasks.workunit.client.1.smithi167.stdout:8/817: stat dc/l1e 0 2024-09-17T01:41:34.124 INFO:tasks.workunit.client.1.smithi167.stdout:0/677: dwrite d5/d8/d9/d2f/f61 [0,4194304] 0 2024-09-17T01:41:34.125 INFO:tasks.workunit.client.1.smithi167.stdout:1/759: rmdir d0/d9/d16/d22 39 2024-09-17T01:41:34.126 INFO:tasks.workunit.client.1.smithi167.stdout:8/818: mkdir dc/d21/d61/dea/d110 0 2024-09-17T01:41:34.128 INFO:tasks.workunit.client.1.smithi167.stdout:0/678: write d5/d8/f46 [776931,85985] 0 2024-09-17T01:41:34.128 INFO:tasks.workunit.client.1.smithi167.stdout:3/750: mkdir d7/d8/d10/d14/d2c/d74/dbb/dfc 0 2024-09-17T01:41:34.130 INFO:tasks.workunit.client.1.smithi167.stdout:7/696: link d0/d2/d14/c3c d0/cf0 0 2024-09-17T01:41:34.130 INFO:tasks.workunit.client.1.smithi167.stdout:7/697: dread - d0/d2/d14/d19/f82 zero size 2024-09-17T01:41:34.132 INFO:tasks.workunit.client.1.smithi167.stdout:1/760: creat d0/d9/d16/d36/ff8 x:0 0 0 2024-09-17T01:41:34.136 INFO:tasks.workunit.client.1.smithi167.stdout:7/698: chown d0/d2/d88/fab 1663127 1 2024-09-17T01:41:34.138 INFO:tasks.workunit.client.1.smithi167.stdout:3/751: fsync d7/d8/d10/d14/d2c/d6f/fe0 0 2024-09-17T01:41:34.138 INFO:tasks.workunit.client.1.smithi167.stdout:6/874: sync 2024-09-17T01:41:34.138 INFO:tasks.workunit.client.1.smithi167.stdout:9/793: sync 2024-09-17T01:41:34.138 INFO:tasks.workunit.client.1.smithi167.stdout:2/712: sync 2024-09-17T01:41:34.138 INFO:tasks.workunit.client.1.smithi167.stdout:5/677: sync 2024-09-17T01:41:34.139 INFO:tasks.workunit.client.1.smithi167.stdout:1/761: mknod d0/d9/d16/d48/de6/cf9 0 2024-09-17T01:41:34.141 INFO:tasks.workunit.client.1.smithi167.stdout:8/819: getdents dc/d56/d57/da0/da7/dc1 0 2024-09-17T01:41:34.143 INFO:tasks.workunit.client.1.smithi167.stdout:6/875: fsync d7/d52/db7/f100 0 2024-09-17T01:41:34.144 INFO:tasks.workunit.client.1.smithi167.stdout:0/679: dwrite d5/d8/d9/f62 [0,4194304] 0 2024-09-17T01:41:34.144 INFO:tasks.workunit.client.1.smithi167.stdout:7/699: write d0/d2/d14/d19/d26/d83/da5/d70/f7e [4013870,130099] 0 2024-09-17T01:41:34.144 INFO:tasks.workunit.client.1.smithi167.stdout:5/678: chown d0/d24/d2b/d49/d4b/dac/f37 4509727 1 2024-09-17T01:41:34.146 INFO:tasks.workunit.client.1.smithi167.stdout:3/752: fdatasync d7/d8/d10/d14/d66/d6c/dab/dcf/fed 0 2024-09-17T01:41:34.147 INFO:tasks.workunit.client.1.smithi167.stdout:1/762: creat d0/d5/d34/d83/ffa x:0 0 0 2024-09-17T01:41:34.149 INFO:tasks.workunit.client.1.smithi167.stdout:7/700: chown d0/d2/d14/d19/d32/fe5 63 1 2024-09-17T01:41:34.151 INFO:tasks.workunit.client.1.smithi167.stdout:0/680: unlink d5/d8/d9/d2f/l53 0 2024-09-17T01:41:34.155 INFO:tasks.workunit.client.1.smithi167.stdout:7/701: dread d0/d2/d14/f8a [0,4194304] 0 2024-09-17T01:41:34.156 INFO:tasks.workunit.client.1.smithi167.stdout:3/753: creat d7/d8/d10/d14/d24/d9c/da3/ffd x:0 0 0 2024-09-17T01:41:34.156 INFO:tasks.workunit.client.1.smithi167.stdout:8/820: write dc/d18/f2d [155306,88572] 0 2024-09-17T01:41:34.158 INFO:tasks.workunit.client.1.smithi167.stdout:0/681: symlink d5/d6b/d77/d6d/d90/dc4/dc7/ldc 0 2024-09-17T01:41:34.160 INFO:tasks.workunit.client.1.smithi167.stdout:0/682: write d5/d8/d9/f3f [3852187,114330] 0 2024-09-17T01:41:34.161 INFO:tasks.workunit.client.1.smithi167.stdout:8/821: fsync f8 0 2024-09-17T01:41:34.162 INFO:tasks.workunit.client.1.smithi167.stdout:4/715: sync 2024-09-17T01:41:34.162 INFO:tasks.workunit.client.1.smithi167.stdout:0/683: chown d5/d6b/d77/d92/db8 27 1 2024-09-17T01:41:34.163 INFO:tasks.workunit.client.1.smithi167.stdout:5/679: rename d0/d9/d64 to d0/d24/d2b/d3d/dd2 0 2024-09-17T01:41:34.164 INFO:tasks.workunit.client.1.smithi167.stdout:3/754: mkdir d7/d8/d10/d14/d25/dfe 0 2024-09-17T01:41:34.166 INFO:tasks.workunit.client.1.smithi167.stdout:4/716: rmdir d0/d4/d7/d6/d5d 39 2024-09-17T01:41:34.169 INFO:tasks.workunit.client.1.smithi167.stdout:1/763: rename d0/d9/d16/d48/d54/d6e/l86 to d0/d5/dbf/ddb/lfb 0 2024-09-17T01:41:34.169 INFO:tasks.workunit.client.1.smithi167.stdout:8/822: fsync dc/d56/d57/d7e/dad/fb9 0 2024-09-17T01:41:34.170 INFO:tasks.workunit.client.1.smithi167.stdout:0/684: truncate d5/d6b/d77/d4d/d56/d7b/fdb 67527 0 2024-09-17T01:41:34.172 INFO:tasks.workunit.client.1.smithi167.stdout:3/755: write d7/d8/d2a/d7a/f88 [1627338,119569] 0 2024-09-17T01:41:34.173 INFO:tasks.workunit.client.1.smithi167.stdout:9/794: dread d4/f38 [0,4194304] 0 2024-09-17T01:41:34.173 INFO:tasks.workunit.client.1.smithi167.stdout:1/764: mkdir d0/dfc 0 2024-09-17T01:41:34.175 INFO:tasks.workunit.client.1.smithi167.stdout:6/876: dwrite d7/d54/d90/d13/d2f/d30/fc9 [0,4194304] 0 2024-09-17T01:41:34.176 INFO:tasks.workunit.client.1.smithi167.stdout:4/717: read d0/d4/d7/d6/d5d/f68 [675327,64812] 0 2024-09-17T01:41:34.177 INFO:tasks.workunit.client.0.smithi082.stdout:5/490: mknod db/d1e/c95 0 2024-09-17T01:41:34.178 INFO:tasks.workunit.client.1.smithi167.stdout:2/713: dread d5/d10/d16/f18 [0,4194304] 0 2024-09-17T01:41:34.183 INFO:tasks.workunit.client.1.smithi167.stdout:1/765: stat d0/d5/d34/d3c/f4e 0 2024-09-17T01:41:34.184 INFO:tasks.workunit.client.1.smithi167.stdout:9/795: symlink d4/d9/d2b/lf9 0 2024-09-17T01:41:34.185 INFO:tasks.workunit.client.1.smithi167.stdout:8/823: dread dc/d21/f3a [4194304,4194304] 0 2024-09-17T01:41:34.185 INFO:tasks.workunit.client.1.smithi167.stdout:5/680: dwrite d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad [4194304,4194304] 0 2024-09-17T01:41:34.185 INFO:tasks.workunit.client.0.smithi082.stdout:6/430: creat d1/d7/d10/d4f/dc/d1d/d36/f9c x:0 0 0 2024-09-17T01:41:34.186 INFO:tasks.workunit.client.1.smithi167.stdout:6/877: creat d7/d54/d90/d34/dc8/f12f x:0 0 0 2024-09-17T01:41:34.189 INFO:tasks.workunit.client.1.smithi167.stdout:5/681: dread - d0/d24/d2b/d4e/fa0 zero size 2024-09-17T01:41:34.189 INFO:tasks.workunit.client.0.smithi082.stdout:1/436: sync 2024-09-17T01:41:34.189 INFO:tasks.workunit.client.0.smithi082.stdout:6/431: creat d1/d1f/f9d x:0 0 0 2024-09-17T01:41:34.191 INFO:tasks.workunit.client.0.smithi082.stdout:1/437: mknod d2/df/c8c 0 2024-09-17T01:41:34.191 INFO:tasks.workunit.client.1.smithi167.stdout:9/796: rmdir d4/d9 39 2024-09-17T01:41:34.192 INFO:tasks.workunit.client.1.smithi167.stdout:6/878: fdatasync d7/d54/d90/d13/d2f/d30/fc9 0 2024-09-17T01:41:34.193 INFO:tasks.workunit.client.1.smithi167.stdout:2/714: dwrite d5/d33/d48/f7b [0,4194304] 0 2024-09-17T01:41:34.193 INFO:tasks.workunit.client.0.smithi082.stdout:1/438: dread - d2/d3f/d24/f7e zero size 2024-09-17T01:41:34.195 INFO:tasks.workunit.client.1.smithi167.stdout:2/715: chown d5/d33/d48/d72/d94 2994777 1 2024-09-17T01:41:34.196 INFO:tasks.workunit.client.1.smithi167.stdout:2/716: readlink d5/l93 0 2024-09-17T01:41:34.198 INFO:tasks.workunit.client.0.smithi082.stdout:1/439: mknod d2/da/d2d/d79/c8d 0 2024-09-17T01:41:34.200 INFO:tasks.workunit.client.1.smithi167.stdout:4/718: creat d0/d4/d7/d10/ff4 x:0 0 0 2024-09-17T01:41:34.200 INFO:tasks.workunit.client.1.smithi167.stdout:0/685: dread d5/d6b/d77/d6d/d90/f9d [0,4194304] 0 2024-09-17T01:41:34.201 INFO:tasks.workunit.client.0.smithi082.stdout:6/432: creat d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e x:0 0 0 2024-09-17T01:41:34.202 INFO:tasks.workunit.client.1.smithi167.stdout:3/756: write d7/d8/d10/d14/f53 [403856,60091] 0 2024-09-17T01:41:34.204 INFO:tasks.workunit.client.0.smithi082.stdout:5/491: unlink db/d1e/f31 0 2024-09-17T01:41:34.205 INFO:tasks.workunit.client.1.smithi167.stdout:1/766: symlink d0/d5/d34/d3c/d85/df6/lfd 0 2024-09-17T01:41:34.209 INFO:tasks.workunit.client.1.smithi167.stdout:8/824: write dc/d56/d59/d82/d8f/de5/dba/dd3/df3/fb6 [374510,85371] 0 2024-09-17T01:41:34.210 INFO:tasks.workunit.client.1.smithi167.stdout:2/717: mkdir d5/d33/df9 0 2024-09-17T01:41:34.211 INFO:tasks.workunit.client.0.smithi082.stdout:1/440: symlink d2/da/d2d/d6c/l8e 0 2024-09-17T01:41:34.212 INFO:tasks.workunit.client.1.smithi167.stdout:5/682: truncate d0/d24/d2b/d4e/f70 1265369 0 2024-09-17T01:41:34.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:33 smithi082 ceph-mon[28077]: pgmap v20: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 223 MiB/s wr, 383 op/s 2024-09-17T01:41:34.215 INFO:tasks.workunit.client.1.smithi167.stdout:0/686: rename d5/d6b/d77/d37/lae to d5/d6b/dd1/ldd 0 2024-09-17T01:41:34.216 INFO:tasks.workunit.client.0.smithi082.stdout:1/441: read d2/d3f/d24/f23 [814331,96816] 0 2024-09-17T01:41:34.218 INFO:tasks.workunit.client.1.smithi167.stdout:4/719: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/dc3/ff5 x:0 0 0 2024-09-17T01:41:34.219 INFO:tasks.workunit.client.1.smithi167.stdout:6/879: dread d7/fa [0,4194304] 0 2024-09-17T01:41:34.220 INFO:tasks.workunit.client.0.smithi082.stdout:6/433: creat d1/d7/d10/f9f x:0 0 0 2024-09-17T01:41:34.220 INFO:tasks.workunit.client.1.smithi167.stdout:4/720: write d0/d4/d7/d6/d2b/d6d/d7e/da8/fe6 [617413,76433] 0 2024-09-17T01:41:34.222 INFO:tasks.workunit.client.0.smithi082.stdout:5/492: link db/d56/f50 db/f96 0 2024-09-17T01:41:34.225 INFO:tasks.workunit.client.0.smithi082.stdout:6/434: unlink d1/d7/d10/f92 0 2024-09-17T01:41:34.227 INFO:tasks.workunit.client.1.smithi167.stdout:2/718: chown d5/d3c/d4c/de2/d45/c11 9 1 2024-09-17T01:41:34.229 INFO:tasks.workunit.client.1.smithi167.stdout:5/683: unlink d0/d24/d2b/d3d/dd2/d95/l97 0 2024-09-17T01:41:34.231 INFO:tasks.workunit.client.1.smithi167.stdout:5/684: chown d0/d24/d2b/d3d/d3b/c84 98702 1 2024-09-17T01:41:34.233 INFO:tasks.workunit.client.0.smithi082.stdout:5/493: creat db/d1e/d20/d4d/f97 x:0 0 0 2024-09-17T01:41:34.239 INFO:tasks.workunit.client.1.smithi167.stdout:8/825: rename dc/d56/d59/d82/d8f/cf7 to dc/d56/dd1/c111 0 2024-09-17T01:41:34.240 INFO:tasks.workunit.client.1.smithi167.stdout:8/826: dread - dc/d56/d59/d82/d8f/de5/f9e zero size 2024-09-17T01:41:34.240 INFO:tasks.workunit.client.1.smithi167.stdout:8/827: fdatasync dc/d21/d61/fb1 0 2024-09-17T01:41:34.241 INFO:tasks.workunit.client.0.smithi082.stdout:1/442: dread d2/d3f/f19 [0,4194304] 0 2024-09-17T01:41:34.241 INFO:tasks.workunit.client.0.smithi082.stdout:5/494: dwrite f3 [0,4194304] 0 2024-09-17T01:41:34.241 INFO:tasks.workunit.client.1.smithi167.stdout:3/757: mknod d7/d8/cff 0 2024-09-17T01:41:34.242 INFO:tasks.workunit.client.1.smithi167.stdout:8/828: write dc/d21/f34 [12322459,20010] 0 2024-09-17T01:41:34.243 INFO:tasks.workunit.client.0.smithi082.stdout:1/443: write d2/d3f/d24/d54/f74 [916529,25041] 0 2024-09-17T01:41:34.243 INFO:tasks.workunit.client.1.smithi167.stdout:8/829: write dc/d56/d59/d82/d8f/de5/f9e [793830,65848] 0 2024-09-17T01:41:34.249 INFO:tasks.workunit.client.1.smithi167.stdout:4/721: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1/ff6 x:0 0 0 2024-09-17T01:41:34.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:33 smithi167 ceph-mon[35643]: pgmap v20: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 223 MiB/s wr, 383 op/s 2024-09-17T01:41:34.255 INFO:tasks.workunit.client.1.smithi167.stdout:1/767: write d0/d5/d34/f7d [3754590,79847] 0 2024-09-17T01:41:34.256 INFO:tasks.workunit.client.1.smithi167.stdout:0/687: rename d5/d6b/d77/d4d/d56/f59 to d5/d6b/d77/d6d/d90/fde 0 2024-09-17T01:41:34.259 INFO:tasks.workunit.client.0.smithi082.stdout:1/444: dwrite d2/da/d2d/f41 [0,4194304] 0 2024-09-17T01:41:34.260 INFO:tasks.workunit.client.1.smithi167.stdout:7/702: sync 2024-09-17T01:41:34.261 INFO:tasks.workunit.client.1.smithi167.stdout:6/880: symlink d7/d54/d90/d13/d2f/d116/l130 0 2024-09-17T01:41:34.263 INFO:tasks.workunit.client.1.smithi167.stdout:6/881: write d7/d54/d90/d13/d2f/d7f/d98/d27/f114 [856481,125049] 0 2024-09-17T01:41:34.263 INFO:tasks.workunit.client.1.smithi167.stdout:6/882: readlink d7/d54/d90/d13/d2f/d7f/d98/l81 0 2024-09-17T01:41:34.264 INFO:tasks.workunit.client.1.smithi167.stdout:9/797: link d4/d9/d21/f27 d4/d9/d21/ffa 0 2024-09-17T01:41:34.265 INFO:tasks.workunit.client.1.smithi167.stdout:6/883: write d7/d54/d90/d13/d2f/d7f/d98/f62 [2878750,75635] 0 2024-09-17T01:41:34.265 INFO:tasks.workunit.client.1.smithi167.stdout:4/722: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d4f/ce4 452060 1 2024-09-17T01:41:34.267 INFO:tasks.workunit.client.0.smithi082.stdout:1/445: dwrite d2/d3f/d24/f7e [0,4194304] 0 2024-09-17T01:41:34.275 INFO:tasks.workunit.client.1.smithi167.stdout:2/719: rename d5/d10/d16 to d5/d3c/d4c/de2/d45/d8e/d98/dfa 0 2024-09-17T01:41:34.276 INFO:tasks.workunit.client.1.smithi167.stdout:1/768: rename d0/d9/d16/d48 to d0/d9/d16/d48/d54/d6f/dfe 22 2024-09-17T01:41:34.276 INFO:tasks.workunit.client.1.smithi167.stdout:2/720: chown d5/d3c/d4c/de2/d2e 15136047 1 2024-09-17T01:41:34.277 INFO:tasks.workunit.client.0.smithi082.stdout:6/435: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f50 [0,4194304] 0 2024-09-17T01:41:34.277 INFO:tasks.workunit.client.1.smithi167.stdout:1/769: write d0/d5/d61/fac [57349,32622] 0 2024-09-17T01:41:34.279 INFO:tasks.workunit.client.1.smithi167.stdout:1/770: read d0/d5/d61/da2/fc7 [42774,17718] 0 2024-09-17T01:41:34.279 INFO:tasks.workunit.client.0.smithi082.stdout:1/446: unlink d2/da/f37 0 2024-09-17T01:41:34.280 INFO:tasks.workunit.client.1.smithi167.stdout:0/688: symlink d5/d6b/ldf 0 2024-09-17T01:41:34.280 INFO:tasks.workunit.client.0.smithi082.stdout:1/447: write d2/d3f/d24/d54/f66 [894654,89988] 0 2024-09-17T01:41:34.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.283+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f895019f640 con 0x7f8938074a80 2024-09-17T01:41:34.287 INFO:tasks.workunit.client.1.smithi167.stdout:8/830: mknod dc/d56/d59/d82/db2/c112 0 2024-09-17T01:41:34.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/436: getdents d1/d7/d10/d4f/d8e 0 2024-09-17T01:41:34.289 INFO:tasks.workunit.client.0.smithi082.stdout:5/495: dwrite db/d56/f50 [0,4194304] 0 2024-09-17T01:41:34.291 INFO:tasks.workunit.client.0.smithi082.stdout:1/448: dwrite d2/d3f/d24/f81 [0,4194304] 0 2024-09-17T01:41:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.297+0000 7f894d7fa640 1 -- 172.21.15.82:0/1311102812 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f895019f640 con 0x7f8938074a80 2024-09-17T01:41:34.295 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:41:34.295 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (6m) 27s ago 8m 24.8M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:41:34.295 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (8m) 27s ago 8m 8665k - 19.1.1-330-gc2ddf972 ebb0615149de 701e72e81717 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (7m) 28s ago 7m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 27s ago 8m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (7m) 28s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (6m) 27s ago 7m 78.7M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (2m) 27s ago 2m 174M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (2m) 27s ago 2m 184M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (2m) 28s ago 2m 23.2M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (2m) 28s ago 2m 21.7M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (9m) 27s ago 9m 244M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (47s) 28s ago 7m 561M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 930ab8ac2a03 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (9m) 27s ago 9m 53.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (7m) 28s ago 7m 42.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (8m) 27s ago 8m 15.4M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:41:34.296 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (7m) 28s ago 7m 16.2M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 27s ago 6m 90.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 27s ago 5m 98.5M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 27s ago 5m 78.1M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (4m) 28s ago 4m 103M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (4m) 28s ago 4m 87.8M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (3m) 28s ago 3m 79.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:41:34.297 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 27s ago 7m 55.9M - 2.43.0 a07b618ecd1d f794527ff3b5 2024-09-17T01:41:34.298 INFO:tasks.workunit.client.1.smithi167.stdout:9/798: unlink d4/d9/d21/f60 0 2024-09-17T01:41:34.298 INFO:tasks.workunit.client.1.smithi167.stdout:9/799: fdatasync d4/d9/d21/d2d/d33/d90/fb7 0 2024-09-17T01:41:34.298 INFO:tasks.workunit.client.1.smithi167.stdout:5/685: write d0/d24/d2b/d49/d4b/dac/d3a/d44/fa5 [1337276,11629] 0 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 msgr2=0x7f8938076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 0x7f8938076f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8944009230 tx=0x7f89440058d0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 msgr2=0x7f8950102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f894000d6f0 tx=0x7f894000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 shutdown_connections 2024-09-17T01:41:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101a60 0x7f8950102e40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8938074a80 0x7f8938076f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 --2- 172.21.15.82:0/1311102812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950100860 0x7f8950104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.302+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 >> 172.21.15.82:0/1311102812 conn(0x7f89500fc010 msgr2=0x7f8950069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.301 INFO:tasks.workunit.client.0.smithi082.stdout:1/449: dwrite d2/da/f6a [0,4194304] 0 2024-09-17T01:41:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.303+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 shutdown_connections 2024-09-17T01:41:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.303+0000 7f89569fe640 1 -- 172.21.15.82:0/1311102812 wait complete. 2024-09-17T01:41:34.303 INFO:tasks.workunit.client.0.smithi082.stdout:6/437: mkdir d1/d7/da0 0 2024-09-17T01:41:34.304 INFO:tasks.workunit.client.1.smithi167.stdout:7/703: write d0/d2/d14/d6f/d87/dae/fb5 [303902,57563] 0 2024-09-17T01:41:34.305 INFO:tasks.workunit.client.0.smithi082.stdout:6/438: fsync d1/d7/d10/d4f/d32/f3f 0 2024-09-17T01:41:34.307 INFO:tasks.workunit.client.0.smithi082.stdout:6/439: truncate d1/d7/d10/f84 703422 0 2024-09-17T01:41:34.309 INFO:tasks.workunit.client.1.smithi167.stdout:2/721: creat d5/d33/d48/d72/d94/de3/ffb x:0 0 0 2024-09-17T01:41:34.310 INFO:tasks.workunit.client.1.smithi167.stdout:0/689: rmdir d5/d6b/d77/d4d 39 2024-09-17T01:41:34.312 INFO:tasks.workunit.client.1.smithi167.stdout:1/771: rename d0/d9/fb to d0/d5/d34/d3c/d85/fff 0 2024-09-17T01:41:34.313 INFO:tasks.workunit.client.1.smithi167.stdout:3/758: creat d7/d8/f100 x:0 0 0 2024-09-17T01:41:34.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/450: creat d2/da/d16/f8f x:0 0 0 2024-09-17T01:41:34.316 INFO:tasks.workunit.client.0.smithi082.stdout:6/440: mknod d1/d7/d10/d4f/dc/d99/ca1 0 2024-09-17T01:41:34.319 INFO:tasks.workunit.client.1.smithi167.stdout:4/723: mknod d0/cf7 0 2024-09-17T01:41:34.319 INFO:tasks.workunit.client.1.smithi167.stdout:5/686: chown d0/d24/d2b/d3d/l36 8 1 2024-09-17T01:41:34.321 INFO:tasks.workunit.client.0.smithi082.stdout:1/451: dwrite d2/d3f/f5a [4194304,4194304] 0 2024-09-17T01:41:34.325 INFO:tasks.workunit.client.0.smithi082.stdout:1/452: fdatasync d2/d3f/f13 0 2024-09-17T01:41:34.328 INFO:tasks.workunit.client.1.smithi167.stdout:0/690: symlink d5/d8/d5c/le0 0 2024-09-17T01:41:34.328 INFO:tasks.workunit.client.1.smithi167.stdout:2/722: mknod d5/d33/d48/d72/d94/de3/cfc 0 2024-09-17T01:41:34.329 INFO:tasks.workunit.client.1.smithi167.stdout:0/691: fsync d5/d6b/d77/d6d/d90/dc4/dc7/fd3 0 2024-09-17T01:41:34.329 INFO:tasks.workunit.client.1.smithi167.stdout:9/800: rename d4/d9/d21/df0/l53 to d4/d9/d21/d2d/d33/d3a/d9c/lfb 0 2024-09-17T01:41:34.330 INFO:tasks.workunit.client.1.smithi167.stdout:9/801: chown d4/da4 12474 1 2024-09-17T01:41:34.332 INFO:tasks.workunit.client.0.smithi082.stdout:1/453: truncate d2/da/d2d/d6c/f6e 479795 0 2024-09-17T01:41:34.333 INFO:tasks.workunit.client.0.smithi082.stdout:1/454: write d2/f11 [1189984,107818] 0 2024-09-17T01:41:34.336 INFO:tasks.workunit.client.1.smithi167.stdout:5/687: symlink d0/d24/d2b/d3d/dd2/ld3 0 2024-09-17T01:41:34.337 INFO:tasks.workunit.client.1.smithi167.stdout:5/688: write d0/d24/d2b/d49/fc7 [837361,90735] 0 2024-09-17T01:41:34.337 INFO:tasks.workunit.client.0.smithi082.stdout:1/455: mknod d2/df/c90 0 2024-09-17T01:41:34.340 INFO:tasks.workunit.client.1.smithi167.stdout:2/723: creat d5/d3c/d4c/de2/db8/da3/db0/ffd x:0 0 0 2024-09-17T01:41:34.343 INFO:tasks.workunit.client.0.smithi082.stdout:1/456: dwrite d2/f4 [4194304,4194304] 0 2024-09-17T01:41:34.344 INFO:tasks.workunit.client.0.smithi082.stdout:6/441: write d1/d7/d10/d4f/dc/d2b/d48/f76 [71508,99594] 0 2024-09-17T01:41:34.346 INFO:tasks.workunit.client.1.smithi167.stdout:6/884: truncate d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/f11b 711107 0 2024-09-17T01:41:34.347 INFO:tasks.workunit.client.1.smithi167.stdout:6/885: chown d7/d54/d90/d13/d2f/d7f/fe7 3 1 2024-09-17T01:41:34.347 INFO:tasks.workunit.client.1.smithi167.stdout:5/689: mkdir d0/d24/d2b/d4e/dd4 0 2024-09-17T01:41:34.352 INFO:tasks.workunit.client.0.smithi082.stdout:1/457: rename d2/d3f/d24/f4f to d2/df/d46/f91 0 2024-09-17T01:41:34.354 INFO:tasks.workunit.client.0.smithi082.stdout:6/442: mknod d1/d7/d10/d4f/d32/ca2 0 2024-09-17T01:41:34.358 INFO:tasks.workunit.client.1.smithi167.stdout:8/831: write dc/d21/d6b/f6c [3224590,48628] 0 2024-09-17T01:41:34.360 INFO:tasks.workunit.client.1.smithi167.stdout:4/724: creat d0/d4/d7/d10/ff8 x:0 0 0 2024-09-17T01:41:34.360 INFO:tasks.workunit.client.1.smithi167.stdout:1/772: dwrite d0/d9/d16/d36/f4a [0,4194304] 0 2024-09-17T01:41:34.361 INFO:tasks.workunit.client.0.smithi082.stdout:6/443: truncate d1/d1f/f66 138306 0 2024-09-17T01:41:34.361 INFO:tasks.workunit.client.1.smithi167.stdout:8/832: fsync dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/fce 0 2024-09-17T01:41:34.363 INFO:tasks.workunit.client.1.smithi167.stdout:6/886: mknod d7/d54/d90/dfc/c131 0 2024-09-17T01:41:34.365 INFO:tasks.workunit.client.1.smithi167.stdout:7/704: getdents d0/d2/d14/d6f/d87 0 2024-09-17T01:41:34.366 INFO:tasks.workunit.client.1.smithi167.stdout:9/802: write d4/d9/d21/d43/d6c/d9e/da1/dbc/fd1 [874118,100679] 0 2024-09-17T01:41:34.367 INFO:tasks.workunit.client.0.smithi082.stdout:1/458: dwrite d2/d3f/d24/f86 [0,4194304] 0 2024-09-17T01:41:34.367 INFO:tasks.workunit.client.1.smithi167.stdout:8/833: dwrite dc/ff [0,4194304] 0 2024-09-17T01:41:34.368 INFO:tasks.workunit.client.1.smithi167.stdout:9/803: stat d4/d9/d21/d2d/d33/d80/f9f 0 2024-09-17T01:41:34.368 INFO:tasks.workunit.client.0.smithi082.stdout:1/459: fsync d2/f5f 0 2024-09-17T01:41:34.371 INFO:tasks.workunit.client.1.smithi167.stdout:5/690: mknod d0/d24/d2b/d3d/d3b/d92/cd5 0 2024-09-17T01:41:34.373 INFO:tasks.workunit.client.1.smithi167.stdout:2/724: mkdir d5/dfe 0 2024-09-17T01:41:34.376 INFO:tasks.workunit.client.0.smithi082.stdout:6/444: dread d1/d7/d10/d4f/dc/f29 [0,4194304] 0 2024-09-17T01:41:34.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/460: rename d2/da/d2d/l78 to d2/da/d76/l92 0 2024-09-17T01:41:34.379 INFO:tasks.workunit.client.0.smithi082.stdout:6/445: write d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f50 [4354541,107285] 0 2024-09-17T01:41:34.379 INFO:tasks.workunit.client.0.smithi082.stdout:1/461: chown d2/f4 14240 1 2024-09-17T01:41:34.381 INFO:tasks.workunit.client.0.smithi082.stdout:1/462: chown d2/da/d2d/f45 1086217 1 2024-09-17T01:41:34.389 INFO:tasks.workunit.client.1.smithi167.stdout:4/725: truncate d0/d4/d7/d6/f83 89140 0 2024-09-17T01:41:34.390 INFO:tasks.workunit.client.0.smithi082.stdout:1/463: mkdir d2/da/d76/d93 0 2024-09-17T01:41:34.391 INFO:tasks.workunit.client.1.smithi167.stdout:3/759: sync 2024-09-17T01:41:34.392 INFO:tasks.workunit.client.1.smithi167.stdout:6/887: creat d7/d54/d90/d13/d2f/d30/d88/f132 x:0 0 0 2024-09-17T01:41:34.395 INFO:tasks.workunit.client.1.smithi167.stdout:8/834: mkdir dc/d21/d6b/d113 0 2024-09-17T01:41:34.395 INFO:tasks.workunit.client.1.smithi167.stdout:7/705: dread d0/d2/d14/f8a [0,4194304] 0 2024-09-17T01:41:34.397 INFO:tasks.workunit.client.1.smithi167.stdout:7/706: stat d0/d2/d14/d23/f38 0 2024-09-17T01:41:34.397 INFO:tasks.workunit.client.1.smithi167.stdout:5/691: rename d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/f6b to d0/d24/d2b/d4e/d63/fd6 0 2024-09-17T01:41:34.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/464: mkdir d2/d3f/d94 0 2024-09-17T01:41:34.401 INFO:tasks.workunit.client.0.smithi082.stdout:6/446: getdents d1/d7/d10/d4f/dc/d2b/d48 0 2024-09-17T01:41:34.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/447: readlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l61 0 2024-09-17T01:41:34.402 INFO:tasks.workunit.client.1.smithi167.stdout:1/773: fsync d0/d5/d61/f71 0 2024-09-17T01:41:34.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/448: fsync d1/d3/f7b 0 2024-09-17T01:41:34.407 INFO:tasks.workunit.client.1.smithi167.stdout:3/760: creat d7/d8/d10/d14/d66/d6c/dab/f101 x:0 0 0 2024-09-17T01:41:34.407 INFO:tasks.workunit.client.0.smithi082.stdout:6/449: symlink d1/d7/d10/d4f/dc/la3 0 2024-09-17T01:41:34.408 INFO:tasks.workunit.client.1.smithi167.stdout:6/888: chown d7/d54/d90/d13/d2f/d64/fbe 39883 1 2024-09-17T01:41:34.408 INFO:tasks.workunit.client.1.smithi167.stdout:9/804: dread d4/f4e [0,4194304] 0 2024-09-17T01:41:34.409 INFO:tasks.workunit.client.1.smithi167.stdout:9/805: readlink d4/d9/d21/d43/d6c/la7 0 2024-09-17T01:41:34.410 INFO:tasks.workunit.client.0.smithi082.stdout:6/450: fdatasync d1/d7/d10/f11 0 2024-09-17T01:41:34.412 INFO:tasks.workunit.client.0.smithi082.stdout:6/451: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/f7d 737968 0 2024-09-17T01:41:34.416 INFO:tasks.workunit.client.1.smithi167.stdout:2/725: rename d5/d3c/d4c/de2/d45/d8e/d98/dfa/f19 to d5/d3c/d4c/de2/d45/d8e/df4/fff 0 2024-09-17T01:41:34.417 INFO:tasks.workunit.client.0.smithi082.stdout:8/348: sync 2024-09-17T01:41:34.419 INFO:tasks.workunit.client.1.smithi167.stdout:5/692: creat d0/d24/d2b/d3d/dd2/d95/fd7 x:0 0 0 2024-09-17T01:41:34.419 INFO:tasks.workunit.client.1.smithi167.stdout:0/692: link d5/d6b/d77/d4d/cda d5/d8/d5c/ce1 0 2024-09-17T01:41:34.420 INFO:tasks.workunit.client.1.smithi167.stdout:0/693: write d5/f1d [812043,1481] 0 2024-09-17T01:41:34.421 INFO:tasks.workunit.client.0.smithi082.stdout:1/465: truncate d2/da/d2d/f3e 969121 0 2024-09-17T01:41:34.421 INFO:tasks.workunit.client.1.smithi167.stdout:0/694: read - d5/d6b/d77/daa/fc9 zero size 2024-09-17T01:41:34.422 INFO:tasks.workunit.client.1.smithi167.stdout:0/695: chown d5/d6b/d77/daa 488 1 2024-09-17T01:41:34.422 INFO:tasks.workunit.client.0.smithi082.stdout:1/466: stat d2/df/d46/c55 0 2024-09-17T01:41:34.426 INFO:tasks.workunit.client.0.smithi082.stdout:6/452: write d1/d7/d10/f11 [3335421,25074] 0 2024-09-17T01:41:34.428 INFO:tasks.workunit.client.1.smithi167.stdout:4/726: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/dac/de9 0 2024-09-17T01:41:34.428 INFO:tasks.workunit.client.1.smithi167.stdout:7/707: write d0/d2/d14/d19/d26/ff [3339828,34497] 0 2024-09-17T01:41:34.429 INFO:tasks.workunit.client.1.smithi167.stdout:7/708: dread - d0/d2/d14/d6f/d87/fcb zero size 2024-09-17T01:41:34.430 INFO:tasks.workunit.client.1.smithi167.stdout:3/761: truncate d7/d1e/f4f 2120091 0 2024-09-17T01:41:34.430 INFO:tasks.workunit.client.0.smithi082.stdout:1/467: dwrite d2/d3f/f13 [4194304,4194304] 0 2024-09-17T01:41:34.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/453: write d1/d7/d10/d4f/f30 [3915142,85096] 0 2024-09-17T01:41:34.436 INFO:tasks.workunit.client.0.smithi082.stdout:8/349: dread d3/dd/f30 [0,4194304] 0 2024-09-17T01:41:34.437 INFO:tasks.workunit.client.1.smithi167.stdout:2/726: unlink d5/d6d/c97 0 2024-09-17T01:41:34.438 INFO:tasks.workunit.client.0.smithi082.stdout:8/350: readlink d3/dd/d18/d2d/d3e/d4a/l4c 0 2024-09-17T01:41:34.439 INFO:tasks.workunit.client.0.smithi082.stdout:6/454: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/la4 0 2024-09-17T01:41:34.441 INFO:tasks.workunit.client.1.smithi167.stdout:0/696: mkdir d5/d6b/d77/d92/de2 0 2024-09-17T01:41:34.442 INFO:tasks.workunit.client.1.smithi167.stdout:2/727: dwrite d5/d33/d48/d72/d94/fb7 [0,4194304] 0 2024-09-17T01:41:34.444 INFO:tasks.workunit.client.1.smithi167.stdout:1/774: symlink d0/d5/d34/d6d/de1/l100 0 2024-09-17T01:41:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.448+0000 7fdf21a40640 1 -- 172.21.15.82:0/2958478147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 msgr2=0x7fdf1c109850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.448+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2958478147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c109850 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009c20 tx=0x7fdf0c02a970 comp rx=0 tx=0).stop 2024-09-17T01:41:34.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 -- 172.21.15.82:0/2958478147 shutdown_connections 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2958478147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2958478147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c109850 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 -- 172.21.15.82:0/2958478147 >> 172.21.15.82:0/2958478147 conn(0x7fdf1c06ea50 msgr2=0x7fdf1c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 -- 172.21.15.82:0/2958478147 shutdown_connections 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.450+0000 7fdf21a40640 1 -- 172.21.15.82:0/2958478147 wait complete. 2024-09-17T01:41:34.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 Processor -- start 2024-09-17T01:41:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 -- start start 2024-09-17T01:41:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c1a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c112fc0 con 0x7fdf1c109450 2024-09-17T01:41:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf21a40640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1c112e40 con 0x7fdf1c109e20 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf127fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c1a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.451+0000 7fdf1affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf127fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c1a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:50278/0 (socket says 172.21.15.82:50278) 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf1affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39138/0 (socket says 172.21.15.82:39138) 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf127fc640 1 -- 172.21.15.82:0/2441302451 learned_addr learned my addr 172.21.15.82:0/2441302451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf1affd640 1 -- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 msgr2=0x7fdf1c1a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf1affd640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c1a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.452+0000 7fdf1affd640 1 -- 172.21.15.82:0/2441302451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1c1a08f0 con 0x7fdf1c109450 2024-09-17T01:41:34.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.453+0000 7fdf1affd640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c02f900 tx=0x7fdf0c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.453+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c047070 con 0x7fdf1c109450 2024-09-17T01:41:34.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.453+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1c1a52f0 con 0x7fdf1c109450 2024-09-17T01:41:34.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.453+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf0c003e30 con 0x7fdf1c109450 2024-09-17T01:41:34.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.453+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1c1a5870 con 0x7fdf1c109450 2024-09-17T01:41:34.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.454+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c047070 con 0x7fdf1c109450 2024-09-17T01:41:34.453 INFO:tasks.workunit.client.0.smithi082.stdout:6/455: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l57 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/la5 0 2024-09-17T01:41:34.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.455+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf1c109850 con 0x7fdf1c109450 2024-09-17T01:41:34.454 INFO:tasks.workunit.client.0.smithi082.stdout:6/456: truncate d1/f5d 748160 0 2024-09-17T01:41:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.456+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fdf0c037020 con 0x7fdf1c109450 2024-09-17T01:41:34.454 INFO:tasks.workunit.client.0.smithi082.stdout:8/351: truncate d3/dd/d18/d2d/d3e/d43/f44 1702761 0 2024-09-17T01:41:34.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.458+0000 7fdf20a3e640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 0x7fdf080770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:34.457 INFO:tasks.workunit.client.0.smithi082.stdout:8/352: truncate d3/dd/d18/d34/f63 1033068 0 2024-09-17T01:41:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.459+0000 7fdf127fc640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 0x7fdf080770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.459+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fdf0c0b6b20 con 0x7fdf1c109450 2024-09-17T01:41:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.460+0000 7fdf127fc640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 0x7fdf080770d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c1a11a0 tx=0x7fdf04005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:34.458 INFO:tasks.workunit.client.1.smithi167.stdout:3/762: dwrite d7/d8/f4c [0,4194304] 0 2024-09-17T01:41:34.458 INFO:tasks.workunit.client.1.smithi167.stdout:6/889: symlink d7/d54/d90/l133 0 2024-09-17T01:41:34.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/468: getdents d2/da/d76 0 2024-09-17T01:41:34.460 INFO:tasks.workunit.client.1.smithi167.stdout:7/709: mknod d0/d2/d14/d6f/d87/dae/cf1 0 2024-09-17T01:41:34.462 INFO:tasks.workunit.client.0.smithi082.stdout:6/457: mknod d1/d7/d10/d4f/dc/d1d/d2c/ca6 0 2024-09-17T01:41:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.464+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fdf0c050020 con 0x7fdf1c109450 2024-09-17T01:41:34.463 INFO:tasks.workunit.client.0.smithi082.stdout:6/458: stat d1/d7/d10/d4f/dc/d1d/d36/d56/f71 0 2024-09-17T01:41:34.463 INFO:tasks.workunit.client.1.smithi167.stdout:9/806: mknod d4/d9/d21/d2d/d33/d80/cfc 0 2024-09-17T01:41:34.466 INFO:tasks.workunit.client.1.smithi167.stdout:5/693: dwrite d0/d24/d2b/d49/d4b/dac/f37 [0,4194304] 0 2024-09-17T01:41:34.466 INFO:tasks.workunit.client.0.smithi082.stdout:8/353: rename d3/dd/d18/d2d/d2e to d3/dd/d18/d2d/d3e/d4a/d6a 0 2024-09-17T01:41:34.469 INFO:tasks.workunit.client.1.smithi167.stdout:8/835: creat dc/d56/d57/da0/f114 x:0 0 0 2024-09-17T01:41:34.472 INFO:tasks.workunit.client.0.smithi082.stdout:6/459: dwrite d1/d7/d10/f9f [0,4194304] 0 2024-09-17T01:41:34.472 INFO:tasks.workunit.client.1.smithi167.stdout:8/836: write dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/fce [4220407,78654] 0 2024-09-17T01:41:34.476 INFO:tasks.workunit.client.1.smithi167.stdout:4/727: write d0/d4/d7/d6/d5d/f68 [1059784,23358] 0 2024-09-17T01:41:34.479 INFO:tasks.workunit.client.1.smithi167.stdout:4/728: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/cca 0 1 2024-09-17T01:41:34.479 INFO:tasks.workunit.client.0.smithi082.stdout:6/460: truncate d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e 944995 0 2024-09-17T01:41:34.479 INFO:tasks.workunit.client.0.smithi082.stdout:1/469: mknod d2/da/d16/c95 0 2024-09-17T01:41:34.482 INFO:tasks.workunit.client.0.smithi082.stdout:8/354: dread d3/dd/d18/f1e [0,4194304] 0 2024-09-17T01:41:34.483 INFO:tasks.workunit.client.0.smithi082.stdout:8/355: stat d3/dd/d18/d34/f63 0 2024-09-17T01:41:34.484 INFO:tasks.workunit.client.1.smithi167.stdout:1/775: rename d0/d9/d16/d36/ff7 to d0/d5/d34/d3c/d85/df6/f101 0 2024-09-17T01:41:34.485 INFO:tasks.workunit.client.1.smithi167.stdout:1/776: chown d0/d5/d34/d3c/d85/df6/lfd 87 1 2024-09-17T01:41:34.486 INFO:tasks.workunit.client.1.smithi167.stdout:1/777: readlink d0/d5/d34/d3c/d85/df6/lfd 0 2024-09-17T01:41:34.488 INFO:tasks.workunit.client.1.smithi167.stdout:3/763: dread d7/d8/d10/d14/f5a [4194304,4194304] 0 2024-09-17T01:41:34.488 INFO:tasks.workunit.client.0.smithi082.stdout:6/461: mkdir d1/d1f/da7 0 2024-09-17T01:41:34.489 INFO:tasks.workunit.client.1.smithi167.stdout:3/764: fsync d7/d8/d2a/f2e 0 2024-09-17T01:41:34.489 INFO:tasks.workunit.client.1.smithi167.stdout:3/765: readlink d7/d8f/lac 0 2024-09-17T01:41:34.489 INFO:tasks.workunit.client.0.smithi082.stdout:1/470: fdatasync d2/f1b 0 2024-09-17T01:41:34.490 INFO:tasks.workunit.client.1.smithi167.stdout:3/766: dread - d7/fec zero size 2024-09-17T01:41:34.492 INFO:tasks.workunit.client.1.smithi167.stdout:5/694: unlink d0/d24/d2b/d3d/fbc 0 2024-09-17T01:41:34.493 INFO:tasks.workunit.client.1.smithi167.stdout:5/695: write d0/d24/faa [4620065,122254] 0 2024-09-17T01:41:34.495 INFO:tasks.workunit.client.1.smithi167.stdout:2/728: getdents d5/d3c/d4c/d4d/d91 0 2024-09-17T01:41:34.497 INFO:tasks.workunit.client.0.smithi082.stdout:1/471: mknod d2/da/d2d/d79/c96 0 2024-09-17T01:41:34.497 INFO:tasks.workunit.client.0.smithi082.stdout:1/472: dread - d2/da/d16/f8f zero size 2024-09-17T01:41:34.498 INFO:tasks.workunit.client.1.smithi167.stdout:5/696: dread d0/d24/d2b/d3d/d3b/f98 [0,4194304] 0 2024-09-17T01:41:34.499 INFO:tasks.workunit.client.0.smithi082.stdout:1/473: write d2/df/d46/f49 [1603806,43215] 0 2024-09-17T01:41:34.499 INFO:tasks.workunit.client.1.smithi167.stdout:5/697: dread - d0/d24/f83 zero size 2024-09-17T01:41:34.501 INFO:tasks.workunit.client.0.smithi082.stdout:6/462: mkdir d1/d7/d10/d4f/d8e/da8 0 2024-09-17T01:41:34.505 INFO:tasks.workunit.client.1.smithi167.stdout:4/729: dread d0/f13 [0,4194304] 0 2024-09-17T01:41:34.505 INFO:tasks.workunit.client.1.smithi167.stdout:1/778: rename d0/d5/d34/d8a to d0/d5/dd7/d102 0 2024-09-17T01:41:34.506 INFO:tasks.workunit.client.1.smithi167.stdout:7/710: mknod d0/d2/d14/d19/d22/cf2 0 2024-09-17T01:41:34.507 INFO:tasks.workunit.client.0.smithi082.stdout:6/463: mknod d1/ca9 0 2024-09-17T01:41:34.508 INFO:tasks.workunit.client.0.smithi082.stdout:6/464: chown d1/d3/l5 29421855 1 2024-09-17T01:41:34.510 INFO:tasks.workunit.client.1.smithi167.stdout:8/837: write dc/d56/d59/fda [1569644,5072] 0 2024-09-17T01:41:34.512 INFO:tasks.workunit.client.0.smithi082.stdout:8/356: dwrite d3/f64 [0,4194304] 0 2024-09-17T01:41:34.514 INFO:tasks.workunit.client.1.smithi167.stdout:1/779: dwrite d0/d9/fc2 [0,4194304] 0 2024-09-17T01:41:34.514 INFO:tasks.workunit.client.1.smithi167.stdout:2/729: chown d5/d3c/d4c/de2/d45/d8e/d98/cc4 899205012 1 2024-09-17T01:41:34.514 INFO:tasks.workunit.client.1.smithi167.stdout:9/807: dwrite d4/f18 [4194304,4194304] 0 2024-09-17T01:41:34.516 INFO:tasks.workunit.client.1.smithi167.stdout:9/808: readlink d4/d9/d97/ldf 0 2024-09-17T01:41:34.517 INFO:tasks.workunit.client.0.smithi082.stdout:1/474: dread d2/da/d2f/d47/f4d [0,4194304] 0 2024-09-17T01:41:34.521 INFO:tasks.workunit.client.1.smithi167.stdout:3/767: mknod d7/d8/d10/d14/c102 0 2024-09-17T01:41:34.521 INFO:tasks.workunit.client.1.smithi167.stdout:8/838: dwrite dc/d21/d6b/d74/fe8 [0,4194304] 0 2024-09-17T01:41:34.523 INFO:tasks.workunit.client.0.smithi082.stdout:8/357: symlink d3/dd/d18/d51/l6b 0 2024-09-17T01:41:34.528 INFO:tasks.workunit.client.1.smithi167.stdout:0/697: sync 2024-09-17T01:41:34.550 INFO:tasks.workunit.client.0.smithi082.stdout:8/358: fdatasync d3/dd/d18/d2d/d3b/f69 0 2024-09-17T01:41:34.552 INFO:tasks.workunit.client.1.smithi167.stdout:6/890: getdents d7/d54/d90/d13 0 2024-09-17T01:41:34.553 INFO:tasks.workunit.client.1.smithi167.stdout:6/891: write d7/d54/d90/d13/f2d [1852742,100121] 0 2024-09-17T01:41:34.554 INFO:tasks.workunit.client.0.smithi082.stdout:9/335: sync 2024-09-17T01:41:34.554 INFO:tasks.workunit.client.0.smithi082.stdout:4/380: sync 2024-09-17T01:41:34.555 INFO:tasks.workunit.client.1.smithi167.stdout:1/780: write d0/d5/d34/d3c/d85/fff [5510322,52935] 0 2024-09-17T01:41:34.555 INFO:tasks.workunit.client.1.smithi167.stdout:6/892: write d7/d54/d90/d13/d2f/fca [2702986,9981] 0 2024-09-17T01:41:34.555 INFO:tasks.workunit.client.1.smithi167.stdout:4/730: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/lf9 0 2024-09-17T01:41:34.556 INFO:tasks.workunit.client.1.smithi167.stdout:9/809: symlink d4/d9/d21/d2d/d33/d90/lfd 0 2024-09-17T01:41:34.558 INFO:tasks.workunit.client.1.smithi167.stdout:7/711: mknod d0/d2/d14/d19/d26/cf3 0 2024-09-17T01:41:34.558 INFO:tasks.workunit.client.1.smithi167.stdout:8/839: rmdir dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7 39 2024-09-17T01:41:34.559 INFO:tasks.workunit.client.0.smithi082.stdout:8/359: dwrite d3/dd/f2b [0,4194304] 0 2024-09-17T01:41:34.559 INFO:tasks.workunit.client.1.smithi167.stdout:9/810: write d4/d9/d21/d43/d6c/d9e/da1/dbc/fd1 [584074,55078] 0 2024-09-17T01:41:34.560 INFO:tasks.workunit.client.0.smithi082.stdout:8/360: readlink d3/dd/d18/d34/l2c 0 2024-09-17T01:41:34.560 INFO:tasks.workunit.client.1.smithi167.stdout:3/768: mknod d7/d8/d10/d14/d66/d6c/dab/dcf/c103 0 2024-09-17T01:41:34.562 INFO:tasks.workunit.client.0.smithi082.stdout:4/381: creat d9/d15/d16/d3e/f7d x:0 0 0 2024-09-17T01:41:34.563 INFO:tasks.workunit.client.1.smithi167.stdout:9/811: dread - d4/d9/d21/d43/d6c/d9e/fe3 zero size 2024-09-17T01:41:34.563 INFO:tasks.workunit.client.1.smithi167.stdout:0/698: mkdir d5/d6b/d77/d6d/d90/dc4/de3 0 2024-09-17T01:41:34.565 INFO:tasks.workunit.client.1.smithi167.stdout:5/698: creat d0/fd8 x:0 0 0 2024-09-17T01:41:34.566 INFO:tasks.workunit.client.1.smithi167.stdout:6/893: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fe4 [0,4194304] 0 2024-09-17T01:41:34.569 INFO:tasks.workunit.client.0.smithi082.stdout:9/336: creat d4/d27/d2d/d60/d11/f70 x:0 0 0 2024-09-17T01:41:34.569 INFO:tasks.workunit.client.1.smithi167.stdout:6/894: read d7/d54/d90/d13/f49 [1401445,72801] 0 2024-09-17T01:41:34.571 INFO:tasks.workunit.client.0.smithi082.stdout:9/337: chown d4/d27/d2d/d60/d11/d39/d29 161808526 1 2024-09-17T01:41:34.572 INFO:tasks.workunit.client.0.smithi082.stdout:9/338: stat d4/f1d 0 2024-09-17T01:41:34.575 INFO:tasks.workunit.client.0.smithi082.stdout:4/382: truncate d9/d15/d16/d18/d4a/d52/f59 899428 0 2024-09-17T01:41:34.578 INFO:tasks.workunit.client.0.smithi082.stdout:1/475: dwrite d2/da/d2d/f3e [0,4194304] 0 2024-09-17T01:41:34.578 INFO:tasks.workunit.client.1.smithi167.stdout:2/730: dwrite d5/d3c/d4c/d4d/fa6 [0,4194304] 0 2024-09-17T01:41:34.580 INFO:tasks.workunit.client.1.smithi167.stdout:8/840: unlink dc/d56/d59/d82/d8f/de5/fbf 0 2024-09-17T01:41:34.585 INFO:tasks.workunit.client.1.smithi167.stdout:9/812: mkdir d4/da4/dfe 0 2024-09-17T01:41:34.587 INFO:tasks.workunit.client.1.smithi167.stdout:0/699: mknod d5/d6b/d77/d92/ce4 0 2024-09-17T01:41:34.587 INFO:tasks.workunit.client.1.smithi167.stdout:0/700: chown d5/d6b/d77/d4d/d56/d7b 84 1 2024-09-17T01:41:34.588 INFO:tasks.workunit.client.1.smithi167.stdout:5/699: fdatasync d0/f14 0 2024-09-17T01:41:34.589 INFO:tasks.workunit.client.0.smithi082.stdout:9/339: dwrite d4/d27/d2d/d60/d11/d39/f41 [0,4194304] 0 2024-09-17T01:41:34.589 INFO:tasks.workunit.client.1.smithi167.stdout:0/701: chown d5/d8/d9/d2f/l8d 1591850 1 2024-09-17T01:41:34.594 INFO:tasks.workunit.client.1.smithi167.stdout:0/702: write d5/d6b/f63 [1162839,99161] 0 2024-09-17T01:41:34.594 INFO:tasks.workunit.client.1.smithi167.stdout:4/731: symlink d0/d4/d7/lfa 0 2024-09-17T01:41:34.596 INFO:tasks.workunit.client.0.smithi082.stdout:8/361: dread d3/f20 [0,4194304] 0 2024-09-17T01:41:34.597 INFO:tasks.workunit.client.1.smithi167.stdout:9/813: dwrite d4/d9/d21/d2d/d33/d80/fcf [0,4194304] 0 2024-09-17T01:41:34.598 INFO:tasks.workunit.client.0.smithi082.stdout:4/383: symlink d9/d15/d16/d18/d4a/d52/d55/l7e 0 2024-09-17T01:41:34.599 INFO:tasks.workunit.client.1.smithi167.stdout:9/814: write d4/d9/d21/d2d/d33/d3a/f98 [3290766,5593] 0 2024-09-17T01:41:34.601 INFO:tasks.workunit.client.0.smithi082.stdout:1/476: mknod d2/da/d2d/d79/c97 0 2024-09-17T01:41:34.607 INFO:tasks.workunit.client.1.smithi167.stdout:6/895: dread d7/d54/d90/d13/d2f/f4d [0,4194304] 0 2024-09-17T01:41:34.607 INFO:tasks.workunit.client.1.smithi167.stdout:9/815: dread d4/d9/d21/d2d/d33/fde [0,4194304] 0 2024-09-17T01:41:34.610 INFO:tasks.workunit.client.0.smithi082.stdout:4/384: mknod d9/d15/d16/c7f 0 2024-09-17T01:41:34.610 INFO:tasks.workunit.client.0.smithi082.stdout:8/362: read d3/dd/f23 [354180,18902] 0 2024-09-17T01:41:34.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/385: dread - d9/f46 zero size 2024-09-17T01:41:34.612 INFO:tasks.workunit.client.1.smithi167.stdout:5/700: symlink d0/d24/d2b/d3d/d3b/d92/ld9 0 2024-09-17T01:41:34.614 INFO:tasks.workunit.client.1.smithi167.stdout:9/816: dwrite d4/d9/d97/dd6/fd7 [0,4194304] 0 2024-09-17T01:41:34.614 INFO:tasks.workunit.client.0.smithi082.stdout:1/477: dwrite d2/da/d2f/d47/f84 [0,4194304] 0 2024-09-17T01:41:34.614 INFO:tasks.workunit.client.1.smithi167.stdout:5/701: fsync d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/f85 0 2024-09-17T01:41:34.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/703: mknod d5/d6b/d77/daa/db1/ce5 0 2024-09-17T01:41:34.618 INFO:tasks.workunit.client.1.smithi167.stdout:3/769: write d7/d1e/f43 [4753983,44552] 0 2024-09-17T01:41:34.618 INFO:tasks.workunit.client.0.smithi082.stdout:9/340: dwrite d4/f57 [0,4194304] 0 2024-09-17T01:41:34.621 INFO:tasks.workunit.client.1.smithi167.stdout:2/731: getdents d5/d33/df9 0 2024-09-17T01:41:34.627 INFO:tasks.workunit.client.1.smithi167.stdout:6/896: dread - d7/d52/d79/da4/fb4 zero size 2024-09-17T01:41:34.632 INFO:tasks.workunit.client.1.smithi167.stdout:2/732: dwrite d5/d33/d48/f80 [0,4194304] 0 2024-09-17T01:41:34.634 INFO:tasks.workunit.client.1.smithi167.stdout:9/817: creat d4/d9/d97/fff x:0 0 0 2024-09-17T01:41:34.634 INFO:tasks.workunit.client.1.smithi167.stdout:2/733: dread - d5/d3c/d4c/d4d/d91/fd1 zero size 2024-09-17T01:41:34.634 INFO:tasks.workunit.client.1.smithi167.stdout:0/704: rmdir d5/d6b/d77/d4d 39 2024-09-17T01:41:34.640 INFO:tasks.workunit.client.1.smithi167.stdout:4/732: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/f98 [0,4194304] 0 2024-09-17T01:41:34.640 INFO:tasks.workunit.client.1.smithi167.stdout:5/702: rename d0/d24/d2b/d3d/d3b/db0/cbf to d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/cda 0 2024-09-17T01:41:34.642 INFO:tasks.workunit.client.1.smithi167.stdout:4/733: truncate d0/d4/d7/d10/fed 209580 0 2024-09-17T01:41:34.643 INFO:tasks.workunit.client.0.smithi082.stdout:8/363: write d3/dd/f30 [5639730,15192] 0 2024-09-17T01:41:34.643 INFO:tasks.workunit.client.0.smithi082.stdout:4/386: creat d9/d15/d16/d44/f80 x:0 0 0 2024-09-17T01:41:34.643 INFO:tasks.workunit.client.1.smithi167.stdout:6/897: read - d7/d54/d90/dd5/fdd zero size 2024-09-17T01:41:34.644 INFO:tasks.workunit.client.0.smithi082.stdout:1/478: symlink d2/d3f/d24/l98 0 2024-09-17T01:41:34.645 INFO:tasks.workunit.client.1.smithi167.stdout:9/818: readlink d4/d9/d2b/da3/lbb 0 2024-09-17T01:41:34.645 INFO:tasks.workunit.client.0.smithi082.stdout:4/387: write d9/d15/d16/d3e/f4e [1432710,119107] 0 2024-09-17T01:41:34.646 INFO:tasks.workunit.client.1.smithi167.stdout:9/819: stat d4/d9/d21/d43/f7d 0 2024-09-17T01:41:34.646 INFO:tasks.workunit.client.0.smithi082.stdout:1/479: truncate d2/f5f 1844064 0 2024-09-17T01:41:34.646 INFO:tasks.workunit.client.0.smithi082.stdout:9/341: mknod d4/d59/d63/c71 0 2024-09-17T01:41:34.650 INFO:tasks.workunit.client.0.smithi082.stdout:1/480: symlink d2/da/d2f/d47/l99 0 2024-09-17T01:41:34.650 INFO:tasks.workunit.client.0.smithi082.stdout:1/481: chown d2/da/d2f 483838532 1 2024-09-17T01:41:34.651 INFO:tasks.workunit.client.1.smithi167.stdout:5/703: chown d0/d24/d2b/d49/d4b/dac/d3a/f7d 145797423 1 2024-09-17T01:41:34.653 INFO:tasks.workunit.client.1.smithi167.stdout:8/841: getdents dc/d56/d57/da0/da7 0 2024-09-17T01:41:34.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/342: creat d4/d27/d2d/d60/d11/d39/d44/f72 x:0 0 0 2024-09-17T01:41:34.654 INFO:tasks.workunit.client.0.smithi082.stdout:9/343: chown d4/d27 0 1 2024-09-17T01:41:34.655 INFO:tasks.workunit.client.0.smithi082.stdout:9/344: dread - d4/d27/d2d/d3d/f5c zero size 2024-09-17T01:41:34.656 INFO:tasks.workunit.client.0.smithi082.stdout:9/345: write d4/d59/d63/f67 [879037,128948] 0 2024-09-17T01:41:34.656 INFO:tasks.workunit.client.1.smithi167.stdout:6/898: creat d7/d54/d90/d13/d2f/d64/f134 x:0 0 0 2024-09-17T01:41:34.658 INFO:tasks.workunit.client.1.smithi167.stdout:6/899: readlink d7/ld 0 2024-09-17T01:41:34.659 INFO:tasks.workunit.client.0.smithi082.stdout:1/482: creat d2/d3f/d24/f9a x:0 0 0 2024-09-17T01:41:34.660 INFO:tasks.workunit.client.0.smithi082.stdout:1/483: truncate d2/df/d46/f64 975208 0 2024-09-17T01:41:34.660 INFO:tasks.workunit.client.1.smithi167.stdout:8/842: dwrite dc/d1a/f73 [0,4194304] 0 2024-09-17T01:41:34.660 INFO:tasks.workunit.client.0.smithi082.stdout:1/484: fdatasync d2/f11 0 2024-09-17T01:41:34.662 INFO:tasks.workunit.client.1.smithi167.stdout:0/705: mknod d5/d6b/d77/d4d/d56/ce6 0 2024-09-17T01:41:34.662 INFO:tasks.workunit.client.1.smithi167.stdout:4/734: dwrite d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/f3d [4194304,4194304] 0 2024-09-17T01:41:34.663 INFO:tasks.workunit.client.0.smithi082.stdout:1/485: write d2/d3f/f26 [8421,120807] 0 2024-09-17T01:41:34.664 INFO:tasks.workunit.client.0.smithi082.stdout:9/346: dwrite d4/d27/d2d/d60/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:34.666 INFO:tasks.workunit.client.0.smithi082.stdout:9/347: chown d4/d27/d2d/d60/d11/d39/d44 338805 1 2024-09-17T01:41:34.666 INFO:tasks.workunit.client.1.smithi167.stdout:8/843: write dc/d56/d57/d5c/f9d [987459,90869] 0 2024-09-17T01:41:34.668 INFO:tasks.workunit.client.0.smithi082.stdout:9/348: truncate d4/d27/d2d/d60/d11/d39/d29/d35/f61 1555491 0 2024-09-17T01:41:34.670 INFO:tasks.workunit.client.1.smithi167.stdout:2/734: creat d5/d3c/d4c/de2/f100 x:0 0 0 2024-09-17T01:41:34.670 INFO:tasks.workunit.client.1.smithi167.stdout:6/900: fdatasync d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/fde 0 2024-09-17T01:41:34.671 INFO:tasks.workunit.client.1.smithi167.stdout:4/735: write d0/d4/d7/d6/d2b/d6d/fd0 [873672,100670] 0 2024-09-17T01:41:34.673 INFO:tasks.workunit.client.1.smithi167.stdout:3/770: write f3 [7494743,96537] 0 2024-09-17T01:41:34.676 INFO:tasks.workunit.client.1.smithi167.stdout:9/820: dread d4/f16 [0,4194304] 0 2024-09-17T01:41:34.679 INFO:tasks.workunit.client.1.smithi167.stdout:2/735: read d5/d10/f42 [530546,85737] 0 2024-09-17T01:41:34.680 INFO:tasks.workunit.client.0.smithi082.stdout:9/349: link d4/d27/d36/d3b/c5e d4/d27/c73 0 2024-09-17T01:41:34.680 INFO:tasks.workunit.client.0.smithi082.stdout:9/350: stat d4/d27/d2d/d60/d11/d39/c48 0 2024-09-17T01:41:34.682 INFO:tasks.workunit.client.1.smithi167.stdout:3/771: write d7/d8/d10/d14/f53 [1400451,59140] 0 2024-09-17T01:41:34.682 INFO:tasks.workunit.client.1.smithi167.stdout:6/901: dread - d7/d54/d90/d13/d2f/d30/fa7 zero size 2024-09-17T01:41:34.684 INFO:tasks.workunit.client.1.smithi167.stdout:2/736: write d5/f44 [3561809,95242] 0 2024-09-17T01:41:34.684 INFO:tasks.workunit.client.1.smithi167.stdout:0/706: dwrite d5/d8/fbc [0,4194304] 0 2024-09-17T01:41:34.685 INFO:tasks.workunit.client.0.smithi082.stdout:9/351: read d4/d27/d2d/d60/f34 [1036449,93379] 0 2024-09-17T01:41:34.685 INFO:tasks.workunit.client.1.smithi167.stdout:4/736: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1/le3 30 1 2024-09-17T01:41:34.685 INFO:tasks.workunit.client.1.smithi167.stdout:8/844: creat dc/d56/d57/f115 x:0 0 0 2024-09-17T01:41:34.688 INFO:tasks.workunit.client.0.smithi082.stdout:9/352: dread - d4/d27/d21/f5a zero size 2024-09-17T01:41:34.688 INFO:tasks.workunit.client.1.smithi167.stdout:9/821: creat d4/d9/d21/d2d/d33/d3a/d9c/f100 x:0 0 0 2024-09-17T01:41:34.690 INFO:tasks.workunit.client.1.smithi167.stdout:6/902: symlink d7/d54/d90/d13/d2f/d96/dab/l135 0 2024-09-17T01:41:34.690 INFO:tasks.workunit.client.0.smithi082.stdout:9/353: chown d4/d27/d21/c3a 0 1 2024-09-17T01:41:34.690 INFO:tasks.workunit.client.0.smithi082.stdout:8/364: dwrite d3/dd/d18/d2d/d3e/d43/f45 [0,4194304] 0 2024-09-17T01:41:34.694 INFO:tasks.workunit.client.1.smithi167.stdout:4/737: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d75/dfb 0 2024-09-17T01:41:34.694 INFO:tasks.workunit.client.1.smithi167.stdout:3/772: dwrite d7/d8/d2a/f3f [4194304,4194304] 0 2024-09-17T01:41:34.694 INFO:tasks.workunit.client.1.smithi167.stdout:9/822: mknod d4/d9/d21/d2d/d33/d3a/d9c/c101 0 2024-09-17T01:41:34.695 INFO:tasks.workunit.client.0.smithi082.stdout:4/388: dread d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:34.703 INFO:tasks.workunit.client.1.smithi167.stdout:8/845: rename dc/d56/d57/f5b to dc/d21/d6b/d113/f116 0 2024-09-17T01:41:34.703 INFO:tasks.workunit.client.0.smithi082.stdout:8/365: read d3/dd/d18/d2d/d3e/d4a/d6a/f42 [989959,72694] 0 2024-09-17T01:41:34.704 INFO:tasks.workunit.client.0.smithi082.stdout:9/354: unlink d4/d27/d2d/d60/d11/d39/f56 0 2024-09-17T01:41:34.707 INFO:tasks.workunit.client.1.smithi167.stdout:6/903: rmdir d7/d54/d90/d13/d2f/d96 39 2024-09-17T01:41:34.710 INFO:tasks.workunit.client.1.smithi167.stdout:3/773: creat d7/d8/d10/d14/d66/f104 x:0 0 0 2024-09-17T01:41:34.713 INFO:tasks.workunit.client.1.smithi167.stdout:6/904: dwrite d7/d54/d90/d13/d2f/d64/d6b/ffe [0,4194304] 0 2024-09-17T01:41:34.713 INFO:tasks.workunit.client.1.smithi167.stdout:9/823: fdatasync d4/d9/d21/d2d/d33/fde 0 2024-09-17T01:41:34.714 INFO:tasks.workunit.client.0.smithi082.stdout:4/389: dwrite d9/d2b/f70 [0,4194304] 0 2024-09-17T01:41:34.716 INFO:tasks.workunit.client.0.smithi082.stdout:8/366: truncate d3/dd/d18/f1e 1233468 0 2024-09-17T01:41:34.717 INFO:tasks.workunit.client.1.smithi167.stdout:0/707: link d5/d6b/d77/d37/l49 d5/d6b/dd1/le7 0 2024-09-17T01:41:34.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/708: write d5/d8/d9/f3f [4388242,79351] 0 2024-09-17T01:41:34.720 INFO:tasks.workunit.client.0.smithi082.stdout:1/486: dwrite d2/da/d2d/f45 [0,4194304] 0 2024-09-17T01:41:34.721 INFO:tasks.workunit.client.1.smithi167.stdout:7/712: sync 2024-09-17T01:41:34.721 INFO:tasks.workunit.client.1.smithi167.stdout:1/781: sync 2024-09-17T01:41:34.723 INFO:tasks.workunit.client.0.smithi082.stdout:9/355: rename d4/d27/d2d/d60/d11/d39/d44/l4a to d4/d59/d63/l74 0 2024-09-17T01:41:34.725 INFO:tasks.workunit.client.0.smithi082.stdout:4/390: creat d9/d15/d16/d18/d4f/f81 x:0 0 0 2024-09-17T01:41:34.731 INFO:tasks.workunit.client.1.smithi167.stdout:3/774: dread - d7/d8/d10/d14/d2c/d7f/f82 zero size 2024-09-17T01:41:34.733 INFO:tasks.workunit.client.0.smithi082.stdout:4/391: chown d9/l10 1358 1 2024-09-17T01:41:34.734 INFO:tasks.workunit.client.0.smithi082.stdout:8/367: symlink d3/dd/d18/l6c 0 2024-09-17T01:41:34.737 INFO:tasks.workunit.client.0.smithi082.stdout:8/368: dread d3/dd/d18/d34/f63 [0,4194304] 0 2024-09-17T01:41:34.737 INFO:tasks.workunit.client.0.smithi082.stdout:9/356: symlink d4/d27/d2d/d60/d11/l75 0 2024-09-17T01:41:34.738 INFO:tasks.workunit.client.1.smithi167.stdout:2/737: dwrite d5/d10/f9c [0,4194304] 0 2024-09-17T01:41:34.739 INFO:tasks.workunit.client.1.smithi167.stdout:7/713: chown d0/d2/d14/d6f/d87/c9e 15016 1 2024-09-17T01:41:34.740 INFO:tasks.workunit.client.0.smithi082.stdout:4/392: rename d9/d15/d16/d3e/f7d to d9/d15/d16/d18/d4a/d52/f82 0 2024-09-17T01:41:34.743 INFO:tasks.workunit.client.1.smithi167.stdout:8/846: mknod dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/c117 0 2024-09-17T01:41:34.744 INFO:tasks.workunit.client.1.smithi167.stdout:3/775: chown d7/d8/d10/d14/d2c/c31 6110 1 2024-09-17T01:41:34.746 INFO:tasks.workunit.client.1.smithi167.stdout:9/824: creat d4/da4/dfe/f102 x:0 0 0 2024-09-17T01:41:34.746 INFO:tasks.workunit.client.1.smithi167.stdout:0/709: dwrite d5/d6b/dca/fd4 [0,4194304] 0 2024-09-17T01:41:34.748 INFO:tasks.workunit.client.0.smithi082.stdout:4/393: unlink d9/d15/d37/l72 0 2024-09-17T01:41:34.748 INFO:tasks.workunit.client.0.smithi082.stdout:4/394: chown d9/d47/f79 565383377 1 2024-09-17T01:41:34.752 INFO:tasks.workunit.client.0.smithi082.stdout:8/369: rename d3/dd/d18/d3a/c65 to d3/dd/d18/d2d/d3e/d4a/d6a/c6d 0 2024-09-17T01:41:34.754 INFO:tasks.workunit.client.1.smithi167.stdout:1/782: dread d0/d5/d34/d3c/f2b [4194304,4194304] 0 2024-09-17T01:41:34.757 INFO:tasks.workunit.client.0.smithi082.stdout:4/395: dwrite d9/d2b/f7b [0,4194304] 0 2024-09-17T01:41:34.757 INFO:tasks.workunit.client.1.smithi167.stdout:8/847: dwrite dc/d21/d6b/d74/fe8 [0,4194304] 0 2024-09-17T01:41:34.764 INFO:tasks.workunit.client.1.smithi167.stdout:7/714: symlink d0/d2/d14/d6f/d87/dae/lf4 0 2024-09-17T01:41:34.767 INFO:tasks.workunit.client.0.smithi082.stdout:2/395: sync 2024-09-17T01:41:34.770 INFO:tasks.workunit.client.1.smithi167.stdout:3/776: dread - d7/d8/d10/d14/d66/d6c/fa1 zero size 2024-09-17T01:41:34.772 INFO:tasks.workunit.client.1.smithi167.stdout:7/715: dread d0/d2/d14/d6f/d87/dae/fd4 [0,4194304] 0 2024-09-17T01:41:34.773 INFO:tasks.workunit.client.0.smithi082.stdout:4/396: rename d9/d15/d16/d18/d4f/f81 to d9/d15/d16/d18/d4a/f83 0 2024-09-17T01:41:34.773 INFO:tasks.workunit.client.1.smithi167.stdout:2/738: dread d5/d3c/d4c/de2/db8/da3/f20 [0,4194304] 0 2024-09-17T01:41:34.773 INFO:tasks.workunit.client.0.smithi082.stdout:1/487: truncate d2/d3f/d24/f86 1028690 0 2024-09-17T01:41:34.775 INFO:tasks.workunit.client.0.smithi082.stdout:2/396: rmdir d1/d35 39 2024-09-17T01:41:34.776 INFO:tasks.workunit.client.1.smithi167.stdout:4/738: link d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/ld9 d0/d4/d7/d6/d2b/d6d/lfc 0 2024-09-17T01:41:34.777 INFO:tasks.workunit.client.1.smithi167.stdout:4/739: dread - d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/dc3/ff5 zero size 2024-09-17T01:41:34.780 INFO:tasks.workunit.client.0.smithi082.stdout:2/397: fdatasync d1/d35/f24 0 2024-09-17T01:41:34.783 INFO:tasks.workunit.client.1.smithi167.stdout:3/777: creat d7/d1e/f105 x:0 0 0 2024-09-17T01:41:34.784 INFO:tasks.workunit.client.0.smithi082.stdout:1/488: dwrite d2/da/d16/f8f [0,4194304] 0 2024-09-17T01:41:34.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/370: dread d3/dd/d18/d2d/d3e/d43/f44 [0,4194304] 0 2024-09-17T01:41:34.785 INFO:tasks.workunit.client.1.smithi167.stdout:7/716: mkdir d0/d2/d88/df5 0 2024-09-17T01:41:34.785 INFO:tasks.workunit.client.1.smithi167.stdout:2/739: rmdir d5/d6d 39 2024-09-17T01:41:34.786 INFO:tasks.workunit.client.1.smithi167.stdout:7/717: write d0/d2/d14/d19/d26/fc0 [2884109,60737] 0 2024-09-17T01:41:34.786 INFO:tasks.workunit.client.0.smithi082.stdout:9/357: dread d4/d27/d2d/d60/d11/d37/f38 [0,4194304] 0 2024-09-17T01:41:34.787 INFO:tasks.workunit.client.1.smithi167.stdout:7/718: chown d0/d2/d14/d6f/fe0 985378 1 2024-09-17T01:41:34.789 INFO:tasks.workunit.client.1.smithi167.stdout:4/740: rename d0/d4/d7/d6/d2b/d6d/fc2 to d0/d4/d7/da/d48/ffd 0 2024-09-17T01:41:34.792 INFO:tasks.workunit.client.0.smithi082.stdout:9/358: write d4/f57 [1091081,91705] 0 2024-09-17T01:41:34.792 INFO:tasks.workunit.client.1.smithi167.stdout:8/848: symlink dc/d56/d59/d82/de7/l118 0 2024-09-17T01:41:34.793 INFO:tasks.workunit.client.0.smithi082.stdout:1/489: creat d2/d3f/d24/d54/f9b x:0 0 0 2024-09-17T01:41:34.794 INFO:tasks.workunit.client.1.smithi167.stdout:3/778: rmdir d7/d8/d10 39 2024-09-17T01:41:34.795 INFO:tasks.workunit.client.0.smithi082.stdout:1/490: write d2/d3f/f5a [7940426,60716] 0 2024-09-17T01:41:34.799 INFO:tasks.workunit.client.1.smithi167.stdout:3/779: dwrite f3 [0,4194304] 0 2024-09-17T01:41:34.802 INFO:tasks.workunit.client.0.smithi082.stdout:8/371: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d6e 0 2024-09-17T01:41:34.808 INFO:tasks.workunit.client.0.smithi082.stdout:8/372: dread d3/f7 [0,4194304] 0 2024-09-17T01:41:34.811 INFO:tasks.workunit.client.0.smithi082.stdout:1/491: creat d2/df/d46/f9c x:0 0 0 2024-09-17T01:41:34.814 INFO:tasks.workunit.client.0.smithi082.stdout:8/373: dread d3/dd/d18/d2d/d3e/d43/f45 [0,4194304] 0 2024-09-17T01:41:34.814 INFO:tasks.workunit.client.1.smithi167.stdout:4/741: rmdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51 39 2024-09-17T01:41:34.815 INFO:tasks.workunit.client.1.smithi167.stdout:8/849: creat dc/d56/d57/da0/da7/f119 x:0 0 0 2024-09-17T01:41:34.818 INFO:tasks.workunit.client.0.smithi082.stdout:2/398: dread d1/d35/f37 [0,4194304] 0 2024-09-17T01:41:34.818 INFO:tasks.workunit.client.1.smithi167.stdout:2/740: symlink d5/d3c/d4c/l101 0 2024-09-17T01:41:34.819 INFO:tasks.workunit.client.1.smithi167.stdout:0/710: write d5/d6b/d77/f66 [973840,736] 0 2024-09-17T01:41:34.821 INFO:tasks.workunit.client.0.smithi082.stdout:9/359: creat d4/d27/d2d/d60/d11/d39/f76 x:0 0 0 2024-09-17T01:41:34.823 INFO:tasks.workunit.client.1.smithi167.stdout:0/711: read d5/d8/d9/d2f/fa6 [2958507,18126] 0 2024-09-17T01:41:34.824 INFO:tasks.workunit.client.1.smithi167.stdout:1/783: link d0/d5/d61/f7f d0/d9/f103 0 2024-09-17T01:41:34.824 INFO:tasks.workunit.client.1.smithi167.stdout:5/704: sync 2024-09-17T01:41:34.825 INFO:tasks.workunit.client.0.smithi082.stdout:1/492: readlink d2/l21 0 2024-09-17T01:41:34.826 INFO:tasks.workunit.client.0.smithi082.stdout:4/397: write d9/d15/d37/d45/f69 [201964,35040] 0 2024-09-17T01:41:34.827 INFO:tasks.workunit.client.0.smithi082.stdout:2/399: dwrite d1/d17/d29/f6e [0,4194304] 0 2024-09-17T01:41:34.829 INFO:tasks.workunit.client.1.smithi167.stdout:6/905: dwrite d7/d54/d90/d13/d2f/d96/dab/f31 [0,4194304] 0 2024-09-17T01:41:34.836 INFO:tasks.workunit.client.0.smithi082.stdout:9/360: dwrite d4/f57 [4194304,4194304] 0 2024-09-17T01:41:34.839 INFO:tasks.workunit.client.1.smithi167.stdout:2/741: rmdir d5/d33/d48/d72/d94/de3 39 2024-09-17T01:41:34.839 INFO:tasks.workunit.client.0.smithi082.stdout:1/493: dwrite d2/d3f/f88 [0,4194304] 0 2024-09-17T01:41:34.845 INFO:tasks.workunit.client.0.smithi082.stdout:4/398: mkdir d9/d15/d16/d44/d84 0 2024-09-17T01:41:34.847 INFO:tasks.workunit.client.0.smithi082.stdout:4/399: dread - d9/d15/d37/d45/f51 zero size 2024-09-17T01:41:34.850 INFO:tasks.workunit.client.1.smithi167.stdout:7/719: write d0/d2/d14/d19/d22/f2a [1897312,85893] 0 2024-09-17T01:41:34.851 INFO:tasks.workunit.client.0.smithi082.stdout:2/400: symlink d1/d5a/l7b 0 2024-09-17T01:41:34.851 INFO:tasks.workunit.client.0.smithi082.stdout:1/494: dwrite d2/da/d2f/f31 [4194304,4194304] 0 2024-09-17T01:41:34.855 INFO:tasks.workunit.client.1.smithi167.stdout:9/825: sync 2024-09-17T01:41:34.856 INFO:tasks.workunit.client.1.smithi167.stdout:3/780: creat d7/d8/d10/d14/d66/d6c/dab/dcf/f106 x:0 0 0 2024-09-17T01:41:34.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/361: unlink d4/d27/d2d/c3f 0 2024-09-17T01:41:34.861 INFO:tasks.workunit.client.0.smithi082.stdout:8/374: link d3/dd/f26 d3/dd/d18/d51/f6f 0 2024-09-17T01:41:34.861 INFO:tasks.workunit.client.1.smithi167.stdout:4/742: symlink d0/d4/d7/d10/lfe 0 2024-09-17T01:41:34.862 INFO:tasks.workunit.client.1.smithi167.stdout:5/705: dwrite d0/d24/d2b/f39 [0,4194304] 0 2024-09-17T01:41:34.863 INFO:tasks.workunit.client.1.smithi167.stdout:5/706: stat d0/d24/d2b/db1 0 2024-09-17T01:41:34.864 INFO:tasks.workunit.client.1.smithi167.stdout:8/850: write dc/d21/f3a [4725501,122201] 0 2024-09-17T01:41:34.866 INFO:tasks.workunit.client.1.smithi167.stdout:8/851: stat dc/d56/d59/d82/dbe/ffd 0 2024-09-17T01:41:34.866 INFO:tasks.workunit.client.0.smithi082.stdout:2/401: mknod d1/d5a/c7c 0 2024-09-17T01:41:34.867 INFO:tasks.workunit.client.0.smithi082.stdout:2/402: chown d1/d17/d38/d42/d52/f70 251412910 1 2024-09-17T01:41:34.868 INFO:tasks.workunit.client.1.smithi167.stdout:0/712: mknod d5/d6b/d77/d4d/ce8 0 2024-09-17T01:41:34.868 INFO:tasks.workunit.client.1.smithi167.stdout:2/742: dread d5/d33/d48/d72/d94/faf [0,4194304] 0 2024-09-17T01:41:34.869 INFO:tasks.workunit.client.1.smithi167.stdout:0/713: chown d5/d6b/d77/d37/f98 5 1 2024-09-17T01:41:34.869 INFO:tasks.workunit.client.1.smithi167.stdout:2/743: fsync d5/d3c/d4c/fb5 0 2024-09-17T01:41:34.871 INFO:tasks.workunit.client.1.smithi167.stdout:7/720: mknod d0/d2/d88/d6e/cf6 0 2024-09-17T01:41:34.872 INFO:tasks.workunit.client.0.smithi082.stdout:8/375: write d3/f64 [6367295,108870] 0 2024-09-17T01:41:34.874 INFO:tasks.workunit.client.0.smithi082.stdout:8/376: readlink d3/dd/d18/d34/l2c 0 2024-09-17T01:41:34.875 INFO:tasks.workunit.client.1.smithi167.stdout:6/906: symlink d7/d54/d90/d34/l136 0 2024-09-17T01:41:34.875 INFO:tasks.workunit.client.1.smithi167.stdout:2/744: dwrite d5/d3c/d4c/de2/d45/d3f/f4a [4194304,4194304] 0 2024-09-17T01:41:34.876 INFO:tasks.workunit.client.1.smithi167.stdout:4/743: chown d0/ca9 40 1 2024-09-17T01:41:34.877 INFO:tasks.workunit.client.0.smithi082.stdout:2/403: dwrite d1/d17/d38/d42/f69 [0,4194304] 0 2024-09-17T01:41:34.878 INFO:tasks.workunit.client.1.smithi167.stdout:5/707: truncate d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae 72516 0 2024-09-17T01:41:34.881 INFO:tasks.workunit.client.1.smithi167.stdout:0/714: mknod d5/d6b/d77/d37/d80/ce9 0 2024-09-17T01:41:34.881 INFO:tasks.workunit.client.1.smithi167.stdout:5/708: read d0/d24/d2b/d3d/f4f [694417,103174] 0 2024-09-17T01:41:34.883 INFO:tasks.workunit.client.0.smithi082.stdout:1/495: getdents d2 0 2024-09-17T01:41:34.884 INFO:tasks.workunit.client.0.smithi082.stdout:1/496: chown d2/d3f/d24/l5c 40 1 2024-09-17T01:41:34.890 INFO:tasks.workunit.client.1.smithi167.stdout:1/784: dwrite d0/d5/f12 [4194304,4194304] 0 2024-09-17T01:41:34.892 INFO:tasks.workunit.client.0.smithi082.stdout:2/404: rename d1/d58 to d1/d17/d38/d5c/d7d 0 2024-09-17T01:41:34.893 INFO:tasks.workunit.client.0.smithi082.stdout:2/405: fdatasync d1/d17/d29/f4c 0 2024-09-17T01:41:34.894 INFO:tasks.workunit.client.0.smithi082.stdout:1/497: creat d2/da/d2d/d6c/f9d x:0 0 0 2024-09-17T01:41:34.895 INFO:tasks.workunit.client.0.smithi082.stdout:1/498: chown d2/d3f/d24/f81 5112 1 2024-09-17T01:41:34.896 INFO:tasks.workunit.client.1.smithi167.stdout:9/826: mkdir d4/d9/d21/d43/dc4/d103 0 2024-09-17T01:41:34.901 INFO:tasks.workunit.client.0.smithi082.stdout:9/362: dread d4/d27/d2d/d60/d11/d37/f3c [4194304,4194304] 0 2024-09-17T01:41:34.901 INFO:tasks.workunit.client.1.smithi167.stdout:4/744: fdatasync d0/d4/d7/da/d48/fb3 0 2024-09-17T01:41:34.902 INFO:tasks.workunit.client.0.smithi082.stdout:1/499: dwrite d2/da/d2d/f3e [0,4194304] 0 2024-09-17T01:41:34.903 INFO:tasks.workunit.client.0.smithi082.stdout:4/400: write d9/d15/f27 [808009,98455] 0 2024-09-17T01:41:34.903 INFO:tasks.workunit.client.1.smithi167.stdout:6/907: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [0,4194304] 0 2024-09-17T01:41:34.904 INFO:tasks.workunit.client.0.smithi082.stdout:1/500: chown d2/d3f/d24/f9a 20423 1 2024-09-17T01:41:34.905 INFO:tasks.workunit.client.0.smithi082.stdout:4/401: write d9/d15/d37/d45/f51 [441919,88668] 0 2024-09-17T01:41:34.908 INFO:tasks.workunit.client.0.smithi082.stdout:8/377: getdents d3/dd/d18/d34 0 2024-09-17T01:41:34.910 INFO:tasks.workunit.client.1.smithi167.stdout:6/908: dwrite d7/d54/d90/d13/d2f/d30/fc9 [0,4194304] 0 2024-09-17T01:41:34.913 INFO:tasks.workunit.client.1.smithi167.stdout:0/715: unlink d5/d6b/d77/daa/fc3 0 2024-09-17T01:41:34.916 INFO:tasks.workunit.client.0.smithi082.stdout:2/406: mkdir d1/d66/d7e 0 2024-09-17T01:41:34.920 INFO:tasks.workunit.client.0.smithi082.stdout:2/407: truncate d1/d17/d29/d50/f6c 451486 0 2024-09-17T01:41:34.922 INFO:tasks.workunit.client.0.smithi082.stdout:2/408: write d1/d10/f54 [418366,44791] 0 2024-09-17T01:41:34.923 INFO:tasks.workunit.client.1.smithi167.stdout:9/827: unlink d4/d9/d2b/f7a 0 2024-09-17T01:41:34.926 INFO:tasks.workunit.client.0.smithi082.stdout:4/402: symlink d9/d15/d16/d18/d4a/l85 0 2024-09-17T01:41:34.927 INFO:tasks.workunit.client.1.smithi167.stdout:8/852: link dc/d56/d59/d82/d8f/de5/lb3 dc/d1a/d45/l11a 0 2024-09-17T01:41:34.927 INFO:tasks.workunit.client.0.smithi082.stdout:4/403: read - d9/d15/d37/f68 zero size 2024-09-17T01:41:34.928 INFO:tasks.workunit.client.1.smithi167.stdout:9/828: dwrite d4/d9/d21/d2d/d33/d3a/f98 [0,4194304] 0 2024-09-17T01:41:34.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/409: creat d1/d10/f7f x:0 0 0 2024-09-17T01:41:34.930 INFO:tasks.workunit.client.1.smithi167.stdout:0/716: creat d5/d6b/d77/d92/fea x:0 0 0 2024-09-17T01:41:34.930 INFO:tasks.workunit.client.0.smithi082.stdout:1/501: link d2/l2b d2/da/d2d/d79/l9e 0 2024-09-17T01:41:34.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.933+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdf1c199dd0 con 0x7fdf1c109450 2024-09-17T01:41:34.931 INFO:tasks.workunit.client.1.smithi167.stdout:0/717: stat d5/d6b/d77/d6d 0 2024-09-17T01:41:34.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.934+0000 7fdf20a3e640 1 -- 172.21.15.82:0/2441302451 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fdf0c03f070 con 0x7fdf1c109450 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:34.933 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:41:34.934 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:41:34.934 INFO:tasks.workunit.client.1.smithi167.stdout:3/781: getdents d7/d8/d10/d29 0 2024-09-17T01:41:34.935 INFO:tasks.workunit.client.1.smithi167.stdout:3/782: readlink d7/d8/d10/d14/d2c/l38 0 2024-09-17T01:41:34.935 INFO:tasks.workunit.client.0.smithi082.stdout:1/502: unlink d2/da/d2f/d47/f51 0 2024-09-17T01:41:34.936 INFO:tasks.workunit.client.1.smithi167.stdout:7/721: creat d0/d2/d14/d19/d26/ff7 x:0 0 0 2024-09-17T01:41:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 msgr2=0x7fdf080770d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 0x7fdf080770d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c1a11a0 tx=0x7fdf04005f90 comp rx=0 tx=0).stop 2024-09-17T01:41:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 msgr2=0x7fdf1c19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c02f900 tx=0x7fdf0c02f5f0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.937 INFO:tasks.workunit.client.0.smithi082.stdout:4/404: mknod d9/d15/d37/d4c/c86 0 2024-09-17T01:41:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 shutdown_connections 2024-09-17T01:41:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf1c109e20 0x7fdf1c1a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdf08074c10 0x7fdf080770d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 --2- 172.21.15.82:0/2441302451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf1c109450 0x7fdf1c19fd00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.939+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 >> 172.21.15.82:0/2441302451 conn(0x7fdf1c06ea50 msgr2=0x7fdf1c10ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.940+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 shutdown_connections 2024-09-17T01:41:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:34.940+0000 7fdf21a40640 1 -- 172.21.15.82:0/2441302451 wait complete. 2024-09-17T01:41:34.941 INFO:tasks.workunit.client.1.smithi167.stdout:7/722: chown d0/d2/d88/f6c 476944037 1 2024-09-17T01:41:34.941 INFO:tasks.workunit.client.1.smithi167.stdout:0/718: dread d5/d6b/f63 [0,4194304] 0 2024-09-17T01:41:34.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/503: creat d2/d3f/d24/d54/f9f x:0 0 0 2024-09-17T01:41:34.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/504: dread - d2/f1b zero size 2024-09-17T01:41:34.943 INFO:tasks.workunit.client.0.smithi082.stdout:9/363: dread d4/f4c [0,4194304] 0 2024-09-17T01:41:34.944 INFO:tasks.workunit.client.0.smithi082.stdout:1/505: chown d2/d3f/d24/d54/f9b 0 1 2024-09-17T01:41:34.945 INFO:tasks.workunit.client.0.smithi082.stdout:4/405: symlink d9/d15/d16/d18/l87 0 2024-09-17T01:41:34.946 INFO:tasks.workunit.client.0.smithi082.stdout:2/410: link d1/l4e d1/d66/l80 0 2024-09-17T01:41:34.946 INFO:tasks.workunit.client.0.smithi082.stdout:4/406: chown d9/d15/d16/d18/d4a/l85 5394869 1 2024-09-17T01:41:34.949 INFO:tasks.workunit.client.0.smithi082.stdout:8/378: write d3/dd/d18/d2d/d3e/d4a/d6a/f42 [964608,53984] 0 2024-09-17T01:41:34.950 INFO:tasks.workunit.client.0.smithi082.stdout:9/364: dwrite d4/d27/d21/f5a [0,4194304] 0 2024-09-17T01:41:34.950 INFO:tasks.workunit.client.1.smithi167.stdout:9/829: creat d4/da4/f104 x:0 0 0 2024-09-17T01:41:34.954 INFO:tasks.workunit.client.0.smithi082.stdout:4/407: stat d9/d2b/c5c 0 2024-09-17T01:41:34.956 INFO:tasks.workunit.client.1.smithi167.stdout:6/909: truncate d7/d54/d90/d13/d2f/d30/d32/f58 2291594 0 2024-09-17T01:41:34.957 INFO:tasks.workunit.client.1.smithi167.stdout:5/709: truncate d0/d24/faa 1598616 0 2024-09-17T01:41:34.958 INFO:tasks.workunit.client.0.smithi082.stdout:2/411: symlink d1/d10/l81 0 2024-09-17T01:41:34.958 INFO:tasks.workunit.client.1.smithi167.stdout:5/710: fsync d0/d24/d2b/d49/d4b/dac/f37 0 2024-09-17T01:41:34.963 INFO:tasks.workunit.client.0.smithi082.stdout:9/365: mkdir d4/d27/d2d/d60/d11/d39/d29/d77 0 2024-09-17T01:41:34.969 INFO:tasks.workunit.client.0.smithi082.stdout:2/412: rename d1/d17/d67 to d1/d17/d38/d42/d52/d78/d82 0 2024-09-17T01:41:34.969 INFO:tasks.workunit.client.1.smithi167.stdout:0/719: dread d5/d6b/d77/d6d/f8e [0,4194304] 0 2024-09-17T01:41:34.974 INFO:tasks.workunit.client.1.smithi167.stdout:2/745: rename d5/d3c/d4c/de2/db8/d5e/l82 to d5/d3c/d4c/de2/d45/d8e/d98/dca/l102 0 2024-09-17T01:41:34.976 INFO:tasks.workunit.client.0.smithi082.stdout:4/408: mknod d9/d15/d16/d3e/d73/c88 0 2024-09-17T01:41:34.977 INFO:tasks.workunit.client.0.smithi082.stdout:4/409: chown d9/d15/d16/d18/f21 6268819 1 2024-09-17T01:41:34.980 INFO:tasks.workunit.client.1.smithi167.stdout:2/746: dwrite d5/d3c/d4c/de2/d45/d3f/fcb [0,4194304] 0 2024-09-17T01:41:34.984 INFO:tasks.workunit.client.0.smithi082.stdout:1/506: dwrite d2/da/f56 [0,4194304] 0 2024-09-17T01:41:34.987 INFO:tasks.workunit.client.0.smithi082.stdout:2/413: dread d1/d17/d29/f33 [0,4194304] 0 2024-09-17T01:41:34.991 INFO:tasks.workunit.client.0.smithi082.stdout:4/410: mknod d9/d15/d37/d4c/c89 0 2024-09-17T01:41:34.992 INFO:tasks.workunit.client.1.smithi167.stdout:3/783: getdents d7/d8/d1f/df1 0 2024-09-17T01:41:34.993 INFO:tasks.workunit.client.1.smithi167.stdout:3/784: fsync d7/d8/d10/d14/d66/d6c/dab/dcf/fed 0 2024-09-17T01:41:34.994 INFO:tasks.workunit.client.0.smithi082.stdout:9/366: truncate d4/f30 119858 0 2024-09-17T01:41:34.995 INFO:tasks.workunit.client.0.smithi082.stdout:9/367: fsync d4/d27/d2d/d60/f51 0 2024-09-17T01:41:34.996 INFO:tasks.workunit.client.1.smithi167.stdout:1/785: sync 2024-09-17T01:41:34.997 INFO:tasks.workunit.client.0.smithi082.stdout:9/368: chown d4/d59/d63/f67 1582 1 2024-09-17T01:41:34.998 INFO:tasks.workunit.client.1.smithi167.stdout:4/745: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a 0 2024-09-17T01:41:34.998 INFO:tasks.workunit.client.1.smithi167.stdout:4/746: stat d0/d4/d7/d6/f66 0 2024-09-17T01:41:34.999 INFO:tasks.workunit.client.0.smithi082.stdout:9/369: write d4/d27/d2d/d60/d11/d39/d29/d35/f61 [875101,53951] 0 2024-09-17T01:41:35.003 INFO:tasks.workunit.client.0.smithi082.stdout:4/411: symlink d9/d15/d37/l8a 0 2024-09-17T01:41:35.005 INFO:tasks.workunit.client.0.smithi082.stdout:9/370: mknod d4/d27/d2d/d60/c78 0 2024-09-17T01:41:35.006 INFO:tasks.workunit.client.0.smithi082.stdout:9/371: chown d4/d27/d2d/d60/d11/d37/l53 6840300 1 2024-09-17T01:41:35.007 INFO:tasks.workunit.client.0.smithi082.stdout:4/412: unlink d9/d15/d16/d18/d4a/d52/d55/d48/c67 0 2024-09-17T01:41:35.011 INFO:tasks.workunit.client.0.smithi082.stdout:1/507: write d2/da/f35 [1838726,49082] 0 2024-09-17T01:41:35.013 INFO:tasks.workunit.client.0.smithi082.stdout:9/372: symlink d4/d27/l79 0 2024-09-17T01:41:35.013 INFO:tasks.workunit.client.0.smithi082.stdout:2/414: write d1/d35/f65 [1336141,5297] 0 2024-09-17T01:41:35.016 INFO:tasks.workunit.client.0.smithi082.stdout:1/508: dread d2/da/d2d/d6c/f6e [0,4194304] 0 2024-09-17T01:41:35.018 INFO:tasks.workunit.client.0.smithi082.stdout:4/413: creat d9/d15/d37/f8b x:0 0 0 2024-09-17T01:41:35.019 INFO:tasks.workunit.client.0.smithi082.stdout:9/373: creat d4/d27/d2d/d60/d11/d39/d31/f7a x:0 0 0 2024-09-17T01:41:35.021 INFO:tasks.workunit.client.0.smithi082.stdout:2/415: creat d1/d17/d38/d42/f83 x:0 0 0 2024-09-17T01:41:35.022 INFO:tasks.workunit.client.0.smithi082.stdout:2/416: fdatasync d1/d17/f7a 0 2024-09-17T01:41:35.023 INFO:tasks.workunit.client.0.smithi082.stdout:1/509: mknod d2/df/ca0 0 2024-09-17T01:41:35.026 INFO:tasks.workunit.client.0.smithi082.stdout:2/417: chown d1/d17/d38/d42/l73 7698324 1 2024-09-17T01:41:35.028 INFO:tasks.workunit.client.0.smithi082.stdout:9/374: truncate d4/d27/d2d/d60/f51 2985434 0 2024-09-17T01:41:35.032 INFO:tasks.workunit.client.0.smithi082.stdout:1/510: symlink d2/da/la1 0 2024-09-17T01:41:35.033 INFO:tasks.workunit.client.0.smithi082.stdout:1/511: write d2/f11 [112465,15641] 0 2024-09-17T01:41:35.034 INFO:tasks.workunit.client.0.smithi082.stdout:1/512: write d2/d3f/d24/f69 [499287,31412] 0 2024-09-17T01:41:35.035 INFO:tasks.workunit.client.0.smithi082.stdout:1/513: read d2/d3f/f5a [6017594,41421] 0 2024-09-17T01:41:35.037 INFO:tasks.workunit.client.0.smithi082.stdout:9/375: rename d4/d27/d2d/d60/d11/d39/d29/d35/f68 to d4/d27/d36/f7b 0 2024-09-17T01:41:35.044 INFO:tasks.workunit.client.0.smithi082.stdout:1/514: fsync d2/da/d2f/f4c 0 2024-09-17T01:41:35.049 INFO:tasks.workunit.client.0.smithi082.stdout:9/376: dread d4/d27/d2d/d3d/f47 [0,4194304] 0 2024-09-17T01:41:35.054 INFO:tasks.workunit.client.0.smithi082.stdout:2/418: dwrite d1/d17/f18 [0,4194304] 0 2024-09-17T01:41:35.055 INFO:tasks.workunit.client.0.smithi082.stdout:2/419: write d1/f9 [180349,101671] 0 2024-09-17T01:41:35.055 INFO:tasks.workunit.client.0.smithi082.stdout:2/420: stat d1/f1f 0 2024-09-17T01:41:35.061 INFO:tasks.workunit.client.0.smithi082.stdout:2/421: unlink d1/l62 0 2024-09-17T01:41:35.063 INFO:tasks.workunit.client.0.smithi082.stdout:2/422: dread - d1/d10/f7f zero size 2024-09-17T01:41:35.065 INFO:tasks.workunit.client.0.smithi082.stdout:9/377: dwrite d4/d27/d2d/d60/d11/d37/f3c [8388608,4194304] 0 2024-09-17T01:41:35.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:34 smithi082 ceph-mon[28077]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:34 smithi082 ceph-mon[28077]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:34 smithi082 ceph-mon[28077]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 -- 172.21.15.82:0/1815146673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b28102b30 msgr2=0x7f7b28104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/1815146673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b28102b30 0x7f7b28104fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009880 tx=0x7f7b1402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 -- 172.21.15.82:0/1815146673 shutdown_connections 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/1815146673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b28102b30 0x7f7b28104fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/1815146673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281001e0 0x7f7b281025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.069+0000 7f7b2ef58640 1 -- 172.21.15.82:0/1815146673 >> 172.21.15.82:0/1815146673 conn(0x7f7b280fbff0 msgr2=0x7f7b280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:35.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.070+0000 7f7b2ef58640 1 -- 172.21.15.82:0/1815146673 shutdown_connections 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.070+0000 7f7b2ef58640 1 -- 172.21.15.82:0/1815146673 wait complete. 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.070+0000 7f7b2ef58640 1 Processor -- start 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ef58640 1 -- start start 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ef58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 0x7f7b280731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ef58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ef58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28110d70 con 0x7f7b281001e0 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ef58640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28110bf0 con 0x7f7b28102b30 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ccf4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 0x7f7b280731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:50294/0 (socket says 172.21.15.82:50294) 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 -- 172.21.15.82:0/2945808717 learned_addr learned my addr 172.21.15.82:0/2945808717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:35.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 -- 172.21.15.82:0/2945808717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 msgr2=0x7f7b280731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 0x7f7b280731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b27fff640 1 -- 172.21.15.82:0/2945808717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b28073d40 con 0x7f7b28102b30 2024-09-17T01:41:35.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.071+0000 7f7b2ccf4640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 0x7f7b280731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:41:35.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.072+0000 7f7b27fff640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009230 tx=0x7f7b140048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:35.071 INFO:tasks.workunit.client.0.smithi082.stdout:1/515: truncate d2/d3f/d24/f81 1626274 0 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.072+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b1403f070 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.072+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b140044d0 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.072+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b281ab760 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.072+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b14035030 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.073+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281abc90 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.074+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b28102f90 con 0x7f7b28102b30 2024-09-17T01:41:35.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.074+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f7b14042070 con 0x7f7b28102b30 2024-09-17T01:41:35.073 INFO:tasks.workunit.client.0.smithi082.stdout:2/423: rename d1/d17/l39 to d1/d17/d38/d5c/l84 0 2024-09-17T01:41:35.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.075+0000 7f7b25ffb640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 0x7f7b18076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.075+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f7b140b70d0 con 0x7f7b28102b30 2024-09-17T01:41:35.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.076+0000 7f7b2ccf4640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 0x7f7b18076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.074 INFO:tasks.workunit.client.1.smithi167.stdout:9/830: mkdir d4/d9/d21/d2d/d33/d105 0 2024-09-17T01:41:35.075 INFO:tasks.workunit.client.0.smithi082.stdout:1/516: dread - d2/da/d2f/f72 zero size 2024-09-17T01:41:35.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.077+0000 7f7b2ccf4640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 0x7f7b18076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c005fd0 tx=0x7f7b1c005f40 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:35.075 INFO:tasks.workunit.client.0.smithi082.stdout:1/517: stat d2/da/d2f/f72 0 2024-09-17T01:41:35.076 INFO:tasks.workunit.client.0.smithi082.stdout:2/424: mkdir d1/d66/d85 0 2024-09-17T01:41:35.076 INFO:tasks.workunit.client.0.smithi082.stdout:1/518: read d2/da/f6a [674508,72933] 0 2024-09-17T01:41:35.076 INFO:tasks.workunit.client.1.smithi167.stdout:2/747: read - d5/d3c/d4c/d4d/d91/fc6 zero size 2024-09-17T01:41:35.076 INFO:tasks.workunit.client.1.smithi167.stdout:9/831: readlink d4/d9/d2b/da3/lc6 0 2024-09-17T01:41:35.076 INFO:tasks.workunit.client.1.smithi167.stdout:6/910: truncate d7/d54/d90/d13/d2f/d30/d32/f47 427306 0 2024-09-17T01:41:35.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.082+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7b140825c0 con 0x7f7b28102b30 2024-09-17T01:41:35.081 INFO:tasks.workunit.client.1.smithi167.stdout:7/723: creat d0/d2/d14/d19/d26/ff8 x:0 0 0 2024-09-17T01:41:35.083 INFO:tasks.workunit.client.0.smithi082.stdout:2/425: dwrite d1/d10/f14 [0,4194304] 0 2024-09-17T01:41:35.086 INFO:tasks.workunit.client.1.smithi167.stdout:0/720: fdatasync d5/d8/d9/fc6 0 2024-09-17T01:41:35.088 INFO:tasks.workunit.client.0.smithi082.stdout:2/426: dread d1/d10/f14 [0,4194304] 0 2024-09-17T01:41:35.092 INFO:tasks.workunit.client.0.smithi082.stdout:9/378: getdents d4/d27/d2d/d60/d11/d39/d44 0 2024-09-17T01:41:35.094 INFO:tasks.workunit.client.1.smithi167.stdout:4/747: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/f34 8545519 1 2024-09-17T01:41:35.097 INFO:tasks.workunit.client.0.smithi082.stdout:2/427: creat d1/d10/f86 x:0 0 0 2024-09-17T01:41:35.098 INFO:tasks.workunit.client.0.smithi082.stdout:2/428: chown d1/d66/d7e 124784 1 2024-09-17T01:41:35.099 INFO:tasks.workunit.client.0.smithi082.stdout:2/429: chown d1/f1f 4468883 1 2024-09-17T01:41:35.099 INFO:tasks.workunit.client.0.smithi082.stdout:9/379: mknod d4/d27/d2d/d3d/c7c 0 2024-09-17T01:41:35.100 INFO:tasks.workunit.client.0.smithi082.stdout:9/380: dread - d4/d27/d2d/d3d/f5c zero size 2024-09-17T01:41:35.101 INFO:tasks.workunit.client.1.smithi167.stdout:2/748: mkdir d5/d3c/d4c/de2/db8/d5e/d103 0 2024-09-17T01:41:35.101 INFO:tasks.workunit.client.1.smithi167.stdout:2/749: readlink d5/d10/l3a 0 2024-09-17T01:41:35.104 INFO:tasks.workunit.client.1.smithi167.stdout:6/911: truncate d7/d54/d90/d13/d2f/d7f/d98/faa 770386 0 2024-09-17T01:41:35.106 INFO:tasks.workunit.client.0.smithi082.stdout:2/430: rename d1/cc to d1/d17/d38/d42/d52/c87 0 2024-09-17T01:41:35.107 INFO:tasks.workunit.client.1.smithi167.stdout:5/711: dwrite d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae [0,4194304] 0 2024-09-17T01:41:35.107 INFO:tasks.workunit.client.0.smithi082.stdout:1/519: write d2/da/f33 [3242937,118472] 0 2024-09-17T01:41:35.109 INFO:tasks.workunit.client.1.smithi167.stdout:7/724: symlink d0/d2/d14/d19/d32/d62/lf9 0 2024-09-17T01:41:35.111 INFO:tasks.workunit.client.1.smithi167.stdout:1/786: write d0/d5/d34/f70 [436759,69917] 0 2024-09-17T01:41:35.111 INFO:tasks.workunit.client.0.smithi082.stdout:1/520: symlink d2/d3f/d34/la2 0 2024-09-17T01:41:35.112 INFO:tasks.workunit.client.1.smithi167.stdout:3/785: dwrite d7/d8/d10/d29/f87 [4194304,4194304] 0 2024-09-17T01:41:35.113 INFO:tasks.workunit.client.1.smithi167.stdout:0/721: rmdir d5/d8/d9 39 2024-09-17T01:41:35.118 INFO:tasks.workunit.client.1.smithi167.stdout:8/853: rename dc/d21/ca6 to dc/d56/d59/d82/d8f/de5/dba/dd3/c11b 0 2024-09-17T01:41:35.118 INFO:tasks.workunit.client.1.smithi167.stdout:9/832: write d4/d9/d21/d2d/d33/d3a/fa0 [839655,121804] 0 2024-09-17T01:41:35.123 INFO:tasks.workunit.client.0.smithi082.stdout:1/521: mkdir d2/da/d80/da3 0 2024-09-17T01:41:35.124 INFO:tasks.workunit.client.0.smithi082.stdout:1/522: fdatasync d2/d3f/f26 0 2024-09-17T01:41:35.125 INFO:tasks.workunit.client.0.smithi082.stdout:1/523: readlink d2/da/d2f/l60 0 2024-09-17T01:41:35.129 INFO:tasks.workunit.client.1.smithi167.stdout:5/712: chown d0/d9/c51 1 1 2024-09-17T01:41:35.129 INFO:tasks.workunit.client.1.smithi167.stdout:2/750: dread d5/d3c/d4c/de2/db8/f53 [0,4194304] 0 2024-09-17T01:41:35.131 INFO:tasks.workunit.client.1.smithi167.stdout:2/751: stat d5/d3c/d4c/de2/d45/d8e 0 2024-09-17T01:41:35.132 INFO:tasks.workunit.client.0.smithi082.stdout:9/381: dwrite d4/f8 [0,4194304] 0 2024-09-17T01:41:35.132 INFO:tasks.workunit.client.1.smithi167.stdout:3/786: creat d7/d8/d2a/d7a/f107 x:0 0 0 2024-09-17T01:41:35.133 INFO:tasks.workunit.client.1.smithi167.stdout:3/787: chown c4 0 1 2024-09-17T01:41:35.133 INFO:tasks.workunit.client.1.smithi167.stdout:0/722: creat d5/d6b/d77/daa/db1/feb x:0 0 0 2024-09-17T01:41:35.134 INFO:tasks.workunit.client.1.smithi167.stdout:8/854: creat dc/dae/f11c x:0 0 0 2024-09-17T01:41:35.138 INFO:tasks.workunit.client.1.smithi167.stdout:5/713: rename d0/d24/d2b/d3d/dd2/d95/cce to d0/d24/d2b/d4e/dd4/cdb 0 2024-09-17T01:41:35.139 INFO:tasks.workunit.client.0.smithi082.stdout:2/431: dwrite d1/d10/f41 [0,4194304] 0 2024-09-17T01:41:35.139 INFO:tasks.workunit.client.1.smithi167.stdout:7/725: link d0/d2/d14/d19/fd6 d0/d2/ded/ffa 0 2024-09-17T01:41:35.140 INFO:tasks.workunit.client.1.smithi167.stdout:7/726: stat d0/d2/d14/d6f/d87/c94 0 2024-09-17T01:41:35.140 INFO:tasks.workunit.client.0.smithi082.stdout:1/524: dwrite d2/d3f/d24/d54/f74 [0,4194304] 0 2024-09-17T01:41:35.141 INFO:tasks.workunit.client.1.smithi167.stdout:7/727: chown d0/d2/d14/d6f/d87/lc5 95 1 2024-09-17T01:41:35.142 INFO:tasks.workunit.client.1.smithi167.stdout:3/788: creat d7/d8/d10/d14/d25/d9e/f108 x:0 0 0 2024-09-17T01:41:35.148 INFO:tasks.workunit.client.0.smithi082.stdout:9/382: mkdir d4/d27/d2d/d60/d11/d39/d7d 0 2024-09-17T01:41:35.151 INFO:tasks.workunit.client.1.smithi167.stdout:8/855: mkdir dc/d21/d11d 0 2024-09-17T01:41:35.153 INFO:tasks.workunit.client.0.smithi082.stdout:2/432: link d1/f1f d1/d10/f88 0 2024-09-17T01:41:35.156 INFO:tasks.workunit.client.0.smithi082.stdout:9/383: rename d4/d27/d2d/d60/l2b to d4/d27/d2d/d60/d11/d39/d7d/l7e 0 2024-09-17T01:41:35.157 INFO:tasks.workunit.client.0.smithi082.stdout:1/525: creat d2/da/d76/d93/fa4 x:0 0 0 2024-09-17T01:41:35.159 INFO:tasks.workunit.client.1.smithi167.stdout:2/752: rename d5/d3c/d4c/de2/d45/d6b/f6f to d5/d3c/d4c/de2/db8/da3/dc8/f104 0 2024-09-17T01:41:35.161 INFO:tasks.workunit.client.1.smithi167.stdout:5/714: creat d0/d24/d2b/d4e/dd4/fdc x:0 0 0 2024-09-17T01:41:35.163 INFO:tasks.workunit.client.1.smithi167.stdout:6/912: dwrite d7/d54/d90/d13/d2f/d96/f9e [0,4194304] 0 2024-09-17T01:41:35.167 INFO:tasks.workunit.client.1.smithi167.stdout:3/789: creat d7/d8/d10/d14/d25/f109 x:0 0 0 2024-09-17T01:41:35.167 INFO:tasks.workunit.client.1.smithi167.stdout:0/723: dwrite d5/d6b/d77/d4d/f5a [0,4194304] 0 2024-09-17T01:41:35.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/433: symlink d1/d66/d85/l89 0 2024-09-17T01:41:35.169 INFO:tasks.workunit.client.1.smithi167.stdout:9/833: truncate d4/d9/f4c 534708 0 2024-09-17T01:41:35.169 INFO:tasks.workunit.client.1.smithi167.stdout:0/724: chown d5/d6b/d77/d6d/f81 10 1 2024-09-17T01:41:35.170 INFO:tasks.workunit.client.1.smithi167.stdout:0/725: chown d5/d6b/d77/d4d/f9c 351 1 2024-09-17T01:41:35.172 INFO:tasks.workunit.client.0.smithi082.stdout:1/526: dread d2/df/d46/f49 [0,4194304] 0 2024-09-17T01:41:35.172 INFO:tasks.workunit.client.0.smithi082.stdout:1/527: readlink d2/d3f/d24/l98 0 2024-09-17T01:41:35.173 INFO:tasks.workunit.client.1.smithi167.stdout:8/856: rename dc/d21/d6b/d74/fe8 to dc/d56/d59/d82/d8f/de5/dba/f11e 0 2024-09-17T01:41:35.174 INFO:tasks.workunit.client.1.smithi167.stdout:8/857: chown dc/d18/f33 31086 1 2024-09-17T01:41:35.174 INFO:tasks.workunit.client.1.smithi167.stdout:2/753: symlink d5/d3c/d4c/de2/db8/da3/db0/l105 0 2024-09-17T01:41:35.176 INFO:tasks.workunit.client.1.smithi167.stdout:5/715: rmdir d0/d24/d93 39 2024-09-17T01:41:35.178 INFO:tasks.workunit.client.1.smithi167.stdout:6/913: fdatasync d7/d54/d90/d13/d2f/d30/d32/f107 0 2024-09-17T01:41:35.179 INFO:tasks.workunit.client.1.smithi167.stdout:5/716: chown d0/d24/d2b/d49/d4b/dac/d80/cbd 0 1 2024-09-17T01:41:35.180 INFO:tasks.workunit.client.1.smithi167.stdout:8/858: dwrite dc/fd [0,4194304] 0 2024-09-17T01:41:35.205 INFO:tasks.workunit.client.1.smithi167.stdout:2/754: dread d5/d3c/d4c/de2/d45/d3f/f4a [0,4194304] 0 2024-09-17T01:41:35.205 INFO:tasks.workunit.client.1.smithi167.stdout:4/748: sync 2024-09-17T01:41:35.235 INFO:tasks.workunit.client.1.smithi167.stdout:3/790: creat d7/d8/d2a/d7a/f10a x:0 0 0 2024-09-17T01:41:35.237 INFO:tasks.workunit.client.0.smithi082.stdout:2/434: link d1/d17/d29/l46 d1/d5a/d6d/l8a 0 2024-09-17T01:41:35.241 INFO:tasks.workunit.client.0.smithi082.stdout:2/435: readlink d1/l4e 0 2024-09-17T01:41:35.244 INFO:tasks.workunit.client.0.smithi082.stdout:2/436: read d1/d17/f3b [2035,107308] 0 2024-09-17T01:41:35.245 INFO:tasks.workunit.client.1.smithi167.stdout:8/859: readlink dc/d56/d59/d82/d85/le2 0 2024-09-17T01:41:35.246 INFO:tasks.workunit.client.1.smithi167.stdout:7/728: dwrite d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:35.248 INFO:tasks.workunit.client.1.smithi167.stdout:5/717: creat d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/fdd x:0 0 0 2024-09-17T01:41:35.249 INFO:tasks.workunit.client.0.smithi082.stdout:2/437: dwrite d1/d17/f18 [0,4194304] 0 2024-09-17T01:41:35.250 INFO:tasks.workunit.client.1.smithi167.stdout:6/914: dread - d7/d54/d90/d13/d2f/d7f/d98/d27/fe2 zero size 2024-09-17T01:41:35.253 INFO:tasks.workunit.client.1.smithi167.stdout:6/915: chown d7/d54/d90/d13/d2f/d7f/d98/f62 10553 1 2024-09-17T01:41:35.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:34 smithi167 ceph-mon[35643]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:34 smithi167 ceph-mon[35643]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:34 smithi167 ceph-mon[35643]: from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:35.255 INFO:tasks.workunit.client.0.smithi082.stdout:2/438: mknod d1/d17/d29/d50/c8b 0 2024-09-17T01:41:35.255 INFO:tasks.workunit.client.0.smithi082.stdout:2/439: chown d1/d10/l44 123628 1 2024-09-17T01:41:35.257 INFO:tasks.workunit.client.1.smithi167.stdout:0/726: creat d5/d94/fec x:0 0 0 2024-09-17T01:41:35.260 INFO:tasks.workunit.client.1.smithi167.stdout:7/729: creat d0/d2/d14/d6f/ffb x:0 0 0 2024-09-17T01:41:35.262 INFO:tasks.workunit.client.1.smithi167.stdout:9/834: link d4/d9/d21/d43/d6c/f8f d4/d9/d21/d2d/d33/f106 0 2024-09-17T01:41:35.262 INFO:tasks.workunit.client.1.smithi167.stdout:6/916: read d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 [1000477,92198] 0 2024-09-17T01:41:35.262 INFO:tasks.workunit.client.1.smithi167.stdout:0/727: mknod d5/d6b/d77/daa/ced 0 2024-09-17T01:41:35.263 INFO:tasks.workunit.client.1.smithi167.stdout:8/860: creat dc/d21/d11d/f11f x:0 0 0 2024-09-17T01:41:35.265 INFO:tasks.workunit.client.1.smithi167.stdout:8/861: chown dc/d1a/f86 5296 1 2024-09-17T01:41:35.265 INFO:tasks.workunit.client.1.smithi167.stdout:0/728: mkdir d5/dee 0 2024-09-17T01:41:35.267 INFO:tasks.workunit.client.1.smithi167.stdout:8/862: mknod dc/d56/d59/d82/d8f/de5/dba/dd3/c120 0 2024-09-17T01:41:35.267 INFO:tasks.workunit.client.1.smithi167.stdout:8/863: chown dc/d21/d61/l96 14 1 2024-09-17T01:41:35.268 INFO:tasks.workunit.client.1.smithi167.stdout:9/835: read d4/d9/d21/f3c [1137194,34899] 0 2024-09-17T01:41:35.269 INFO:tasks.workunit.client.1.smithi167.stdout:9/836: chown d4/d9/d21/d2d/d33/d80/f9f 843 1 2024-09-17T01:41:35.269 INFO:tasks.workunit.client.1.smithi167.stdout:0/729: creat d5/d6b/d77/fef x:0 0 0 2024-09-17T01:41:35.272 INFO:tasks.workunit.client.1.smithi167.stdout:0/730: rmdir d5/d6b/d77/daa 39 2024-09-17T01:41:35.277 INFO:tasks.workunit.client.1.smithi167.stdout:0/731: creat d5/d8/ff0 x:0 0 0 2024-09-17T01:41:35.277 INFO:tasks.workunit.client.1.smithi167.stdout:9/837: getdents d4/d9/d21/d43/d6c/d9e 0 2024-09-17T01:41:35.277 INFO:tasks.workunit.client.1.smithi167.stdout:0/732: rmdir d5/d6b/dca 39 2024-09-17T01:41:35.279 INFO:tasks.workunit.client.1.smithi167.stdout:9/838: unlink d4/d9/d21/d2d/d33/fde 0 2024-09-17T01:41:35.286 INFO:tasks.workunit.client.0.smithi082.stdout:2/440: mknod d1/d66/c8c 0 2024-09-17T01:41:35.290 INFO:tasks.workunit.client.0.smithi082.stdout:2/441: rename d1/d35/f24 to d1/d66/f8d 0 2024-09-17T01:41:35.291 INFO:tasks.workunit.client.1.smithi167.stdout:7/730: write d0/d2/f21 [3042475,98990] 0 2024-09-17T01:41:35.291 INFO:tasks.workunit.client.0.smithi082.stdout:1/528: dwrite d2/f10 [0,4194304] 0 2024-09-17T01:41:35.295 INFO:tasks.workunit.client.1.smithi167.stdout:4/749: dwrite d0/f64 [0,4194304] 0 2024-09-17T01:41:35.296 INFO:tasks.workunit.client.0.smithi082.stdout:2/442: mknod d1/d17/c8e 0 2024-09-17T01:41:35.296 INFO:tasks.workunit.client.1.smithi167.stdout:6/917: dread d7/d54/d90/d13/d2f/d64/d6b/fa5 [0,4194304] 0 2024-09-17T01:41:35.299 INFO:tasks.workunit.client.1.smithi167.stdout:3/791: dwrite d7/d8/d2a/d4e/f59 [0,4194304] 0 2024-09-17T01:41:35.300 INFO:tasks.workunit.client.0.smithi082.stdout:2/443: mknod d1/d35/c8f 0 2024-09-17T01:41:35.301 INFO:tasks.workunit.client.0.smithi082.stdout:2/444: chown d1/d17/d38/d5c/d7d/l59 41 1 2024-09-17T01:41:35.302 INFO:tasks.workunit.client.1.smithi167.stdout:8/864: dread dc/d56/d57/d7e/dad/fcd [0,4194304] 0 2024-09-17T01:41:35.303 INFO:tasks.workunit.client.1.smithi167.stdout:5/718: dwrite d0/d54/f76 [0,4194304] 0 2024-09-17T01:41:35.304 INFO:tasks.workunit.client.1.smithi167.stdout:7/731: mknod d0/d2/d88/d6e/da3/cfc 0 2024-09-17T01:41:35.305 INFO:tasks.workunit.client.1.smithi167.stdout:1/787: sync 2024-09-17T01:41:35.306 INFO:tasks.workunit.client.1.smithi167.stdout:0/733: dread d5/d8/f96 [0,4194304] 0 2024-09-17T01:41:35.309 INFO:tasks.workunit.client.0.smithi082.stdout:2/445: dwrite d1/d17/d38/d5c/f64 [0,4194304] 0 2024-09-17T01:41:35.311 INFO:tasks.workunit.client.1.smithi167.stdout:3/792: mknod d7/d8/c10b 0 2024-09-17T01:41:35.311 INFO:tasks.workunit.client.1.smithi167.stdout:8/865: fsync dc/d56/f9b 0 2024-09-17T01:41:35.311 INFO:tasks.workunit.client.1.smithi167.stdout:6/918: chown d7/d52/d79/da4/cd1 532 1 2024-09-17T01:41:35.312 INFO:tasks.workunit.client.0.smithi082.stdout:2/446: fdatasync d1/d17/d38/d5c/f79 0 2024-09-17T01:41:35.312 INFO:tasks.workunit.client.0.smithi082.stdout:2/447: write d1/d10/f6b [2253049,15393] 0 2024-09-17T01:41:35.312 INFO:tasks.workunit.client.1.smithi167.stdout:7/732: rmdir d0/d2/d14/d19/d7f 39 2024-09-17T01:41:35.314 INFO:tasks.workunit.client.1.smithi167.stdout:0/734: symlink d5/d6b/d77/d4d/d56/lf1 0 2024-09-17T01:41:35.316 INFO:tasks.workunit.client.1.smithi167.stdout:9/839: dwrite d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:35.316 INFO:tasks.workunit.client.1.smithi167.stdout:5/719: unlink d0/d24/d2b/d3d/d3b/d92/ld9 0 2024-09-17T01:41:35.318 INFO:tasks.workunit.client.1.smithi167.stdout:3/793: unlink d7/f72 0 2024-09-17T01:41:35.319 INFO:tasks.workunit.client.1.smithi167.stdout:3/794: chown d7/d1e/f43 0 1 2024-09-17T01:41:35.319 INFO:tasks.workunit.client.0.smithi082.stdout:2/448: mkdir d1/d90 0 2024-09-17T01:41:35.320 INFO:tasks.workunit.client.1.smithi167.stdout:8/866: symlink dc/d21/d6b/d74/l121 0 2024-09-17T01:41:35.321 INFO:tasks.workunit.client.0.smithi082.stdout:2/449: dread d1/d17/d38/d42/d52/f70 [0,4194304] 0 2024-09-17T01:41:35.321 INFO:tasks.workunit.client.0.smithi082.stdout:2/450: read - d1/d17/d38/d5c/f79 zero size 2024-09-17T01:41:35.322 INFO:tasks.workunit.client.0.smithi082.stdout:2/451: chown d1/d17 420 1 2024-09-17T01:41:35.323 INFO:tasks.workunit.client.1.smithi167.stdout:5/720: symlink d0/d24/d2b/d49/d4b/dac/d3a/d4d/lde 0 2024-09-17T01:41:35.325 INFO:tasks.workunit.client.1.smithi167.stdout:7/733: mkdir d0/d2/ded/dfd 0 2024-09-17T01:41:35.326 INFO:tasks.workunit.client.1.smithi167.stdout:6/919: mkdir d7/d54/d90/d13/d2f/d10f/d137 0 2024-09-17T01:41:35.328 INFO:tasks.workunit.client.1.smithi167.stdout:9/840: getdents d4/d9/d21/d2d/de4/de7 0 2024-09-17T01:41:35.329 INFO:tasks.workunit.client.0.smithi082.stdout:2/452: rename d1/d17/d38/d5c/l84 to d1/d5a/d6d/l91 0 2024-09-17T01:41:35.330 INFO:tasks.workunit.client.0.smithi082.stdout:2/453: fdatasync d1/d17/d29/f6e 0 2024-09-17T01:41:35.331 INFO:tasks.workunit.client.1.smithi167.stdout:3/795: dwrite d7/d8/f4c [0,4194304] 0 2024-09-17T01:41:35.331 INFO:tasks.workunit.client.1.smithi167.stdout:2/755: sync 2024-09-17T01:41:35.332 INFO:tasks.workunit.client.1.smithi167.stdout:8/867: rmdir dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/d101 39 2024-09-17T01:41:35.333 INFO:tasks.workunit.client.1.smithi167.stdout:2/756: write d5/d3c/d4c/de2/d2e/f59 [1773794,90221] 0 2024-09-17T01:41:35.335 INFO:tasks.workunit.client.1.smithi167.stdout:5/721: creat d0/d24/d2b/d3d/dd2/fdf x:0 0 0 2024-09-17T01:41:35.336 INFO:tasks.workunit.client.0.smithi082.stdout:2/454: rmdir d1/d35 39 2024-09-17T01:41:35.340 INFO:tasks.workunit.client.1.smithi167.stdout:4/750: rename d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d4f to d0/d4/d7/dff 0 2024-09-17T01:41:35.341 INFO:tasks.workunit.client.0.smithi082.stdout:2/455: symlink d1/d17/d38/l92 0 2024-09-17T01:41:35.342 INFO:tasks.workunit.client.1.smithi167.stdout:2/757: dwrite d5/d3c/d4c/de2/d45/d8e/f9b [0,4194304] 0 2024-09-17T01:41:35.343 INFO:tasks.workunit.client.1.smithi167.stdout:6/920: truncate d7/d52/db7/fe8 54430 0 2024-09-17T01:41:35.344 INFO:tasks.workunit.client.0.smithi082.stdout:2/456: creat d1/d66/d85/f93 x:0 0 0 2024-09-17T01:41:35.345 INFO:tasks.workunit.client.1.smithi167.stdout:1/788: dread d0/d9/d16/d22/f84 [0,4194304] 0 2024-09-17T01:41:35.346 INFO:tasks.workunit.client.1.smithi167.stdout:3/796: chown d7/d8/d10/fef 61427958 1 2024-09-17T01:41:35.351 INFO:tasks.workunit.client.1.smithi167.stdout:7/734: write d0/d2/d88/f5d [3381520,94832] 0 2024-09-17T01:41:35.352 INFO:tasks.workunit.client.1.smithi167.stdout:7/735: chown d0/d2/d88/d6e/l9a 938518 1 2024-09-17T01:41:35.353 INFO:tasks.workunit.client.0.smithi082.stdout:2/457: creat d1/d17/f94 x:0 0 0 2024-09-17T01:41:35.356 INFO:tasks.workunit.client.0.smithi082.stdout:2/458: fsync d1/d10/f88 0 2024-09-17T01:41:35.357 INFO:tasks.workunit.client.1.smithi167.stdout:9/841: symlink d4/d9/d21/d2d/d33/d105/l107 0 2024-09-17T01:41:35.357 INFO:tasks.workunit.client.1.smithi167.stdout:9/842: chown d4/f83 15 1 2024-09-17T01:41:35.357 INFO:tasks.workunit.client.1.smithi167.stdout:6/921: fsync d7/d54/d90/d13/f49 0 2024-09-17T01:41:35.357 INFO:tasks.workunit.client.1.smithi167.stdout:0/735: link d5/d6b/lab d5/d8/d9/d2f/d9b/lf2 0 2024-09-17T01:41:35.358 INFO:tasks.workunit.client.1.smithi167.stdout:3/797: mkdir d7/d8/d10/d14/d25/dc7/dd1/dc2/d10c 0 2024-09-17T01:41:35.359 INFO:tasks.workunit.client.0.smithi082.stdout:2/459: mknod d1/d17/d38/d5c/c95 0 2024-09-17T01:41:35.360 INFO:tasks.workunit.client.1.smithi167.stdout:2/758: read d5/d3c/d4c/de2/f37 [2805155,52409] 0 2024-09-17T01:41:35.369 INFO:tasks.workunit.client.1.smithi167.stdout:6/922: truncate d7/d54/d90/d13/d2f/d7f/fc5 685973 0 2024-09-17T01:41:35.372 INFO:tasks.workunit.client.1.smithi167.stdout:8/868: link dc/d56/d59/d82/d85/ld2 dc/d21/d61/dea/d110/l122 0 2024-09-17T01:41:35.372 INFO:tasks.workunit.client.1.smithi167.stdout:5/722: dread d0/d24/d2b/d49/d4b/dac/d3a/dd1/f23 [4194304,4194304] 0 2024-09-17T01:41:35.373 INFO:tasks.workunit.client.1.smithi167.stdout:7/736: creat d0/d2/d88/df5/ffe x:0 0 0 2024-09-17T01:41:35.374 INFO:tasks.workunit.client.1.smithi167.stdout:1/789: dread d0/d5/d34/d6d/fba [0,4194304] 0 2024-09-17T01:41:35.374 INFO:tasks.workunit.client.1.smithi167.stdout:0/736: symlink d5/dee/lf3 0 2024-09-17T01:41:35.375 INFO:tasks.workunit.client.1.smithi167.stdout:5/723: readlink d0/d24/d2b/d49/d4b/dac/d3a/dd1/l68 0 2024-09-17T01:41:35.376 INFO:tasks.workunit.client.1.smithi167.stdout:5/724: chown d0/d24/d2b/d3d/d3b/c84 322903170 1 2024-09-17T01:41:35.376 INFO:tasks.workunit.client.1.smithi167.stdout:6/923: symlink d7/d54/l138 0 2024-09-17T01:41:35.379 INFO:tasks.workunit.client.0.smithi082.stdout:2/460: dread d1/d10/f6b [0,4194304] 0 2024-09-17T01:41:35.379 INFO:tasks.workunit.client.1.smithi167.stdout:2/759: mknod d5/d6d/c106 0 2024-09-17T01:41:35.379 INFO:tasks.workunit.client.0.smithi082.stdout:2/461: readlink d1/d17/d38/l56 0 2024-09-17T01:41:35.380 INFO:tasks.workunit.client.1.smithi167.stdout:2/760: readlink d5/d3c/d4c/de2/d45/d8e/d98/ld2 0 2024-09-17T01:41:35.381 INFO:tasks.workunit.client.1.smithi167.stdout:9/843: rename d4/d9/d21/d2d/d33/d3a/d9c/f100 to d4/d9/d21/f108 0 2024-09-17T01:41:35.381 INFO:tasks.workunit.client.1.smithi167.stdout:4/751: truncate d0/d4/d7/d6/f66 3116428 0 2024-09-17T01:41:35.382 INFO:tasks.workunit.client.1.smithi167.stdout:4/752: chown d0/d4/d7/fec 28465 1 2024-09-17T01:41:35.382 INFO:tasks.workunit.client.1.smithi167.stdout:7/737: mknod d0/d2/d88/df5/cff 0 2024-09-17T01:41:35.383 INFO:tasks.workunit.client.0.smithi082.stdout:2/462: write d1/d35/f37 [7697398,52954] 0 2024-09-17T01:41:35.384 INFO:tasks.workunit.client.1.smithi167.stdout:4/753: stat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/c4a 0 2024-09-17T01:41:35.385 INFO:tasks.workunit.client.1.smithi167.stdout:8/869: truncate dc/d56/d57/d5c/f68 822019 0 2024-09-17T01:41:35.387 INFO:tasks.workunit.client.1.smithi167.stdout:0/737: creat d5/d6b/d77/d4d/d56/ff4 x:0 0 0 2024-09-17T01:41:35.387 INFO:tasks.workunit.client.1.smithi167.stdout:8/870: chown dc/f29 433293 1 2024-09-17T01:41:35.388 INFO:tasks.workunit.client.1.smithi167.stdout:5/725: chown d0/d9/c1b 3 1 2024-09-17T01:41:35.390 INFO:tasks.workunit.client.1.smithi167.stdout:3/798: dwrite d7/d8/d10/d14/d66/d6c/fe1 [0,4194304] 0 2024-09-17T01:41:35.391 INFO:tasks.workunit.client.1.smithi167.stdout:5/726: write d0/d24/d2b/f39 [4579011,41951] 0 2024-09-17T01:41:35.393 INFO:tasks.workunit.client.1.smithi167.stdout:9/844: mknod d4/d9/d21/d81/dbf/c109 0 2024-09-17T01:41:35.395 INFO:tasks.workunit.client.1.smithi167.stdout:1/790: mkdir d0/d9/d16/d104 0 2024-09-17T01:41:35.396 INFO:tasks.workunit.client.0.smithi082.stdout:2/463: truncate d1/d17/d38/d42/f69 1068581 0 2024-09-17T01:41:35.399 INFO:tasks.workunit.client.1.smithi167.stdout:5/727: dread d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae [0,4194304] 0 2024-09-17T01:41:35.400 INFO:tasks.workunit.client.0.smithi082.stdout:2/464: symlink d1/d5a/d6d/l96 0 2024-09-17T01:41:35.401 INFO:tasks.workunit.client.1.smithi167.stdout:5/728: write d0/d24/d2b/d49/d4b/f55 [2596514,45914] 0 2024-09-17T01:41:35.402 INFO:tasks.workunit.client.1.smithi167.stdout:5/729: write d0/d24/fcf [354303,127407] 0 2024-09-17T01:41:35.403 INFO:tasks.workunit.client.1.smithi167.stdout:2/761: mknod d5/d3c/d4c/de2/db8/d5e/d103/c107 0 2024-09-17T01:41:35.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/465: dread d1/d17/d29/f6e [0,4194304] 0 2024-09-17T01:41:35.405 INFO:tasks.workunit.client.1.smithi167.stdout:7/738: mknod d0/d2/c100 0 2024-09-17T01:41:35.407 INFO:tasks.workunit.client.1.smithi167.stdout:9/845: creat d4/d9/d21/df0/f10a x:0 0 0 2024-09-17T01:41:35.408 INFO:tasks.workunit.client.0.smithi082.stdout:2/466: mknod d1/d17/d38/d42/d52/d78/d82/c97 0 2024-09-17T01:41:35.409 INFO:tasks.workunit.client.0.smithi082.stdout:2/467: write d1/d5a/f63 [856898,26413] 0 2024-09-17T01:41:35.411 INFO:tasks.workunit.client.1.smithi167.stdout:1/791: symlink d0/d9/d16/d48/d54/d6f/ddd/l105 0 2024-09-17T01:41:35.413 INFO:tasks.workunit.client.1.smithi167.stdout:6/924: truncate d7/d54/d90/d13/d2f/d64/d6b/f11f 186489 0 2024-09-17T01:41:35.414 INFO:tasks.workunit.client.0.smithi082.stdout:2/468: creat d1/d10/f98 x:0 0 0 2024-09-17T01:41:35.414 INFO:tasks.workunit.client.1.smithi167.stdout:6/925: readlink d7/ld9 0 2024-09-17T01:41:35.415 INFO:tasks.workunit.client.1.smithi167.stdout:8/871: mknod dc/d56/d59/d65/df9/c123 0 2024-09-17T01:41:35.415 INFO:tasks.workunit.client.1.smithi167.stdout:7/739: dwrite d0/d2/d14/d19/d32/d62/fe1 [0,4194304] 0 2024-09-17T01:41:35.418 INFO:tasks.workunit.client.1.smithi167.stdout:4/754: dwrite d0/d4/d7/da/d48/fb3 [0,4194304] 0 2024-09-17T01:41:35.419 INFO:tasks.workunit.client.1.smithi167.stdout:5/730: chown d0/d24/d2b/d3d/dd2/l82 417386 1 2024-09-17T01:41:35.419 INFO:tasks.workunit.client.0.smithi082.stdout:2/469: rename d1/d10/f54 to d1/d17/d38/f99 0 2024-09-17T01:41:35.420 INFO:tasks.workunit.client.0.smithi082.stdout:2/470: chown d1/d17/d29/f4c 0 1 2024-09-17T01:41:35.422 INFO:tasks.workunit.client.1.smithi167.stdout:0/738: dwrite d5/d8/d5c/fcd [0,4194304] 0 2024-09-17T01:41:35.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.424+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7b281ac4f0 con 0x7f7b28102b30 2024-09-17T01:41:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.426+0000 7f7b25ffb640 1 -- 172.21.15.82:0/2945808717 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f7b14087470 con 0x7f7b28102b30 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:41:35.425 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:41:35.426 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:41:35.427 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:41:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:41:35.428 INFO:tasks.workunit.client.0.smithi082.stdout:2/471: dwrite d1/d17/d38/d42/f83 [0,4194304] 0 2024-09-17T01:41:35.429 INFO:tasks.workunit.client.1.smithi167.stdout:2/762: fsync d5/d3c/d4c/de2/d45/d8e/d98/dfa/f18 0 2024-09-17T01:41:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 msgr2=0x7f7b18076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 0x7f7b18076f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c005fd0 tx=0x7f7b1c005f40 comp rx=0 tx=0).stop 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 msgr2=0x7f7b28073730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009230 tx=0x7f7b140048f0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 shutdown_connections 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28102b30 0x7f7b28073730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f7b18074a80 0x7f7b18076f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 --2- 172.21.15.82:0/2945808717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281001e0 0x7f7b280731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.431+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 >> 172.21.15.82:0/2945808717 conn(0x7f7b280fbff0 msgr2=0x7f7b280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.432+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 shutdown_connections 2024-09-17T01:41:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.432+0000 7f7b2ef58640 1 -- 172.21.15.82:0/2945808717 wait complete. 2024-09-17T01:41:35.435 INFO:tasks.workunit.client.1.smithi167.stdout:0/739: write d5/d6b/d77/fef [869153,35003] 0 2024-09-17T01:41:35.436 INFO:tasks.workunit.client.0.smithi082.stdout:2/472: dwrite d1/d17/d29/d50/f6c [0,4194304] 0 2024-09-17T01:41:35.437 INFO:tasks.workunit.client.1.smithi167.stdout:3/799: creat d7/d8/d10/d14/f10d x:0 0 0 2024-09-17T01:41:35.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/473: read d1/d10/f88 [3727824,13697] 0 2024-09-17T01:41:35.445 INFO:tasks.workunit.client.1.smithi167.stdout:0/740: chown d5/d6b/d77/d92/db8 2855689 1 2024-09-17T01:41:35.446 INFO:tasks.workunit.client.1.smithi167.stdout:4/755: creat d0/d4/d7/d6/d2b/d6d/d7e/da8/f100 x:0 0 0 2024-09-17T01:41:35.447 INFO:tasks.workunit.client.1.smithi167.stdout:8/872: dwrite dc/d1a/d45/fd0 [0,4194304] 0 2024-09-17T01:41:35.448 INFO:tasks.workunit.client.0.smithi082.stdout:2/474: creat d1/d17/d38/d42/d52/d78/d82/f9a x:0 0 0 2024-09-17T01:41:35.449 INFO:tasks.workunit.client.1.smithi167.stdout:7/740: dwrite d0/d2/d14/d19/d32/d62/fe1 [0,4194304] 0 2024-09-17T01:41:35.449 INFO:tasks.workunit.client.1.smithi167.stdout:2/763: mkdir d5/d3c/d4c/de2/db8/d5e/d103/d108 0 2024-09-17T01:41:35.450 INFO:tasks.workunit.client.0.smithi082.stdout:2/475: mknod d1/d17/d29/c9b 0 2024-09-17T01:41:35.451 INFO:tasks.workunit.client.1.smithi167.stdout:3/800: write d7/d8/d2a/d4e/f67 [41882,46387] 0 2024-09-17T01:41:35.451 INFO:tasks.workunit.client.0.smithi082.stdout:2/476: fdatasync d1/f16 0 2024-09-17T01:41:35.454 INFO:tasks.workunit.client.1.smithi167.stdout:5/731: dwrite d0/d24/d2b/d49/d4b/dac/fc9 [0,4194304] 0 2024-09-17T01:41:35.455 INFO:tasks.workunit.client.1.smithi167.stdout:8/873: read - dc/d56/d57/da0/da7/f119 zero size 2024-09-17T01:41:35.455 INFO:tasks.workunit.client.1.smithi167.stdout:7/741: fdatasync d0/d2/d14/d19/d26/fc0 0 2024-09-17T01:41:35.459 INFO:tasks.workunit.client.1.smithi167.stdout:5/732: fdatasync d0/d9/f12 0 2024-09-17T01:41:35.463 INFO:tasks.workunit.client.1.smithi167.stdout:9/846: dwrite d4/d9/f6d [0,4194304] 0 2024-09-17T01:41:35.463 INFO:tasks.workunit.client.1.smithi167.stdout:0/741: symlink d5/d6b/d77/d6d/d90/lf5 0 2024-09-17T01:41:35.466 INFO:tasks.workunit.client.1.smithi167.stdout:4/756: unlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/laf 0 2024-09-17T01:41:35.467 INFO:tasks.workunit.client.1.smithi167.stdout:7/742: symlink d0/d2/d88/l101 0 2024-09-17T01:41:35.467 INFO:tasks.workunit.client.1.smithi167.stdout:3/801: rename c4 to d7/d8/d10/d14/d25/c10e 0 2024-09-17T01:41:35.468 INFO:tasks.workunit.client.1.smithi167.stdout:8/874: truncate dc/d56/d59/f64 329182 0 2024-09-17T01:41:35.471 INFO:tasks.workunit.client.1.smithi167.stdout:7/743: readlink d0/d2/d14/d6f/d87/lc5 0 2024-09-17T01:41:35.473 INFO:tasks.workunit.client.1.smithi167.stdout:3/802: mknod d7/d8/d10/d29/c10f 0 2024-09-17T01:41:35.474 INFO:tasks.workunit.client.1.smithi167.stdout:1/792: dwrite d0/d5/d34/d3c/f4e [4194304,4194304] 0 2024-09-17T01:41:35.474 INFO:tasks.workunit.client.1.smithi167.stdout:8/875: mkdir dc/d56/dd1/d124 0 2024-09-17T01:41:35.477 INFO:tasks.workunit.client.1.smithi167.stdout:5/733: truncate d0/d24/d2b/d3d/d6d/fba 7187827 0 2024-09-17T01:41:35.479 INFO:tasks.workunit.client.1.smithi167.stdout:0/742: truncate d5/d6b/d77/daa/fc9 999484 0 2024-09-17T01:41:35.480 INFO:tasks.workunit.client.1.smithi167.stdout:2/764: dread d5/d33/f57 [0,4194304] 0 2024-09-17T01:41:35.482 INFO:tasks.workunit.client.1.smithi167.stdout:7/744: write d0/d2/d88/f6c [1892779,8240] 0 2024-09-17T01:41:35.485 INFO:tasks.workunit.client.1.smithi167.stdout:1/793: symlink d0/d5/dd7/d102/de7/l106 0 2024-09-17T01:41:35.488 INFO:tasks.workunit.client.1.smithi167.stdout:4/757: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51 0 2024-09-17T01:41:35.489 INFO:tasks.workunit.client.1.smithi167.stdout:8/876: creat dc/d56/d59/d82/f125 x:0 0 0 2024-09-17T01:41:35.490 INFO:tasks.workunit.client.1.smithi167.stdout:6/926: dwrite d7/d54/d90/d13/f49 [0,4194304] 0 2024-09-17T01:41:35.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/318: sync 2024-09-17T01:41:35.496 INFO:tasks.workunit.client.1.smithi167.stdout:1/794: mkdir d0/d5/dd7/d102/de7/d107 0 2024-09-17T01:41:35.497 INFO:tasks.workunit.client.1.smithi167.stdout:8/877: mknod dc/d21/d11d/c126 0 2024-09-17T01:41:35.499 INFO:tasks.workunit.client.1.smithi167.stdout:3/803: dwrite d7/d8/d10/d14/d24/d62/d92/fc6 [0,4194304] 0 2024-09-17T01:41:35.505 INFO:tasks.workunit.client.1.smithi167.stdout:0/743: dwrite d5/d6b/d77/d37/fbe [0,4194304] 0 2024-09-17T01:41:35.507 INFO:tasks.workunit.client.1.smithi167.stdout:4/758: getdents d0/d4 0 2024-09-17T01:41:35.507 INFO:tasks.workunit.client.1.smithi167.stdout:5/734: dwrite d0/d24/d2b/d3d/dd2/fdf [0,4194304] 0 2024-09-17T01:41:35.507 INFO:tasks.workunit.client.1.smithi167.stdout:8/878: dread - dc/d56/d57/f115 zero size 2024-09-17T01:41:35.507 INFO:tasks.workunit.client.1.smithi167.stdout:4/759: readlink d0/l1a 0 2024-09-17T01:41:35.510 INFO:tasks.workunit.client.1.smithi167.stdout:0/744: truncate d5/d8/d5c/fd2 519792 0 2024-09-17T01:41:35.512 INFO:tasks.workunit.client.1.smithi167.stdout:6/927: getdents d7/d52 0 2024-09-17T01:41:35.512 INFO:tasks.workunit.client.1.smithi167.stdout:8/879: chown dc/d56/lbb 3 1 2024-09-17T01:41:35.512 INFO:tasks.workunit.client.1.smithi167.stdout:1/795: dread d0/d9/d16/d48/d54/d6e/d7e/f9a [0,4194304] 0 2024-09-17T01:41:35.512 INFO:tasks.workunit.client.1.smithi167.stdout:2/765: link d5/d3c/d4c/de2/db8/d5e/ca4 d5/d3c/d4c/de2/d45/d3f/c109 0 2024-09-17T01:41:35.513 INFO:tasks.workunit.client.1.smithi167.stdout:4/760: chown d0/d4/d7/d6/d2b/d6d/d7e/c87 107705 1 2024-09-17T01:41:35.520 INFO:tasks.workunit.client.1.smithi167.stdout:5/735: creat d0/d24/d2b/d49/d4b/dac/d3a/fe0 x:0 0 0 2024-09-17T01:41:35.522 INFO:tasks.workunit.client.1.smithi167.stdout:2/766: write d5/d3c/d4c/de2/d45/d8e/f64 [3702448,116746] 0 2024-09-17T01:41:35.522 INFO:tasks.workunit.client.1.smithi167.stdout:3/804: dwrite d7/d8/d10/d14/d2c/f2d [4194304,4194304] 0 2024-09-17T01:41:35.522 INFO:tasks.workunit.client.0.smithi082.stdout:2/477: truncate d1/d10/f14 1235080 0 2024-09-17T01:41:35.523 INFO:tasks.workunit.client.1.smithi167.stdout:5/736: readlink d0/d24/d2b/d49/d4b/dac/d3a/l7e 0 2024-09-17T01:41:35.523 INFO:tasks.workunit.client.1.smithi167.stdout:6/928: symlink d7/d54/d90/d13/d2f/d64/d6b/l139 0 2024-09-17T01:41:35.524 INFO:tasks.workunit.client.1.smithi167.stdout:4/761: creat d0/dce/f101 x:0 0 0 2024-09-17T01:41:35.525 INFO:tasks.workunit.client.0.smithi082.stdout:2/478: mkdir d1/d66/d7e/d9c 0 2024-09-17T01:41:35.526 INFO:tasks.workunit.client.1.smithi167.stdout:3/805: read d7/f3e [928027,63898] 0 2024-09-17T01:41:35.528 INFO:tasks.workunit.client.1.smithi167.stdout:6/929: write d7/d54/d90/d13/d2f/d30/fc9 [111917,24033] 0 2024-09-17T01:41:35.529 INFO:tasks.workunit.client.1.smithi167.stdout:0/745: getdents d5/d94 0 2024-09-17T01:41:35.530 INFO:tasks.workunit.client.1.smithi167.stdout:3/806: fdatasync d7/d8/d10/d14/d24/f97 0 2024-09-17T01:41:35.531 INFO:tasks.workunit.client.1.smithi167.stdout:8/880: link dc/d1a/c1f dc/d18/c127 0 2024-09-17T01:41:35.532 INFO:tasks.workunit.client.1.smithi167.stdout:6/930: chown d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61 1017166067 1 2024-09-17T01:41:35.532 INFO:tasks.workunit.client.1.smithi167.stdout:1/796: getdents d0/d5/dbf 0 2024-09-17T01:41:35.535 INFO:tasks.workunit.client.1.smithi167.stdout:6/931: read - d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/f104 zero size 2024-09-17T01:41:35.537 INFO:tasks.workunit.client.1.smithi167.stdout:1/797: creat d0/d5/d34/f108 x:0 0 0 2024-09-17T01:41:35.539 INFO:tasks.workunit.client.1.smithi167.stdout:0/746: unlink d5/d8/l23 0 2024-09-17T01:41:35.539 INFO:tasks.workunit.client.1.smithi167.stdout:1/798: dread - d0/d5/d61/da2/fe8 zero size 2024-09-17T01:41:35.540 INFO:tasks.workunit.client.1.smithi167.stdout:3/807: fdatasync d7/d1e/f4f 0 2024-09-17T01:41:35.542 INFO:tasks.workunit.client.1.smithi167.stdout:1/799: write d0/d5/d34/d3c/f4e [7671156,110025] 0 2024-09-17T01:41:35.545 INFO:tasks.workunit.client.0.smithi082.stdout:7/427: sync 2024-09-17T01:41:35.545 INFO:tasks.workunit.client.1.smithi167.stdout:8/881: rename dc/d56/d57/c76 to dc/d1a/d45/c128 0 2024-09-17T01:41:35.545 INFO:tasks.workunit.client.1.smithi167.stdout:4/762: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/d6f/f79 [0,4194304] 0 2024-09-17T01:41:35.546 INFO:tasks.workunit.client.1.smithi167.stdout:3/808: chown d7/d8/d10/d14/d25/f109 417514 1 2024-09-17T01:41:35.548 INFO:tasks.workunit.client.1.smithi167.stdout:0/747: readlink d5/d8/d9/d2f/d9b/lf2 0 2024-09-17T01:41:35.550 INFO:tasks.workunit.client.1.smithi167.stdout:4/763: dread d0/d4/d7/d6/f43 [0,4194304] 0 2024-09-17T01:41:35.551 INFO:tasks.workunit.client.1.smithi167.stdout:4/764: chown d0/d4/d69/fbb 7693680 1 2024-09-17T01:41:35.553 INFO:tasks.workunit.client.1.smithi167.stdout:4/765: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/f34 193994248 1 2024-09-17T01:41:35.555 INFO:tasks.workunit.client.0.smithi082.stdout:0/319: dwrite f7 [0,4194304] 0 2024-09-17T01:41:35.555 INFO:tasks.workunit.client.1.smithi167.stdout:5/737: dread d0/d24/d2b/d4e/d63/fd6 [0,4194304] 0 2024-09-17T01:41:35.555 INFO:tasks.workunit.client.1.smithi167.stdout:5/738: stat d0/d24/d2b/f39 0 2024-09-17T01:41:35.556 INFO:tasks.workunit.client.0.smithi082.stdout:7/428: creat d0/d3/f8f x:0 0 0 2024-09-17T01:41:35.559 INFO:tasks.workunit.client.1.smithi167.stdout:2/767: dread d5/d3c/d4c/de2/d45/d3f/f7e [0,4194304] 0 2024-09-17T01:41:35.564 INFO:tasks.workunit.client.1.smithi167.stdout:8/882: write dc/d1a/f108 [6705817,88098] 0 2024-09-17T01:41:35.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 -- 172.21.15.82:0/3409267974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4102430 msgr2=0x7f54b4104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3409267974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4102430 0x7f54b4104820 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009880 tx=0x7f54b002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.565 INFO:tasks.workunit.client.0.smithi082.stdout:2/479: dread d1/f4d [0,4194304] 0 2024-09-17T01:41:35.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 -- 172.21.15.82:0/3409267974 shutdown_connections 2024-09-17T01:41:35.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3409267974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4104d60 0x7f54b4107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3409267974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4102430 0x7f54b4104820 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.564+0000 7f54bbd87640 1 -- 172.21.15.82:0/3409267974 >> 172.21.15.82:0/3409267974 conn(0x7f54b40fc010 msgr2=0x7f54b40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.565+0000 7f54bbd87640 1 -- 172.21.15.82:0/3409267974 shutdown_connections 2024-09-17T01:41:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.565+0000 7f54bbd87640 1 -- 172.21.15.82:0/3409267974 wait complete. 2024-09-17T01:41:35.566 INFO:tasks.workunit.client.0.smithi082.stdout:0/320: creat da/df/d2b/d59/f73 x:0 0 0 2024-09-17T01:41:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.565+0000 7f54bbd87640 1 Processor -- start 2024-09-17T01:41:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.565+0000 7f54bbd87640 1 -- start start 2024-09-17T01:41:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54bbd87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 0x7f54b4199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54bbd87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.567 INFO:tasks.workunit.client.0.smithi082.stdout:0/321: chown da/df/c20 452546 1 2024-09-17T01:41:35.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54bbd87640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54b410a820 con 0x7f54b4104d60 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54bbd87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54b410a6a0 con 0x7f54b4102430 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54b9322640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54b9322640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39176/0 (socket says 172.21.15.82:39176) 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.566+0000 7f54b9322640 1 -- 172.21.15.82:0/3980990178 learned_addr learned my addr 172.21.15.82:0/3980990178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.567+0000 7f54b9b23640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 0x7f54b4199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.567+0000 7f54b9322640 1 -- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 msgr2=0x7f54b4199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.567+0000 7f54b9322640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 0x7f54b4199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.567+0000 7f54b9322640 1 -- 172.21.15.82:0/3980990178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b419a130 con 0x7f54b4104d60 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.567+0000 7f54b9322640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b3d0 tx=0x7f54a400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.568+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54a4015020 con 0x7f54b4104d60 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.568+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54a4011af0 con 0x7f54b4104d60 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.568+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b419eb70 con 0x7f54b4104d60 2024-09-17T01:41:35.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.568+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b419f120 con 0x7f54b4104d60 2024-09-17T01:41:35.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.568+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54a4010cf0 con 0x7f54b4104d60 2024-09-17T01:41:35.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.571+0000 7f54b9b23640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 0x7f54b4199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:41:35.570 INFO:tasks.workunit.client.1.smithi167.stdout:3/809: creat d7/d8/d10/d14/d25/d9e/f110 x:0 0 0 2024-09-17T01:41:35.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.572+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f54a4018020 con 0x7f54b4104d60 2024-09-17T01:41:35.571 INFO:tasks.workunit.client.0.smithi082.stdout:7/429: symlink d0/dd/d2c/d42/l90 0 2024-09-17T01:41:35.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.571+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b40fdb00 con 0x7f54b4104d60 2024-09-17T01:41:35.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.572+0000 7f54aaffd640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 0x7f54a0077040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:35.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.572+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f54a4095c30 con 0x7f54b4104d60 2024-09-17T01:41:35.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.573+0000 7f54b9b23640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 0x7f54a0077040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:35.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.574+0000 7f54b9b23640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 0x7f54a0077040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54b00096c0 tx=0x7f54b000b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:35.575 INFO:tasks.workunit.client.0.smithi082.stdout:0/322: rename f0 to da/d1e/f74 0 2024-09-17T01:41:35.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.581+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f54a401f020 con 0x7f54b4104d60 2024-09-17T01:41:35.580 INFO:tasks.workunit.client.0.smithi082.stdout:0/323: truncate da/f14 96600 0 2024-09-17T01:41:35.582 INFO:tasks.workunit.client.0.smithi082.stdout:7/430: creat d0/d62/d7e/f91 x:0 0 0 2024-09-17T01:41:35.582 INFO:tasks.workunit.client.0.smithi082.stdout:7/431: chown d0/d3/db/d7d 1737 1 2024-09-17T01:41:35.584 INFO:tasks.workunit.client.0.smithi082.stdout:7/432: readlink d0/dd/d34/d58/l75 0 2024-09-17T01:41:35.584 INFO:tasks.workunit.client.0.smithi082.stdout:2/480: creat d1/f9d x:0 0 0 2024-09-17T01:41:35.585 INFO:tasks.workunit.client.1.smithi167.stdout:0/748: mknod d5/d6b/d77/d92/de2/cf6 0 2024-09-17T01:41:35.587 INFO:tasks.workunit.client.1.smithi167.stdout:0/749: write d5/d8/ff0 [444513,93643] 0 2024-09-17T01:41:35.587 INFO:tasks.workunit.client.1.smithi167.stdout:2/768: dread d5/d3c/d4c/d4d/fac [0,4194304] 0 2024-09-17T01:41:35.588 INFO:tasks.workunit.client.1.smithi167.stdout:6/932: dwrite d7/d52/d79/da4/fce [4194304,4194304] 0 2024-09-17T01:41:35.589 INFO:tasks.workunit.client.0.smithi082.stdout:7/433: symlink d0/d3/d36/d37/d86/l92 0 2024-09-17T01:41:35.589 INFO:tasks.workunit.client.1.smithi167.stdout:6/933: dread - d7/ff1 zero size 2024-09-17T01:41:35.590 INFO:tasks.workunit.client.0.smithi082.stdout:7/434: write d0/f7a [970732,11576] 0 2024-09-17T01:41:35.591 INFO:tasks.workunit.client.1.smithi167.stdout:8/883: link dc/d56/d57/ff0 dc/d56/f129 0 2024-09-17T01:41:35.594 INFO:tasks.workunit.client.1.smithi167.stdout:1/800: dwrite d0/d5/d34/d6d/fa6 [0,4194304] 0 2024-09-17T01:41:35.595 INFO:tasks.workunit.client.1.smithi167.stdout:1/801: fdatasync d0/d5/d61/da2/fe8 0 2024-09-17T01:41:35.598 INFO:tasks.workunit.client.1.smithi167.stdout:2/769: fdatasync d5/d3c/d4c/de2/d45/d3f/f7e 0 2024-09-17T01:41:35.603 INFO:tasks.workunit.client.1.smithi167.stdout:6/934: mknod d7/d52/db7/c13a 0 2024-09-17T01:41:35.603 INFO:tasks.workunit.client.1.smithi167.stdout:4/766: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/f3a [570874,121311] 0 2024-09-17T01:41:35.606 INFO:tasks.workunit.client.1.smithi167.stdout:4/767: readlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d75/lc1 0 2024-09-17T01:41:35.607 INFO:tasks.workunit.client.1.smithi167.stdout:8/884: rmdir dc/d21/d61/dea 39 2024-09-17T01:41:35.609 INFO:tasks.workunit.client.1.smithi167.stdout:0/750: creat d5/d6b/d77/d37/d45/da9/ff7 x:0 0 0 2024-09-17T01:41:35.611 INFO:tasks.workunit.client.1.smithi167.stdout:6/935: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 [0,4194304] 0 2024-09-17T01:41:35.612 INFO:tasks.workunit.client.1.smithi167.stdout:3/810: dread d7/d8/d2a/f22 [0,4194304] 0 2024-09-17T01:41:35.613 INFO:tasks.workunit.client.0.smithi082.stdout:2/481: dread d1/d10/f19 [0,4194304] 0 2024-09-17T01:41:35.613 INFO:tasks.workunit.client.1.smithi167.stdout:3/811: chown d7/d8/d2a/f2e 601 1 2024-09-17T01:41:35.613 INFO:tasks.workunit.client.1.smithi167.stdout:8/885: creat dc/d56/f12a x:0 0 0 2024-09-17T01:41:35.619 INFO:tasks.workunit.client.0.smithi082.stdout:0/324: dwrite da/df/f53 [0,4194304] 0 2024-09-17T01:41:35.621 INFO:tasks.workunit.client.1.smithi167.stdout:3/812: dwrite d7/d8/d10/d14/d24/d62/f90 [0,4194304] 0 2024-09-17T01:41:35.623 INFO:tasks.workunit.client.1.smithi167.stdout:0/751: creat d5/d6b/d7e/ff8 x:0 0 0 2024-09-17T01:41:35.626 INFO:tasks.workunit.client.1.smithi167.stdout:0/752: write d5/d6b/d77/d37/d45/fa1 [51741,26432] 0 2024-09-17T01:41:35.628 INFO:tasks.workunit.client.1.smithi167.stdout:6/936: unlink d7/d54/d90/d13/d60/c77 0 2024-09-17T01:41:35.630 INFO:tasks.workunit.client.1.smithi167.stdout:8/886: creat dc/d56/d57/dc2/d100/f12b x:0 0 0 2024-09-17T01:41:35.630 INFO:tasks.workunit.client.0.smithi082.stdout:7/435: write d0/dd/f16 [18827,13659] 0 2024-09-17T01:41:35.635 INFO:tasks.workunit.client.0.smithi082.stdout:2/482: creat d1/d17/d38/f9e x:0 0 0 2024-09-17T01:41:35.638 INFO:tasks.workunit.client.1.smithi167.stdout:0/753: readlink d5/d6b/d77/d4d/d56/lb0 0 2024-09-17T01:41:35.639 INFO:tasks.workunit.client.0.smithi082.stdout:2/483: dread d1/d10/f19 [0,4194304] 0 2024-09-17T01:41:35.639 INFO:tasks.workunit.client.1.smithi167.stdout:0/754: chown d5/d8/d9/f62 0 1 2024-09-17T01:41:35.640 INFO:tasks.workunit.client.1.smithi167.stdout:6/937: creat d7/d54/d90/d13/d2f/d30/f13b x:0 0 0 2024-09-17T01:41:35.641 INFO:tasks.workunit.client.1.smithi167.stdout:1/802: truncate d0/d9/f103 1728760 0 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:4/414: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:8/379: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:6/465: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:5/496: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:1/529: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:3/324: sync 2024-09-17T01:41:35.644 INFO:tasks.workunit.client.0.smithi082.stdout:9/384: sync 2024-09-17T01:41:35.645 INFO:tasks.workunit.client.0.smithi082.stdout:2/484: symlink d1/d10/l9f 0 2024-09-17T01:41:35.645 INFO:tasks.workunit.client.1.smithi167.stdout:0/755: rmdir d5/d6b/d77/d37/d45 39 2024-09-17T01:41:35.645 INFO:tasks.workunit.client.1.smithi167.stdout:8/887: dread dc/d56/d59/f64 [0,4194304] 0 2024-09-17T01:41:35.645 INFO:tasks.workunit.client.1.smithi167.stdout:4/768: dwrite d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f85 [0,4194304] 0 2024-09-17T01:41:35.648 INFO:tasks.workunit.client.0.smithi082.stdout:7/436: creat d0/dd/d34/d58/d6e/d8a/f93 x:0 0 0 2024-09-17T01:41:35.648 INFO:tasks.workunit.client.1.smithi167.stdout:2/770: truncate d5/d3c/d4c/d4d/fc9 212895 0 2024-09-17T01:41:35.649 INFO:tasks.workunit.client.1.smithi167.stdout:3/813: mknod d7/d8/d10/d29/c111 0 2024-09-17T01:41:35.650 INFO:tasks.workunit.client.1.smithi167.stdout:2/771: chown d5/d3c/d4c/de2/d45/d8e/d98/dfa/c38 113 1 2024-09-17T01:41:35.651 INFO:tasks.workunit.client.1.smithi167.stdout:2/772: readlink d5/d3c/d4c/de2/l35 0 2024-09-17T01:41:35.651 INFO:tasks.workunit.client.1.smithi167.stdout:1/803: dread - d0/d9/d16/d48/d54/d6e/d7e/fa8 zero size 2024-09-17T01:41:35.652 INFO:tasks.workunit.client.1.smithi167.stdout:0/756: dread d5/d8/f44 [0,4194304] 0 2024-09-17T01:41:35.653 INFO:tasks.workunit.client.0.smithi082.stdout:5/497: stat db/d1e/f55 0 2024-09-17T01:41:35.655 INFO:tasks.workunit.client.0.smithi082.stdout:2/485: dread d1/d10/f19 [0,4194304] 0 2024-09-17T01:41:35.656 INFO:tasks.workunit.client.1.smithi167.stdout:3/814: readlink l0 0 2024-09-17T01:41:35.657 INFO:tasks.workunit.client.1.smithi167.stdout:4/769: dread d0/d4/f47 [4194304,4194304] 0 2024-09-17T01:41:35.658 INFO:tasks.workunit.client.0.smithi082.stdout:6/466: dwrite d1/d3/f7b [0,4194304] 0 2024-09-17T01:41:35.658 INFO:tasks.workunit.client.0.smithi082.stdout:2/486: chown d1/d66/f8d 30176 1 2024-09-17T01:41:35.659 INFO:tasks.workunit.client.1.smithi167.stdout:2/773: mkdir d5/d3c/d10a 0 2024-09-17T01:41:35.659 INFO:tasks.workunit.client.1.smithi167.stdout:3/815: fdatasync d7/d8/d10/d14/f8d 0 2024-09-17T01:41:35.659 INFO:tasks.workunit.client.0.smithi082.stdout:5/498: write db/d56/d18/d23/f66 [539485,128841] 0 2024-09-17T01:41:35.659 INFO:tasks.workunit.client.0.smithi082.stdout:9/385: creat d4/d27/d36/f7f x:0 0 0 2024-09-17T01:41:35.661 INFO:tasks.workunit.client.1.smithi167.stdout:8/888: dwrite dc/d21/d61/dea/ff6 [0,4194304] 0 2024-09-17T01:41:35.662 INFO:tasks.workunit.client.0.smithi082.stdout:4/415: fdatasync d9/d15/d16/d18/d4a/f83 0 2024-09-17T01:41:35.666 INFO:tasks.workunit.client.0.smithi082.stdout:7/437: creat d0/d3/d36/d37/d71/f94 x:0 0 0 2024-09-17T01:41:35.667 INFO:tasks.workunit.client.1.smithi167.stdout:0/757: unlink d5/d6b/d77/l5f 0 2024-09-17T01:41:35.669 INFO:tasks.workunit.client.0.smithi082.stdout:0/325: creat da/d1b/d23/d4d/f75 x:0 0 0 2024-09-17T01:41:35.672 INFO:tasks.workunit.client.1.smithi167.stdout:9/847: sync 2024-09-17T01:41:35.672 INFO:tasks.workunit.client.1.smithi167.stdout:4/770: mknod d0/d4/d7/d6/d5d/da2/c102 0 2024-09-17T01:41:35.672 INFO:tasks.workunit.client.1.smithi167.stdout:9/848: fdatasync d4/d9/d97/dd6/fd7 0 2024-09-17T01:41:35.673 INFO:tasks.workunit.client.1.smithi167.stdout:4/771: truncate d0/d4/d7/d10/ff0 910225 0 2024-09-17T01:41:35.674 INFO:tasks.workunit.client.0.smithi082.stdout:5/499: dwrite db/f5a [0,4194304] 0 2024-09-17T01:41:35.674 INFO:tasks.workunit.client.0.smithi082.stdout:8/380: symlink d3/dd/d18/l70 0 2024-09-17T01:41:35.676 INFO:tasks.workunit.client.0.smithi082.stdout:2/487: dread d1/f9 [0,4194304] 0 2024-09-17T01:41:35.678 INFO:tasks.workunit.client.0.smithi082.stdout:1/530: mknod d2/da/d16/ca5 0 2024-09-17T01:41:35.679 INFO:tasks.workunit.client.1.smithi167.stdout:3/816: rename d7/d8/d10/d14/d66/d6c/da2 to d7/d8/d10/d14/d25/dc7/dd1/dc2/d112 0 2024-09-17T01:41:35.679 INFO:tasks.workunit.client.0.smithi082.stdout:2/488: dread - d1/d10/f7f zero size 2024-09-17T01:41:35.680 INFO:tasks.workunit.client.1.smithi167.stdout:3/817: chown d7/c1d 1771278 1 2024-09-17T01:41:35.683 INFO:tasks.workunit.client.1.smithi167.stdout:0/758: chown d5/d8/d9/l93 444511 1 2024-09-17T01:41:35.685 INFO:tasks.workunit.client.0.smithi082.stdout:7/438: dwrite d0/f7a [0,4194304] 0 2024-09-17T01:41:35.686 INFO:tasks.workunit.client.0.smithi082.stdout:6/467: creat d1/d7/d10/d4f/dc/d2b/d48/faa x:0 0 0 2024-09-17T01:41:35.687 INFO:tasks.workunit.client.0.smithi082.stdout:0/326: dwrite da/df/d71/f48 [0,4194304] 0 2024-09-17T01:41:35.692 INFO:tasks.workunit.client.0.smithi082.stdout:4/416: stat d9/d15/d16/f36 0 2024-09-17T01:41:35.692 INFO:tasks.workunit.client.1.smithi167.stdout:8/889: mkdir dc/d18/d12c 0 2024-09-17T01:41:35.693 INFO:tasks.workunit.client.0.smithi082.stdout:3/325: dread d9/db/d26/f31 [0,4194304] 0 2024-09-17T01:41:35.701 INFO:tasks.workunit.client.0.smithi082.stdout:5/500: mkdir db/d56/d18/d98 0 2024-09-17T01:41:35.702 INFO:tasks.workunit.client.0.smithi082.stdout:5/501: write db/d56/d18/f4a [317737,63672] 0 2024-09-17T01:41:35.703 INFO:tasks.workunit.client.1.smithi167.stdout:0/759: unlink d5/d8/d5c/fcd 0 2024-09-17T01:41:35.703 INFO:tasks.workunit.client.1.smithi167.stdout:9/849: dread d4/d9/d21/df0/f55 [0,4194304] 0 2024-09-17T01:41:35.706 INFO:tasks.workunit.client.1.smithi167.stdout:8/890: symlink dc/d21/d6b/d113/l12d 0 2024-09-17T01:41:35.708 INFO:tasks.workunit.client.0.smithi082.stdout:1/531: creat d2/da/d2f/d47/fa6 x:0 0 0 2024-09-17T01:41:35.711 INFO:tasks.workunit.client.1.smithi167.stdout:2/774: link d5/d3c/d4c/de2/d45/d8e/d98/dfa/f65 d5/d3c/d4c/f10b 0 2024-09-17T01:41:35.713 INFO:tasks.workunit.client.0.smithi082.stdout:9/386: write d4/d27/d2d/d60/d11/d37/f38 [3092810,29848] 0 2024-09-17T01:41:35.715 INFO:tasks.workunit.client.1.smithi167.stdout:4/772: write d0/f3 [7290810,113785] 0 2024-09-17T01:41:35.715 INFO:tasks.workunit.client.0.smithi082.stdout:6/468: rename d1 to d1/d7/d10/d4f/dc/d2b/dab 22 2024-09-17T01:41:35.717 INFO:tasks.workunit.client.0.smithi082.stdout:6/469: chown d1/d7/d10/d4f/dc/d2b/l9a 302612 1 2024-09-17T01:41:35.718 INFO:tasks.workunit.client.0.smithi082.stdout:0/327: symlink da/df/d2b/d59/l76 0 2024-09-17T01:41:35.720 INFO:tasks.workunit.client.0.smithi082.stdout:3/326: write d9/db/f18 [2636550,101413] 0 2024-09-17T01:41:35.721 INFO:tasks.workunit.client.1.smithi167.stdout:4/773: dwrite d0/fd [0,4194304] 0 2024-09-17T01:41:35.722 INFO:tasks.workunit.client.0.smithi082.stdout:3/327: read d9/d35/f4b [392517,86046] 0 2024-09-17T01:41:35.725 INFO:tasks.workunit.client.1.smithi167.stdout:2/775: mkdir d5/d3c/d4c/de2/d45/d3f/d10c 0 2024-09-17T01:41:35.726 INFO:tasks.workunit.client.0.smithi082.stdout:8/381: link d3/dd/f56 d3/dd/d18/d2d/d3e/f71 0 2024-09-17T01:41:35.727 INFO:tasks.workunit.client.1.smithi167.stdout:2/776: chown d5/d6d/c106 1427 1 2024-09-17T01:41:35.729 INFO:tasks.workunit.client.1.smithi167.stdout:4/774: dwrite d0/d4/d7/da/f2c [4194304,4194304] 0 2024-09-17T01:41:35.731 INFO:tasks.workunit.client.1.smithi167.stdout:0/760: write d5/d6b/d77/d37/f69 [258994,65525] 0 2024-09-17T01:41:35.731 INFO:tasks.workunit.client.1.smithi167.stdout:3/818: dread d7/d8/d10/d29/f87 [0,4194304] 0 2024-09-17T01:41:35.732 INFO:tasks.workunit.client.0.smithi082.stdout:2/489: fdatasync d1/d17/d38/d42/f69 0 2024-09-17T01:41:35.733 INFO:tasks.workunit.client.1.smithi167.stdout:9/850: mknod d4/d9/d21/d81/c10b 0 2024-09-17T01:41:35.735 INFO:tasks.workunit.client.0.smithi082.stdout:9/387: truncate d4/d27/d2d/d60/d11/d39/d31/f40 736859 0 2024-09-17T01:41:35.735 INFO:tasks.workunit.client.0.smithi082.stdout:7/439: dwrite d0/d3/db/d10/d47/f5c [0,4194304] 0 2024-09-17T01:41:35.738 INFO:tasks.workunit.client.0.smithi082.stdout:9/388: dread - d4/d27/d36/f7b zero size 2024-09-17T01:41:35.739 INFO:tasks.workunit.client.1.smithi167.stdout:8/891: dread dc/d56/d59/d65/fb4 [0,4194304] 0 2024-09-17T01:41:35.739 INFO:tasks.workunit.client.1.smithi167.stdout:2/777: readlink d5/d3c/d4c/de2/d45/d8e/d98/dca/l102 0 2024-09-17T01:41:35.740 INFO:tasks.workunit.client.0.smithi082.stdout:0/328: rmdir da/df/d2b/d59/d6f 39 2024-09-17T01:41:35.741 INFO:tasks.workunit.client.1.smithi167.stdout:4/775: creat d0/d4/d7/da/d48/f103 x:0 0 0 2024-09-17T01:41:35.741 INFO:tasks.workunit.client.1.smithi167.stdout:2/778: write d5/d3c/d4c/de2/d45/d8e/d98/ff6 [174745,65051] 0 2024-09-17T01:41:35.743 INFO:tasks.workunit.client.1.smithi167.stdout:0/761: mknod d5/d6b/d77/daa/cf9 0 2024-09-17T01:41:35.744 INFO:tasks.workunit.client.0.smithi082.stdout:3/328: dread - d9/db/f3e zero size 2024-09-17T01:41:35.746 INFO:tasks.workunit.client.0.smithi082.stdout:2/490: dwrite d1/d66/d85/f93 [0,4194304] 0 2024-09-17T01:41:35.748 INFO:tasks.workunit.client.0.smithi082.stdout:8/382: symlink d3/dd/d18/d51/l72 0 2024-09-17T01:41:35.751 INFO:tasks.workunit.client.1.smithi167.stdout:2/779: dwrite d5/d3c/d4c/de2/d46/fb6 [0,4194304] 0 2024-09-17T01:41:35.752 INFO:tasks.workunit.client.0.smithi082.stdout:1/532: symlink d2/da/d16/la7 0 2024-09-17T01:41:35.753 INFO:tasks.workunit.client.1.smithi167.stdout:0/762: dread d5/d6b/d77/d37/f69 [0,4194304] 0 2024-09-17T01:41:35.754 INFO:tasks.workunit.client.0.smithi082.stdout:1/533: read d2/d3f/d24/d54/f66 [450755,106719] 0 2024-09-17T01:41:35.758 INFO:tasks.workunit.client.0.smithi082.stdout:1/534: read f0 [2847043,30318] 0 2024-09-17T01:41:35.758 INFO:tasks.workunit.client.1.smithi167.stdout:4/776: mknod d0/d4/d7/da/d48/c104 0 2024-09-17T01:41:35.758 INFO:tasks.workunit.client.1.smithi167.stdout:2/780: read d5/d3c/d4c/de2/d45/d8e/d98/dfa/f65 [1337415,82291] 0 2024-09-17T01:41:35.759 INFO:tasks.workunit.client.0.smithi082.stdout:1/535: write d2/f4 [3404809,108359] 0 2024-09-17T01:41:35.761 INFO:tasks.workunit.client.0.smithi082.stdout:1/536: write d2/df/d46/f64 [141704,51438] 0 2024-09-17T01:41:35.761 INFO:tasks.workunit.client.0.smithi082.stdout:4/417: link d9/d15/d16/d3e/c75 d9/d15/d16/d3e/d73/c8c 0 2024-09-17T01:41:35.766 INFO:tasks.workunit.client.0.smithi082.stdout:3/329: mkdir d9/db/d6d 0 2024-09-17T01:41:35.767 INFO:tasks.workunit.client.0.smithi082.stdout:3/330: write d9/db/f18 [446963,13515] 0 2024-09-17T01:41:35.767 INFO:tasks.workunit.client.0.smithi082.stdout:2/491: mkdir d1/d17/d38/d42/d52/d78/da0 0 2024-09-17T01:41:35.769 INFO:tasks.workunit.client.0.smithi082.stdout:2/492: dread - d1/d17/d38/d42/d52/f76 zero size 2024-09-17T01:41:35.770 INFO:tasks.workunit.client.1.smithi167.stdout:2/781: creat d5/d3c/d4c/de2/d45/d3f/f10d x:0 0 0 2024-09-17T01:41:35.771 INFO:tasks.workunit.client.1.smithi167.stdout:2/782: readlink d5/d6d/l9e 0 2024-09-17T01:41:35.772 INFO:tasks.workunit.client.1.smithi167.stdout:3/819: rename d7/d8/d10/d14/d66/ceb to d7/d8/d10/c113 0 2024-09-17T01:41:35.773 INFO:tasks.workunit.client.1.smithi167.stdout:2/783: write d5/d3c/d4c/de2/d45/d8e/f64 [2219118,10694] 0 2024-09-17T01:41:35.773 INFO:tasks.workunit.client.1.smithi167.stdout:0/763: mkdir d5/d6b/d77/d4d/dfa 0 2024-09-17T01:41:35.774 INFO:tasks.workunit.client.1.smithi167.stdout:9/851: dread d4/d9/d21/d43/f69 [0,4194304] 0 2024-09-17T01:41:35.775 INFO:tasks.workunit.client.0.smithi082.stdout:9/389: mknod d4/d27/d2d/d60/d11/d39/d29/d77/c80 0 2024-09-17T01:41:35.775 INFO:tasks.workunit.client.1.smithi167.stdout:0/764: stat d5/d6b/d77/d92/de2/cf6 0 2024-09-17T01:41:35.776 INFO:tasks.workunit.client.0.smithi082.stdout:4/418: mkdir d9/d15/d16/d44/d8d 0 2024-09-17T01:41:35.781 INFO:tasks.workunit.client.1.smithi167.stdout:2/784: rename d5/d3c/d4c/de2/d45/d3f/f4a to d5/dfe/f10e 0 2024-09-17T01:41:35.787 INFO:tasks.workunit.client.0.smithi082.stdout:3/331: dread d9/db/f13 [0,4194304] 0 2024-09-17T01:41:35.787 INFO:tasks.workunit.client.1.smithi167.stdout:0/765: chown d5/d8/d9/ccc 27 1 2024-09-17T01:41:35.788 INFO:tasks.workunit.client.1.smithi167.stdout:0/766: dread - d5/d6b/d77/d92/fb4 zero size 2024-09-17T01:41:35.788 INFO:tasks.workunit.client.1.smithi167.stdout:5/739: sync 2024-09-17T01:41:35.788 INFO:tasks.workunit.client.1.smithi167.stdout:7/745: sync 2024-09-17T01:41:35.789 INFO:tasks.workunit.client.1.smithi167.stdout:0/767: readlink d5/dee/lf3 0 2024-09-17T01:41:35.789 INFO:tasks.workunit.client.1.smithi167.stdout:0/768: stat d5/d8/d9/d2f/c6f 0 2024-09-17T01:41:35.790 INFO:tasks.workunit.client.0.smithi082.stdout:2/493: unlink d1/d17/d38/d42/l73 0 2024-09-17T01:41:35.790 INFO:tasks.workunit.client.1.smithi167.stdout:0/769: chown d5/d8/d9/ccc 10853885 1 2024-09-17T01:41:35.790 INFO:tasks.workunit.client.0.smithi082.stdout:2/494: write d1/d17/f21 [8696725,111899] 0 2024-09-17T01:41:35.791 INFO:tasks.workunit.client.0.smithi082.stdout:6/470: truncate d1/d7/d10/f8c 3176603 0 2024-09-17T01:41:35.794 INFO:tasks.workunit.client.0.smithi082.stdout:1/537: mkdir d2/da/d2f/da8 0 2024-09-17T01:41:35.796 INFO:tasks.workunit.client.0.smithi082.stdout:9/390: mkdir d4/d27/d2d/d3d/d81 0 2024-09-17T01:41:35.797 INFO:tasks.workunit.client.0.smithi082.stdout:9/391: fdatasync d4/d27/d36/f4e 0 2024-09-17T01:41:35.798 INFO:tasks.workunit.client.0.smithi082.stdout:9/392: chown d4/d27/d21/f42 14465521 1 2024-09-17T01:41:35.801 INFO:tasks.workunit.client.0.smithi082.stdout:4/419: mknod d9/d15/d37/d45/c8e 0 2024-09-17T01:41:35.801 INFO:tasks.workunit.client.1.smithi167.stdout:8/892: write dc/f48 [1525063,128195] 0 2024-09-17T01:41:35.801 INFO:tasks.workunit.client.1.smithi167.stdout:5/740: mkdir d0/d54/d56/de1 0 2024-09-17T01:41:35.802 INFO:tasks.workunit.client.0.smithi082.stdout:7/440: link d0/c39 d0/d3/d36/d37/d86/c95 0 2024-09-17T01:41:35.803 INFO:tasks.workunit.client.1.smithi167.stdout:5/741: truncate d0/d24/d2b/d4e/fa0 985591 0 2024-09-17T01:41:35.803 INFO:tasks.workunit.client.1.smithi167.stdout:7/746: mkdir d0/d2/d14/d19/d26/d83/d102 0 2024-09-17T01:41:35.804 INFO:tasks.workunit.client.1.smithi167.stdout:5/742: truncate d0/d24/d2b/d3d/dd2/d95/fd7 525404 0 2024-09-17T01:41:35.805 INFO:tasks.workunit.client.1.smithi167.stdout:5/743: chown d0/d24/d2b/d3d/d6d 1421775 1 2024-09-17T01:41:35.806 INFO:tasks.workunit.client.1.smithi167.stdout:0/770: unlink d5/d6b/l9f 0 2024-09-17T01:41:35.808 INFO:tasks.workunit.client.0.smithi082.stdout:3/332: unlink d9/d35/l56 0 2024-09-17T01:41:35.808 INFO:tasks.workunit.client.0.smithi082.stdout:7/441: dread d0/f7a [0,4194304] 0 2024-09-17T01:41:35.808 INFO:tasks.workunit.client.0.smithi082.stdout:4/420: dwrite d9/d15/d16/d18/d4a/f83 [0,4194304] 0 2024-09-17T01:41:35.810 INFO:tasks.workunit.client.0.smithi082.stdout:4/421: write d9/f46 [997141,54638] 0 2024-09-17T01:41:35.810 INFO:tasks.workunit.client.1.smithi167.stdout:3/820: rmdir d7/d8/d10/d14/d2c/d7f/dd5 0 2024-09-17T01:41:35.812 INFO:tasks.workunit.client.1.smithi167.stdout:0/771: dwrite d5/d6b/d77/d92/fea [0,4194304] 0 2024-09-17T01:41:35.813 INFO:tasks.workunit.client.1.smithi167.stdout:3/821: write d7/d8/d2a/f63 [3675810,3477] 0 2024-09-17T01:41:35.815 INFO:tasks.workunit.client.0.smithi082.stdout:4/422: dread d9/d2b/f70 [0,4194304] 0 2024-09-17T01:41:35.816 INFO:tasks.workunit.client.0.smithi082.stdout:4/423: stat d9/d15/d16/d3e/d54/c58 0 2024-09-17T01:41:35.816 INFO:tasks.workunit.client.1.smithi167.stdout:7/747: dread d0/d2/d88/fab [0,4194304] 0 2024-09-17T01:41:35.816 INFO:tasks.workunit.client.1.smithi167.stdout:1/804: sync 2024-09-17T01:41:35.817 INFO:tasks.workunit.client.1.smithi167.stdout:6/938: sync 2024-09-17T01:41:35.817 INFO:tasks.workunit.client.1.smithi167.stdout:4/777: truncate d0/fd 3952604 0 2024-09-17T01:41:35.825 INFO:tasks.workunit.client.0.smithi082.stdout:9/393: symlink d4/d27/d2d/d60/d11/d39/d29/d77/l82 0 2024-09-17T01:41:35.825 INFO:tasks.workunit.client.1.smithi167.stdout:6/939: dwrite d7/d54/d90/d13/d2f/d7f/d98/f1c [0,4194304] 0 2024-09-17T01:41:35.826 INFO:tasks.workunit.client.1.smithi167.stdout:9/852: write d4/d9/d21/d43/d6c/f86 [5067499,4361] 0 2024-09-17T01:41:35.827 INFO:tasks.workunit.client.1.smithi167.stdout:0/772: mknod d5/dee/cfb 0 2024-09-17T01:41:35.828 INFO:tasks.workunit.client.1.smithi167.stdout:6/940: write d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/f63 [4126460,102977] 0 2024-09-17T01:41:35.830 INFO:tasks.workunit.client.0.smithi082.stdout:7/442: creat d0/d3/d36/d37/f96 x:0 0 0 2024-09-17T01:41:35.831 INFO:tasks.workunit.client.1.smithi167.stdout:2/785: getdents d5/d71 0 2024-09-17T01:41:35.833 INFO:tasks.workunit.client.0.smithi082.stdout:3/333: rename d9/db/d49/d4e/f50 to d9/db/d26/d4f/f6e 0 2024-09-17T01:41:35.834 INFO:tasks.workunit.client.1.smithi167.stdout:9/853: dwrite d4/d9/d21/d2d/dae/fe2 [0,4194304] 0 2024-09-17T01:41:35.840 INFO:tasks.workunit.client.1.smithi167.stdout:2/786: dwrite d5/d3c/d4c/de2/d2e/f36 [0,4194304] 0 2024-09-17T01:41:35.840 INFO:tasks.workunit.client.0.smithi082.stdout:0/329: write da/d1b/d23/d4d/f2a [1985092,13381] 0 2024-09-17T01:41:35.843 INFO:tasks.workunit.client.1.smithi167.stdout:4/778: creat d0/d4/d7/da/f105 x:0 0 0 2024-09-17T01:41:35.846 INFO:tasks.workunit.client.0.smithi082.stdout:9/394: creat d4/d27/d2d/d60/d11/d39/d44/f83 x:0 0 0 2024-09-17T01:41:35.847 INFO:tasks.workunit.client.0.smithi082.stdout:9/395: readlink d4/d27/d2d/d3d/l43 0 2024-09-17T01:41:35.851 INFO:tasks.workunit.client.1.smithi167.stdout:5/744: mkdir d0/d24/d2b/d3d/d6d/de2 0 2024-09-17T01:41:35.861 INFO:tasks.workunit.client.0.smithi082.stdout:1/538: write d2/da/d2f/d47/f50 [901812,6738] 0 2024-09-17T01:41:35.861 INFO:tasks.workunit.client.1.smithi167.stdout:6/941: read d7/fd4 [261301,74265] 0 2024-09-17T01:41:35.862 INFO:tasks.workunit.client.1.smithi167.stdout:0/773: write d5/d6b/d77/f54 [3060717,118185] 0 2024-09-17T01:41:35.862 INFO:tasks.workunit.client.1.smithi167.stdout:8/893: dwrite dc/d56/d57/d5c/fc6 [0,4194304] 0 2024-09-17T01:41:35.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/443: dread d0/dd/f17 [0,4194304] 0 2024-09-17T01:41:35.863 INFO:tasks.workunit.client.0.smithi082.stdout:6/471: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/fac x:0 0 0 2024-09-17T01:41:35.864 INFO:tasks.workunit.client.1.smithi167.stdout:8/894: chown dc/d56/d59/f60 7 1 2024-09-17T01:41:35.864 INFO:tasks.workunit.client.0.smithi082.stdout:7/444: chown d0/dd/d2c/d55/c6f 0 1 2024-09-17T01:41:35.865 INFO:tasks.workunit.client.1.smithi167.stdout:8/895: chown dc/d56/d57/dc2/d100/f12b 134172 1 2024-09-17T01:41:35.865 INFO:tasks.workunit.client.0.smithi082.stdout:7/445: chown d0/d3/db/f14 208981297 1 2024-09-17T01:41:35.866 INFO:tasks.workunit.client.0.smithi082.stdout:7/446: chown d0/d3/d36/c38 1030688 1 2024-09-17T01:41:35.866 INFO:tasks.workunit.client.0.smithi082.stdout:4/424: mkdir d9/d15/d16/d18/d4a/d8f 0 2024-09-17T01:41:35.869 INFO:tasks.workunit.client.1.smithi167.stdout:0/774: dwrite d5/d8/d9/f35 [0,4194304] 0 2024-09-17T01:41:35.873 INFO:tasks.workunit.client.1.smithi167.stdout:9/854: unlink d4/d9/d21/d2d/d33/d80/c8a 0 2024-09-17T01:41:35.876 INFO:tasks.workunit.client.1.smithi167.stdout:3/822: dwrite d7/d8/f78 [0,4194304] 0 2024-09-17T01:41:35.877 INFO:tasks.workunit.client.1.smithi167.stdout:3/823: fsync d7/faf 0 2024-09-17T01:41:35.880 INFO:tasks.workunit.client.1.smithi167.stdout:2/787: rename d5/d3c/d4c/de2/d2e/f7d to d5/dfe/f10f 0 2024-09-17T01:41:35.881 INFO:tasks.workunit.client.1.smithi167.stdout:4/779: mknod d0/d4/db4/c106 0 2024-09-17T01:41:35.882 INFO:tasks.workunit.client.0.smithi082.stdout:6/472: mknod d1/d7/d10/d4f/dc/d1d/cad 0 2024-09-17T01:41:35.883 INFO:tasks.workunit.client.1.smithi167.stdout:4/780: stat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/dc3/ff5 0 2024-09-17T01:41:35.884 INFO:tasks.workunit.client.0.smithi082.stdout:7/447: symlink d0/d3/d36/d37/d71/l97 0 2024-09-17T01:41:35.887 INFO:tasks.workunit.client.0.smithi082.stdout:0/330: rmdir da/d1b/d23/d4d/d5d 39 2024-09-17T01:41:35.887 INFO:tasks.workunit.client.0.smithi082.stdout:0/331: chown da/d1e 26475669 1 2024-09-17T01:41:35.891 INFO:tasks.workunit.client.0.smithi082.stdout:3/334: creat d9/f6f x:0 0 0 2024-09-17T01:41:35.892 INFO:tasks.workunit.client.1.smithi167.stdout:6/942: creat d7/d52/d8c/d10d/f13c x:0 0 0 2024-09-17T01:41:35.895 INFO:tasks.workunit.client.1.smithi167.stdout:1/805: creat d0/d9/f109 x:0 0 0 2024-09-17T01:41:35.896 INFO:tasks.workunit.client.0.smithi082.stdout:7/448: unlink d0/d3/d36/f76 0 2024-09-17T01:41:35.897 INFO:tasks.workunit.client.0.smithi082.stdout:7/449: write d0/d3/d36/f6b [639770,116245] 0 2024-09-17T01:41:35.897 INFO:tasks.workunit.client.0.smithi082.stdout:0/332: mkdir da/d1b/d23/d42/d4b/d77 0 2024-09-17T01:41:35.898 INFO:tasks.workunit.client.0.smithi082.stdout:0/333: read - da/df/d2b/d59/f73 zero size 2024-09-17T01:41:35.900 INFO:tasks.workunit.client.0.smithi082.stdout:3/335: creat d9/db/d49/d4e/d53/d5b/f70 x:0 0 0 2024-09-17T01:41:35.903 INFO:tasks.workunit.client.0.smithi082.stdout:0/334: dread da/df/d71/f25 [0,4194304] 0 2024-09-17T01:41:35.903 INFO:tasks.workunit.client.0.smithi082.stdout:1/539: rmdir d2/d3f/d94 0 2024-09-17T01:41:35.905 INFO:tasks.workunit.client.0.smithi082.stdout:6/473: mkdir d1/d7/d10/d4f/d8e/da8/dae 0 2024-09-17T01:41:35.906 INFO:tasks.workunit.client.1.smithi167.stdout:2/788: fdatasync d5/d6d/f8f 0 2024-09-17T01:41:35.907 INFO:tasks.workunit.client.0.smithi082.stdout:6/474: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/f7d 1262442 0 2024-09-17T01:41:35.908 INFO:tasks.workunit.client.0.smithi082.stdout:6/475: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/l6d 129744577 1 2024-09-17T01:41:35.910 INFO:tasks.workunit.client.1.smithi167.stdout:5/745: mknod d0/d24/d93/d99/ce3 0 2024-09-17T01:41:35.910 INFO:tasks.workunit.client.0.smithi082.stdout:7/450: symlink d0/d3/d36/d37/l98 0 2024-09-17T01:41:35.912 INFO:tasks.workunit.client.1.smithi167.stdout:4/781: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f107 x:0 0 0 2024-09-17T01:41:35.915 INFO:tasks.workunit.client.1.smithi167.stdout:5/746: dwrite d0/d24/d2b/d49/d4b/dac/d3a/dd1/f60 [0,4194304] 0 2024-09-17T01:41:35.915 INFO:tasks.workunit.client.0.smithi082.stdout:9/396: write d4/d27/d2d/d60/d11/d39/d31/f40 [1673855,13575] 0 2024-09-17T01:41:35.916 INFO:tasks.workunit.client.0.smithi082.stdout:9/397: fdatasync d4/d27/d2d/d60/d11/d39/d44/f83 0 2024-09-17T01:41:35.917 INFO:tasks.workunit.client.1.smithi167.stdout:6/943: creat d7/d54/d90/d13/d2f/d96/dab/f13d x:0 0 0 2024-09-17T01:41:35.919 INFO:tasks.workunit.client.1.smithi167.stdout:8/896: mknod dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/c12e 0 2024-09-17T01:41:35.920 INFO:tasks.workunit.client.0.smithi082.stdout:6/476: truncate d1/d3/f1b 843313 0 2024-09-17T01:41:35.922 INFO:tasks.workunit.client.0.smithi082.stdout:6/477: write d1/d7/d10/d4f/d32/f9b [201839,30808] 0 2024-09-17T01:41:35.922 INFO:tasks.workunit.client.1.smithi167.stdout:1/806: creat d0/d9/d16/d48/de6/f10a x:0 0 0 2024-09-17T01:41:35.925 INFO:tasks.workunit.client.1.smithi167.stdout:9/855: symlink d4/d9/l10c 0 2024-09-17T01:41:35.928 INFO:tasks.workunit.client.1.smithi167.stdout:1/807: dwrite d0/d9/d16/d22/f66 [0,4194304] 0 2024-09-17T01:41:35.929 INFO:tasks.workunit.client.1.smithi167.stdout:7/748: link d0/d2/d14/d19/d7f/lc2 d0/d2/d14/d19/d32/d62/l103 0 2024-09-17T01:41:35.930 INFO:tasks.workunit.client.0.smithi082.stdout:6/478: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 [0,4194304] 0 2024-09-17T01:41:35.930 INFO:tasks.workunit.client.1.smithi167.stdout:7/749: readlink d0/d2/d14/d19/d32/d62/l6d 0 2024-09-17T01:41:35.932 INFO:tasks.workunit.client.0.smithi082.stdout:9/398: rename d4/d27/d36/f7f to d4/d27/d2d/d60/d11/d39/d29/d77/f84 0 2024-09-17T01:41:35.933 INFO:tasks.workunit.client.1.smithi167.stdout:9/856: dwrite d4/d9/d21/d2d/d33/d90/fb7 [0,4194304] 0 2024-09-17T01:41:35.936 INFO:tasks.workunit.client.1.smithi167.stdout:3/824: write d7/d8/d10/d14/d66/d6c/fa1 [348367,29868] 0 2024-09-17T01:41:35.948 INFO:tasks.workunit.client.0.smithi082.stdout:9/399: creat d4/d27/d2d/d3d/f85 x:0 0 0 2024-09-17T01:41:35.950 INFO:tasks.workunit.client.1.smithi167.stdout:5/747: rename d0/d24/d2b/d49/d4b/dac/d3a/dd1/f23 to d0/d24/d2b/d3d/d6d/de2/fe4 0 2024-09-17T01:41:35.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.955+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f54b4062630 con 0x7f54a0074b80 2024-09-17T01:41:35.953 INFO:tasks.workunit.client.1.smithi167.stdout:6/944: read d7/d54/d90/d13/d2f/d96/dab/fda [1881910,32275] 0 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.956+0000 7f54aaffd640 1 -- 172.21.15.82:0/3980990178 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7f54b4062630 con 0x7f54a0074b80 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:41:35.954 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:41:35.955 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:41:35.955 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-09-17T01:41:35.955 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:41:35.955 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:41:35.955 INFO:tasks.workunit.client.1.smithi167.stdout:8/897: creat dc/d21/d61/dea/f12f x:0 0 0 2024-09-17T01:41:35.955 INFO:tasks.workunit.client.1.smithi167.stdout:8/898: dread - dc/d56/d57/dc2/d100/f12b zero size 2024-09-17T01:41:35.956 INFO:tasks.workunit.client.1.smithi167.stdout:8/899: chown dc/d1a/l2b 0 1 2024-09-17T01:41:35.956 INFO:tasks.workunit.client.1.smithi167.stdout:1/808: rmdir d0/d9/d16/d22 39 2024-09-17T01:41:35.958 INFO:tasks.workunit.client.1.smithi167.stdout:6/945: read d7/d52/d79/da4/fce [4083375,30202] 0 2024-09-17T01:41:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 msgr2=0x7f54a0077040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 0x7f54a0077040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f54b00096c0 tx=0x7f54b000b040 comp rx=0 tx=0).stop 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 msgr2=0x7f54b4199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54a400b3d0 tx=0x7f54a400b890 comp rx=0 tx=0).stop 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 shutdown_connections 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f54a0074b80 0x7f54a0077040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54b4104d60 0x7f54b4199ab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 --2- 172.21.15.82:0/3980990178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54b4102430 0x7f54b4199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 >> 172.21.15.82:0/3980990178 conn(0x7f54b40fc010 msgr2=0x7f54b41006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 shutdown_connections 2024-09-17T01:41:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:35.960+0000 7f54bbd87640 1 -- 172.21.15.82:0/3980990178 wait complete. 2024-09-17T01:41:35.960 INFO:tasks.workunit.client.1.smithi167.stdout:6/946: stat d7/d54/d90/d34/dc8/cf2 0 2024-09-17T01:41:35.960 INFO:tasks.workunit.client.0.smithi082.stdout:6/479: getdents d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49 0 2024-09-17T01:41:35.960 INFO:tasks.workunit.client.0.smithi082.stdout:3/336: dwrite d9/db/d49/d4e/d53/d5b/f6c [0,4194304] 0 2024-09-17T01:41:35.961 INFO:tasks.workunit.client.1.smithi167.stdout:7/750: mkdir d0/d2/d14/d6f/d87/dae/d104 0 2024-09-17T01:41:35.962 INFO:tasks.workunit.client.1.smithi167.stdout:8/900: dwrite dc/d56/d57/d7e/f91 [4194304,4194304] 0 2024-09-17T01:41:35.963 INFO:tasks.workunit.client.0.smithi082.stdout:6/480: chown d1/d7/d10/d4f/dc/d2b 7769 1 2024-09-17T01:41:35.963 INFO:tasks.workunit.client.1.smithi167.stdout:9/857: rmdir d4/d9/d21/d2d/d33/d80 39 2024-09-17T01:41:35.964 INFO:tasks.workunit.client.0.smithi082.stdout:7/451: write d0/d3/f2b [622236,90427] 0 2024-09-17T01:41:35.965 INFO:tasks.workunit.client.0.smithi082.stdout:9/400: dwrite d4/d27/d2d/d3d/f47 [0,4194304] 0 2024-09-17T01:41:35.968 INFO:tasks.workunit.client.0.smithi082.stdout:7/452: readlink d0/d3/d36/d37/d71/l97 0 2024-09-17T01:41:35.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/337: rename d9/db/d26/d4f to d9/d35/d71 0 2024-09-17T01:41:35.972 INFO:tasks.workunit.client.0.smithi082.stdout:3/338: write d9/db/d49/d4e/f57 [3262464,96794] 0 2024-09-17T01:41:35.973 INFO:tasks.workunit.client.1.smithi167.stdout:3/825: symlink d7/d8/d2a/d4e/l114 0 2024-09-17T01:41:35.973 INFO:tasks.workunit.client.1.smithi167.stdout:0/775: creat d5/d6b/d77/d6d/d90/ffc x:0 0 0 2024-09-17T01:41:35.979 INFO:tasks.workunit.client.0.smithi082.stdout:9/401: dwrite d4/f5f [0,4194304] 0 2024-09-17T01:41:35.980 INFO:tasks.workunit.client.0.smithi082.stdout:6/481: rename d1/d7/d10/d4f/dc/d1d/f7c to d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55/faf 0 2024-09-17T01:41:35.984 INFO:tasks.workunit.client.0.smithi082.stdout:7/453: fdatasync d0/d3/db/d10/d47/f6c 0 2024-09-17T01:41:35.986 INFO:tasks.workunit.client.1.smithi167.stdout:1/809: creat d0/d5/dd7/d102/f10b x:0 0 0 2024-09-17T01:41:35.987 INFO:tasks.workunit.client.0.smithi082.stdout:6/482: dread d1/d3/f7b [0,4194304] 0 2024-09-17T01:41:35.987 INFO:tasks.workunit.client.0.smithi082.stdout:9/402: symlink d4/d27/d36/d3b/l86 0 2024-09-17T01:41:35.988 INFO:tasks.workunit.client.1.smithi167.stdout:6/947: rename d7/d52/c67 to d7/d52/d79/d109/c13e 0 2024-09-17T01:41:35.992 INFO:tasks.workunit.client.0.smithi082.stdout:7/454: rename d0/d3/db/f4f to d0/dd/d2c/d42/f99 0 2024-09-17T01:41:35.993 INFO:tasks.workunit.client.1.smithi167.stdout:3/826: mknod d7/d8/d2a/d4e/c115 0 2024-09-17T01:41:35.995 INFO:tasks.workunit.client.1.smithi167.stdout:3/827: read d7/d8/d10/d14/d24/f97 [1421578,50928] 0 2024-09-17T01:41:35.995 INFO:tasks.workunit.client.0.smithi082.stdout:7/455: read d0/d3/db/f2e [8386,11284] 0 2024-09-17T01:41:35.995 INFO:tasks.workunit.client.0.smithi082.stdout:3/339: creat d9/db/d49/d4e/f72 x:0 0 0 2024-09-17T01:41:35.996 INFO:tasks.workunit.client.1.smithi167.stdout:3/828: truncate d7/d8/d2a/d7a/f107 476317 0 2024-09-17T01:41:36.001 INFO:tasks.workunit.client.0.smithi082.stdout:7/456: mknod d0/d3/d36/d37/d71/c9a 0 2024-09-17T01:41:36.005 INFO:tasks.workunit.client.0.smithi082.stdout:3/340: rename d9/db/l36 to d9/db/d49/l73 0 2024-09-17T01:41:36.010 INFO:tasks.workunit.client.0.smithi082.stdout:9/403: dread d4/f49 [0,4194304] 0 2024-09-17T01:41:36.010 INFO:tasks.workunit.client.0.smithi082.stdout:7/457: rename d0/dd/d2c/d55/c6f to d0/dd/d2c/d42/d77/c9b 0 2024-09-17T01:41:36.014 INFO:tasks.workunit.client.0.smithi082.stdout:9/404: symlink d4/d27/d2d/l87 0 2024-09-17T01:41:36.017 INFO:tasks.workunit.client.0.smithi082.stdout:7/458: rename d0/d50/c7f to d0/d3/db/d10/d47/c9c 0 2024-09-17T01:41:36.018 INFO:tasks.workunit.client.0.smithi082.stdout:7/459: read d0/f13 [394287,55725] 0 2024-09-17T01:41:36.019 INFO:tasks.workunit.client.0.smithi082.stdout:3/341: dread d9/f4d [0,4194304] 0 2024-09-17T01:41:36.019 INFO:tasks.workunit.client.0.smithi082.stdout:3/342: read - d9/db/f3e zero size 2024-09-17T01:41:36.020 INFO:tasks.workunit.client.0.smithi082.stdout:9/405: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d88 0 2024-09-17T01:41:36.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/460: rename d0/f2f to d0/dd/d2c/d55/f9d 0 2024-09-17T01:41:36.026 INFO:tasks.workunit.client.0.smithi082.stdout:3/343: mknod d9/d35/d71/d69/c74 0 2024-09-17T01:41:36.027 INFO:tasks.workunit.client.0.smithi082.stdout:9/406: symlink d4/d27/d21/l89 0 2024-09-17T01:41:36.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/344: creat d9/d35/d71/f75 x:0 0 0 2024-09-17T01:41:36.032 INFO:tasks.workunit.client.0.smithi082.stdout:7/461: rename d0/d3/db/d10/d47/c85 to d0/c9e 0 2024-09-17T01:41:36.033 INFO:tasks.workunit.client.0.smithi082.stdout:3/345: truncate d9/db/d26/f31 442764 0 2024-09-17T01:41:36.034 INFO:tasks.workunit.client.0.smithi082.stdout:9/407: creat d4/d27/d2d/d60/d11/f8a x:0 0 0 2024-09-17T01:41:36.037 INFO:tasks.workunit.client.0.smithi082.stdout:3/346: chown d9/l2d 438 1 2024-09-17T01:41:36.041 INFO:tasks.workunit.client.0.smithi082.stdout:7/462: dwrite d0/d3/db/f2e [4194304,4194304] 0 2024-09-17T01:41:36.043 INFO:tasks.workunit.client.0.smithi082.stdout:7/463: write d0/d3/d36/d37/d71/f94 [347804,95801] 0 2024-09-17T01:41:36.046 INFO:tasks.workunit.client.0.smithi082.stdout:3/347: link d9/c1c d9/db/d49/c76 0 2024-09-17T01:41:36.047 INFO:tasks.workunit.client.0.smithi082.stdout:7/464: symlink d0/dd/d34/d58/d6e/d8a/l9f 0 2024-09-17T01:41:36.053 INFO:tasks.workunit.client.0.smithi082.stdout:7/465: truncate d0/dd/d2c/d54/f5a 232331 0 2024-09-17T01:41:36.060 INFO:tasks.workunit.client.0.smithi082.stdout:3/348: rename d9/l45 to d9/l77 0 2024-09-17T01:41:36.064 INFO:tasks.workunit.client.1.smithi167.stdout:7/751: creat d0/d2/ded/dfd/f105 x:0 0 0 2024-09-17T01:41:36.065 INFO:tasks.workunit.client.1.smithi167.stdout:7/752: fdatasync d0/d2/d14/d19/d26/ff 0 2024-09-17T01:41:36.066 INFO:tasks.workunit.client.0.smithi082.stdout:3/349: mkdir d9/d78 0 2024-09-17T01:41:36.069 INFO:tasks.workunit.client.1.smithi167.stdout:2/789: getdents d5/d3c/d4c/de2/d45/d8e/d98/dca 0 2024-09-17T01:41:36.071 INFO:tasks.workunit.client.1.smithi167.stdout:3/829: mkdir d7/d8f/d9b/d116 0 2024-09-17T01:41:36.072 INFO:tasks.workunit.client.1.smithi167.stdout:4/782: getdents d0/d4/db4 0 2024-09-17T01:41:36.075 INFO:tasks.workunit.client.0.smithi082.stdout:3/350: dwrite d9/d35/d71/f6e [0,4194304] 0 2024-09-17T01:41:36.076 INFO:tasks.workunit.client.1.smithi167.stdout:7/753: mknod d0/d2/d88/d6e/c106 0 2024-09-17T01:41:36.078 INFO:tasks.workunit.client.1.smithi167.stdout:9/858: creat d4/d9/d21/d2d/d33/f10d x:0 0 0 2024-09-17T01:41:36.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 -- 172.21.15.82:0/657608501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48101a60 msgr2=0x7f2a48101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 --2- 172.21.15.82:0/657608501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48101a60 0x7f2a48101ee0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009880 tx=0x7f2a3c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.082 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:35 smithi082 ceph-mon[28077]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 223 MiB/s wr, 383 op/s 2024-09-17T01:41:36.082 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2441302451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:41:36.082 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:35 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2945808717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 -- 172.21.15.82:0/657608501 shutdown_connections 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 --2- 172.21.15.82:0/657608501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48101a60 0x7f2a48101ee0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 --2- 172.21.15.82:0/657608501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48100860 0x7f2a48100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 -- 172.21.15.82:0/657608501 >> 172.21.15.82:0/657608501 conn(0x7f2a480fc010 msgr2=0x7f2a480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 -- 172.21.15.82:0/657608501 shutdown_connections 2024-09-17T01:41:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.084+0000 7f2a4cd04640 1 -- 172.21.15.82:0/657608501 wait complete. 2024-09-17T01:41:36.083 INFO:tasks.workunit.client.1.smithi167.stdout:5/748: getdents d0/d24/d2b/d3d/dd2 0 2024-09-17T01:41:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.085+0000 7f2a4cd04640 1 Processor -- start 2024-09-17T01:41:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4cd04640 1 -- start start 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4cd04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4cd04640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48101a60 0x7f2a48197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4cd04640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48109720 con 0x7f2a48100860 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4cd04640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481095a0 con 0x7f2a48101a60 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39192/0 (socket says 172.21.15.82:39192) 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.086+0000 7f2a4659c640 1 -- 172.21.15.82:0/2023397744 learned_addr learned my addr 172.21.15.82:0/2023397744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a4659c640 1 -- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48101a60 msgr2=0x7f2a48197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a4659c640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48101a60 0x7f2a48197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a4659c640 1 -- 172.21.15.82:0/2023397744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a48198180 con 0x7f2a48100860 2024-09-17T01:41:36.086 INFO:tasks.workunit.client.1.smithi167.stdout:5/749: read d0/f18 [6238996,16087] 0 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a4659c640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800b3d0 tx=0x7f2a3800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a38015020 con 0x7f2a48100860 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a38011af0 con 0x7f2a48100860 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.087+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a38010da0 con 0x7f2a48100860 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.088+0000 7f2a4cd04640 1 -- 172.21.15.82:0/2023397744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a48102ce0 con 0x7f2a48100860 2024-09-17T01:41:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.088+0000 7f2a4cd04640 1 -- 172.21.15.82:0/2023397744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481032f0 con 0x7f2a48100860 2024-09-17T01:41:36.087 INFO:tasks.workunit.client.0.smithi082.stdout:3/351: dwrite d9/db/f13 [4194304,4194304] 0 2024-09-17T01:41:36.088 INFO:tasks.workunit.client.0.smithi082.stdout:3/352: stat d9/db/d26/f3f 0 2024-09-17T01:41:36.088 INFO:tasks.workunit.client.1.smithi167.stdout:6/948: rename d7/d54/d90/d13/d2f/d30/f13b to d7/d54/d90/f13f 0 2024-09-17T01:41:36.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.090+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2c005290 con 0x7f2a48100860 2024-09-17T01:41:36.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.090+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f2a38018020 con 0x7f2a48100860 2024-09-17T01:41:36.089 INFO:tasks.workunit.client.1.smithi167.stdout:0/776: getdents d5/d8/d5c 0 2024-09-17T01:41:36.089 INFO:tasks.workunit.client.0.smithi082.stdout:3/353: write d9/db/d49/d4e/f57 [22731,34014] 0 2024-09-17T01:41:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.091+0000 7f2a377fe640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 0x7f2a30076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:41:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.092+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f2a38095d40 con 0x7f2a48100860 2024-09-17T01:41:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.092+0000 7f2a45d9b640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 0x7f2a30076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:41:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.094+0000 7f2a45d9b640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 0x7f2a30076f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0096c0 tx=0x7f2a3c000bc0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:41:36.092 INFO:tasks.workunit.client.1.smithi167.stdout:0/777: read d5/f83 [331318,3698] 0 2024-09-17T01:41:36.095 INFO:tasks.workunit.client.1.smithi167.stdout:0/778: write d5/d6b/d77/d6d/d90/dc4/dc7/fd3 [815572,108890] 0 2024-09-17T01:41:36.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.097+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f2a3801f020 con 0x7f2a48100860 2024-09-17T01:41:36.096 INFO:tasks.workunit.client.0.smithi082.stdout:3/354: mkdir d9/d35/d71/d69/d79 0 2024-09-17T01:41:36.096 INFO:tasks.workunit.client.1.smithi167.stdout:4/783: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/fd3 [0,4194304] 0 2024-09-17T01:41:36.097 INFO:tasks.workunit.client.1.smithi167.stdout:0/779: stat d5/d6b/d77/daa/ced 0 2024-09-17T01:41:36.098 INFO:tasks.workunit.client.0.smithi082.stdout:3/355: stat d9/d35 0 2024-09-17T01:41:36.098 INFO:tasks.workunit.client.1.smithi167.stdout:1/810: write d0/d5/d34/d83/fd5 [915408,51236] 0 2024-09-17T01:41:36.100 INFO:tasks.workunit.client.0.smithi082.stdout:7/466: dwrite d0/dd/f3d [0,4194304] 0 2024-09-17T01:41:36.103 INFO:tasks.workunit.client.0.smithi082.stdout:3/356: unlink d9/db/d49/l64 0 2024-09-17T01:41:36.108 INFO:tasks.workunit.client.1.smithi167.stdout:3/830: write d7/d8/d10/d14/d25/fbd [707575,39147] 0 2024-09-17T01:41:36.109 INFO:tasks.workunit.client.0.smithi082.stdout:7/467: truncate d0/d3/db/d10/f27 1272834 0 2024-09-17T01:41:36.109 INFO:tasks.workunit.client.1.smithi167.stdout:3/831: chown d7/d8/d10/d14/c45 229687 1 2024-09-17T01:41:36.110 INFO:tasks.workunit.client.0.smithi082.stdout:7/468: chown d0/dd/d34/d58/d6e 95320713 1 2024-09-17T01:41:36.110 INFO:tasks.workunit.client.1.smithi167.stdout:1/811: mkdir d0/d5/d34/d3c/d85/d10c 0 2024-09-17T01:41:36.111 INFO:tasks.workunit.client.0.smithi082.stdout:3/357: dwrite d9/db/d26/f3b [0,4194304] 0 2024-09-17T01:41:36.114 INFO:tasks.workunit.client.1.smithi167.stdout:0/780: dwrite d5/d6b/d77/d37/d45/fa1 [0,4194304] 0 2024-09-17T01:41:36.114 INFO:tasks.workunit.client.1.smithi167.stdout:7/754: rename d0/d2/d14/d23/f58 to d0/d2/d14/f107 0 2024-09-17T01:41:36.115 INFO:tasks.workunit.client.1.smithi167.stdout:6/949: link d7/d54/d90/d13/d2f/d64/d6b/fa0 d7/d52/d79/f140 0 2024-09-17T01:41:36.117 INFO:tasks.workunit.client.1.smithi167.stdout:6/950: truncate d7/d54/f11e 209829 0 2024-09-17T01:41:36.117 INFO:tasks.workunit.client.0.smithi082.stdout:3/358: unlink d9/db/d26/f52 0 2024-09-17T01:41:36.120 INFO:tasks.workunit.client.1.smithi167.stdout:9/859: rename d4/d9/f25 to d4/d9/d2b/f10e 0 2024-09-17T01:41:36.122 INFO:tasks.workunit.client.1.smithi167.stdout:0/781: truncate d5/d8/f96 854959 0 2024-09-17T01:41:36.123 INFO:tasks.workunit.client.1.smithi167.stdout:9/860: fdatasync d4/d9/d21/d2d/d33/d3a/d74/f89 0 2024-09-17T01:41:36.124 INFO:tasks.workunit.client.1.smithi167.stdout:4/784: creat d0/d4/d7/d6/f108 x:0 0 0 2024-09-17T01:41:36.125 INFO:tasks.workunit.client.1.smithi167.stdout:3/832: symlink d7/d8/d10/d14/d2c/d74/dbb/dfc/l117 0 2024-09-17T01:41:36.125 INFO:tasks.workunit.client.1.smithi167.stdout:0/782: truncate d5/d6b/d77/d6d/d90/dc4/dc7/fd3 1485454 0 2024-09-17T01:41:36.126 INFO:tasks.workunit.client.1.smithi167.stdout:6/951: mkdir d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/d141 0 2024-09-17T01:41:36.126 INFO:tasks.workunit.client.1.smithi167.stdout:7/755: mkdir d0/d2/d14/d19/d32/d108 0 2024-09-17T01:41:36.127 INFO:tasks.workunit.client.1.smithi167.stdout:5/750: rename d0/d24/d93/d99/ce3 to d0/d24/d2b/db1/ce5 0 2024-09-17T01:41:36.128 INFO:tasks.workunit.client.1.smithi167.stdout:9/861: mknod d4/d9/d21/d2d/d33/d3a/d74/c10f 0 2024-09-17T01:41:36.129 INFO:tasks.workunit.client.1.smithi167.stdout:4/785: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d109 0 2024-09-17T01:41:36.134 INFO:tasks.workunit.client.1.smithi167.stdout:5/751: dwrite d0/f19 [4194304,4194304] 0 2024-09-17T01:41:36.134 INFO:tasks.workunit.client.1.smithi167.stdout:7/756: fdatasync d0/f74 0 2024-09-17T01:41:36.138 INFO:tasks.workunit.client.1.smithi167.stdout:5/752: mkdir d0/d24/d2b/d3d/d6d/de6 0 2024-09-17T01:41:36.140 INFO:tasks.workunit.client.1.smithi167.stdout:5/753: truncate d0/d24/fab 13751 0 2024-09-17T01:41:36.143 INFO:tasks.workunit.client.1.smithi167.stdout:7/757: link d0/d2/d14/d19/d32/d62/lbd d0/d2/d14/d19/d32/d9c/l109 0 2024-09-17T01:41:36.146 INFO:tasks.workunit.client.1.smithi167.stdout:8/901: sync 2024-09-17T01:41:36.151 INFO:tasks.workunit.client.1.smithi167.stdout:0/783: dread d5/d6b/d77/daa/fad [0,4194304] 0 2024-09-17T01:41:36.151 INFO:tasks.workunit.client.1.smithi167.stdout:3/833: dread d7/d8/d10/d14/f8d [0,4194304] 0 2024-09-17T01:41:36.152 INFO:tasks.workunit.client.1.smithi167.stdout:8/902: rename dc/d56/lbb to dc/d56/d57/dc2/d100/l130 0 2024-09-17T01:41:36.152 INFO:tasks.workunit.client.1.smithi167.stdout:3/834: read - d7/d1e/f105 zero size 2024-09-17T01:41:36.153 INFO:tasks.workunit.client.1.smithi167.stdout:0/784: stat d5/d6b/d77/d6d/cd5 0 2024-09-17T01:41:36.154 INFO:tasks.workunit.client.1.smithi167.stdout:6/952: write d7/d54/d90/d13/f17 [4611184,78039] 0 2024-09-17T01:41:36.156 INFO:tasks.workunit.client.1.smithi167.stdout:3/835: chown d7/d8/d10/d14/d2c/d7f/f82 15 1 2024-09-17T01:41:36.158 INFO:tasks.workunit.client.1.smithi167.stdout:0/785: creat d5/d6b/d77/d4d/d56/d7b/ffd x:0 0 0 2024-09-17T01:41:36.159 INFO:tasks.workunit.client.1.smithi167.stdout:9/862: dread d4/d9/d21/d2d/d33/d3a/f67 [0,4194304] 0 2024-09-17T01:41:36.160 INFO:tasks.workunit.client.1.smithi167.stdout:6/953: mkdir d7/d54/d90/d13/d2f/d64/d142 0 2024-09-17T01:41:36.160 INFO:tasks.workunit.client.1.smithi167.stdout:3/836: rmdir d7/d8/d10/d14/d25/dc7/dd1/dc2/d112 39 2024-09-17T01:41:36.160 INFO:tasks.workunit.client.1.smithi167.stdout:8/903: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f131 x:0 0 0 2024-09-17T01:41:36.162 INFO:tasks.workunit.client.1.smithi167.stdout:5/754: dread d0/d9/f8c [0,4194304] 0 2024-09-17T01:41:36.162 INFO:tasks.workunit.client.1.smithi167.stdout:9/863: creat d4/d9/d21/df0/f110 x:0 0 0 2024-09-17T01:41:36.164 INFO:tasks.workunit.client.1.smithi167.stdout:0/786: getdents d5/d6b/d77/d37/d45 0 2024-09-17T01:41:36.166 INFO:tasks.workunit.client.1.smithi167.stdout:8/904: mkdir dc/d56/d59/d82/d132 0 2024-09-17T01:41:36.169 INFO:tasks.workunit.client.1.smithi167.stdout:0/787: creat d5/d6b/d7e/ffe x:0 0 0 2024-09-17T01:41:36.172 INFO:tasks.workunit.client.1.smithi167.stdout:8/905: creat dc/d21/d6b/f133 x:0 0 0 2024-09-17T01:41:36.176 INFO:tasks.workunit.client.1.smithi167.stdout:9/864: rename d4/d9/d21/d2d/d33/d105/l107 to d4/d9/d21/d2d/de4/l111 0 2024-09-17T01:41:36.177 INFO:tasks.workunit.client.1.smithi167.stdout:7/758: dread d0/d2/d88/d6e/f71 [0,4194304] 0 2024-09-17T01:41:36.177 INFO:tasks.workunit.client.1.smithi167.stdout:0/788: mknod d5/d6b/d77/daa/db1/cff 0 2024-09-17T01:41:36.177 INFO:tasks.workunit.client.1.smithi167.stdout:6/954: dwrite d7/d54/d90/d13/d2f/d7f/d98/d27/f114 [0,4194304] 0 2024-09-17T01:41:36.177 INFO:tasks.workunit.client.1.smithi167.stdout:5/755: dwrite d0/d24/d2b/d3d/dd2/fdf [0,4194304] 0 2024-09-17T01:41:36.179 INFO:tasks.workunit.client.1.smithi167.stdout:7/759: dread - d0/d2/d14/d19/d22/d40/fe9 zero size 2024-09-17T01:41:36.181 INFO:tasks.workunit.client.1.smithi167.stdout:3/837: dread d7/d8/d10/d29/fa5 [0,4194304] 0 2024-09-17T01:41:36.181 INFO:tasks.workunit.client.1.smithi167.stdout:6/955: write d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f73 [3632656,68317] 0 2024-09-17T01:41:36.182 INFO:tasks.workunit.client.1.smithi167.stdout:8/906: rename dc/d21/d61 to dc/d56/d59/d82/d8f/de5/dba/d134 0 2024-09-17T01:41:36.183 INFO:tasks.workunit.client.1.smithi167.stdout:6/956: write d7/d54/d90/d13/d2f/d64/d6b/ffe [2749339,35648] 0 2024-09-17T01:41:36.186 INFO:tasks.workunit.client.1.smithi167.stdout:7/760: creat d0/d2/d88/d6e/da3/f10a x:0 0 0 2024-09-17T01:41:36.189 INFO:tasks.workunit.client.1.smithi167.stdout:3/838: rmdir d7/d8/d10/d14/d24/d9c 39 2024-09-17T01:41:36.190 INFO:tasks.workunit.client.1.smithi167.stdout:0/789: rename d5/lb2 to d5/d8/d9/d2f/l100 0 2024-09-17T01:41:36.191 INFO:tasks.workunit.client.1.smithi167.stdout:0/790: chown d5/d6b/c60 491 1 2024-09-17T01:41:36.191 INFO:tasks.workunit.client.1.smithi167.stdout:8/907: symlink dc/d56/d57/d7e/l135 0 2024-09-17T01:41:36.193 INFO:tasks.workunit.client.1.smithi167.stdout:8/908: write dc/d56/d59/d65/fa9 [5570821,72115] 0 2024-09-17T01:41:36.193 INFO:tasks.workunit.client.1.smithi167.stdout:7/761: fdatasync d0/d2/f9d 0 2024-09-17T01:41:36.208 INFO:tasks.workunit.client.0.smithi082.stdout:7/469: dread d0/d3/d36/d37/d71/f7b [0,4194304] 0 2024-09-17T01:41:36.212 INFO:tasks.workunit.client.0.smithi082.stdout:7/470: dread d0/d3/db/d10/d3f/f5d [0,4194304] 0 2024-09-17T01:41:36.216 INFO:tasks.workunit.client.0.smithi082.stdout:7/471: dread d0/dd/d2c/f89 [0,4194304] 0 2024-09-17T01:41:36.217 INFO:tasks.workunit.client.0.smithi082.stdout:7/472: creat d0/d3/db/d10/fa0 x:0 0 0 2024-09-17T01:41:36.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/473: write d0/d3/db/d10/d47/f5c [2483319,61462] 0 2024-09-17T01:41:36.220 INFO:tasks.workunit.client.0.smithi082.stdout:7/474: write d0/dd/f1f [2776801,129729] 0 2024-09-17T01:41:36.222 INFO:tasks.workunit.client.0.smithi082.stdout:7/475: write d0/dd/d2c/d42/f99 [971418,606] 0 2024-09-17T01:41:36.223 INFO:tasks.workunit.client.1.smithi167.stdout:7/762: chown d0/d2/d88/d6e/dd8 3 1 2024-09-17T01:41:36.224 INFO:tasks.workunit.client.1.smithi167.stdout:5/756: truncate d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae 1186137 0 2024-09-17T01:41:36.224 INFO:tasks.workunit.client.0.smithi082.stdout:7/476: creat d0/d3/db/d10/d47/fa1 x:0 0 0 2024-09-17T01:41:36.225 INFO:tasks.workunit.client.1.smithi167.stdout:8/909: creat dc/d56/d57/dc2/d100/d103/f136 x:0 0 0 2024-09-17T01:41:36.226 INFO:tasks.workunit.client.0.smithi082.stdout:7/477: write d0/d3/db/d10/d47/fa1 [566595,3662] 0 2024-09-17T01:41:36.227 INFO:tasks.workunit.client.1.smithi167.stdout:0/791: rename d5/d6b/d77/d4d/d56/l87 to d5/d6b/d77/d4d/l101 0 2024-09-17T01:41:36.228 INFO:tasks.workunit.client.0.smithi082.stdout:7/478: unlink d0/d3/c28 0 2024-09-17T01:41:36.229 INFO:tasks.workunit.client.1.smithi167.stdout:9/865: dwrite d4/d9/d21/d2d/d33/d90/dac/f68 [0,4194304] 0 2024-09-17T01:41:36.230 INFO:tasks.workunit.client.1.smithi167.stdout:8/910: fsync dc/d56/d57/ff0 0 2024-09-17T01:41:36.231 INFO:tasks.workunit.client.1.smithi167.stdout:7/763: mkdir d0/d2/d14/d19/d32/d10b 0 2024-09-17T01:41:36.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/479: dread d0/dd/d2c/d54/f5a [0,4194304] 0 2024-09-17T01:41:36.233 INFO:tasks.workunit.client.1.smithi167.stdout:3/839: rename d7/d8/d10/d14/d25/dc7/dd1/dc2/d112/dc3 to d7/d8/d10/d14/d25/dfe/d118 0 2024-09-17T01:41:36.235 INFO:tasks.workunit.client.1.smithi167.stdout:5/757: truncate d0/d24/f35 1185758 0 2024-09-17T01:41:36.237 INFO:tasks.workunit.client.0.smithi082.stdout:7/480: truncate d0/f13 1610339 0 2024-09-17T01:41:36.243 INFO:tasks.workunit.client.0.smithi082.stdout:7/481: read d0/dd/d2c/d55/f9d [111458,66074] 0 2024-09-17T01:41:36.246 INFO:tasks.workunit.client.1.smithi167.stdout:7/764: rmdir d0/d2/d14/d19/d32/d62 39 2024-09-17T01:41:36.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/840: rename d7/d8/d2a to d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119 0 2024-09-17T01:41:36.250 INFO:tasks.workunit.client.0.smithi082.stdout:7/482: creat d0/dd/fa2 x:0 0 0 2024-09-17T01:41:36.252 INFO:tasks.workunit.client.1.smithi167.stdout:9/866: mkdir d4/d9/d21/d43/dc4/d103/d112 0 2024-09-17T01:41:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:35 smithi167 ceph-mon[35643]: pgmap v21: 65 pgs: 65 active+clean; 2.0 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 223 MiB/s wr, 383 op/s 2024-09-17T01:41:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2441302451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:41:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:35 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2945808717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:41:36.255 INFO:tasks.workunit.client.1.smithi167.stdout:7/765: dread - d0/d2/d14/d19/d26/d83/da5/d5b/f9f zero size 2024-09-17T01:41:36.256 INFO:tasks.workunit.client.1.smithi167.stdout:3/841: creat d7/d8/d10/d14/d2c/d74/dbb/dfb/dc8/f11a x:0 0 0 2024-09-17T01:41:36.257 INFO:tasks.workunit.client.1.smithi167.stdout:2/790: sync 2024-09-17T01:41:36.257 INFO:tasks.workunit.client.0.smithi082.stdout:7/483: rename d0/dd/d34/c53 to d0/d3/d36/d37/d86/ca3 0 2024-09-17T01:41:36.258 INFO:tasks.workunit.client.1.smithi167.stdout:0/792: dread d5/d8/d9/d2f/fa6 [0,4194304] 0 2024-09-17T01:41:36.259 INFO:tasks.workunit.client.0.smithi082.stdout:7/484: fdatasync d0/dd/d2c/f40 0 2024-09-17T01:41:36.261 INFO:tasks.workunit.client.0.smithi082.stdout:7/485: write d0/d3/db/f18 [3147814,9645] 0 2024-09-17T01:41:36.262 INFO:tasks.workunit.client.0.smithi082.stdout:7/486: stat d0/d50/l70 0 2024-09-17T01:41:36.263 INFO:tasks.workunit.client.1.smithi167.stdout:3/842: mkdir d7/d8/d10/d14/d2c/d74/d11b 0 2024-09-17T01:41:36.263 INFO:tasks.workunit.client.0.smithi082.stdout:7/487: write d0/dd/f3d [5061389,40766] 0 2024-09-17T01:41:36.265 INFO:tasks.workunit.client.1.smithi167.stdout:8/911: getdents dc/d56/d59/d82/d85 0 2024-09-17T01:41:36.268 INFO:tasks.workunit.client.1.smithi167.stdout:0/793: dwrite d5/d8/fc2 [0,4194304] 0 2024-09-17T01:41:36.268 INFO:tasks.workunit.client.0.smithi082.stdout:7/488: creat d0/d62/d7e/fa4 x:0 0 0 2024-09-17T01:41:36.270 INFO:tasks.workunit.client.0.smithi082.stdout:7/489: read - d0/d3/db/f83 zero size 2024-09-17T01:41:36.273 INFO:tasks.workunit.client.1.smithi167.stdout:7/766: fsync d0/f61 0 2024-09-17T01:41:36.274 INFO:tasks.workunit.client.1.smithi167.stdout:5/758: getdents d0/d24/d2b/d49 0 2024-09-17T01:41:36.277 INFO:tasks.workunit.client.0.smithi082.stdout:7/490: rename d0/d3/d36/d37/d71/c9a to d0/dd/ca5 0 2024-09-17T01:41:36.279 INFO:tasks.workunit.client.1.smithi167.stdout:3/843: read - d7/d8/d10/d14/d24/d9c/da3/ffd zero size 2024-09-17T01:41:36.280 INFO:tasks.workunit.client.1.smithi167.stdout:5/759: dwrite d0/d24/d2b/d49/d4b/fcd [0,4194304] 0 2024-09-17T01:41:36.294 INFO:tasks.workunit.client.0.smithi082.stdout:7/491: write d0/dd/f17 [320534,68629] 0 2024-09-17T01:41:36.296 INFO:tasks.workunit.client.0.smithi082.stdout:7/492: chown d0/dd/c1a 133357 1 2024-09-17T01:41:36.296 INFO:tasks.workunit.client.0.smithi082.stdout:7/493: dread - d0/d62/d7e/fa4 zero size 2024-09-17T01:41:36.299 INFO:tasks.workunit.client.1.smithi167.stdout:2/791: unlink d5/d33/d48/d72/d94/de3/cfc 0 2024-09-17T01:41:36.300 INFO:tasks.workunit.client.1.smithi167.stdout:9/867: write d4/d9/d21/d2d/d33/d90/dac/f82 [2379421,59286] 0 2024-09-17T01:41:36.301 INFO:tasks.workunit.client.1.smithi167.stdout:0/794: write d5/d6b/d77/d37/f65 [2175089,126397] 0 2024-09-17T01:41:36.302 INFO:tasks.workunit.client.1.smithi167.stdout:3/844: write d7/d8/d10/d14/d24/d62/f69 [578693,87985] 0 2024-09-17T01:41:36.303 INFO:tasks.workunit.client.1.smithi167.stdout:5/760: creat d0/d24/d2b/d49/d4b/dac/d80/fe7 x:0 0 0 2024-09-17T01:41:36.303 INFO:tasks.workunit.client.1.smithi167.stdout:9/868: dread - d4/da4/dfe/f102 zero size 2024-09-17T01:41:36.304 INFO:tasks.workunit.client.1.smithi167.stdout:2/792: creat d5/d3c/d4c/d4d/d91/f110 x:0 0 0 2024-09-17T01:41:36.306 INFO:tasks.workunit.client.1.smithi167.stdout:0/795: creat d5/d6b/d77/d6d/f102 x:0 0 0 2024-09-17T01:41:36.308 INFO:tasks.workunit.client.1.smithi167.stdout:9/869: fdatasync d4/d9/d21/d2d/d33/d80/fcf 0 2024-09-17T01:41:36.309 INFO:tasks.workunit.client.1.smithi167.stdout:3/845: dread - d7/d8/d10/d14/d25/dc7/dd1/dc2/fd8 zero size 2024-09-17T01:41:36.310 INFO:tasks.workunit.client.1.smithi167.stdout:0/796: mkdir d5/dee/d103 0 2024-09-17T01:41:36.311 INFO:tasks.workunit.client.1.smithi167.stdout:2/793: dread - d5/d3c/d4c/de2/db8/da3/db0/ffd zero size 2024-09-17T01:41:36.311 INFO:tasks.workunit.client.1.smithi167.stdout:8/912: dwrite dc/d56/d59/d82/d85/f94 [0,4194304] 0 2024-09-17T01:41:36.314 INFO:tasks.workunit.client.1.smithi167.stdout:9/870: fsync d4/d9/d21/f2f 0 2024-09-17T01:41:36.317 INFO:tasks.workunit.client.1.smithi167.stdout:5/761: dread d0/d24/d2b/d49/d4b/dac/d3a/dd1/f60 [0,4194304] 0 2024-09-17T01:41:36.318 INFO:tasks.workunit.client.1.smithi167.stdout:0/797: creat d5/d6b/d77/d6d/d90/dc4/f104 x:0 0 0 2024-09-17T01:41:36.321 INFO:tasks.workunit.client.1.smithi167.stdout:5/762: stat d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad 0 2024-09-17T01:41:36.323 INFO:tasks.workunit.client.1.smithi167.stdout:0/798: mknod d5/d8/d9/d2f/d9b/c105 0 2024-09-17T01:41:36.325 INFO:tasks.workunit.client.1.smithi167.stdout:3/846: dwrite d7/d8/d10/d14/f53 [0,4194304] 0 2024-09-17T01:41:36.333 INFO:tasks.workunit.client.1.smithi167.stdout:0/799: symlink d5/d6b/d77/d37/d80/l106 0 2024-09-17T01:41:36.335 INFO:tasks.workunit.client.1.smithi167.stdout:2/794: dwrite d5/d3c/d4c/de2/db8/da3/db0/ffd [0,4194304] 0 2024-09-17T01:41:36.338 INFO:tasks.workunit.client.1.smithi167.stdout:8/913: dwrite dc/d56/d59/d65/fb4 [0,4194304] 0 2024-09-17T01:41:36.341 INFO:tasks.workunit.client.1.smithi167.stdout:9/871: dwrite d4/da4/fbe [0,4194304] 0 2024-09-17T01:41:36.343 INFO:tasks.workunit.client.1.smithi167.stdout:8/914: dread - dc/d56/d59/d82/d8f/de5/dba/d134/fe9 zero size 2024-09-17T01:41:36.345 INFO:tasks.workunit.client.1.smithi167.stdout:3/847: truncate d7/d8/d10/d29/d75/f86 1155463 0 2024-09-17T01:41:36.345 INFO:tasks.workunit.client.1.smithi167.stdout:0/800: creat d5/d6b/d77/d6d/d90/dc4/f107 x:0 0 0 2024-09-17T01:41:36.347 INFO:tasks.workunit.client.1.smithi167.stdout:0/801: readlink d5/d6b/d77/d4d/d56/lb0 0 2024-09-17T01:41:36.349 INFO:tasks.workunit.client.1.smithi167.stdout:8/915: fsync dc/f29 0 2024-09-17T01:41:36.352 INFO:tasks.workunit.client.1.smithi167.stdout:0/802: mkdir d5/d6b/d77/d4d/d56/d108 0 2024-09-17T01:41:36.354 INFO:tasks.workunit.client.1.smithi167.stdout:2/795: dread d5/d3c/d4c/d4d/fc9 [0,4194304] 0 2024-09-17T01:41:36.355 INFO:tasks.workunit.client.1.smithi167.stdout:1/812: sync 2024-09-17T01:41:36.355 INFO:tasks.workunit.client.1.smithi167.stdout:4/786: sync 2024-09-17T01:41:36.355 INFO:tasks.workunit.client.1.smithi167.stdout:0/803: mknod d5/d8/d5c/c109 0 2024-09-17T01:41:36.357 INFO:tasks.workunit.client.1.smithi167.stdout:8/916: fsync dc/d56/d57/f8a 0 2024-09-17T01:41:36.358 INFO:tasks.workunit.client.1.smithi167.stdout:3/848: dread d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f67 [0,4194304] 0 2024-09-17T01:41:36.359 INFO:tasks.workunit.client.1.smithi167.stdout:0/804: read - d5/d6b/d77/d6d/f102 zero size 2024-09-17T01:41:36.359 INFO:tasks.workunit.client.1.smithi167.stdout:1/813: write d0/d5/d34/d6d/fba [4961685,97112] 0 2024-09-17T01:41:36.360 INFO:tasks.workunit.client.1.smithi167.stdout:4/787: creat d0/d4/d7/da/d48/f10a x:0 0 0 2024-09-17T01:41:36.360 INFO:tasks.workunit.client.1.smithi167.stdout:5/763: dread d0/d9/fb [0,4194304] 0 2024-09-17T01:41:36.361 INFO:tasks.workunit.client.1.smithi167.stdout:8/917: symlink dc/d21/d11d/l137 0 2024-09-17T01:41:36.363 INFO:tasks.workunit.client.1.smithi167.stdout:1/814: stat d0/d9/d16/d48/d54/d6f 0 2024-09-17T01:41:36.364 INFO:tasks.workunit.client.1.smithi167.stdout:0/805: chown d5/d6b/d77/d37/d80/fbd 356 1 2024-09-17T01:41:36.366 INFO:tasks.workunit.client.1.smithi167.stdout:5/764: unlink d0/d24/d93/d99/lc8 0 2024-09-17T01:41:36.367 INFO:tasks.workunit.client.1.smithi167.stdout:4/788: mknod d0/d4/d7/d6/d2b/d6d/d7e/c10b 0 2024-09-17T01:41:36.367 INFO:tasks.workunit.client.1.smithi167.stdout:2/796: dwrite d5/d3c/d4c/d4d/fac [0,4194304] 0 2024-09-17T01:41:36.369 INFO:tasks.workunit.client.1.smithi167.stdout:8/918: symlink dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/l138 0 2024-09-17T01:41:36.370 INFO:tasks.workunit.client.1.smithi167.stdout:0/806: stat d5/d6b/d77/d4d/d56/cd8 0 2024-09-17T01:41:36.371 INFO:tasks.workunit.client.1.smithi167.stdout:4/789: chown d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51/d2d/d2e/d31/d75/dfb 913360545 1 2024-09-17T01:41:36.373 INFO:tasks.workunit.client.1.smithi167.stdout:1/815: symlink d0/d5/d34/d3c/d85/df6/l10d 0 2024-09-17T01:41:36.374 INFO:tasks.workunit.client.1.smithi167.stdout:0/807: fdatasync d5/d8/fc2 0 2024-09-17T01:41:36.375 INFO:tasks.workunit.client.1.smithi167.stdout:5/765: creat d0/d24/d2b/d3d/d6d/de2/fe8 x:0 0 0 2024-09-17T01:41:36.380 INFO:tasks.workunit.client.1.smithi167.stdout:2/797: dwrite d5/d3c/d4c/de2/fe6 [0,4194304] 0 2024-09-17T01:41:36.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/919: unlink dc/d56/d57/dc2/cfa 0 2024-09-17T01:41:36.381 INFO:tasks.workunit.client.1.smithi167.stdout:8/920: dread - dc/d56/f12a zero size 2024-09-17T01:41:36.381 INFO:tasks.workunit.client.1.smithi167.stdout:1/816: symlink d0/l10e 0 2024-09-17T01:41:36.381 INFO:tasks.workunit.client.1.smithi167.stdout:3/849: link d7/d8/d10/d14/d25/dc7/dd1/dc2/fc5 d7/d8/d1f/f11c 0 2024-09-17T01:41:36.385 INFO:tasks.workunit.client.1.smithi167.stdout:4/790: dwrite d0/d4/d69/fd7 [12582912,4194304] 0 2024-09-17T01:41:36.386 INFO:tasks.workunit.client.1.smithi167.stdout:0/808: rename d5/d94 to d5/d6b/d77/d37/d45/da9/d10a 0 2024-09-17T01:41:36.388 INFO:tasks.workunit.client.1.smithi167.stdout:8/921: readlink dc/d56/d59/d82/d85/ld2 0 2024-09-17T01:41:36.388 INFO:tasks.workunit.client.1.smithi167.stdout:0/809: dread d5/d6b/d77/daa/fc9 [0,4194304] 0 2024-09-17T01:41:36.390 INFO:tasks.workunit.client.1.smithi167.stdout:1/817: symlink d0/d5/d34/d3c/d85/db5/l10f 0 2024-09-17T01:41:36.391 INFO:tasks.workunit.client.1.smithi167.stdout:3/850: mkdir d7/d8/d10/d14/d24/d62/d11d 0 2024-09-17T01:41:36.392 INFO:tasks.workunit.client.1.smithi167.stdout:5/766: symlink d0/le9 0 2024-09-17T01:41:36.393 INFO:tasks.workunit.client.1.smithi167.stdout:5/767: fdatasync d0/d24/fab 0 2024-09-17T01:41:36.395 INFO:tasks.workunit.client.1.smithi167.stdout:4/791: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8/f10c x:0 0 0 2024-09-17T01:41:36.398 INFO:tasks.workunit.client.1.smithi167.stdout:8/922: creat dc/d56/d59/d82/d8f/de5/f139 x:0 0 0 2024-09-17T01:41:36.400 INFO:tasks.workunit.client.1.smithi167.stdout:4/792: dread d0/d4/d7/da/f2c [4194304,4194304] 0 2024-09-17T01:41:36.403 INFO:tasks.workunit.client.1.smithi167.stdout:1/818: creat d0/d9/d16/d48/d54/f110 x:0 0 0 2024-09-17T01:41:36.405 INFO:tasks.workunit.client.1.smithi167.stdout:1/819: stat d0/d5/dd7/d102/f10b 0 2024-09-17T01:41:36.405 INFO:tasks.workunit.client.1.smithi167.stdout:5/768: dwrite d0/d24/d2b/fa9 [0,4194304] 0 2024-09-17T01:41:36.407 INFO:tasks.workunit.client.1.smithi167.stdout:3/851: link d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f58 d7/d8/d10/d29/f11e 0 2024-09-17T01:41:36.410 INFO:tasks.workunit.client.1.smithi167.stdout:5/769: chown d0/d24/l2e 2572317 1 2024-09-17T01:41:36.411 INFO:tasks.workunit.client.1.smithi167.stdout:4/793: rename d0/d4/d7/da/f105 to d0/d4/d7/d6/d2b/d6d/f10d 0 2024-09-17T01:41:36.412 INFO:tasks.workunit.client.1.smithi167.stdout:1/820: creat d0/dfc/f111 x:0 0 0 2024-09-17T01:41:36.413 INFO:tasks.workunit.client.1.smithi167.stdout:0/810: write d5/d6b/d77/d4d/f40 [591654,90900] 0 2024-09-17T01:41:36.413 INFO:tasks.workunit.client.1.smithi167.stdout:4/794: dread d0/d4/d7/d10/f3f [0,4194304] 0 2024-09-17T01:41:36.413 INFO:tasks.workunit.client.1.smithi167.stdout:3/852: symlink d7/d8/d10/d14/d66/d6c/dab/dcf/l11f 0 2024-09-17T01:41:36.415 INFO:tasks.workunit.client.1.smithi167.stdout:8/923: write dc/d56/d57/dc2/fd6 [1602446,56406] 0 2024-09-17T01:41:36.416 INFO:tasks.workunit.client.1.smithi167.stdout:5/770: mknod d0/d24/d2b/d3d/dd2/dc4/cea 0 2024-09-17T01:41:36.417 INFO:tasks.workunit.client.1.smithi167.stdout:2/798: dread d5/d71/fae [0,4194304] 0 2024-09-17T01:41:36.418 INFO:tasks.workunit.client.1.smithi167.stdout:1/821: rename d0/d5/d34/d3c to d0/d5/d34/d83/d112 0 2024-09-17T01:41:36.419 INFO:tasks.workunit.client.1.smithi167.stdout:2/799: readlink d5/d3c/d4c/de2/db8/lf1 0 2024-09-17T01:41:36.419 INFO:tasks.workunit.client.1.smithi167.stdout:8/924: mkdir dc/d21/d13a 0 2024-09-17T01:41:36.420 INFO:tasks.workunit.client.1.smithi167.stdout:0/811: mkdir d5/d6b/d77/d4d/dfa/d10b 0 2024-09-17T01:41:36.422 INFO:tasks.workunit.client.1.smithi167.stdout:1/822: stat d0/d5/d34/d83/d112/c45 0 2024-09-17T01:41:36.423 INFO:tasks.workunit.client.1.smithi167.stdout:6/957: sync 2024-09-17T01:41:36.424 INFO:tasks.workunit.client.1.smithi167.stdout:2/800: creat d5/d33/d48/d72/f111 x:0 0 0 2024-09-17T01:41:36.426 INFO:tasks.workunit.client.1.smithi167.stdout:3/853: rename d7/d8/d10/d14/d2c/d74/dbb/dfb/dc8 to d7/d8/d10/d29/d120 0 2024-09-17T01:41:36.427 INFO:tasks.workunit.client.1.smithi167.stdout:8/925: chown dc/d56/d59/d82/d8f/de5/dba/dd3/c11b 208864 1 2024-09-17T01:41:36.428 INFO:tasks.workunit.client.1.smithi167.stdout:1/823: dread - d0/d5/d61/da2/fb4 zero size 2024-09-17T01:41:36.429 INFO:tasks.workunit.client.1.smithi167.stdout:4/795: write d0/d4/d7/d6/d2b/f7d [4826793,101826] 0 2024-09-17T01:41:36.429 INFO:tasks.workunit.client.1.smithi167.stdout:5/771: dwrite d0/d24/d2b/d49/d4b/dac/d3a/dd1/f60 [0,4194304] 0 2024-09-17T01:41:36.430 INFO:tasks.workunit.client.1.smithi167.stdout:2/801: write d5/d3c/d4c/d4d/fac [3331296,126283] 0 2024-09-17T01:41:36.434 INFO:tasks.workunit.client.1.smithi167.stdout:0/812: dwrite d5/d6b/d77/d6d/f102 [0,4194304] 0 2024-09-17T01:41:36.435 INFO:tasks.workunit.client.1.smithi167.stdout:6/958: rename d7/fae to d7/d54/d90/d13/d2f/d96/f143 0 2024-09-17T01:41:36.438 INFO:tasks.workunit.client.1.smithi167.stdout:4/796: fsync d0/d4/d69/fbb 0 2024-09-17T01:41:36.438 INFO:tasks.workunit.client.1.smithi167.stdout:0/813: fsync d5/d6b/d77/f66 0 2024-09-17T01:41:36.440 INFO:tasks.workunit.client.1.smithi167.stdout:1/824: write d0/d5/d34/fa7 [673034,28009] 0 2024-09-17T01:41:36.441 INFO:tasks.workunit.client.1.smithi167.stdout:6/959: write d7/d54/d90/d13/f99 [4084238,88847] 0 2024-09-17T01:41:36.442 INFO:tasks.workunit.client.1.smithi167.stdout:8/926: creat dc/d56/d59/d82/d132/f13b x:0 0 0 2024-09-17T01:41:36.442 INFO:tasks.workunit.client.1.smithi167.stdout:3/854: creat d7/d8/d10/d14/d24/d62/d11d/f121 x:0 0 0 2024-09-17T01:41:36.444 INFO:tasks.workunit.client.1.smithi167.stdout:8/927: stat dc/dae/f11c 0 2024-09-17T01:41:36.447 INFO:tasks.workunit.client.1.smithi167.stdout:4/797: fsync d0/d4/d7/d6/d2b/d6d/f97 0 2024-09-17T01:41:36.450 INFO:tasks.workunit.client.1.smithi167.stdout:1/825: link d0/f2e d0/d9/d16/d48/d54/d78/d90/f113 0 2024-09-17T01:41:36.451 INFO:tasks.workunit.client.1.smithi167.stdout:7/767: sync 2024-09-17T01:41:36.451 INFO:tasks.workunit.client.1.smithi167.stdout:9/872: sync 2024-09-17T01:41:36.452 INFO:tasks.workunit.client.1.smithi167.stdout:8/928: chown dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/c117 20 1 2024-09-17T01:41:36.457 INFO:tasks.workunit.client.1.smithi167.stdout:1/826: dread - d0/d9/d16/d36/ff8 zero size 2024-09-17T01:41:36.457 INFO:tasks.workunit.client.1.smithi167.stdout:0/814: dwrite d5/d6b/d77/d37/d45/da9/ff7 [0,4194304] 0 2024-09-17T01:41:36.460 INFO:tasks.workunit.client.1.smithi167.stdout:6/960: dwrite d7/d54/d90/d34/f51 [0,4194304] 0 2024-09-17T01:41:36.465 INFO:tasks.workunit.client.1.smithi167.stdout:7/768: mknod d0/d2/d14/d19/d32/d9c/c10c 0 2024-09-17T01:41:36.465 INFO:tasks.workunit.client.1.smithi167.stdout:3/855: dwrite d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/f2e [0,4194304] 0 2024-09-17T01:41:36.465 INFO:tasks.workunit.client.1.smithi167.stdout:9/873: rename d4/d9/d21/f2f to d4/d9/d97/dd6/f113 0 2024-09-17T01:41:36.469 INFO:tasks.workunit.client.1.smithi167.stdout:9/874: chown d4/l93 6521 1 2024-09-17T01:41:36.471 INFO:tasks.workunit.client.1.smithi167.stdout:8/929: creat dc/d56/d59/d82/d8f/de5/dba/d134/dea/d110/f13c x:0 0 0 2024-09-17T01:41:36.471 INFO:tasks.workunit.client.1.smithi167.stdout:1/827: truncate d0/dfc/f111 760240 0 2024-09-17T01:41:36.473 INFO:tasks.workunit.client.1.smithi167.stdout:0/815: creat d5/d6b/d77/d92/f10c x:0 0 0 2024-09-17T01:41:36.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.476+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2a2c005850 con 0x7f2a48100860 2024-09-17T01:41:36.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.477+0000 7f2a377fe640 1 -- 172.21.15.82:0/2023397744 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f2a380623d0 con 0x7f2a48100860 2024-09-17T01:41:36.475 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:41:36.475 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:41:36.475 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:41:36.476 INFO:tasks.workunit.client.1.smithi167.stdout:2/802: dwrite d5/d3c/d4c/de2/d2e/f8c [0,4194304] 0 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 msgr2=0x7f2a30076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 0x7f2a30076f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0096c0 tx=0x7f2a3c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 msgr2=0x7f2a481975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800b3d0 tx=0x7f2a3800b890 comp rx=0 tx=0).stop 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 shutdown_connections 2024-09-17T01:41:36.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48101a60 0x7f2a48197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f2a30074ab0 0x7f2a30076f70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 --2- 172.21.15.82:0/2023397744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a48100860 0x7f2a481975c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:41:36.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 >> 172.21.15.82:0/2023397744 conn(0x7f2a480fc010 msgr2=0x7f2a48069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:41:36.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 shutdown_connections 2024-09-17T01:41:36.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:41:36.479+0000 7f2a357fa640 1 -- 172.21.15.82:0/2023397744 wait complete. 2024-09-17T01:41:36.478 INFO:tasks.workunit.client.1.smithi167.stdout:9/875: fdatasync d4/d9/d21/d2d/d33/d3a/d74/f89 0 2024-09-17T01:41:36.479 INFO:tasks.workunit.client.1.smithi167.stdout:5/772: dread d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad [4194304,4194304] 0 2024-09-17T01:41:36.483 INFO:tasks.workunit.client.1.smithi167.stdout:6/961: rename d7/d54/d90/d13/d2f/d30/d32/f107 to d7/d54/d90/dfc/d10c/f144 0 2024-09-17T01:41:36.485 INFO:tasks.workunit.client.1.smithi167.stdout:8/930: mkdir dc/d56/d57/da0/d13d 0 2024-09-17T01:41:36.489 INFO:tasks.workunit.client.1.smithi167.stdout:7/769: truncate d0/d2/d14/d19/d32/d62/f64 4325112 0 2024-09-17T01:41:36.491 INFO:tasks.workunit.client.1.smithi167.stdout:2/803: mknod d5/d3c/d4c/de2/d45/d8e/d98/c112 0 2024-09-17T01:41:36.492 INFO:tasks.workunit.client.1.smithi167.stdout:8/931: chown dc/d56/d57/f115 2 1 2024-09-17T01:41:36.493 INFO:tasks.workunit.client.1.smithi167.stdout:3/856: rename d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/c99 to d7/d8/d10/d14/d66/d6c/dab/dcf/c122 0 2024-09-17T01:41:36.493 INFO:tasks.workunit.client.1.smithi167.stdout:4/798: dwrite d0/d4/d7/d6/d2b/d6d/d7e/f94 [0,4194304] 0 2024-09-17T01:41:36.495 INFO:tasks.workunit.client.1.smithi167.stdout:9/876: mkdir d4/d9/d21/d2d/d33/d3a/d74/d114 0 2024-09-17T01:41:36.497 INFO:tasks.workunit.client.1.smithi167.stdout:3/857: fsync d7/d8/d10/d14/f8d 0 2024-09-17T01:41:36.497 INFO:tasks.workunit.client.1.smithi167.stdout:1/828: dwrite d0/d5/dd7/fda [0,4194304] 0 2024-09-17T01:41:36.498 INFO:tasks.workunit.client.1.smithi167.stdout:0/816: dread d5/d6b/d77/d37/d45/da9/ff7 [0,4194304] 0 2024-09-17T01:41:36.498 INFO:tasks.workunit.client.1.smithi167.stdout:6/962: unlink d7/d54/d90/d13/d2f/d7f/fe7 0 2024-09-17T01:41:36.500 INFO:tasks.workunit.client.1.smithi167.stdout:7/770: write d0/d2/d88/f7c [284605,45502] 0 2024-09-17T01:41:36.501 INFO:tasks.workunit.client.1.smithi167.stdout:4/799: read d0/d4/d7/da/f80 [503782,40829] 0 2024-09-17T01:41:36.502 INFO:tasks.workunit.client.1.smithi167.stdout:1/829: write d0/d5/f12 [4067438,21864] 0 2024-09-17T01:41:36.503 INFO:tasks.workunit.client.1.smithi167.stdout:2/804: rename d5/d3c/d4c/de2/db8/d5e/d103/c107 to d5/d33/d48/d72/c113 0 2024-09-17T01:41:36.506 INFO:tasks.workunit.client.1.smithi167.stdout:6/963: fsync d7/d52/d79/da4/fb4 0 2024-09-17T01:41:36.506 INFO:tasks.workunit.client.1.smithi167.stdout:3/858: chown d7/d8/d10/d14/d66/d6c/dab/cdc 3189020 1 2024-09-17T01:41:36.506 INFO:tasks.workunit.client.1.smithi167.stdout:5/773: truncate d0/d24/d2b/d49/d4b/dac/d3a/d44/f5e 536733 0 2024-09-17T01:41:36.508 INFO:tasks.workunit.client.1.smithi167.stdout:1/830: chown d0/d9/c57 37564 1 2024-09-17T01:41:36.508 INFO:tasks.workunit.client.1.smithi167.stdout:0/817: mknod d5/d6b/d77/d4d/d56/d7b/c10d 0 2024-09-17T01:41:36.511 INFO:tasks.workunit.client.1.smithi167.stdout:8/932: rename dc/d56/d57/da0/l102 to dc/d56/d59/d82/d8f/de5/l13e 0 2024-09-17T01:41:36.513 INFO:tasks.workunit.client.1.smithi167.stdout:5/774: write d0/d24/d2b/f39 [4730377,75826] 0 2024-09-17T01:41:36.513 INFO:tasks.workunit.client.1.smithi167.stdout:3/859: fsync d7/d8/d10/d14/d24/d62/f90 0 2024-09-17T01:41:36.515 INFO:tasks.workunit.client.1.smithi167.stdout:7/771: truncate d0/d2/d14/d6f/d8b/fe6 173752 0 2024-09-17T01:41:36.516 INFO:tasks.workunit.client.1.smithi167.stdout:1/831: write d0/d5/d34/d83/d112/f2b [10262687,94427] 0 2024-09-17T01:41:36.517 INFO:tasks.workunit.client.1.smithi167.stdout:4/800: rename d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/d51 to d0/d4/d7/da/d10e 0 2024-09-17T01:41:36.517 INFO:tasks.workunit.client.1.smithi167.stdout:9/877: dwrite d4/d9/d21/d2d/d33/d80/fcf [4194304,4194304] 0 2024-09-17T01:41:36.518 INFO:tasks.workunit.client.1.smithi167.stdout:8/933: rmdir dc/d56/d59/d82/db2 39 2024-09-17T01:41:36.521 INFO:tasks.workunit.client.1.smithi167.stdout:5/775: unlink d0/d24/d2b/d4e/dd4/fdc 0 2024-09-17T01:41:36.522 INFO:tasks.workunit.client.1.smithi167.stdout:8/934: fdatasync dc/ff 0 2024-09-17T01:41:36.523 INFO:tasks.workunit.client.1.smithi167.stdout:9/878: stat d4/d9/d21/d2d/d33/d3a/f67 0 2024-09-17T01:41:36.523 INFO:tasks.workunit.client.1.smithi167.stdout:1/832: creat d0/d5/dd7/f114 x:0 0 0 2024-09-17T01:41:36.524 INFO:tasks.workunit.client.1.smithi167.stdout:4/801: chown d0/d4/d7/d6/d2b/d6d/fd0 1172 1 2024-09-17T01:41:36.525 INFO:tasks.workunit.client.1.smithi167.stdout:0/818: rename d5/d8/d9/d2f/f61 to d5/d6b/d77/d37/d80/f10e 0 2024-09-17T01:41:36.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/776: chown d0/d24/d2b/d49/d4b/dac/d3a/f7d 13505 1 2024-09-17T01:41:36.527 INFO:tasks.workunit.client.1.smithi167.stdout:1/833: chown d0/d5/d34/d83/d112/d85/df6/f101 10850 1 2024-09-17T01:41:36.527 INFO:tasks.workunit.client.1.smithi167.stdout:3/860: chown d7/d8/d10/d14/d24/d9c/da3/cf7 216366 1 2024-09-17T01:41:36.529 INFO:tasks.workunit.client.1.smithi167.stdout:2/805: write d5/d3c/f81 [4977718,62730] 0 2024-09-17T01:41:36.529 INFO:tasks.workunit.client.1.smithi167.stdout:5/777: chown d0/d24/d2b/d49/d4b/dac/d3a/d4d/c7c 13 1 2024-09-17T01:41:36.530 INFO:tasks.workunit.client.1.smithi167.stdout:3/861: chown d7/d1e/l5b 1 1 2024-09-17T01:41:36.531 INFO:tasks.workunit.client.1.smithi167.stdout:0/819: mknod d5/d6b/d77/d37/d45/c10f 0 2024-09-17T01:41:36.533 INFO:tasks.workunit.client.1.smithi167.stdout:8/935: mknod dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/c13f 0 2024-09-17T01:41:36.534 INFO:tasks.workunit.client.1.smithi167.stdout:9/879: mknod d4/d9/d21/c115 0 2024-09-17T01:41:36.534 INFO:tasks.workunit.client.1.smithi167.stdout:5/778: readlink d0/d24/d2b/d49/d4b/dac/d3a/d4d/la8 0 2024-09-17T01:41:36.535 INFO:tasks.workunit.client.1.smithi167.stdout:0/820: dread - d5/d6b/d77/d92/f10c zero size 2024-09-17T01:41:36.537 INFO:tasks.workunit.client.1.smithi167.stdout:4/802: dwrite d0/d4/d7/da/f6e [0,4194304] 0 2024-09-17T01:41:36.537 INFO:tasks.workunit.client.1.smithi167.stdout:1/834: mknod d0/d9/d16/d48/d54/d6e/d7e/c115 0 2024-09-17T01:41:36.537 INFO:tasks.workunit.client.1.smithi167.stdout:2/806: rmdir d5/d3c/d4c/de2/d45/d3f 39 2024-09-17T01:41:36.539 INFO:tasks.workunit.client.1.smithi167.stdout:3/862: creat d7/d8/d10/d29/d120/f123 x:0 0 0 2024-09-17T01:41:36.541 INFO:tasks.workunit.client.1.smithi167.stdout:0/821: fsync d5/d6b/d77/f54 0 2024-09-17T01:41:36.542 INFO:tasks.workunit.client.1.smithi167.stdout:7/772: rename d0/d2/ded/ffa to d0/d2/f10d 0 2024-09-17T01:41:36.545 INFO:tasks.workunit.client.1.smithi167.stdout:2/807: chown d5/d3c/d4c/fb5 15470380 1 2024-09-17T01:41:36.545 INFO:tasks.workunit.client.1.smithi167.stdout:1/835: rmdir d0/d5/dd7 39 2024-09-17T01:41:36.545 INFO:tasks.workunit.client.1.smithi167.stdout:6/964: dwrite d7/d54/d90/d13/d2f/d64/d6b/fa0 [0,4194304] 0 2024-09-17T01:41:36.547 INFO:tasks.workunit.client.1.smithi167.stdout:8/936: rename dc/d56/d57/da0/da7/dc1 to dc/d56/d59/d82/d85/d140 0 2024-09-17T01:41:36.550 INFO:tasks.workunit.client.1.smithi167.stdout:7/773: chown d0/d2/d14/d19/d26/f59 11341 1 2024-09-17T01:41:36.553 INFO:tasks.workunit.client.1.smithi167.stdout:9/880: rename d4/d9/d21/d43/d6c/f9d to d4/d9/d21/d43/d6c/d9e/da1/f116 0 2024-09-17T01:41:36.554 INFO:tasks.workunit.client.1.smithi167.stdout:5/779: dwrite d0/d24/d93/d99/fbb [0,4194304] 0 2024-09-17T01:41:36.558 INFO:tasks.workunit.client.1.smithi167.stdout:9/881: dread - d4/d9/d21/d81/fdc zero size 2024-09-17T01:41:36.562 INFO:tasks.workunit.client.1.smithi167.stdout:4/803: creat d0/d4/d7/da/d10e/d2d/f10f x:0 0 0 2024-09-17T01:41:36.563 INFO:tasks.workunit.client.1.smithi167.stdout:3/863: getdents d7/d1e 0 2024-09-17T01:41:36.566 INFO:tasks.workunit.client.1.smithi167.stdout:2/808: getdents d5/d33/d48 0 2024-09-17T01:41:36.567 INFO:tasks.workunit.client.1.smithi167.stdout:6/965: dwrite d7/d54/d90/d13/d2f/d96/f9e [0,4194304] 0 2024-09-17T01:41:36.567 INFO:tasks.workunit.client.1.smithi167.stdout:9/882: unlink d4/d9/d21/d43/f7d 0 2024-09-17T01:41:36.571 INFO:tasks.workunit.client.1.smithi167.stdout:7/774: dwrite d0/d2/d14/fd7 [0,4194304] 0 2024-09-17T01:41:36.572 INFO:tasks.workunit.client.1.smithi167.stdout:1/836: rename d0/d5/d34/l21 to d0/d5/l116 0 2024-09-17T01:41:36.575 INFO:tasks.workunit.client.1.smithi167.stdout:0/822: write d5/d6b/d77/d6d/d90/fde [263344,53243] 0 2024-09-17T01:41:36.575 INFO:tasks.workunit.client.1.smithi167.stdout:4/804: creat d0/d4/d7/de2/f110 x:0 0 0 2024-09-17T01:41:36.580 INFO:tasks.workunit.client.1.smithi167.stdout:8/937: dwrite dc/f29 [0,4194304] 0 2024-09-17T01:41:36.581 INFO:tasks.workunit.client.1.smithi167.stdout:0/823: chown d5/d6b/ldf 11 1 2024-09-17T01:41:36.582 INFO:tasks.workunit.client.1.smithi167.stdout:2/809: mkdir d5/d3c/d4c/de2/d2e/d114 0 2024-09-17T01:41:36.583 INFO:tasks.workunit.client.1.smithi167.stdout:1/837: dread - d0/d9/d16/d48/d54/d6f/fd1 zero size 2024-09-17T01:41:36.584 INFO:tasks.workunit.client.1.smithi167.stdout:6/966: creat d7/f145 x:0 0 0 2024-09-17T01:41:36.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/883: dread d4/d9/d21/d2d/d33/d90/fb7 [0,4194304] 0 2024-09-17T01:41:36.585 INFO:tasks.workunit.client.1.smithi167.stdout:3/864: write d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f94 [3487754,125813] 0 2024-09-17T01:41:36.586 INFO:tasks.workunit.client.1.smithi167.stdout:9/884: chown d4/d9/d21/df0 151009340 1 2024-09-17T01:41:36.586 INFO:tasks.workunit.client.1.smithi167.stdout:8/938: truncate dc/d56/faa 580752 0 2024-09-17T01:41:36.587 INFO:tasks.workunit.client.1.smithi167.stdout:3/865: readlink d7/d8/d10/d14/d25/l1b 0 2024-09-17T01:41:36.587 INFO:tasks.workunit.client.1.smithi167.stdout:6/967: write d7/d54/d90/d13/d2f/fca [1663636,103304] 0 2024-09-17T01:41:36.588 INFO:tasks.workunit.client.1.smithi167.stdout:0/824: mknod d5/d6b/d77/d37/d45/da9/d10a/c110 0 2024-09-17T01:41:36.591 INFO:tasks.workunit.client.1.smithi167.stdout:4/805: creat d0/d4/d7/dff/df2/f111 x:0 0 0 2024-09-17T01:41:36.591 INFO:tasks.workunit.client.1.smithi167.stdout:2/810: creat d5/d3c/d4c/de2/d45/d6b/f115 x:0 0 0 2024-09-17T01:41:36.592 INFO:tasks.workunit.client.1.smithi167.stdout:4/806: readlink d0/d4/d7/lfa 0 2024-09-17T01:41:36.594 INFO:tasks.workunit.client.1.smithi167.stdout:8/939: stat dc/d56/d59/d82/d8f/de5/dba/d134/f88 0 2024-09-17T01:41:36.595 INFO:tasks.workunit.client.1.smithi167.stdout:3/866: mkdir d7/d8/d10/d14/d66/dc4/d124 0 2024-09-17T01:41:36.596 INFO:tasks.workunit.client.1.smithi167.stdout:7/775: getdents d0/d2/d14/d19/d26/d83/da5/d5b 0 2024-09-17T01:41:36.597 INFO:tasks.workunit.client.1.smithi167.stdout:0/825: fdatasync d5/d6b/dca/fc5 0 2024-09-17T01:41:36.598 INFO:tasks.workunit.client.1.smithi167.stdout:6/968: rename d7/d52/d79/da4/cb9 to d7/d54/c146 0 2024-09-17T01:41:36.599 INFO:tasks.workunit.client.1.smithi167.stdout:2/811: mknod d5/d3c/d4c/de2/d2e/c116 0 2024-09-17T01:41:36.599 INFO:tasks.workunit.client.1.smithi167.stdout:5/780: dread d0/d24/d2b/d49/d4b/dac/f87 [0,4194304] 0 2024-09-17T01:41:36.600 INFO:tasks.workunit.client.1.smithi167.stdout:4/807: mkdir d0/d4/d7/d10/d70/dc7/d112 0 2024-09-17T01:41:36.600 INFO:tasks.workunit.client.1.smithi167.stdout:9/885: dwrite d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:36.600 INFO:tasks.workunit.client.1.smithi167.stdout:8/940: fsync dc/d56/d59/d82/d85/d140/fca 0 2024-09-17T01:41:36.602 INFO:tasks.workunit.client.1.smithi167.stdout:1/838: rename d0/d9/d16/d22/c35 to d0/d5/dbf/ddb/c117 0 2024-09-17T01:41:36.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/826: chown d5/d6b/d77/d6d/d90/fde 5882267 1 2024-09-17T01:41:36.605 INFO:tasks.workunit.client.1.smithi167.stdout:6/969: readlink d7/d54/d90/d13/d2f/d96/dab/de3/l112 0 2024-09-17T01:41:36.608 INFO:tasks.workunit.client.1.smithi167.stdout:0/827: read d5/d8/d9/f35 [2604651,110299] 0 2024-09-17T01:41:36.608 INFO:tasks.workunit.client.1.smithi167.stdout:1/839: fdatasync d0/d9/d16/d36/daf/fd3 0 2024-09-17T01:41:36.611 INFO:tasks.workunit.client.1.smithi167.stdout:0/828: write d5/d8/f46 [1860609,18723] 0 2024-09-17T01:41:36.612 INFO:tasks.workunit.client.1.smithi167.stdout:8/941: symlink dc/d56/dd1/d124/l141 0 2024-09-17T01:41:36.614 INFO:tasks.workunit.client.1.smithi167.stdout:4/808: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/f113 x:0 0 0 2024-09-17T01:41:36.615 INFO:tasks.workunit.client.1.smithi167.stdout:3/867: getdents d7/d8/d10/d14/d66/dc4 0 2024-09-17T01:41:36.615 INFO:tasks.workunit.client.1.smithi167.stdout:2/812: dread d5/d3c/d4c/de2/db8/d5e/fc0 [0,4194304] 0 2024-09-17T01:41:36.617 INFO:tasks.workunit.client.1.smithi167.stdout:3/868: fsync d7/d8/d10/d14/f10d 0 2024-09-17T01:41:36.620 INFO:tasks.workunit.client.1.smithi167.stdout:0/829: creat d5/d6b/d77/d6d/d90/dc4/f111 x:0 0 0 2024-09-17T01:41:36.623 INFO:tasks.workunit.client.1.smithi167.stdout:6/970: rename d7/d54/d90/d13/d2f/d30/d88/f132 to d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/f147 0 2024-09-17T01:41:36.624 INFO:tasks.workunit.client.1.smithi167.stdout:5/781: dread d0/d24/d2b/f81 [0,4194304] 0 2024-09-17T01:41:36.625 INFO:tasks.workunit.client.1.smithi167.stdout:9/886: dwrite d4/d9/f3d [4194304,4194304] 0 2024-09-17T01:41:36.625 INFO:tasks.workunit.client.1.smithi167.stdout:4/809: fsync d0/d4/d7/d6/d2b/d6d/d7e/fde 0 2024-09-17T01:41:36.626 INFO:tasks.workunit.client.1.smithi167.stdout:2/813: dwrite d5/f44 [0,4194304] 0 2024-09-17T01:41:36.627 INFO:tasks.workunit.client.1.smithi167.stdout:6/971: readlink d7/d54/d90/dfc/d10c/l128 0 2024-09-17T01:41:36.628 INFO:tasks.workunit.client.1.smithi167.stdout:3/869: creat d7/d8f/d9b/f125 x:0 0 0 2024-09-17T01:41:36.628 INFO:tasks.workunit.client.1.smithi167.stdout:9/887: fsync d4/d9/d21/df0/f110 0 2024-09-17T01:41:36.631 INFO:tasks.workunit.client.1.smithi167.stdout:6/972: write d7/d54/d90/d13/d2f/d96/f9e [755722,106057] 0 2024-09-17T01:41:36.631 INFO:tasks.workunit.client.1.smithi167.stdout:9/888: read - d4/d9/d21/d43/d6c/d9e/ff6 zero size 2024-09-17T01:41:36.632 INFO:tasks.workunit.client.1.smithi167.stdout:6/973: readlink d7/d54/d90/l74 0 2024-09-17T01:41:36.633 INFO:tasks.workunit.client.1.smithi167.stdout:0/830: unlink d5/d8/d9/d2f/c5e 0 2024-09-17T01:41:36.636 INFO:tasks.workunit.client.1.smithi167.stdout:1/840: rename d0/d9/d16/d48/d54/c76 to d0/d5/dd7/c118 0 2024-09-17T01:41:36.636 INFO:tasks.workunit.client.1.smithi167.stdout:6/974: write d7/d42/f117 [870661,130216] 0 2024-09-17T01:41:36.638 INFO:tasks.workunit.client.1.smithi167.stdout:4/810: creat d0/d4/db4/f114 x:0 0 0 2024-09-17T01:41:36.638 INFO:tasks.workunit.client.1.smithi167.stdout:5/782: mknod d0/d24/d2b/d3d/d6d/ceb 0 2024-09-17T01:41:36.642 INFO:tasks.workunit.client.1.smithi167.stdout:9/889: dread - d4/d9/d21/d81/db9/fd4 zero size 2024-09-17T01:41:36.643 INFO:tasks.workunit.client.1.smithi167.stdout:2/814: dwrite d5/d3c/d4c/de2/d45/d8e/d98/dfa/fdd [0,4194304] 0 2024-09-17T01:41:36.648 INFO:tasks.workunit.client.1.smithi167.stdout:4/811: symlink d0/d4/d7/da/d10e/d2d/d2e/d31/l115 0 2024-09-17T01:41:36.649 INFO:tasks.workunit.client.1.smithi167.stdout:9/890: dwrite d4/d9/d97/dd6/fd7 [0,4194304] 0 2024-09-17T01:41:36.650 INFO:tasks.workunit.client.1.smithi167.stdout:9/891: chown d4/d9/d2b/da3/lc6 175 1 2024-09-17T01:41:36.652 INFO:tasks.workunit.client.1.smithi167.stdout:6/975: mknod d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d61/c148 0 2024-09-17T01:41:36.652 INFO:tasks.workunit.client.1.smithi167.stdout:2/815: write d5/dfe/f10f [4735350,48577] 0 2024-09-17T01:41:36.653 INFO:tasks.workunit.client.1.smithi167.stdout:2/816: readlink d5/d3c/d4c/d4d/l9a 0 2024-09-17T01:41:36.654 INFO:tasks.workunit.client.1.smithi167.stdout:3/870: link d7/d8/d10/d14/l96 d7/d8/d10/d14/d24/d62/l126 0 2024-09-17T01:41:36.655 INFO:tasks.workunit.client.1.smithi167.stdout:4/812: creat d0/d4/d7/d10/d70/dc7/f116 x:0 0 0 2024-09-17T01:41:36.658 INFO:tasks.workunit.client.1.smithi167.stdout:3/871: write d7/d8/d10/d14/d66/d6c/dab/f101 [970411,105574] 0 2024-09-17T01:41:36.660 INFO:tasks.workunit.client.1.smithi167.stdout:4/813: mknod d0/d4/d7/da/d10e/c117 0 2024-09-17T01:41:36.662 INFO:tasks.workunit.client.1.smithi167.stdout:2/817: rename d5/d3c/d4c/de2/d45/d8e/d98/dfa/c70 to d5/d3c/d4c/de2/db8/da3/c117 0 2024-09-17T01:41:36.663 INFO:tasks.workunit.client.1.smithi167.stdout:3/872: symlink d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/l127 0 2024-09-17T01:41:36.682 INFO:tasks.workunit.client.1.smithi167.stdout:1/841: dread d0/d5/d34/d6d/fba [0,4194304] 0 2024-09-17T01:41:36.743 INFO:tasks.workunit.client.1.smithi167.stdout:7/776: sync 2024-09-17T01:41:36.744 INFO:tasks.workunit.client.1.smithi167.stdout:7/777: chown d0/d2/d14/d19/d22/fee 11992 1 2024-09-17T01:41:36.761 INFO:tasks.workunit.client.1.smithi167.stdout:4/814: rename d0/d4/d7/d10/d70/dc7/f116 to d0/d4/d7/dff/f118 0 2024-09-17T01:41:36.763 INFO:tasks.workunit.client.1.smithi167.stdout:6/976: creat d7/f149 x:0 0 0 2024-09-17T01:41:36.764 INFO:tasks.workunit.client.1.smithi167.stdout:6/977: read - d7/d54/d90/d13/d2f/d7f/d98/d27/d3a/d56/d97/f104 zero size 2024-09-17T01:41:36.767 INFO:tasks.workunit.client.1.smithi167.stdout:7/778: mknod d0/d2/d14/d19/d32/d62/c10e 0 2024-09-17T01:41:36.770 INFO:tasks.workunit.client.1.smithi167.stdout:3/873: mknod d7/d8/d10/d14/d25/dc7/dd1/dc2/d10c/c128 0 2024-09-17T01:41:36.770 INFO:tasks.workunit.client.1.smithi167.stdout:3/874: chown d7/d8/d10/d14/d25/dc7/dd1 14758359 1 2024-09-17T01:41:36.771 INFO:tasks.workunit.client.1.smithi167.stdout:2/818: creat d5/d10/f118 x:0 0 0 2024-09-17T01:41:36.772 INFO:tasks.workunit.client.1.smithi167.stdout:7/779: fdatasync d0/d2/d14/d19/d26/f78 0 2024-09-17T01:41:36.773 INFO:tasks.workunit.client.1.smithi167.stdout:4/815: rmdir d0/d4/d7/da/d10e/d2d/d2e/d31/d75 39 2024-09-17T01:41:36.774 INFO:tasks.workunit.client.1.smithi167.stdout:7/780: readlink d0/d2/d88/d6e/l9a 0 2024-09-17T01:41:36.776 INFO:tasks.workunit.client.1.smithi167.stdout:7/781: chown d0/d2/d14/d19 55647 1 2024-09-17T01:41:36.777 INFO:tasks.workunit.client.1.smithi167.stdout:3/875: dwrite d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/f3f [0,4194304] 0 2024-09-17T01:41:36.779 INFO:tasks.workunit.client.1.smithi167.stdout:1/842: getdents d0/d9/d16/d48/d54/d78/d90 0 2024-09-17T01:41:36.779 INFO:tasks.workunit.client.1.smithi167.stdout:4/816: fsync d0/d4/d7/da/f2c 0 2024-09-17T01:41:36.779 INFO:tasks.workunit.client.1.smithi167.stdout:6/978: link d7/d54/d90/d13/d2f/d7f/d98/d27/c3d d7/d54/d90/d13/d2f/d64/d6b/dbc/c14a 0 2024-09-17T01:41:36.779 INFO:tasks.workunit.client.1.smithi167.stdout:0/831: write d5/d8/f96 [138235,5587] 0 2024-09-17T01:41:36.781 INFO:tasks.workunit.client.1.smithi167.stdout:1/843: chown d0/d5/d34/d6d/lbe 254683 1 2024-09-17T01:41:36.783 INFO:tasks.workunit.client.1.smithi167.stdout:2/819: link d5/d3c/d4c/de2/d2e/f4b d5/d71/dc7/f119 0 2024-09-17T01:41:36.783 INFO:tasks.workunit.client.1.smithi167.stdout:7/782: creat d0/d2/d14/d19/d32/d108/f10f x:0 0 0 2024-09-17T01:41:36.786 INFO:tasks.workunit.client.1.smithi167.stdout:2/820: readlink d5/d3c/d4c/ld0 0 2024-09-17T01:41:36.786 INFO:tasks.workunit.client.1.smithi167.stdout:1/844: write d0/d5/d34/f63 [681174,75611] 0 2024-09-17T01:41:36.786 INFO:tasks.workunit.client.1.smithi167.stdout:5/783: write d0/d24/faa [1862590,15069] 0 2024-09-17T01:41:36.788 INFO:tasks.workunit.client.1.smithi167.stdout:6/979: creat d7/d54/d90/d13/d2f/d30/d88/f14b x:0 0 0 2024-09-17T01:41:36.789 INFO:tasks.workunit.client.1.smithi167.stdout:3/876: link d7/f65 d7/d8/d10/d14/d2c/d74/d11b/f129 0 2024-09-17T01:41:36.791 INFO:tasks.workunit.client.1.smithi167.stdout:0/832: mkdir d5/d6b/d77/d37/d45/d112 0 2024-09-17T01:41:36.794 INFO:tasks.workunit.client.1.smithi167.stdout:2/821: mkdir d5/d3c/d4c/de2/db8/d5e/d103/d11a 0 2024-09-17T01:41:36.795 INFO:tasks.workunit.client.1.smithi167.stdout:8/942: sync 2024-09-17T01:41:36.795 INFO:tasks.workunit.client.1.smithi167.stdout:9/892: dwrite d4/d9/d21/df0/f55 [0,4194304] 0 2024-09-17T01:41:36.797 INFO:tasks.workunit.client.1.smithi167.stdout:4/817: truncate d0/d4/d7/d6/d2b/d6d/d7e/fde 1707629 0 2024-09-17T01:41:36.799 INFO:tasks.workunit.client.1.smithi167.stdout:6/980: creat d7/d54/d90/dfc/d10c/f14c x:0 0 0 2024-09-17T01:41:36.803 INFO:tasks.workunit.client.1.smithi167.stdout:5/784: unlink d0/l61 0 2024-09-17T01:41:36.803 INFO:tasks.workunit.client.1.smithi167.stdout:0/833: symlink d5/d6b/d77/d37/d80/l113 0 2024-09-17T01:41:36.804 INFO:tasks.workunit.client.1.smithi167.stdout:1/845: dwrite d0/d5/dd7/f114 [0,4194304] 0 2024-09-17T01:41:36.806 INFO:tasks.workunit.client.1.smithi167.stdout:0/834: fdatasync d5/d6b/d77/d92/fc0 0 2024-09-17T01:41:36.807 INFO:tasks.workunit.client.1.smithi167.stdout:2/822: read d5/d33/d48/d72/d94/fb7 [2745755,11767] 0 2024-09-17T01:41:36.814 INFO:tasks.workunit.client.1.smithi167.stdout:7/783: creat d0/d2/d14/d19/d32/f110 x:0 0 0 2024-09-17T01:41:36.815 INFO:tasks.workunit.client.1.smithi167.stdout:1/846: fdatasync d0/d9/f37 0 2024-09-17T01:41:36.817 INFO:tasks.workunit.client.1.smithi167.stdout:4/818: dwrite d0/d4/d7/d10/ff8 [0,4194304] 0 2024-09-17T01:41:36.818 INFO:tasks.workunit.client.1.smithi167.stdout:3/877: write d7/d8/d10/d14/d25/d9e/fb1 [967435,87072] 0 2024-09-17T01:41:36.819 INFO:tasks.workunit.client.1.smithi167.stdout:2/823: dread - d5/d3c/d4c/de2/d45/d8e/d98/dca/ff2 zero size 2024-09-17T01:41:36.821 INFO:tasks.workunit.client.1.smithi167.stdout:9/893: write d4/d9/f28 [1243747,22421] 0 2024-09-17T01:41:36.823 INFO:tasks.workunit.client.1.smithi167.stdout:1/847: stat d0/d9/d16/d48/d54/d6f/fd1 0 2024-09-17T01:41:36.825 INFO:tasks.workunit.client.1.smithi167.stdout:5/785: dwrite d0/d24/d2b/d4e/fa0 [0,4194304] 0 2024-09-17T01:41:36.827 INFO:tasks.workunit.client.1.smithi167.stdout:1/848: stat d0/d5/dbf/ddb/de9 0 2024-09-17T01:41:36.832 INFO:tasks.workunit.client.1.smithi167.stdout:5/786: read d0/d24/d2b/f81 [2724126,71062] 0 2024-09-17T01:41:36.833 INFO:tasks.workunit.client.1.smithi167.stdout:1/849: fsync d0/d9/d16/d36/ff8 0 2024-09-17T01:41:36.834 INFO:tasks.workunit.client.1.smithi167.stdout:2/824: mknod d5/d3c/d4c/de2/d45/d8e/d98/dfa/c11b 0 2024-09-17T01:41:36.835 INFO:tasks.workunit.client.1.smithi167.stdout:8/943: dwrite dc/d56/d59/d82/d8f/de5/dba/dd3/df3/fb7 [0,4194304] 0 2024-09-17T01:41:36.837 INFO:tasks.workunit.client.1.smithi167.stdout:5/787: write d0/d24/d2b/fb2 [21908,119525] 0 2024-09-17T01:41:36.837 INFO:tasks.workunit.client.1.smithi167.stdout:4/819: creat d0/d4/d7/da/d10e/d2d/d2e/d31/f119 x:0 0 0 2024-09-17T01:41:36.838 INFO:tasks.workunit.client.1.smithi167.stdout:9/894: truncate d4/d9/d21/d43/d6c/f8f 3508206 0 2024-09-17T01:41:36.838 INFO:tasks.workunit.client.1.smithi167.stdout:7/784: link d0/d2/d14/d19/d26/c28 d0/d2/d14/d19/d22/c111 0 2024-09-17T01:41:36.840 INFO:tasks.workunit.client.1.smithi167.stdout:1/850: mkdir d0/d5/d34/d83/d112/d85/db5/dc1/d119 0 2024-09-17T01:41:36.840 INFO:tasks.workunit.client.1.smithi167.stdout:0/835: dread d5/d6b/d77/d92/fea [0,4194304] 0 2024-09-17T01:41:36.862 INFO:tasks.workunit.client.0.smithi082.stdout:5/502: sync 2024-09-17T01:41:36.864 INFO:tasks.workunit.client.0.smithi082.stdout:5/503: rename l2 to db/d56/d78/l99 0 2024-09-17T01:41:36.865 INFO:tasks.workunit.client.0.smithi082.stdout:5/504: write db/d56/d18/d23/f66 [375353,75229] 0 2024-09-17T01:41:36.866 INFO:tasks.workunit.client.0.smithi082.stdout:5/505: readlink db/d1e/d20/l6d 0 2024-09-17T01:41:36.867 INFO:tasks.workunit.client.0.smithi082.stdout:5/506: chown db/d1e/c95 206289486 1 2024-09-17T01:41:36.868 INFO:tasks.workunit.client.0.smithi082.stdout:5/507: readlink db/d1e/l81 0 2024-09-17T01:41:36.897 INFO:tasks.workunit.client.1.smithi167.stdout:9/895: mknod d4/d9/d21/d43/d6c/da5/c117 0 2024-09-17T01:41:36.897 INFO:tasks.workunit.client.1.smithi167.stdout:4/820: dread - d0/d4/d7/da/d10e/d2d/f10f zero size 2024-09-17T01:41:36.897 INFO:tasks.workunit.client.1.smithi167.stdout:2/825: getdents d5/d3c/d4c/de2/db8/dd5 0 2024-09-17T01:41:36.898 INFO:tasks.workunit.client.1.smithi167.stdout:3/878: write d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/f22 [575405,21470] 0 2024-09-17T01:41:36.899 INFO:tasks.workunit.client.1.smithi167.stdout:0/836: chown d5/d6b/d77/d6d/d90/dc4/f104 17 1 2024-09-17T01:41:36.900 INFO:tasks.workunit.client.1.smithi167.stdout:2/826: truncate d5/d10/f42 1796712 0 2024-09-17T01:41:36.902 INFO:tasks.workunit.client.1.smithi167.stdout:0/837: write d5/d8/d9/f62 [1306807,25518] 0 2024-09-17T01:41:36.905 INFO:tasks.workunit.client.1.smithi167.stdout:0/838: read - d5/d8/f97 zero size 2024-09-17T01:41:36.909 INFO:tasks.workunit.client.1.smithi167.stdout:1/851: dwrite d0/d5/d34/d83/d112/d74/fc8 [0,4194304] 0 2024-09-17T01:41:36.911 INFO:tasks.workunit.client.1.smithi167.stdout:9/896: dwrite d4/d9/d21/d2d/d33/d3a/d74/fe6 [0,4194304] 0 2024-09-17T01:41:36.913 INFO:tasks.workunit.client.1.smithi167.stdout:3/879: dwrite d7/d8/d10/d14/d66/d6c/fb0 [0,4194304] 0 2024-09-17T01:41:36.967 INFO:tasks.workunit.client.1.smithi167.stdout:6/981: sync 2024-09-17T01:41:36.968 INFO:tasks.workunit.client.1.smithi167.stdout:6/982: stat d7/d54/d90/db3 0 2024-09-17T01:41:36.973 INFO:tasks.workunit.client.1.smithi167.stdout:6/983: dwrite d7/d52/d8c/d10d/f12e [0,4194304] 0 2024-09-17T01:41:36.984 INFO:tasks.workunit.client.1.smithi167.stdout:6/984: dwrite d7/d54/d90/d13/d2f/d96/f9e [4194304,4194304] 0 2024-09-17T01:41:36.995 INFO:tasks.workunit.client.1.smithi167.stdout:5/788: symlink d0/d24/d2b/d49/d4b/dac/d3a/dd1/lec 0 2024-09-17T01:41:36.996 INFO:tasks.workunit.client.1.smithi167.stdout:7/785: symlink d0/l112 0 2024-09-17T01:41:36.998 INFO:tasks.workunit.client.1.smithi167.stdout:4/821: symlink d0/d4/d7/de2/l11a 0 2024-09-17T01:41:36.999 INFO:tasks.workunit.client.1.smithi167.stdout:4/822: stat d0/d4/d7/d6/d2b/ccd 0 2024-09-17T01:41:37.001 INFO:tasks.workunit.client.1.smithi167.stdout:2/827: creat d5/d3c/d4c/de2/d45/d8e/d98/f11c x:0 0 0 2024-09-17T01:41:37.003 INFO:tasks.workunit.client.1.smithi167.stdout:0/839: creat d5/d6b/d77/d4d/dfa/f114 x:0 0 0 2024-09-17T01:41:37.004 INFO:tasks.workunit.client.1.smithi167.stdout:1/852: symlink d0/d5/dd7/l11a 0 2024-09-17T01:41:37.006 INFO:tasks.workunit.client.0.smithi082.stdout:5/508: dwrite f6 [0,4194304] 0 2024-09-17T01:41:37.006 INFO:tasks.workunit.client.1.smithi167.stdout:3/880: mkdir d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d12a 0 2024-09-17T01:41:37.007 INFO:tasks.workunit.client.1.smithi167.stdout:1/853: chown d0/d5/dd7/d102/ff4 21336 1 2024-09-17T01:41:37.009 INFO:tasks.workunit.client.1.smithi167.stdout:2/828: dwrite d5/d3c/d4c/de2/fa7 [0,4194304] 0 2024-09-17T01:41:37.010 INFO:tasks.workunit.client.1.smithi167.stdout:8/944: sync 2024-09-17T01:41:37.013 INFO:tasks.workunit.client.1.smithi167.stdout:0/840: dwrite d5/d8/ff0 [0,4194304] 0 2024-09-17T01:41:37.014 INFO:tasks.workunit.client.1.smithi167.stdout:3/881: read d7/d8/d10/d14/d24/d62/f77 [3472750,73732] 0 2024-09-17T01:41:37.016 INFO:tasks.workunit.client.1.smithi167.stdout:0/841: fsync d5/d6b/d77/d4d/fc8 0 2024-09-17T01:41:37.018 INFO:tasks.workunit.client.1.smithi167.stdout:0/842: truncate d5/d8/f96 1871449 0 2024-09-17T01:41:37.028 INFO:tasks.workunit.client.0.smithi082.stdout:5/509: write db/f17 [1412489,16136] 0 2024-09-17T01:41:37.036 INFO:tasks.workunit.client.1.smithi167.stdout:6/985: rename d7/d54/d90/d13/d2f/d64/d6b/d95/db1/ffd to d7/d42/df4/f14d 0 2024-09-17T01:41:37.036 INFO:tasks.workunit.client.1.smithi167.stdout:5/789: mknod d0/d24/d2b/d49/d4b/dac/d3a/d44/ced 0 2024-09-17T01:41:37.037 INFO:tasks.workunit.client.0.smithi082.stdout:5/510: dwrite db/d2b/f7f [0,4194304] 0 2024-09-17T01:41:37.038 INFO:tasks.workunit.client.1.smithi167.stdout:7/786: creat d0/d2/d14/d6f/d87/dae/f113 x:0 0 0 2024-09-17T01:41:37.040 INFO:tasks.workunit.client.1.smithi167.stdout:4/823: write d0/d4/d7/da/d10e/d2d/d2e/d31/fb0 [7785662,12024] 0 2024-09-17T01:41:37.043 INFO:tasks.workunit.client.0.smithi082.stdout:5/511: mknod db/d2b/d59/c9a 0 2024-09-17T01:41:37.044 INFO:tasks.workunit.client.1.smithi167.stdout:9/897: mknod d4/d9/d21/d81/c118 0 2024-09-17T01:41:37.045 INFO:tasks.workunit.client.1.smithi167.stdout:1/854: creat d0/d9/d16/d48/f11b x:0 0 0 2024-09-17T01:41:37.049 INFO:tasks.workunit.client.1.smithi167.stdout:3/882: chown d7/d8/d10/d14/d66/d6c/lb5 37617189 1 2024-09-17T01:41:37.051 INFO:tasks.workunit.client.0.smithi082.stdout:5/512: creat db/d1e/d20/f9b x:0 0 0 2024-09-17T01:41:37.052 INFO:tasks.workunit.client.0.smithi082.stdout:5/513: fdatasync db/d56/d29/f7e 0 2024-09-17T01:41:37.055 INFO:tasks.workunit.client.1.smithi167.stdout:6/986: read d7/d54/d90/f1b [3666938,81300] 0 2024-09-17T01:41:37.057 INFO:tasks.workunit.client.1.smithi167.stdout:4/824: mkdir d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/d11b 0 2024-09-17T01:41:37.058 INFO:tasks.workunit.client.1.smithi167.stdout:4/825: truncate d0/d4/d7/d6/d2b/d6d/f10d 610278 0 2024-09-17T01:41:37.059 INFO:tasks.workunit.client.1.smithi167.stdout:1/855: write d0/d9/d16/d48/d54/f60 [1719731,112258] 0 2024-09-17T01:41:37.060 INFO:tasks.workunit.client.0.smithi082.stdout:5/514: link db/d1e/d20/d4d/c5e db/d1e/d20/d4d/c9c 0 2024-09-17T01:41:37.060 INFO:tasks.workunit.client.0.smithi082.stdout:8/383: sync 2024-09-17T01:41:37.061 INFO:tasks.workunit.client.0.smithi082.stdout:5/515: rmdir db/d1e 39 2024-09-17T01:41:37.063 INFO:tasks.workunit.client.1.smithi167.stdout:3/883: creat d7/d8/d10/d14/d24/d9c/f12b x:0 0 0 2024-09-17T01:41:37.063 INFO:tasks.workunit.client.0.smithi082.stdout:8/384: symlink d3/dd/d18/d2d/d3e/d43/l73 0 2024-09-17T01:41:37.066 INFO:tasks.workunit.client.1.smithi167.stdout:7/787: creat d0/d2/d88/d6e/dd8/f114 x:0 0 0 2024-09-17T01:41:37.068 INFO:tasks.workunit.client.1.smithi167.stdout:6/987: rename d7/c5d to d7/d54/d90/d13/d2f/d10f/d137/c14e 0 2024-09-17T01:41:37.071 INFO:tasks.workunit.client.0.smithi082.stdout:5/516: creat db/f9d x:0 0 0 2024-09-17T01:41:37.072 INFO:tasks.workunit.client.0.smithi082.stdout:5/517: write db/f5a [992645,78365] 0 2024-09-17T01:41:37.073 INFO:tasks.workunit.client.1.smithi167.stdout:4/826: unlink d0/d4/d7/d6/fda 0 2024-09-17T01:41:37.074 INFO:tasks.workunit.client.1.smithi167.stdout:4/827: chown d0/d4/d7/da/d10e/d2d/dac/ce0 569 1 2024-09-17T01:41:37.081 INFO:tasks.workunit.client.0.smithi082.stdout:8/385: rename d3/dd/f56 to d3/f74 0 2024-09-17T01:41:37.082 INFO:tasks.workunit.client.1.smithi167.stdout:7/788: creat d0/d2/d14/d19/d26/d83/f115 x:0 0 0 2024-09-17T01:41:37.086 INFO:tasks.workunit.client.1.smithi167.stdout:8/945: write dc/d56/d57/da0/da7/fab [1732894,25756] 0 2024-09-17T01:41:37.090 INFO:tasks.workunit.client.1.smithi167.stdout:5/790: write d0/d24/d2b/d3d/dd2/fa1 [1422582,7501] 0 2024-09-17T01:41:37.092 INFO:tasks.workunit.client.1.smithi167.stdout:1/856: dread d0/f17 [0,4194304] 0 2024-09-17T01:41:37.092 INFO:tasks.workunit.client.0.smithi082.stdout:8/386: link d3/dd/d18/d34/c49 d3/dd/d18/d2d/d60/c75 0 2024-09-17T01:41:37.093 INFO:tasks.workunit.client.1.smithi167.stdout:2/829: dwrite d5/d6d/ff5 [0,4194304] 0 2024-09-17T01:41:37.095 INFO:tasks.workunit.client.1.smithi167.stdout:0/843: dwrite d5/d6b/d77/daa/fc9 [0,4194304] 0 2024-09-17T01:41:37.099 INFO:tasks.workunit.client.1.smithi167.stdout:0/844: write d5/d6b/dca/fd7 [926275,67554] 0 2024-09-17T01:41:37.100 INFO:tasks.workunit.client.1.smithi167.stdout:3/884: creat d7/d8/f12c x:0 0 0 2024-09-17T01:41:37.102 INFO:tasks.workunit.client.1.smithi167.stdout:9/898: write d4/d9/d21/d43/d6c/d9e/da1/dbc/fc1 [706433,90039] 0 2024-09-17T01:41:37.103 INFO:tasks.workunit.client.1.smithi167.stdout:4/828: link d0/d4/db4/fb5 d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/f11c 0 2024-09-17T01:41:37.103 INFO:tasks.workunit.client.1.smithi167.stdout:3/885: chown d7/d8/d10/d14/d66/f104 5 1 2024-09-17T01:41:37.105 INFO:tasks.workunit.client.1.smithi167.stdout:5/791: dwrite d0/d24/d93/d99/fbb [0,4194304] 0 2024-09-17T01:41:37.106 INFO:tasks.workunit.client.1.smithi167.stdout:4/829: dread - d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/f113 zero size 2024-09-17T01:41:37.108 INFO:tasks.workunit.client.0.smithi082.stdout:8/387: creat d3/f76 x:0 0 0 2024-09-17T01:41:37.113 INFO:tasks.workunit.client.0.smithi082.stdout:8/388: chown d3/dd/d18/d34/l37 238616 1 2024-09-17T01:41:37.115 INFO:tasks.workunit.client.1.smithi167.stdout:2/830: rmdir d5/d3c/d4c/de2 39 2024-09-17T01:41:37.116 INFO:tasks.workunit.client.1.smithi167.stdout:6/988: truncate d7/d54/d90/d13/d2f/f4d 3176892 0 2024-09-17T01:41:37.117 INFO:tasks.workunit.client.0.smithi082.stdout:5/518: dwrite db/d1e/d20/f73 [0,4194304] 0 2024-09-17T01:41:37.117 INFO:tasks.workunit.client.0.smithi082.stdout:8/389: read d3/dd/d18/d2d/d3b/f69 [3806583,55731] 0 2024-09-17T01:41:37.119 INFO:tasks.workunit.client.1.smithi167.stdout:3/886: creat d7/d8/d10/d14/d2c/d6f/db6/f12d x:0 0 0 2024-09-17T01:41:37.121 INFO:tasks.workunit.client.1.smithi167.stdout:7/789: dwrite d0/d2/d14/d19/d22/fe7 [0,4194304] 0 2024-09-17T01:41:37.122 INFO:tasks.workunit.client.0.smithi082.stdout:5/519: rename db/f17 to db/d56/d78/f9e 0 2024-09-17T01:41:37.123 INFO:tasks.workunit.client.1.smithi167.stdout:8/946: creat dc/f142 x:0 0 0 2024-09-17T01:41:37.123 INFO:tasks.workunit.client.1.smithi167.stdout:8/947: chown dc/d56/d57/da0/d13d 642 1 2024-09-17T01:41:37.124 INFO:tasks.workunit.client.0.smithi082.stdout:8/390: creat d3/dd/d18/d2d/d3e/d4a/d66/f77 x:0 0 0 2024-09-17T01:41:37.128 INFO:tasks.workunit.client.1.smithi167.stdout:5/792: symlink d0/d9/lee 0 2024-09-17T01:41:37.130 INFO:tasks.workunit.client.1.smithi167.stdout:5/793: stat d0/d24/d2b/d49/d4b/dac/d3a/d4d/c7c 0 2024-09-17T01:41:37.132 INFO:tasks.workunit.client.0.smithi082.stdout:5/520: symlink db/d1e/d20/d30/l9f 0 2024-09-17T01:41:37.134 INFO:tasks.workunit.client.0.smithi082.stdout:8/391: link d3/dd/d18/d2d/d3e/d4a/d6a/f42 d3/dd/d18/d2d/d3e/d4a/d68/f78 0 2024-09-17T01:41:37.139 INFO:tasks.workunit.client.1.smithi167.stdout:3/887: rename d7/d8/d10/d14/d2c/c31 to d7/d8/d10/d29/d75/c12e 0 2024-09-17T01:41:37.140 INFO:tasks.workunit.client.1.smithi167.stdout:8/948: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/f143 x:0 0 0 2024-09-17T01:41:37.141 INFO:tasks.workunit.client.1.smithi167.stdout:8/949: chown dc/l1e 37089 1 2024-09-17T01:41:37.144 INFO:tasks.workunit.client.1.smithi167.stdout:5/794: rmdir d0/d24/d2b/d3d/dd2/dc4 39 2024-09-17T01:41:37.145 INFO:tasks.workunit.client.1.smithi167.stdout:3/888: dread d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f67 [0,4194304] 0 2024-09-17T01:41:37.145 INFO:tasks.workunit.client.1.smithi167.stdout:8/950: truncate dc/d56/d59/d82/d8f/de5/dba/d134/dea/f12f 683243 0 2024-09-17T01:41:37.145 INFO:tasks.workunit.client.1.smithi167.stdout:7/790: dread d0/d2/d14/d19/d22/f2a [0,4194304] 0 2024-09-17T01:41:37.146 INFO:tasks.workunit.client.1.smithi167.stdout:1/857: getdents d0/d9/d16/d48/d80 0 2024-09-17T01:41:37.147 INFO:tasks.workunit.client.1.smithi167.stdout:3/889: fsync d7/d8/d10/d14/d66/d6c/dab/dcf/f106 0 2024-09-17T01:41:37.147 INFO:tasks.workunit.client.1.smithi167.stdout:0/845: link d5/d6b/d77/d92/c99 d5/d6b/d77/d37/c115 0 2024-09-17T01:41:37.148 INFO:tasks.workunit.client.1.smithi167.stdout:9/899: getdents d4/d9/d21/d2d/d33/d90 0 2024-09-17T01:41:37.150 INFO:tasks.workunit.client.1.smithi167.stdout:4/830: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a 0 2024-09-17T01:41:37.151 INFO:tasks.workunit.client.1.smithi167.stdout:1/858: dread d0/d5/d34/d83/d112/d74/fca [0,4194304] 0 2024-09-17T01:41:37.154 INFO:tasks.workunit.client.1.smithi167.stdout:5/795: creat d0/d54/d9d/fef x:0 0 0 2024-09-17T01:41:37.154 INFO:tasks.workunit.client.1.smithi167.stdout:2/831: getdents d5/d3c/d4c/de2/d45/d8e 0 2024-09-17T01:41:37.156 INFO:tasks.workunit.client.1.smithi167.stdout:3/890: truncate d7/d8/d10/d14/d25/dc7/dd1/dc2/fd8 672995 0 2024-09-17T01:41:37.157 INFO:tasks.workunit.client.1.smithi167.stdout:4/831: fdatasync d0/d4/d7/da/d48/ffd 0 2024-09-17T01:41:37.159 INFO:tasks.workunit.client.0.smithi082.stdout:5/521: dwrite db/d56/d29/f68 [4194304,4194304] 0 2024-09-17T01:41:37.160 INFO:tasks.workunit.client.1.smithi167.stdout:9/900: dread d4/d9/d21/d43/d6c/d9e/da1/dbc/fc1 [0,4194304] 0 2024-09-17T01:41:37.161 INFO:tasks.workunit.client.0.smithi082.stdout:8/392: dwrite d3/dd/d18/d34/f4f [0,4194304] 0 2024-09-17T01:41:37.162 INFO:tasks.workunit.client.1.smithi167.stdout:1/859: write d0/d5/d34/d6d/fba [2880559,64302] 0 2024-09-17T01:41:37.162 INFO:tasks.workunit.client.1.smithi167.stdout:3/891: stat d7/d8/d10/d14/d24/d9c/da3/cf7 0 2024-09-17T01:41:37.162 INFO:tasks.workunit.client.1.smithi167.stdout:0/846: dwrite d5/d6b/d77/f54 [0,4194304] 0 2024-09-17T01:41:37.164 INFO:tasks.workunit.client.1.smithi167.stdout:5/796: rename d0/d54/f75 to d0/d54/d56/ff0 0 2024-09-17T01:41:37.164 INFO:tasks.workunit.client.0.smithi082.stdout:5/522: rmdir db/d2b 39 2024-09-17T01:41:37.165 INFO:tasks.workunit.client.1.smithi167.stdout:6/989: dwrite d7/d54/d90/d13/f65 [0,4194304] 0 2024-09-17T01:41:37.168 INFO:tasks.workunit.client.0.smithi082.stdout:5/523: mkdir db/d56/d78/da0 0 2024-09-17T01:41:37.170 INFO:tasks.workunit.client.1.smithi167.stdout:9/901: read d4/f4e [251423,82914] 0 2024-09-17T01:41:37.173 INFO:tasks.workunit.client.0.smithi082.stdout:5/524: fdatasync db/d2b/f8c 0 2024-09-17T01:41:37.173 INFO:tasks.workunit.client.0.smithi082.stdout:8/393: getdents d3/dd/d18/d51 0 2024-09-17T01:41:37.177 INFO:tasks.workunit.client.0.smithi082.stdout:5/525: mknod db/d56/d78/ca1 0 2024-09-17T01:41:37.178 INFO:tasks.workunit.client.1.smithi167.stdout:7/791: link d0/d2/d14/d19/d26/c5c d0/d2/d14/d19/d26/d83/d102/c116 0 2024-09-17T01:41:37.179 INFO:tasks.workunit.client.0.smithi082.stdout:8/394: mknod d3/dd/d18/d2d/d3e/d4a/d66/c79 0 2024-09-17T01:41:37.180 INFO:tasks.workunit.client.1.smithi167.stdout:6/990: chown d7/d54/d90/d13/d2f/d7f/d98/l4a 41818 1 2024-09-17T01:41:37.181 INFO:tasks.workunit.client.1.smithi167.stdout:0/847: creat d5/d6b/d77/d92/de2/f116 x:0 0 0 2024-09-17T01:41:37.184 INFO:tasks.workunit.client.1.smithi167.stdout:9/902: mkdir d4/d9/d21/d2d/d33/d90/d119 0 2024-09-17T01:41:37.188 INFO:tasks.workunit.client.0.smithi082.stdout:5/526: dwrite db/f8f [0,4194304] 0 2024-09-17T01:41:37.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/395: dwrite d3/dd/d18/d2d/d3e/d43/f45 [0,4194304] 0 2024-09-17T01:41:37.192 INFO:tasks.workunit.client.1.smithi167.stdout:1/860: creat d0/d5/f11c x:0 0 0 2024-09-17T01:41:37.194 INFO:tasks.workunit.client.0.smithi082.stdout:5/527: creat db/d2b/fa2 x:0 0 0 2024-09-17T01:41:37.195 INFO:tasks.workunit.client.1.smithi167.stdout:8/951: dwrite dc/d56/d59/d82/d85/d140/fca [4194304,4194304] 0 2024-09-17T01:41:37.195 INFO:tasks.workunit.client.0.smithi082.stdout:5/528: write db/f5a [2428753,108235] 0 2024-09-17T01:41:37.204 INFO:tasks.workunit.client.1.smithi167.stdout:4/832: dwrite d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/fe5 [0,4194304] 0 2024-09-17T01:41:37.207 INFO:tasks.workunit.client.0.smithi082.stdout:2/495: sync 2024-09-17T01:41:37.208 INFO:tasks.workunit.client.1.smithi167.stdout:5/797: dwrite d0/d24/d2b/d3d/dd2/fdf [4194304,4194304] 0 2024-09-17T01:41:37.208 INFO:tasks.workunit.client.0.smithi082.stdout:2/496: chown d1/d17/d29/f33 22 1 2024-09-17T01:41:37.209 INFO:tasks.workunit.client.1.smithi167.stdout:3/892: dwrite d7/d8/d10/d14/f10d [0,4194304] 0 2024-09-17T01:41:37.209 INFO:tasks.workunit.client.1.smithi167.stdout:6/991: creat d7/d54/d90/d13/d2f/d10f/d137/f14f x:0 0 0 2024-09-17T01:41:37.209 INFO:tasks.workunit.client.0.smithi082.stdout:2/497: chown d1/d17/d38 59 1 2024-09-17T01:41:37.210 INFO:tasks.workunit.client.1.smithi167.stdout:5/798: readlink d0/d54/d56/l5d 0 2024-09-17T01:41:37.212 INFO:tasks.workunit.client.1.smithi167.stdout:9/903: link d4/l1b d4/d9/d21/d2d/de4/l11a 0 2024-09-17T01:41:37.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:36 smithi082 ceph-mon[28077]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:37.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:36 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2023397744' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:41:37.214 INFO:tasks.workunit.client.0.smithi082.stdout:4/425: sync 2024-09-17T01:41:37.215 INFO:tasks.workunit.client.1.smithi167.stdout:9/904: chown d4/d9/d21/d2d/fb4 311961 1 2024-09-17T01:41:37.215 INFO:tasks.workunit.client.1.smithi167.stdout:0/848: rename d5/d6b/d77/d4d/f9c to d5/d6b/d77/d37/f117 0 2024-09-17T01:41:37.217 INFO:tasks.workunit.client.1.smithi167.stdout:9/905: write d4/da4/fbe [4025074,28973] 0 2024-09-17T01:41:37.217 INFO:tasks.workunit.client.1.smithi167.stdout:2/832: dread d5/d3c/d4c/de2/d45/d8e/f9b [0,4194304] 0 2024-09-17T01:41:37.217 INFO:tasks.workunit.client.0.smithi082.stdout:2/498: creat d1/d35/fa1 x:0 0 0 2024-09-17T01:41:37.217 INFO:tasks.workunit.client.1.smithi167.stdout:0/849: write d5/d6b/d77/fef [969960,50813] 0 2024-09-17T01:41:37.219 INFO:tasks.workunit.client.1.smithi167.stdout:0/850: dread - d5/d6b/d77/daa/db1/feb zero size 2024-09-17T01:41:37.221 INFO:tasks.workunit.client.1.smithi167.stdout:3/893: creat d7/d8/d10/d14/d25/d9e/f12f x:0 0 0 2024-09-17T01:41:37.222 INFO:tasks.workunit.client.1.smithi167.stdout:8/952: unlink dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/fce 0 2024-09-17T01:41:37.223 INFO:tasks.workunit.client.0.smithi082.stdout:2/499: symlink d1/d17/d38/d42/d52/d78/d82/la2 0 2024-09-17T01:41:37.226 INFO:tasks.workunit.client.1.smithi167.stdout:6/992: rename d7/d54/d90/d13/d2f/fca to d7/d52/d8c/d10d/f150 0 2024-09-17T01:41:37.226 INFO:tasks.workunit.client.1.smithi167.stdout:8/953: write dc/d56/d59/d82/d8f/de5/dba/dd3/df3/fb6 [1229911,110741] 0 2024-09-17T01:41:37.226 INFO:tasks.workunit.client.1.smithi167.stdout:5/799: dread d0/d24/d2b/fb2 [0,4194304] 0 2024-09-17T01:41:37.227 INFO:tasks.workunit.client.0.smithi082.stdout:2/500: symlink d1/d17/d38/d42/d52/d78/da0/la3 0 2024-09-17T01:41:37.228 INFO:tasks.workunit.client.1.smithi167.stdout:4/833: mknod d0/d4/d7/d10/c11d 0 2024-09-17T01:41:37.229 INFO:tasks.workunit.client.1.smithi167.stdout:8/954: truncate dc/d1a/f73 4251648 0 2024-09-17T01:41:37.230 INFO:tasks.workunit.client.1.smithi167.stdout:5/800: write d0/d24/d2b/d49/fc7 [1421671,105966] 0 2024-09-17T01:41:37.231 INFO:tasks.workunit.client.1.smithi167.stdout:3/894: creat d7/d8/d10/d14/d2c/d74/f130 x:0 0 0 2024-09-17T01:41:37.231 INFO:tasks.workunit.client.1.smithi167.stdout:4/834: dread - d0/d4/d7/da/d10e/d2d/d2e/d31/f119 zero size 2024-09-17T01:41:37.232 INFO:tasks.workunit.client.1.smithi167.stdout:5/801: chown d0/d24/d2b/fb2 22774887 1 2024-09-17T01:41:37.232 INFO:tasks.workunit.client.0.smithi082.stdout:2/501: mknod d1/ca4 0 2024-09-17T01:41:37.233 INFO:tasks.workunit.client.0.smithi082.stdout:2/502: write d1/d35/fa1 [559758,51934] 0 2024-09-17T01:41:37.236 INFO:tasks.workunit.client.1.smithi167.stdout:9/906: symlink d4/l11b 0 2024-09-17T01:41:37.237 INFO:tasks.workunit.client.1.smithi167.stdout:2/833: mkdir d5/d11d 0 2024-09-17T01:41:37.238 INFO:tasks.workunit.client.1.smithi167.stdout:8/955: dwrite dc/d56/d59/fda [0,4194304] 0 2024-09-17T01:41:37.238 INFO:tasks.workunit.client.0.smithi082.stdout:2/503: creat d1/d17/d29/d50/fa5 x:0 0 0 2024-09-17T01:41:37.239 INFO:tasks.workunit.client.1.smithi167.stdout:7/792: dread d0/d2/d14/d19/d26/fc0 [0,4194304] 0 2024-09-17T01:41:37.240 INFO:tasks.workunit.client.0.smithi082.stdout:2/504: write d1/d17/d38/d5c/f79 [1018747,102516] 0 2024-09-17T01:41:37.248 INFO:tasks.workunit.client.1.smithi167.stdout:5/802: creat d0/d24/d2b/d3d/d6d/ff1 x:0 0 0 2024-09-17T01:41:37.248 INFO:tasks.workunit.client.1.smithi167.stdout:9/907: rmdir d4/d9/d21/d2d/de4 39 2024-09-17T01:41:37.249 INFO:tasks.workunit.client.0.smithi082.stdout:8/396: write d3/dd/f23 [1673307,116274] 0 2024-09-17T01:41:37.250 INFO:tasks.workunit.client.1.smithi167.stdout:7/793: truncate d0/d2/d14/d23/f39 1768091 0 2024-09-17T01:41:37.250 INFO:tasks.workunit.client.1.smithi167.stdout:9/908: write d4/d9/d21/d2d/d33/d3a/d74/f89 [1007783,60093] 0 2024-09-17T01:41:37.252 INFO:tasks.workunit.client.1.smithi167.stdout:7/794: truncate d0/d2/d14/d19/d22/fee 379789 0 2024-09-17T01:41:37.253 INFO:tasks.workunit.client.0.smithi082.stdout:5/529: write db/d56/d18/d23/f65 [2999483,112556] 0 2024-09-17T01:41:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:36 smithi167 ceph-mon[35643]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:41:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:36 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2023397744' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:41:37.254 INFO:tasks.workunit.client.0.smithi082.stdout:8/397: mknod d3/dd/d18/d34/c7a 0 2024-09-17T01:41:37.255 INFO:tasks.workunit.client.1.smithi167.stdout:8/956: symlink dc/d56/d57/dc2/def/l144 0 2024-09-17T01:41:37.259 INFO:tasks.workunit.client.0.smithi082.stdout:5/530: rename db/d56/d29/c4c to db/d56/d78/da0/ca3 0 2024-09-17T01:41:37.259 INFO:tasks.workunit.client.1.smithi167.stdout:6/993: dread d7/d54/d90/f1b [0,4194304] 0 2024-09-17T01:41:37.259 INFO:tasks.workunit.client.0.smithi082.stdout:5/531: truncate db/d2b/fa2 785043 0 2024-09-17T01:41:37.261 INFO:tasks.workunit.client.1.smithi167.stdout:9/909: creat d4/d9/d21/d2d/d33/d105/f11c x:0 0 0 2024-09-17T01:41:37.262 INFO:tasks.workunit.client.1.smithi167.stdout:4/835: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/fd3 [0,4194304] 0 2024-09-17T01:41:37.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/398: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b 0 2024-09-17T01:41:37.262 INFO:tasks.workunit.client.1.smithi167.stdout:1/861: dwrite d0/d9/f103 [0,4194304] 0 2024-09-17T01:41:37.264 INFO:tasks.workunit.client.1.smithi167.stdout:3/895: creat d7/f131 x:0 0 0 2024-09-17T01:41:37.264 INFO:tasks.workunit.client.1.smithi167.stdout:1/862: write d0/d9/d16/d48/f11b [513150,80920] 0 2024-09-17T01:41:37.265 INFO:tasks.workunit.client.1.smithi167.stdout:3/896: readlink d7/d8f/lc1 0 2024-09-17T01:41:37.266 INFO:tasks.workunit.client.1.smithi167.stdout:1/863: fdatasync d0/d5/d34/d83/ffa 0 2024-09-17T01:41:37.268 INFO:tasks.workunit.client.1.smithi167.stdout:7/795: chown d0/d2/d14/d19/d32/f4d 0 1 2024-09-17T01:41:37.268 INFO:tasks.workunit.client.1.smithi167.stdout:3/897: write d7/d8/d10/d29/d75/fa0 [5195763,82826] 0 2024-09-17T01:41:37.269 INFO:tasks.workunit.client.1.smithi167.stdout:7/796: write d0/d2/d14/d19/f3e [1839268,23351] 0 2024-09-17T01:41:37.272 INFO:tasks.workunit.client.0.smithi082.stdout:5/532: dwrite db/d56/d29/d4f/f82 [0,4194304] 0 2024-09-17T01:41:37.273 INFO:tasks.workunit.client.0.smithi082.stdout:4/426: dwrite f7 [0,4194304] 0 2024-09-17T01:41:37.275 INFO:tasks.workunit.client.1.smithi167.stdout:8/957: dread dc/d56/faa [0,4194304] 0 2024-09-17T01:41:37.276 INFO:tasks.workunit.client.1.smithi167.stdout:5/803: chown d0/d24/d2b/d49/d66/l79 62971191 1 2024-09-17T01:41:37.277 INFO:tasks.workunit.client.0.smithi082.stdout:2/505: dread d1/f16 [0,4194304] 0 2024-09-17T01:41:37.281 INFO:tasks.workunit.client.0.smithi082.stdout:4/427: chown d9/d15/d16/d18/c24 310067 1 2024-09-17T01:41:37.282 INFO:tasks.workunit.client.0.smithi082.stdout:2/506: dread - d1/d10/f86 zero size 2024-09-17T01:41:37.283 INFO:tasks.workunit.client.0.smithi082.stdout:8/399: creat d3/dd/d18/d2d/d3e/f7c x:0 0 0 2024-09-17T01:41:37.283 INFO:tasks.workunit.client.0.smithi082.stdout:4/428: write d9/d15/d37/d45/f51 [492077,111438] 0 2024-09-17T01:41:37.285 INFO:tasks.workunit.client.1.smithi167.stdout:0/851: write d5/d6b/fb9 [310458,52543] 0 2024-09-17T01:41:37.285 INFO:tasks.workunit.client.0.smithi082.stdout:5/533: creat db/d56/d78/da0/fa4 x:0 0 0 2024-09-17T01:41:37.286 INFO:tasks.workunit.client.0.smithi082.stdout:5/534: read - db/d56/d78/da0/fa4 zero size 2024-09-17T01:41:37.290 INFO:tasks.workunit.client.1.smithi167.stdout:1/864: mknod d0/d5/d34/d83/d112/d85/df6/c11d 0 2024-09-17T01:41:37.291 INFO:tasks.workunit.client.0.smithi082.stdout:8/400: mknod d3/dd/d18/d2d/d3e/d4a/c7d 0 2024-09-17T01:41:37.294 INFO:tasks.workunit.client.1.smithi167.stdout:3/898: symlink d7/d8/d10/d14/d25/dfe/l132 0 2024-09-17T01:41:37.295 INFO:tasks.workunit.client.0.smithi082.stdout:2/507: mknod d1/d90/ca6 0 2024-09-17T01:41:37.298 INFO:tasks.workunit.client.0.smithi082.stdout:5/535: symlink db/d1e/d5b/la5 0 2024-09-17T01:41:37.300 INFO:tasks.workunit.client.1.smithi167.stdout:3/899: dwrite d7/faf [0,4194304] 0 2024-09-17T01:41:37.301 INFO:tasks.workunit.client.1.smithi167.stdout:9/910: fsync d4/d9/d21/d43/d6c/f8f 0 2024-09-17T01:41:37.303 INFO:tasks.workunit.client.0.smithi082.stdout:4/429: creat d9/d15/d37/f90 x:0 0 0 2024-09-17T01:41:37.307 INFO:tasks.workunit.client.0.smithi082.stdout:8/401: creat d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e x:0 0 0 2024-09-17T01:41:37.309 INFO:tasks.workunit.client.0.smithi082.stdout:2/508: mknod d1/ca7 0 2024-09-17T01:41:37.310 INFO:tasks.workunit.client.0.smithi082.stdout:4/430: readlink d9/lf 0 2024-09-17T01:41:37.313 INFO:tasks.workunit.client.1.smithi167.stdout:1/865: dwrite d0/d5/d34/d83/d112/d85/df6/f101 [0,4194304] 0 2024-09-17T01:41:37.314 INFO:tasks.workunit.client.0.smithi082.stdout:8/402: mknod d3/dd/d18/d2d/d3e/d43/c7f 0 2024-09-17T01:41:37.314 INFO:tasks.workunit.client.0.smithi082.stdout:8/403: chown d3/dd/d18/d3a 104875 1 2024-09-17T01:41:37.315 INFO:tasks.workunit.client.0.smithi082.stdout:2/509: rename d1/d5a/l7b to d1/d66/d85/la8 0 2024-09-17T01:41:37.318 INFO:tasks.workunit.client.1.smithi167.stdout:3/900: mkdir d7/d8/d10/d14/d66/d133 0 2024-09-17T01:41:37.323 INFO:tasks.workunit.client.0.smithi082.stdout:2/510: creat d1/d5a/d6d/fa9 x:0 0 0 2024-09-17T01:41:37.325 INFO:tasks.workunit.client.0.smithi082.stdout:4/431: mkdir d9/d15/d16/d18/d4a/d8f/d91 0 2024-09-17T01:41:37.326 INFO:tasks.workunit.client.1.smithi167.stdout:6/994: link d7/d54/d90/d34/dc8/f115 d7/d54/d90/d13/d2f/d96/dab/f151 0 2024-09-17T01:41:37.328 INFO:tasks.workunit.client.1.smithi167.stdout:0/852: mkdir d5/d6b/d77/d4d/d56/d108/d118 0 2024-09-17T01:41:37.329 INFO:tasks.workunit.client.1.smithi167.stdout:9/911: dwrite d4/d9/d21/d43/d6c/d9e/da1/f116 [4194304,4194304] 0 2024-09-17T01:41:37.330 INFO:tasks.workunit.client.0.smithi082.stdout:2/511: dwrite d1/d17/f21 [4194304,4194304] 0 2024-09-17T01:41:37.332 INFO:tasks.workunit.client.0.smithi082.stdout:0/335: sync 2024-09-17T01:41:37.333 INFO:tasks.workunit.client.0.smithi082.stdout:1/540: sync 2024-09-17T01:41:37.333 INFO:tasks.workunit.client.1.smithi167.stdout:4/836: rename d0/d4/d7/da/f80 to d0/d4/d7/da/d10e/d2d/f11e 0 2024-09-17T01:41:37.333 INFO:tasks.workunit.client.0.smithi082.stdout:1/541: chown d2/df/d46/f49 0 1 2024-09-17T01:41:37.337 INFO:tasks.workunit.client.0.smithi082.stdout:4/432: truncate d9/fa 862498 0 2024-09-17T01:41:37.338 INFO:tasks.workunit.client.1.smithi167.stdout:5/804: write d0/f13 [788580,72413] 0 2024-09-17T01:41:37.338 INFO:tasks.workunit.client.0.smithi082.stdout:4/433: chown d9/d15/d16/f2f 0 1 2024-09-17T01:41:37.340 INFO:tasks.workunit.client.1.smithi167.stdout:1/866: mkdir d0/d5/d34/d83/d112/d74/d11e 0 2024-09-17T01:41:37.341 INFO:tasks.workunit.client.0.smithi082.stdout:1/542: mknod d2/d3f/d24/ca9 0 2024-09-17T01:41:37.343 INFO:tasks.workunit.client.1.smithi167.stdout:0/853: dwrite d5/d6b/d77/d4d/d56/ff4 [0,4194304] 0 2024-09-17T01:41:37.344 INFO:tasks.workunit.client.0.smithi082.stdout:5/536: write db/d56/d29/d4f/f57 [415168,59828] 0 2024-09-17T01:41:37.344 INFO:tasks.workunit.client.1.smithi167.stdout:1/867: chown d0/d9/d16/d22 148376 1 2024-09-17T01:41:37.345 INFO:tasks.workunit.client.1.smithi167.stdout:9/912: symlink d4/d9/d21/d2d/d33/d90/dac/l11d 0 2024-09-17T01:41:37.346 INFO:tasks.workunit.client.1.smithi167.stdout:6/995: read d7/d54/d90/d13/d2f/d30/d32/f58 [298030,2892] 0 2024-09-17T01:41:37.347 INFO:tasks.workunit.client.1.smithi167.stdout:5/805: write d0/d24/d2b/d49/d4b/dac/d80/fe7 [64784,733] 0 2024-09-17T01:41:37.347 INFO:tasks.workunit.client.0.smithi082.stdout:4/434: dwrite d9/d15/f62 [0,4194304] 0 2024-09-17T01:41:37.348 INFO:tasks.workunit.client.0.smithi082.stdout:1/543: mkdir d2/df/d46/daa 0 2024-09-17T01:41:37.348 INFO:tasks.workunit.client.1.smithi167.stdout:7/797: getdents d0/d2/d14/d6f/d87/dae 0 2024-09-17T01:41:37.350 INFO:tasks.workunit.client.1.smithi167.stdout:8/958: dwrite dc/dae/fd9 [0,4194304] 0 2024-09-17T01:41:37.352 INFO:tasks.workunit.client.0.smithi082.stdout:2/512: rename d1/d10/f19 to d1/d17/faa 0 2024-09-17T01:41:37.352 INFO:tasks.workunit.client.1.smithi167.stdout:6/996: fsync d7/d52/d79/f140 0 2024-09-17T01:41:37.355 INFO:tasks.workunit.client.0.smithi082.stdout:8/404: write d3/dd/ff [1340401,120822] 0 2024-09-17T01:41:37.356 INFO:tasks.workunit.client.1.smithi167.stdout:3/901: dread d7/d8/d10/d14/d2c/d6f/fe0 [0,4194304] 0 2024-09-17T01:41:37.357 INFO:tasks.workunit.client.0.smithi082.stdout:1/544: creat d2/df/fab x:0 0 0 2024-09-17T01:41:37.361 INFO:tasks.workunit.client.0.smithi082.stdout:2/513: symlink d1/d5a/d6d/lab 0 2024-09-17T01:41:37.363 INFO:tasks.workunit.client.1.smithi167.stdout:1/868: rename d0/d9/d16/d48/de6/f10a to d0/d5/d34/d83/d112/d85/d10c/f11f 0 2024-09-17T01:41:37.365 INFO:tasks.workunit.client.1.smithi167.stdout:1/869: write d0/d5/d34/f70 [5218665,125022] 0 2024-09-17T01:41:37.366 INFO:tasks.workunit.client.1.smithi167.stdout:1/870: write d0/d5/d34/f7d [3106677,52918] 0 2024-09-17T01:41:37.366 INFO:tasks.workunit.client.0.smithi082.stdout:0/336: rename da/d1b/d23/c61 to da/d1b/d23/d42/d43/d6b/c78 0 2024-09-17T01:41:37.367 INFO:tasks.workunit.client.1.smithi167.stdout:1/871: chown d0/l10e 133837 1 2024-09-17T01:41:37.368 INFO:tasks.workunit.client.0.smithi082.stdout:9/408: sync 2024-09-17T01:41:37.368 INFO:tasks.workunit.client.0.smithi082.stdout:7/494: sync 2024-09-17T01:41:37.368 INFO:tasks.workunit.client.0.smithi082.stdout:6/483: sync 2024-09-17T01:41:37.368 INFO:tasks.workunit.client.0.smithi082.stdout:3/359: sync 2024-09-17T01:41:37.372 INFO:tasks.workunit.client.0.smithi082.stdout:1/545: creat d2/da/d2f/d47/fac x:0 0 0 2024-09-17T01:41:37.372 INFO:tasks.workunit.client.1.smithi167.stdout:8/959: symlink dc/d56/d59/d82/d8f/de5/dba/d134/dea/l145 0 2024-09-17T01:41:37.377 INFO:tasks.workunit.client.1.smithi167.stdout:9/913: mkdir d4/d9/d21/d2d/d11e 0 2024-09-17T01:41:37.379 INFO:tasks.workunit.client.0.smithi082.stdout:8/405: rename d3/dd/d18/l70 to d3/dd/d18/d2d/d3e/d4a/d6a/l80 0 2024-09-17T01:41:37.381 INFO:tasks.workunit.client.0.smithi082.stdout:2/514: dwrite d1/d17/d38/f99 [0,4194304] 0 2024-09-17T01:41:37.382 INFO:tasks.workunit.client.1.smithi167.stdout:4/837: dread d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/f11c [0,4194304] 0 2024-09-17T01:41:37.384 INFO:tasks.workunit.client.1.smithi167.stdout:4/838: fdatasync d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/dad/f113 0 2024-09-17T01:41:37.388 INFO:tasks.workunit.client.0.smithi082.stdout:5/537: creat db/d56/d29/fa6 x:0 0 0 2024-09-17T01:41:37.390 INFO:tasks.workunit.client.1.smithi167.stdout:7/798: write d0/d2/d14/d19/d26/fa6 [276075,4566] 0 2024-09-17T01:41:37.391 INFO:tasks.workunit.client.0.smithi082.stdout:3/360: symlink d9/db/l7a 0 2024-09-17T01:41:37.392 INFO:tasks.workunit.client.1.smithi167.stdout:6/997: dread d7/d54/d90/d13/d2f/d64/d6b/ffe [0,4194304] 0 2024-09-17T01:41:37.393 INFO:tasks.workunit.client.0.smithi082.stdout:5/538: dwrite db/d56/f50 [0,4194304] 0 2024-09-17T01:41:37.395 INFO:tasks.workunit.client.0.smithi082.stdout:9/409: mknod d4/d27/d2d/d60/d11/d39/d31/c8b 0 2024-09-17T01:41:37.396 INFO:tasks.workunit.client.0.smithi082.stdout:9/410: chown d4/d27/d2d/d60/d11/d39/d31/c6a 294241853 1 2024-09-17T01:41:37.400 INFO:tasks.workunit.client.1.smithi167.stdout:8/960: mkdir dc/d21/d6b/d113/d146 0 2024-09-17T01:41:37.402 INFO:tasks.workunit.client.0.smithi082.stdout:8/406: creat d3/dd/d18/d2d/d3e/d4a/f81 x:0 0 0 2024-09-17T01:41:37.403 INFO:tasks.workunit.client.0.smithi082.stdout:0/337: dread da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:37.404 INFO:tasks.workunit.client.0.smithi082.stdout:2/515: read d1/d10/f2f [2973579,698] 0 2024-09-17T01:41:37.405 INFO:tasks.workunit.client.0.smithi082.stdout:6/484: unlink d1/d1f/f66 0 2024-09-17T01:41:37.405 INFO:tasks.workunit.client.1.smithi167.stdout:4/839: chown d0/d4/d7/da/d10e/d2d/d2e/d31/d75/lc1 25 1 2024-09-17T01:41:37.406 INFO:tasks.workunit.client.1.smithi167.stdout:7/799: mknod d0/d2/d14/d6f/c117 0 2024-09-17T01:41:37.407 INFO:tasks.workunit.client.1.smithi167.stdout:6/998: rmdir d7/d54/d90/d13/d2f/d7f/d98 39 2024-09-17T01:41:37.407 INFO:tasks.workunit.client.1.smithi167.stdout:6/999: stat d7/d52/l101 0 2024-09-17T01:41:37.409 INFO:tasks.workunit.client.1.smithi167.stdout:5/806: link d0/d9/c1b d0/d54/d56/de1/cf2 0 2024-09-17T01:41:37.410 INFO:tasks.workunit.client.1.smithi167.stdout:8/961: creat dc/d1a/f147 x:0 0 0 2024-09-17T01:41:37.411 INFO:tasks.workunit.client.0.smithi082.stdout:9/411: creat d4/d27/d2d/d3d/f8c x:0 0 0 2024-09-17T01:41:37.412 INFO:tasks.workunit.client.0.smithi082.stdout:4/435: getdents d9/d15/d16/d18/d4a/d52/d55 0 2024-09-17T01:41:37.413 INFO:tasks.workunit.client.1.smithi167.stdout:4/840: truncate d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f7b 1119562 0 2024-09-17T01:41:37.414 INFO:tasks.workunit.client.0.smithi082.stdout:0/338: mknod da/d1b/c79 0 2024-09-17T01:41:37.414 INFO:tasks.workunit.client.1.smithi167.stdout:7/800: truncate d0/d2/d14/d6f/d87/f93 1662035 0 2024-09-17T01:41:37.416 INFO:tasks.workunit.client.1.smithi167.stdout:5/807: mkdir d0/d24/d2b/d3d/d3b/d92/df3 0 2024-09-17T01:41:37.418 INFO:tasks.workunit.client.0.smithi082.stdout:2/516: creat d1/d66/d85/fac x:0 0 0 2024-09-17T01:41:37.419 INFO:tasks.workunit.client.0.smithi082.stdout:6/485: mkdir d1/d1f/db0 0 2024-09-17T01:41:37.420 INFO:tasks.workunit.client.1.smithi167.stdout:3/902: link d7/d8/d10/d14/d24/d62/d92/cdf d7/d8/d10/d14/df5/c134 0 2024-09-17T01:41:37.420 INFO:tasks.workunit.client.1.smithi167.stdout:3/903: readlink d7/d8/d10/d14/d25/l49 0 2024-09-17T01:41:37.421 INFO:tasks.workunit.client.0.smithi082.stdout:0/339: dwrite da/df/f53 [0,4194304] 0 2024-09-17T01:41:37.423 INFO:tasks.workunit.client.0.smithi082.stdout:5/539: mkdir db/da7 0 2024-09-17T01:41:37.423 INFO:tasks.workunit.client.0.smithi082.stdout:0/340: chown da/df/d71/f51 0 1 2024-09-17T01:41:37.427 INFO:tasks.workunit.client.1.smithi167.stdout:7/801: unlink d0/d2/d14/d19/d32/d9c/cea 0 2024-09-17T01:41:37.428 INFO:tasks.workunit.client.1.smithi167.stdout:7/802: dread - d0/d2/d14/d6f/fdc zero size 2024-09-17T01:41:37.429 INFO:tasks.workunit.client.1.smithi167.stdout:2/834: sync 2024-09-17T01:41:37.430 INFO:tasks.workunit.client.1.smithi167.stdout:5/808: fdatasync d0/d9/f8c 0 2024-09-17T01:41:37.433 INFO:tasks.workunit.client.1.smithi167.stdout:8/962: symlink dc/d56/d59/d82/d8f/de5/dba/dd3/l148 0 2024-09-17T01:41:37.435 INFO:tasks.workunit.client.1.smithi167.stdout:9/914: dread d4/d9/f9a [0,4194304] 0 2024-09-17T01:41:37.435 INFO:tasks.workunit.client.1.smithi167.stdout:3/904: readlink d7/d8/l47 0 2024-09-17T01:41:37.436 INFO:tasks.workunit.client.1.smithi167.stdout:7/803: dwrite d0/d2/d14/d19/d22/fc6 [0,4194304] 0 2024-09-17T01:41:37.437 INFO:tasks.workunit.client.1.smithi167.stdout:3/905: chown d7/d8/d10/d14/d25 337860 1 2024-09-17T01:41:37.437 INFO:tasks.workunit.client.1.smithi167.stdout:4/841: mkdir d0/d4/d7/da/d10e/d2d/d11f 0 2024-09-17T01:41:37.446 INFO:tasks.workunit.client.0.smithi082.stdout:1/546: truncate d2/da/f35 1203266 0 2024-09-17T01:41:37.447 INFO:tasks.workunit.client.1.smithi167.stdout:5/809: mknod d0/d24/d2b/d49/d4b/dac/d3a/d4d/cf4 0 2024-09-17T01:41:37.450 INFO:tasks.workunit.client.0.smithi082.stdout:0/341: dwrite da/d1b/d23/d4d/d5d/f66 [0,4194304] 0 2024-09-17T01:41:37.451 INFO:tasks.workunit.client.0.smithi082.stdout:4/436: creat d9/d15/d16/d44/d8d/f92 x:0 0 0 2024-09-17T01:41:37.452 INFO:tasks.workunit.client.1.smithi167.stdout:5/810: dwrite d0/d24/fab [0,4194304] 0 2024-09-17T01:41:37.453 INFO:tasks.workunit.client.0.smithi082.stdout:0/342: truncate da/d1b/d23/d42/d43/f5f 517036 0 2024-09-17T01:41:37.454 INFO:tasks.workunit.client.0.smithi082.stdout:8/407: link d3/dd/d18/d2d/d3b/l62 d3/dd/d18/d2d/d3e/l82 0 2024-09-17T01:41:37.458 INFO:tasks.workunit.client.1.smithi167.stdout:9/915: mknod d4/d9/d2b/c11f 0 2024-09-17T01:41:37.460 INFO:tasks.workunit.client.0.smithi082.stdout:6/486: mknod d1/d7/d10/d4f/dc/d1d/d36/cb1 0 2024-09-17T01:41:37.461 INFO:tasks.workunit.client.0.smithi082.stdout:6/487: chown d1/d7/f85 2311 1 2024-09-17T01:41:37.462 INFO:tasks.workunit.client.1.smithi167.stdout:4/842: unlink d0/d4/d7/da/d48/ca4 0 2024-09-17T01:41:37.464 INFO:tasks.workunit.client.1.smithi167.stdout:4/843: dread - d0/d4/d7/da/d48/f10a zero size 2024-09-17T01:41:37.464 INFO:tasks.workunit.client.0.smithi082.stdout:9/412: write d4/f49 [4913720,56754] 0 2024-09-17T01:41:37.470 INFO:tasks.workunit.client.0.smithi082.stdout:1/547: symlink d2/df/lad 0 2024-09-17T01:41:37.471 INFO:tasks.workunit.client.0.smithi082.stdout:4/437: readlink d9/d15/l30 0 2024-09-17T01:41:37.473 INFO:tasks.workunit.client.1.smithi167.stdout:8/963: link dc/dae/f11c dc/d21/d6b/dee/f149 0 2024-09-17T01:41:37.473 INFO:tasks.workunit.client.0.smithi082.stdout:8/408: creat d3/dd/d18/d2d/d58/f83 x:0 0 0 2024-09-17T01:41:37.474 INFO:tasks.workunit.client.1.smithi167.stdout:5/811: chown d0/d24/d2b/d3d/dd2/dc4 248615 1 2024-09-17T01:41:37.474 INFO:tasks.workunit.client.1.smithi167.stdout:3/906: dread d7/d8/d10/d14/d24/d62/f77 [0,4194304] 0 2024-09-17T01:41:37.474 INFO:tasks.workunit.client.1.smithi167.stdout:8/964: truncate dc/d21/d11d/f11f 503291 0 2024-09-17T01:41:37.475 INFO:tasks.workunit.client.0.smithi082.stdout:8/409: write d3/dd/d18/d2d/d58/f83 [475596,80279] 0 2024-09-17T01:41:37.476 INFO:tasks.workunit.client.1.smithi167.stdout:3/907: readlink d7/d8/d10/d14/d25/l49 0 2024-09-17T01:41:37.479 INFO:tasks.workunit.client.1.smithi167.stdout:7/804: dread d0/d2/d14/f107 [0,4194304] 0 2024-09-17T01:41:37.481 INFO:tasks.workunit.client.0.smithi082.stdout:1/548: creat d2/d3f/d24/d54/fae x:0 0 0 2024-09-17T01:41:37.481 INFO:tasks.workunit.client.1.smithi167.stdout:8/965: dread - dc/d1a/d45/f54 zero size 2024-09-17T01:41:37.483 INFO:tasks.workunit.client.1.smithi167.stdout:4/844: symlink d0/d4/d7/d6/l120 0 2024-09-17T01:41:37.483 INFO:tasks.workunit.client.1.smithi167.stdout:4/845: dread - d0/d4/d7/d6/f108 zero size 2024-09-17T01:41:37.484 INFO:tasks.workunit.client.1.smithi167.stdout:4/846: write d0/d4/d7/d10/ff4 [473423,74206] 0 2024-09-17T01:41:37.485 INFO:tasks.workunit.client.1.smithi167.stdout:0/854: sync 2024-09-17T01:41:37.488 INFO:tasks.workunit.client.1.smithi167.stdout:3/908: rename d7/d8/d10/d29/d75/lba to d7/d8/d10/d14/d24/d62/d92/l135 0 2024-09-17T01:41:37.490 INFO:tasks.workunit.client.0.smithi082.stdout:2/517: getdents d1/d10 0 2024-09-17T01:41:37.490 INFO:tasks.workunit.client.1.smithi167.stdout:9/916: getdents d4/d9/d21/d2d/de4/de7 0 2024-09-17T01:41:37.491 INFO:tasks.workunit.client.0.smithi082.stdout:6/488: mkdir d1/d7/d10/d4f/dc/d2b/db2 0 2024-09-17T01:41:37.493 INFO:tasks.workunit.client.1.smithi167.stdout:7/805: fdatasync d0/d2/f9d 0 2024-09-17T01:41:37.493 INFO:tasks.workunit.client.0.smithi082.stdout:6/489: truncate d1/d7/d10/d4f/dc/d2b/d48/f2a 1350411 0 2024-09-17T01:41:37.495 INFO:tasks.workunit.client.1.smithi167.stdout:0/855: dwrite d5/d6b/d77/f54 [4194304,4194304] 0 2024-09-17T01:41:37.497 INFO:tasks.workunit.client.1.smithi167.stdout:2/835: dwrite d5/d3c/d4c/de2/d2e/f4b [0,4194304] 0 2024-09-17T01:41:37.497 INFO:tasks.workunit.client.1.smithi167.stdout:0/856: readlink d5/d6b/d77/d37/d80/l113 0 2024-09-17T01:41:37.498 INFO:tasks.workunit.client.1.smithi167.stdout:2/836: fdatasync d5/d3c/d4c/d4d/fac 0 2024-09-17T01:41:37.499 INFO:tasks.workunit.client.0.smithi082.stdout:5/540: getdents db/d56/d18 0 2024-09-17T01:41:37.500 INFO:tasks.workunit.client.1.smithi167.stdout:2/837: readlink d5/d3c/d4c/de2/d45/d8e/d98/dfa/l7a 0 2024-09-17T01:41:37.500 INFO:tasks.workunit.client.1.smithi167.stdout:5/812: fdatasync d0/d24/d2b/d49/d4b/dac/d3a/d44/f5e 0 2024-09-17T01:41:37.501 INFO:tasks.workunit.client.0.smithi082.stdout:0/343: truncate da/d1b/d23/d42/f58 860025 0 2024-09-17T01:41:37.505 INFO:tasks.workunit.client.1.smithi167.stdout:8/966: dread dc/d21/f44 [0,4194304] 0 2024-09-17T01:41:37.506 INFO:tasks.workunit.client.1.smithi167.stdout:8/967: write dc/d56/d59/d82/d8f/de5/dba/d134/dea/d110/f13c [37148,5681] 0 2024-09-17T01:41:37.509 INFO:tasks.workunit.client.0.smithi082.stdout:8/410: write d3/dd/d18/d2d/d3e/f71 [1029159,18127] 0 2024-09-17T01:41:37.515 INFO:tasks.workunit.client.1.smithi167.stdout:3/909: mkdir d7/d8/d10/d14/d25/dc7/dd1/dc2/d112/d136 0 2024-09-17T01:41:37.517 INFO:tasks.workunit.client.0.smithi082.stdout:0/344: mknod da/d1b/c7a 0 2024-09-17T01:41:37.518 INFO:tasks.workunit.client.0.smithi082.stdout:9/413: dwrite d4/f30 [0,4194304] 0 2024-09-17T01:41:37.518 INFO:tasks.workunit.client.0.smithi082.stdout:6/490: dread d1/d1f/f64 [0,4194304] 0 2024-09-17T01:41:37.520 INFO:tasks.workunit.client.0.smithi082.stdout:2/518: dread d1/d17/d29/d50/f77 [0,4194304] 0 2024-09-17T01:41:37.520 INFO:tasks.workunit.client.0.smithi082.stdout:8/411: dread d3/dd/d18/d2d/d3b/f48 [0,4194304] 0 2024-09-17T01:41:37.521 INFO:tasks.workunit.client.0.smithi082.stdout:6/491: stat d1/d7/d10/f38 0 2024-09-17T01:41:37.522 INFO:tasks.workunit.client.0.smithi082.stdout:2/519: fdatasync d1/fd 0 2024-09-17T01:41:37.522 INFO:tasks.workunit.client.0.smithi082.stdout:0/345: fdatasync da/d1b/d23/d42/d43/d6b/f6c 0 2024-09-17T01:41:37.523 INFO:tasks.workunit.client.1.smithi167.stdout:2/838: mknod d5/d3c/d4c/de2/d46/c11e 0 2024-09-17T01:41:37.524 INFO:tasks.workunit.client.0.smithi082.stdout:9/414: rmdir d4/d27/d2d/d3d 39 2024-09-17T01:41:37.524 INFO:tasks.workunit.client.0.smithi082.stdout:6/492: fsync d1/d7/f5c 0 2024-09-17T01:41:37.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/813: mknod d0/d24/d2b/d49/d4b/dac/d3a/cf5 0 2024-09-17T01:41:37.525 INFO:tasks.workunit.client.0.smithi082.stdout:5/541: creat db/d1e/fa8 x:0 0 0 2024-09-17T01:41:37.526 INFO:tasks.workunit.client.1.smithi167.stdout:4/847: getdents d0/d4/d7/da/d10e/d2d/d2e/d31/d75/dfb 0 2024-09-17T01:41:37.526 INFO:tasks.workunit.client.0.smithi082.stdout:6/493: chown d1/d7/f2e 0 1 2024-09-17T01:41:37.529 INFO:tasks.workunit.client.0.smithi082.stdout:8/412: creat d3/dd/f84 x:0 0 0 2024-09-17T01:41:37.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/438: truncate d9/d15/d16/d3e/f50 4277 0 2024-09-17T01:41:37.532 INFO:tasks.workunit.client.1.smithi167.stdout:4/848: dwrite d0/d4/d7/dff/df2/f111 [0,4194304] 0 2024-09-17T01:41:37.532 INFO:tasks.workunit.client.0.smithi082.stdout:2/520: creat d1/d66/d85/fad x:0 0 0 2024-09-17T01:41:37.533 INFO:tasks.workunit.client.0.smithi082.stdout:9/415: dwrite d4/f30 [0,4194304] 0 2024-09-17T01:41:37.535 INFO:tasks.workunit.client.1.smithi167.stdout:1/872: sync 2024-09-17T01:41:37.536 INFO:tasks.workunit.client.1.smithi167.stdout:1/873: dread - d0/d5/f11c zero size 2024-09-17T01:41:37.538 INFO:tasks.workunit.client.1.smithi167.stdout:7/806: write d0/d2/f66 [245169,48190] 0 2024-09-17T01:41:37.539 INFO:tasks.workunit.client.0.smithi082.stdout:0/346: dread - da/d1b/f4f zero size 2024-09-17T01:41:37.540 INFO:tasks.workunit.client.1.smithi167.stdout:0/857: creat d5/d6b/d77/d6d/d90/dc4/de3/f119 x:0 0 0 2024-09-17T01:41:37.541 INFO:tasks.workunit.client.1.smithi167.stdout:7/807: truncate d0/d2/d88/d6e/dd8/f114 906103 0 2024-09-17T01:41:37.542 INFO:tasks.workunit.client.0.smithi082.stdout:5/542: chown db/d2b/l6e 17924 1 2024-09-17T01:41:37.544 INFO:tasks.workunit.client.0.smithi082.stdout:8/413: mkdir d3/dd/d18/d2d/d58/d85 0 2024-09-17T01:41:37.546 INFO:tasks.workunit.client.1.smithi167.stdout:5/814: mknod d0/d24/d2b/d3d/d3b/d5f/cf6 0 2024-09-17T01:41:37.546 INFO:tasks.workunit.client.0.smithi082.stdout:6/494: dread d1/d3/f3b [0,4194304] 0 2024-09-17T01:41:37.546 INFO:tasks.workunit.client.0.smithi082.stdout:8/414: truncate d3/dd/d18/d3a/f57 658439 0 2024-09-17T01:41:37.546 INFO:tasks.workunit.client.1.smithi167.stdout:5/815: chown d0/d24/d2b/d49/d4b/dac/d3a/d4d/fd0 119 1 2024-09-17T01:41:37.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/521: truncate d1/f1b 3099769 0 2024-09-17T01:41:37.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/522: stat d1/d10/f88 0 2024-09-17T01:41:37.549 INFO:tasks.workunit.client.0.smithi082.stdout:9/416: rmdir d4/d59 39 2024-09-17T01:41:37.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/415: read d3/dd/f27 [3937183,92911] 0 2024-09-17T01:41:37.553 INFO:tasks.workunit.client.1.smithi167.stdout:4/849: stat d0/d4/c8 0 2024-09-17T01:41:37.554 INFO:tasks.workunit.client.1.smithi167.stdout:4/850: write d0/d4/d7/d10/ff0 [1170078,108592] 0 2024-09-17T01:41:37.555 INFO:tasks.workunit.client.1.smithi167.stdout:9/917: creat d4/d9/d21/d2d/d33/d3a/f120 x:0 0 0 2024-09-17T01:41:37.556 INFO:tasks.workunit.client.0.smithi082.stdout:5/543: rmdir db/d56/d18 39 2024-09-17T01:41:37.556 INFO:tasks.workunit.client.1.smithi167.stdout:9/918: write d4/da4/fbe [328236,28432] 0 2024-09-17T01:41:37.563 INFO:tasks.workunit.client.0.smithi082.stdout:2/523: mknod d1/d90/cae 0 2024-09-17T01:41:37.565 INFO:tasks.workunit.client.0.smithi082.stdout:9/417: dread d4/d27/d2d/d60/d11/d37/f3c [4194304,4194304] 0 2024-09-17T01:41:37.571 INFO:tasks.workunit.client.1.smithi167.stdout:1/874: write d0/d9/d16/d48/d54/d6e/d7e/fe5 [467513,103644] 0 2024-09-17T01:41:37.572 INFO:tasks.workunit.client.1.smithi167.stdout:7/808: write d0/d2/d14/d19/d26/f1c [1801319,92158] 0 2024-09-17T01:41:37.574 INFO:tasks.workunit.client.1.smithi167.stdout:2/839: dread d5/dfe/f10e [4194304,4194304] 0 2024-09-17T01:41:37.575 INFO:tasks.workunit.client.1.smithi167.stdout:9/919: dread d4/d9/d21/f3c [0,4194304] 0 2024-09-17T01:41:37.576 INFO:tasks.workunit.client.1.smithi167.stdout:8/968: rename dc/d56/d57/da0/da7/ff2 to dc/d56/d59/d82/d8f/de5/dba/dd3/f14a 0 2024-09-17T01:41:37.577 INFO:tasks.workunit.client.0.smithi082.stdout:6/495: dwrite d1/d7/f24 [0,4194304] 0 2024-09-17T01:41:37.577 INFO:tasks.workunit.client.1.smithi167.stdout:8/969: write dc/d56/d59/d82/f109 [3559279,35113] 0 2024-09-17T01:41:37.578 INFO:tasks.workunit.client.0.smithi082.stdout:6/496: readlink d1/d7/d10/d4f/dc/d2b/d48/l59 0 2024-09-17T01:41:37.579 INFO:tasks.workunit.client.0.smithi082.stdout:2/524: unlink d1/d17/d38/d42/f43 0 2024-09-17T01:41:37.580 INFO:tasks.workunit.client.1.smithi167.stdout:8/970: truncate dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f10d 915997 0 2024-09-17T01:41:37.583 INFO:tasks.workunit.client.1.smithi167.stdout:7/809: creat d0/d2/d88/f118 x:0 0 0 2024-09-17T01:41:37.584 INFO:tasks.workunit.client.0.smithi082.stdout:8/416: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86 0 2024-09-17T01:41:37.584 INFO:tasks.workunit.client.1.smithi167.stdout:9/920: mkdir d4/d9/d2b/d121 0 2024-09-17T01:41:37.585 INFO:tasks.workunit.client.1.smithi167.stdout:2/840: mkdir d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f 0 2024-09-17T01:41:37.587 INFO:tasks.workunit.client.0.smithi082.stdout:0/347: dwrite da/d1e/f74 [0,4194304] 0 2024-09-17T01:41:37.588 INFO:tasks.workunit.client.1.smithi167.stdout:3/910: rename d7/d8/d10/d14/d2c/d74/c8c to d7/d8f/d9b/c137 0 2024-09-17T01:41:37.595 INFO:tasks.workunit.client.0.smithi082.stdout:2/525: chown d1/d66/d85/la8 1751670 1 2024-09-17T01:41:37.598 INFO:tasks.workunit.client.1.smithi167.stdout:0/858: rename d5/dee/lf3 to d5/d6b/d77/daa/db1/l11a 0 2024-09-17T01:41:37.599 INFO:tasks.workunit.client.0.smithi082.stdout:9/418: mkdir d4/d27/d2d/d60/d11/d8d 0 2024-09-17T01:41:37.599 INFO:tasks.workunit.client.1.smithi167.stdout:0/859: stat d5/d6b/d77/d6d/d90/dc4/f107 0 2024-09-17T01:41:37.599 INFO:tasks.workunit.client.1.smithi167.stdout:3/911: read - d7/d8f/fae zero size 2024-09-17T01:41:37.600 INFO:tasks.workunit.client.0.smithi082.stdout:9/419: chown d4/d27/d2d/d60/d11/d39/d29 993951 1 2024-09-17T01:41:37.600 INFO:tasks.workunit.client.1.smithi167.stdout:3/912: write d7/d8/d10/d14/d24/d62/f90 [1304506,80665] 0 2024-09-17T01:41:37.601 INFO:tasks.workunit.client.1.smithi167.stdout:4/851: getdents d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/dcb/ddb 0 2024-09-17T01:41:37.608 INFO:tasks.workunit.client.1.smithi167.stdout:9/921: creat d4/d9/d21/d43/dc4/d103/d112/f122 x:0 0 0 2024-09-17T01:41:37.608 INFO:tasks.workunit.client.0.smithi082.stdout:5/544: creat db/d56/d18/d98/fa9 x:0 0 0 2024-09-17T01:41:37.609 INFO:tasks.workunit.client.1.smithi167.stdout:2/841: fdatasync d5/d3c/d4c/de2/db8/da3/f26 0 2024-09-17T01:41:37.610 INFO:tasks.workunit.client.0.smithi082.stdout:6/497: mkdir d1/d7/d10/d4f/dc/d2b/db2/db3 0 2024-09-17T01:41:37.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/439: truncate d9/d15/d16/d3e/f50 450202 0 2024-09-17T01:41:37.611 INFO:tasks.workunit.client.1.smithi167.stdout:9/922: dwrite d4/d9/d21/d2d/dae/fe2 [4194304,4194304] 0 2024-09-17T01:41:37.613 INFO:tasks.workunit.client.0.smithi082.stdout:8/417: truncate d3/dd/d18/f1e 2043472 0 2024-09-17T01:41:37.615 INFO:tasks.workunit.client.1.smithi167.stdout:3/913: unlink f3 0 2024-09-17T01:41:37.617 INFO:tasks.workunit.client.1.smithi167.stdout:7/810: dwrite d0/d2/d14/d19/f77 [0,4194304] 0 2024-09-17T01:41:37.618 INFO:tasks.workunit.client.1.smithi167.stdout:4/852: mknod d0/d4/d7/dff/df2/c121 0 2024-09-17T01:41:37.619 INFO:tasks.workunit.client.0.smithi082.stdout:9/420: mknod d4/d27/d2d/d60/d11/d39/d44/c8e 0 2024-09-17T01:41:37.620 INFO:tasks.workunit.client.0.smithi082.stdout:5/545: mknod db/d1e/d5b/caa 0 2024-09-17T01:41:37.623 INFO:tasks.workunit.client.0.smithi082.stdout:4/440: rename d9/lf to d9/d15/d16/d18/d4a/d52/l93 0 2024-09-17T01:41:37.624 INFO:tasks.workunit.client.1.smithi167.stdout:2/842: symlink d5/d6d/l120 0 2024-09-17T01:41:37.626 INFO:tasks.workunit.client.1.smithi167.stdout:5/816: rename d0/d24/l67 to d0/d24/d2b/d3d/d3b/d92/df3/lf7 0 2024-09-17T01:41:37.629 INFO:tasks.workunit.client.1.smithi167.stdout:9/923: mkdir d4/d9/d21/d43/dc4/d123 0 2024-09-17T01:41:37.630 INFO:tasks.workunit.client.0.smithi082.stdout:4/441: dwrite d9/d15/d16/d3e/f4e [0,4194304] 0 2024-09-17T01:41:37.636 INFO:tasks.workunit.client.1.smithi167.stdout:4/853: chown d0/d4/d7/f26 3654 1 2024-09-17T01:41:37.641 INFO:tasks.workunit.client.1.smithi167.stdout:0/860: creat d5/d6b/d77/d37/f11b x:0 0 0 2024-09-17T01:41:37.642 INFO:tasks.workunit.client.0.smithi082.stdout:6/498: write d1/f63 [410826,109091] 0 2024-09-17T01:41:37.643 INFO:tasks.workunit.client.1.smithi167.stdout:5/817: creat d0/d24/d93/d99/ff8 x:0 0 0 2024-09-17T01:41:37.644 INFO:tasks.workunit.client.0.smithi082.stdout:0/348: dwrite da/fc [0,4194304] 0 2024-09-17T01:41:37.646 INFO:tasks.workunit.client.1.smithi167.stdout:9/924: symlink d4/d9/d21/d43/dc4/l124 0 2024-09-17T01:41:37.651 INFO:tasks.workunit.client.1.smithi167.stdout:4/854: write d0/d4/d7/d6/d2b/d6d/f10d [503395,87548] 0 2024-09-17T01:41:37.654 INFO:tasks.workunit.client.1.smithi167.stdout:5/818: creat d0/d24/d93/d99/ff9 x:0 0 0 2024-09-17T01:41:37.658 INFO:tasks.workunit.client.0.smithi082.stdout:5/546: creat db/d1e/d5b/fab x:0 0 0 2024-09-17T01:41:37.658 INFO:tasks.workunit.client.1.smithi167.stdout:7/811: dwrite d0/d2/d88/d6e/f71 [0,4194304] 0 2024-09-17T01:41:37.659 INFO:tasks.workunit.client.0.smithi082.stdout:9/421: symlink d4/d27/d2d/d60/d11/d39/d29/d77/l8f 0 2024-09-17T01:41:37.659 INFO:tasks.workunit.client.1.smithi167.stdout:5/819: read d0/d24/d2b/d49/d4b/dac/d3a/d44/fa5 [1575222,88455] 0 2024-09-17T01:41:37.659 INFO:tasks.workunit.client.1.smithi167.stdout:3/914: getdents d7/d8/d10/d14/d25/dc7/dd1/dc2/d10c 0 2024-09-17T01:41:37.661 INFO:tasks.workunit.client.0.smithi082.stdout:8/418: symlink d3/dd/d18/l87 0 2024-09-17T01:41:37.661 INFO:tasks.workunit.client.1.smithi167.stdout:9/925: link d4/d9/d2b/da3/lbb d4/d9/d97/l125 0 2024-09-17T01:41:37.664 INFO:tasks.workunit.client.1.smithi167.stdout:0/861: rename d5/ca to d5/d6b/c11c 0 2024-09-17T01:41:37.666 INFO:tasks.workunit.client.1.smithi167.stdout:5/820: unlink d0/l1e 0 2024-09-17T01:41:37.667 INFO:tasks.workunit.client.0.smithi082.stdout:9/422: dwrite d4/d27/d2d/d60/d11/d39/d31/f40 [0,4194304] 0 2024-09-17T01:41:37.669 INFO:tasks.workunit.client.1.smithi167.stdout:9/926: readlink d4/d9/d21/lba 0 2024-09-17T01:41:37.674 INFO:tasks.workunit.client.0.smithi082.stdout:8/419: write d3/fb [3244140,56488] 0 2024-09-17T01:41:37.675 INFO:tasks.workunit.client.0.smithi082.stdout:8/420: dread - d3/dd/d18/d34/f5c zero size 2024-09-17T01:41:37.675 INFO:tasks.workunit.client.0.smithi082.stdout:4/442: truncate d9/fa 1089069 0 2024-09-17T01:41:37.676 INFO:tasks.workunit.client.0.smithi082.stdout:8/421: chown d3/f33 49737 1 2024-09-17T01:41:37.677 INFO:tasks.workunit.client.1.smithi167.stdout:9/927: creat d4/d9/d21/d2d/d33/d3a/d74/f126 x:0 0 0 2024-09-17T01:41:37.681 INFO:tasks.workunit.client.1.smithi167.stdout:5/821: fsync d0/d24/d2b/d49/d4b/dac/d3a/d4d/fae 0 2024-09-17T01:41:37.684 INFO:tasks.workunit.client.1.smithi167.stdout:9/928: dwrite d4/d9/f4c [0,4194304] 0 2024-09-17T01:41:37.686 INFO:tasks.workunit.client.0.smithi082.stdout:9/423: rename d4/f30 to d4/d27/d2d/d60/d11/d39/d29/d6d/f90 0 2024-09-17T01:41:37.688 INFO:tasks.workunit.client.0.smithi082.stdout:9/424: write d4/d27/d2d/d60/d11/d39/d29/d35/f61 [32079,70547] 0 2024-09-17T01:41:37.689 INFO:tasks.workunit.client.0.smithi082.stdout:4/443: creat d9/d15/d16/d3e/f94 x:0 0 0 2024-09-17T01:41:37.690 INFO:tasks.workunit.client.1.smithi167.stdout:5/822: mknod d0/d54/d9d/cfa 0 2024-09-17T01:41:37.691 INFO:tasks.workunit.client.1.smithi167.stdout:7/812: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:37.692 INFO:tasks.workunit.client.1.smithi167.stdout:9/929: creat d4/d9/d21/d2d/dae/f127 x:0 0 0 2024-09-17T01:41:37.693 INFO:tasks.workunit.client.1.smithi167.stdout:3/915: dread d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f59 [0,4194304] 0 2024-09-17T01:41:37.696 INFO:tasks.workunit.client.1.smithi167.stdout:4/855: truncate d0/d4/d69/fd7 3766292 0 2024-09-17T01:41:37.696 INFO:tasks.workunit.client.1.smithi167.stdout:8/971: sync 2024-09-17T01:41:37.701 INFO:tasks.workunit.client.1.smithi167.stdout:3/916: unlink d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d7a/le7 0 2024-09-17T01:41:37.701 INFO:tasks.workunit.client.1.smithi167.stdout:7/813: dwrite d0/d2/d14/d19/fb9 [0,4194304] 0 2024-09-17T01:41:37.701 INFO:tasks.workunit.client.0.smithi082.stdout:0/349: getdents da/df/d2b 0 2024-09-17T01:41:37.703 INFO:tasks.workunit.client.0.smithi082.stdout:6/499: write d1/d7/d10/f33 [3748982,77442] 0 2024-09-17T01:41:37.721 INFO:tasks.workunit.client.1.smithi167.stdout:1/875: sync 2024-09-17T01:41:37.721 INFO:tasks.workunit.client.1.smithi167.stdout:2/843: sync 2024-09-17T01:41:37.722 INFO:tasks.workunit.client.1.smithi167.stdout:1/876: write d0/d9/d16/d22/f4d [4192952,51075] 0 2024-09-17T01:41:37.740 INFO:tasks.workunit.client.1.smithi167.stdout:1/877: dread d0/d5/d34/d83/d112/f2b [8388608,4194304] 0 2024-09-17T01:41:37.745 INFO:tasks.workunit.client.1.smithi167.stdout:1/878: dwrite d0/d5/d34/d83/d112/f4e [4194304,4194304] 0 2024-09-17T01:41:37.778 INFO:tasks.workunit.client.1.smithi167.stdout:0/862: write d5/d6b/d77/d6d/f8e [31079,116956] 0 2024-09-17T01:41:37.778 INFO:tasks.workunit.client.1.smithi167.stdout:0/863: fdatasync d5/d8/ff0 0 2024-09-17T01:41:37.779 INFO:tasks.workunit.client.0.smithi082.stdout:5/547: truncate db/f5a 3103090 0 2024-09-17T01:41:37.780 INFO:tasks.workunit.client.1.smithi167.stdout:0/864: write d5/d6b/d77/d6d/d90/dc4/f111 [960320,37743] 0 2024-09-17T01:41:37.780 INFO:tasks.workunit.client.1.smithi167.stdout:0/865: readlink d5/lbb 0 2024-09-17T01:41:37.781 INFO:tasks.workunit.client.0.smithi082.stdout:0/350: rename da/df/d27/f3c to da/d1e/d69/f7b 0 2024-09-17T01:41:37.798 INFO:tasks.workunit.client.0.smithi082.stdout:0/351: read da/df/d71/f2e [150684,89783] 0 2024-09-17T01:41:37.799 INFO:tasks.workunit.client.1.smithi167.stdout:5/823: truncate d0/d24/d2b/d3d/dd2/fa1 1543582 0 2024-09-17T01:41:37.801 INFO:tasks.workunit.client.0.smithi082.stdout:8/422: truncate d3/dd/d18/d34/f4f 2599678 0 2024-09-17T01:41:37.801 INFO:tasks.workunit.client.0.smithi082.stdout:6/500: symlink d1/d7/d10/d4f/dc/d2b/db2/db3/lb4 0 2024-09-17T01:41:37.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/444: link d9/d15/d16/d3e/f50 d9/d15/d16/d18/d4a/d8f/d91/f95 0 2024-09-17T01:41:37.805 INFO:tasks.workunit.client.0.smithi082.stdout:4/445: readlink d9/l53 0 2024-09-17T01:41:37.811 INFO:tasks.workunit.client.1.smithi167.stdout:8/972: mknod dc/d18/c14b 0 2024-09-17T01:41:37.813 INFO:tasks.workunit.client.1.smithi167.stdout:1/879: dread d0/d9/d16/d48/d54/d78/f9f [0,4194304] 0 2024-09-17T01:41:37.814 INFO:tasks.workunit.client.0.smithi082.stdout:8/423: rename d3/dd/d18/d34/f63 to d3/dd/d18/d2d/d3e/d4a/f88 0 2024-09-17T01:41:37.821 INFO:tasks.workunit.client.0.smithi082.stdout:5/548: creat db/d1e/d20/fac x:0 0 0 2024-09-17T01:41:37.826 INFO:tasks.workunit.client.0.smithi082.stdout:5/549: dread db/f8f [0,4194304] 0 2024-09-17T01:41:37.831 INFO:tasks.workunit.client.0.smithi082.stdout:5/550: dread db/d56/d29/f68 [4194304,4194304] 0 2024-09-17T01:41:37.832 INFO:tasks.workunit.client.0.smithi082.stdout:6/501: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5 0 2024-09-17T01:41:37.836 INFO:tasks.workunit.client.0.smithi082.stdout:8/424: dwrite d3/f20 [4194304,4194304] 0 2024-09-17T01:41:37.837 INFO:tasks.workunit.client.1.smithi167.stdout:8/973: dread - dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/d101/f10e zero size 2024-09-17T01:41:37.837 INFO:tasks.workunit.client.1.smithi167.stdout:2/844: sync 2024-09-17T01:41:37.842 INFO:tasks.workunit.client.1.smithi167.stdout:1/880: symlink d0/d5/dd7/d102/de7/l120 0 2024-09-17T01:41:37.845 INFO:tasks.workunit.client.1.smithi167.stdout:2/845: dread d5/d3c/d4c/de2/d45/d8e/d98/ff6 [0,4194304] 0 2024-09-17T01:41:37.846 INFO:tasks.workunit.client.1.smithi167.stdout:2/846: chown d5/d3c/d4c/de2/d45/d8e/d98/dfa/l6c 707022497 1 2024-09-17T01:41:37.846 INFO:tasks.workunit.client.1.smithi167.stdout:2/847: readlink d5/d33/lad 0 2024-09-17T01:41:37.852 INFO:tasks.workunit.client.1.smithi167.stdout:8/974: dread - dc/d56/d57/d7e/fd8 zero size 2024-09-17T01:41:37.861 INFO:tasks.workunit.client.1.smithi167.stdout:8/975: creat dc/d56/d59/d82/d8f/f14c x:0 0 0 2024-09-17T01:41:37.863 INFO:tasks.workunit.client.1.smithi167.stdout:2/848: link d5/d33/d48/d72/d94/faf d5/d3c/d4c/de2/d45/d6b/f121 0 2024-09-17T01:41:37.863 INFO:tasks.workunit.client.1.smithi167.stdout:5/824: getdents d0/d54/d56 0 2024-09-17T01:41:37.867 INFO:tasks.workunit.client.1.smithi167.stdout:8/976: dwrite dc/fd [4194304,4194304] 0 2024-09-17T01:41:37.877 INFO:tasks.workunit.client.1.smithi167.stdout:7/814: rename d0/d2/d14/d6f/d87/lc5 to d0/l119 0 2024-09-17T01:41:37.880 INFO:tasks.workunit.client.1.smithi167.stdout:1/881: rename d0/d9/d16/d48/f11b to d0/d5/d34/d83/d112/d74/d11e/f121 0 2024-09-17T01:41:37.885 INFO:tasks.workunit.client.1.smithi167.stdout:7/815: truncate d0/d2/d88/f96 2242940 0 2024-09-17T01:41:37.886 INFO:tasks.workunit.client.1.smithi167.stdout:7/816: fdatasync d0/d2/d14/d23/f7b 0 2024-09-17T01:41:37.889 INFO:tasks.workunit.client.1.smithi167.stdout:4/856: creat d0/d4/d7/da/d48/f122 x:0 0 0 2024-09-17T01:41:37.895 INFO:tasks.workunit.client.1.smithi167.stdout:4/857: dwrite d0/d4/d7/d6/d2b/d6d/d7e/f94 [0,4194304] 0 2024-09-17T01:41:37.899 INFO:tasks.workunit.client.1.smithi167.stdout:4/858: rename d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/lf1 to d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/l123 0 2024-09-17T01:41:37.905 INFO:tasks.workunit.client.1.smithi167.stdout:4/859: dwrite d0/f3 [0,4194304] 0 2024-09-17T01:41:37.907 INFO:tasks.workunit.client.1.smithi167.stdout:1/882: creat d0/d5/dbf/ddb/f122 x:0 0 0 2024-09-17T01:41:37.911 INFO:tasks.workunit.client.1.smithi167.stdout:4/860: dread d0/d4/d7/d6/d2b/d6d/d7e/da8/ddf/f11c [0,4194304] 0 2024-09-17T01:41:37.911 INFO:tasks.workunit.client.1.smithi167.stdout:1/883: truncate d0/d9/d16/d48/fb0 884599 0 2024-09-17T01:41:37.927 INFO:tasks.workunit.client.1.smithi167.stdout:5/825: dread - d0/d24/d2b/d3d/d3b/d5f/fa4 zero size 2024-09-17T01:41:37.930 INFO:tasks.workunit.client.1.smithi167.stdout:5/826: mkdir d0/d24/d2b/d49/d4b/dac/d3a/d4d/dfb 0 2024-09-17T01:41:37.931 INFO:tasks.workunit.client.1.smithi167.stdout:5/827: read - d0/d24/d2b/d49/d4b/dac/d3a/d4d/fd0 zero size 2024-09-17T01:41:37.938 INFO:tasks.workunit.client.1.smithi167.stdout:3/917: write d7/d8/d10/d14/d2c/d74/dbb/fe6 [1784678,27846] 0 2024-09-17T01:41:37.938 INFO:tasks.workunit.client.1.smithi167.stdout:3/918: readlink d7/d8f/lc1 0 2024-09-17T01:41:37.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/352: dwrite da/fe [0,4194304] 0 2024-09-17T01:41:37.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/353: dread - da/d1b/f4f zero size 2024-09-17T01:41:37.947 INFO:tasks.workunit.client.0.smithi082.stdout:0/354: getdents da/df/d2b 0 2024-09-17T01:41:37.949 INFO:tasks.workunit.client.0.smithi082.stdout:0/355: symlink da/df/d71/l7c 0 2024-09-17T01:41:37.955 INFO:tasks.workunit.client.0.smithi082.stdout:5/551: rename db/d56/d29/l5f to db/d56/lad 0 2024-09-17T01:41:37.955 INFO:tasks.workunit.client.0.smithi082.stdout:8/425: dwrite d3/dd/d18/f1e [0,4194304] 0 2024-09-17T01:41:37.963 INFO:tasks.workunit.client.0.smithi082.stdout:6/502: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d55 to d1/d7/d10/d4f/dc/d2b/db6 0 2024-09-17T01:41:37.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:37 smithi082 ceph-mon[28077]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 325 MiB/s wr, 588 op/s 2024-09-17T01:41:37.964 INFO:tasks.workunit.client.0.smithi082.stdout:5/552: rmdir db/d56/d6b 0 2024-09-17T01:41:37.964 INFO:tasks.workunit.client.0.smithi082.stdout:5/553: chown fa 27560 1 2024-09-17T01:41:37.965 INFO:tasks.workunit.client.0.smithi082.stdout:6/503: mknod d1/d7/d10/d4f/dc/d2b/d48/cb7 0 2024-09-17T01:41:37.966 INFO:tasks.workunit.client.0.smithi082.stdout:5/554: fsync db/d56/d18/f1d 0 2024-09-17T01:41:37.967 INFO:tasks.workunit.client.0.smithi082.stdout:6/504: fdatasync d1/d7/d10/d4f/dc/d2b/d48/f8d 0 2024-09-17T01:41:37.968 INFO:tasks.workunit.client.1.smithi167.stdout:2/849: dwrite d5/d3c/d4c/de2/d2e/f87 [0,4194304] 0 2024-09-17T01:41:37.974 INFO:tasks.workunit.client.0.smithi082.stdout:5/555: dwrite db/d56/d78/da0/fa4 [0,4194304] 0 2024-09-17T01:41:37.975 INFO:tasks.workunit.client.1.smithi167.stdout:2/850: rename d5/d6d/l9e to d5/d3c/d4c/de2/d2e/l122 0 2024-09-17T01:41:37.976 INFO:tasks.workunit.client.1.smithi167.stdout:9/930: creat d4/d9/d21/d2d/d33/f128 x:0 0 0 2024-09-17T01:41:37.978 INFO:tasks.workunit.client.0.smithi082.stdout:6/505: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/cb8 0 2024-09-17T01:41:37.978 INFO:tasks.workunit.client.0.smithi082.stdout:6/506: fsync d1/d7/d10/f33 0 2024-09-17T01:41:37.979 INFO:tasks.workunit.client.1.smithi167.stdout:9/931: readlink d4/l7c 0 2024-09-17T01:41:37.981 INFO:tasks.workunit.client.1.smithi167.stdout:7/817: fsync d0/d2/d88/f96 0 2024-09-17T01:41:37.981 INFO:tasks.workunit.client.0.smithi082.stdout:6/507: truncate d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/fac 616250 0 2024-09-17T01:41:37.982 INFO:tasks.workunit.client.1.smithi167.stdout:2/851: creat d5/d3c/d4c/de2/d45/f123 x:0 0 0 2024-09-17T01:41:37.983 INFO:tasks.workunit.client.1.smithi167.stdout:9/932: symlink d4/d9/d97/dd6/deb/l129 0 2024-09-17T01:41:37.984 INFO:tasks.workunit.client.0.smithi082.stdout:6/508: truncate d1/d7/d10/f16 2567259 0 2024-09-17T01:41:37.986 INFO:tasks.workunit.client.0.smithi082.stdout:6/509: chown d1/d7/d10/d4f/dc/d1d/d36/cb1 1054653656 1 2024-09-17T01:41:37.989 INFO:tasks.workunit.client.1.smithi167.stdout:8/977: creat dc/d56/d59/d82/f14d x:0 0 0 2024-09-17T01:41:37.990 INFO:tasks.workunit.client.1.smithi167.stdout:9/933: creat d4/d9/d21/d2d/de4/f12a x:0 0 0 2024-09-17T01:41:37.992 INFO:tasks.workunit.client.0.smithi082.stdout:6/510: link d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/fac d1/d7/d10/d4f/d8e/da8/fb9 0 2024-09-17T01:41:37.996 INFO:tasks.workunit.client.1.smithi167.stdout:0/866: rename d5/d6b/d77/d92/f10c to d5/d6b/d77/d92/f11d 0 2024-09-17T01:41:38.001 INFO:tasks.workunit.client.1.smithi167.stdout:0/867: dwrite d5/d6b/dca/fd7 [0,4194304] 0 2024-09-17T01:41:38.004 INFO:tasks.workunit.client.1.smithi167.stdout:4/861: truncate d0/d4/d7/d10/ff8 3747853 0 2024-09-17T01:41:38.007 INFO:tasks.workunit.client.1.smithi167.stdout:1/884: dwrite d0/d9/f37 [0,4194304] 0 2024-09-17T01:41:38.011 INFO:tasks.workunit.client.0.smithi082.stdout:4/446: link d9/d15/d16/d3e/d73/c88 d9/d15/d16/d3e/c96 0 2024-09-17T01:41:38.015 INFO:tasks.workunit.client.0.smithi082.stdout:3/361: sync 2024-09-17T01:41:38.016 INFO:tasks.workunit.client.0.smithi082.stdout:7/495: sync 2024-09-17T01:41:38.016 INFO:tasks.workunit.client.0.smithi082.stdout:4/447: dread d9/d15/d37/d45/f69 [0,4194304] 0 2024-09-17T01:41:38.017 INFO:tasks.workunit.client.0.smithi082.stdout:7/496: write d0/d3/db/f18 [3761796,93859] 0 2024-09-17T01:41:38.020 INFO:tasks.workunit.client.0.smithi082.stdout:7/497: fsync d0/d3/db/f29 0 2024-09-17T01:41:38.022 INFO:tasks.workunit.client.1.smithi167.stdout:7/818: truncate d0/d2/d14/d19/d26/ff 3025424 0 2024-09-17T01:41:38.022 INFO:tasks.workunit.client.1.smithi167.stdout:7/819: write d0/d2/f21 [580364,53118] 0 2024-09-17T01:41:38.023 INFO:tasks.workunit.client.1.smithi167.stdout:9/934: creat d4/d9/d97/f12b x:0 0 0 2024-09-17T01:41:38.025 INFO:tasks.workunit.client.0.smithi082.stdout:7/498: symlink d0/dd/d34/d58/la6 0 2024-09-17T01:41:38.025 INFO:tasks.workunit.client.1.smithi167.stdout:9/935: truncate d4/d9/d97/dd6/deb/ff4 919556 0 2024-09-17T01:41:38.026 INFO:tasks.workunit.client.1.smithi167.stdout:0/868: creat d5/d6b/d77/d4d/d56/d108/f11e x:0 0 0 2024-09-17T01:41:38.027 INFO:tasks.workunit.client.0.smithi082.stdout:7/499: creat d0/d3/db/d10/d3f/fa7 x:0 0 0 2024-09-17T01:41:38.030 INFO:tasks.workunit.client.0.smithi082.stdout:7/500: creat d0/d3/d36/d37/d86/fa8 x:0 0 0 2024-09-17T01:41:38.031 INFO:tasks.workunit.client.1.smithi167.stdout:7/820: creat d0/d2/d88/d6e/da3/f11a x:0 0 0 2024-09-17T01:41:38.031 INFO:tasks.workunit.client.1.smithi167.stdout:9/936: dread - d4/d9/d21/d2d/fb4 zero size 2024-09-17T01:41:38.032 INFO:tasks.workunit.client.1.smithi167.stdout:4/862: mknod d0/d4/d7/d10/c124 0 2024-09-17T01:41:38.032 INFO:tasks.workunit.client.1.smithi167.stdout:7/821: dread - d0/d2/d88/d6e/da3/f10a zero size 2024-09-17T01:41:38.033 INFO:tasks.workunit.client.0.smithi082.stdout:7/501: unlink d0/fa 0 2024-09-17T01:41:38.034 INFO:tasks.workunit.client.1.smithi167.stdout:7/822: truncate d0/d2/d14/d19/d22/fe8 564623 0 2024-09-17T01:41:38.036 INFO:tasks.workunit.client.1.smithi167.stdout:0/869: creat d5/d6b/d7e/f11f x:0 0 0 2024-09-17T01:41:38.036 INFO:tasks.workunit.client.1.smithi167.stdout:1/885: truncate d0/d5/d34/d83/d112/f41 3717065 0 2024-09-17T01:41:38.042 INFO:tasks.workunit.client.0.smithi082.stdout:4/448: dread d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:38.042 INFO:tasks.workunit.client.1.smithi167.stdout:1/886: dwrite d0/d5/d34/d83/d112/d74/fc8 [0,4194304] 0 2024-09-17T01:41:38.043 INFO:tasks.workunit.client.1.smithi167.stdout:1/887: readlink d0/d5/d34/d83/d112/d85/lb7 0 2024-09-17T01:41:38.044 INFO:tasks.workunit.client.1.smithi167.stdout:1/888: chown d0/d5/f12 1372270 1 2024-09-17T01:41:38.044 INFO:tasks.workunit.client.0.smithi082.stdout:7/502: link d0/f48 d0/dd/d34/d58/d6e/fa9 0 2024-09-17T01:41:38.045 INFO:tasks.workunit.client.1.smithi167.stdout:4/863: truncate d0/d4/d7/d6/d5d/fbd 988499 0 2024-09-17T01:41:38.046 INFO:tasks.workunit.client.1.smithi167.stdout:2/852: rename d5/d3c/d4c/de2/d45/c11 to d5/d33/d48/d72/d94/c124 0 2024-09-17T01:41:38.046 INFO:tasks.workunit.client.1.smithi167.stdout:7/823: fsync d0/d2/d14/d23/f7b 0 2024-09-17T01:41:38.049 INFO:tasks.workunit.client.0.smithi082.stdout:7/503: symlink d0/d3/d36/d37/d86/laa 0 2024-09-17T01:41:38.051 INFO:tasks.workunit.client.1.smithi167.stdout:9/937: symlink d4/d9/d21/d81/dbf/dca/l12c 0 2024-09-17T01:41:38.051 INFO:tasks.workunit.client.0.smithi082.stdout:7/504: dread - d0/d3/db/f83 zero size 2024-09-17T01:41:38.051 INFO:tasks.workunit.client.0.smithi082.stdout:4/449: dwrite d9/d47/f79 [0,4194304] 0 2024-09-17T01:41:38.052 INFO:tasks.workunit.client.1.smithi167.stdout:9/938: fdatasync d4/d9/f6d 0 2024-09-17T01:41:38.054 INFO:tasks.workunit.client.1.smithi167.stdout:4/864: dwrite d0/d4/d7/da/d10e/d2d/f65 [0,4194304] 0 2024-09-17T01:41:38.055 INFO:tasks.workunit.client.1.smithi167.stdout:7/824: fsync d0/fdb 0 2024-09-17T01:41:38.057 INFO:tasks.workunit.client.1.smithi167.stdout:7/825: truncate d0/d2/d14/d19/d32/f110 633017 0 2024-09-17T01:41:38.060 INFO:tasks.workunit.client.1.smithi167.stdout:2/853: creat d5/d33/d48/d72/f125 x:0 0 0 2024-09-17T01:41:38.061 INFO:tasks.workunit.client.0.smithi082.stdout:7/505: creat d0/dd/fab x:0 0 0 2024-09-17T01:41:38.064 INFO:tasks.workunit.client.0.smithi082.stdout:0/356: dwrite da/d1b/d23/d42/f4e [0,4194304] 0 2024-09-17T01:41:38.065 INFO:tasks.workunit.client.0.smithi082.stdout:0/357: chown f7 95 1 2024-09-17T01:41:38.067 INFO:tasks.workunit.client.0.smithi082.stdout:5/556: dread db/f19 [0,4194304] 0 2024-09-17T01:41:38.067 INFO:tasks.workunit.client.0.smithi082.stdout:4/450: rename d9/d15/d37/d45/f69 to d9/d15/d16/d18/f97 0 2024-09-17T01:41:38.067 INFO:tasks.workunit.client.1.smithi167.stdout:0/870: symlink d5/dee/d103/l120 0 2024-09-17T01:41:38.068 INFO:tasks.workunit.client.0.smithi082.stdout:8/426: write d3/dd/d18/d51/f6f [513968,56329] 0 2024-09-17T01:41:38.074 INFO:tasks.workunit.client.0.smithi082.stdout:7/506: symlink d0/d3/db/lac 0 2024-09-17T01:41:38.076 INFO:tasks.workunit.client.1.smithi167.stdout:9/939: mkdir d4/d9/d97/d12d 0 2024-09-17T01:41:38.078 INFO:tasks.workunit.client.1.smithi167.stdout:4/865: rmdir d0/d4/d7/d6/d5d 39 2024-09-17T01:41:38.078 INFO:tasks.workunit.client.1.smithi167.stdout:4/866: chown d0/d4/db4/cc6 1923728860 1 2024-09-17T01:41:38.079 INFO:tasks.workunit.client.0.smithi082.stdout:8/427: readlink d3/dd/d18/l19 0 2024-09-17T01:41:38.079 INFO:tasks.workunit.client.1.smithi167.stdout:7/826: rmdir d0/d2/d14/d19/d26/d83/d102 39 2024-09-17T01:41:38.080 INFO:tasks.workunit.client.1.smithi167.stdout:7/827: read - d0/d2/d88/f118 zero size 2024-09-17T01:41:38.081 INFO:tasks.workunit.client.1.smithi167.stdout:7/828: chown d0/d2/d88/d6e/da3/dd0/f9b 512950387 1 2024-09-17T01:41:38.081 INFO:tasks.workunit.client.1.smithi167.stdout:2/854: fdatasync d5/d3c/d4c/de2/d2e/f51 0 2024-09-17T01:41:38.084 INFO:tasks.workunit.client.1.smithi167.stdout:5/828: sync 2024-09-17T01:41:38.089 INFO:tasks.workunit.client.0.smithi082.stdout:7/507: mknod d0/d3/cad 0 2024-09-17T01:41:38.090 INFO:tasks.workunit.client.0.smithi082.stdout:7/508: truncate d0/d62/d7e/f91 768662 0 2024-09-17T01:41:38.093 INFO:tasks.workunit.client.1.smithi167.stdout:7/829: mknod d0/d2/d88/d6e/da3/c11b 0 2024-09-17T01:41:38.095 INFO:tasks.workunit.client.0.smithi082.stdout:7/509: rename d0/dd/l2d to d0/dd/lae 0 2024-09-17T01:41:38.096 INFO:tasks.workunit.client.0.smithi082.stdout:7/510: fdatasync d0/d3/f5e 0 2024-09-17T01:41:38.096 INFO:tasks.workunit.client.0.smithi082.stdout:4/451: link d9/d15/c1a d9/d47/c98 0 2024-09-17T01:41:38.097 INFO:tasks.workunit.client.1.smithi167.stdout:0/871: dread d5/d6b/d77/d6d/f81 [0,4194304] 0 2024-09-17T01:41:38.098 INFO:tasks.workunit.client.1.smithi167.stdout:5/829: rmdir d0/d24/d2b/d3d/d3b/db0 39 2024-09-17T01:41:38.100 INFO:tasks.workunit.client.0.smithi082.stdout:7/511: mkdir d0/d3/db/d10/d3f/daf 0 2024-09-17T01:41:38.101 INFO:tasks.workunit.client.0.smithi082.stdout:7/512: chown d0/d3/d36/l45 23 1 2024-09-17T01:41:38.102 INFO:tasks.workunit.client.0.smithi082.stdout:4/452: rename d9/d15/l30 to d9/d15/d16/d44/d8d/l99 0 2024-09-17T01:41:38.104 INFO:tasks.workunit.client.0.smithi082.stdout:6/511: write d1/d7/f46 [2303572,22918] 0 2024-09-17T01:41:38.105 INFO:tasks.workunit.client.1.smithi167.stdout:2/855: fdatasync d5/f2a 0 2024-09-17T01:41:38.106 INFO:tasks.workunit.client.0.smithi082.stdout:4/453: dread d9/d15/d37/d45/f51 [0,4194304] 0 2024-09-17T01:41:38.109 INFO:tasks.workunit.client.1.smithi167.stdout:0/872: mknod d5/d6b/d7e/c121 0 2024-09-17T01:41:38.112 INFO:tasks.workunit.client.0.smithi082.stdout:4/454: chown d9/d15/d16/d3e/f50 32953851 1 2024-09-17T01:41:38.112 INFO:tasks.workunit.client.0.smithi082.stdout:8/428: dread d3/dd/d18/f24 [0,4194304] 0 2024-09-17T01:41:38.115 INFO:tasks.workunit.client.1.smithi167.stdout:9/940: getdents d4/d9 0 2024-09-17T01:41:38.117 INFO:tasks.workunit.client.1.smithi167.stdout:0/873: symlink d5/d6b/d77/d92/l122 0 2024-09-17T01:41:38.121 INFO:tasks.workunit.client.1.smithi167.stdout:5/830: creat d0/d24/d2b/d3d/ffc x:0 0 0 2024-09-17T01:41:38.122 INFO:tasks.workunit.client.1.smithi167.stdout:9/941: dread d4/d9/d21/d43/f69 [4194304,4194304] 0 2024-09-17T01:41:38.123 INFO:tasks.workunit.client.1.smithi167.stdout:5/831: mkdir d0/d24/d2b/d49/dfd 0 2024-09-17T01:41:38.123 INFO:tasks.workunit.client.1.smithi167.stdout:9/942: read d4/d9/d97/dd6/deb/ff4 [68236,12262] 0 2024-09-17T01:41:38.124 INFO:tasks.workunit.client.1.smithi167.stdout:9/943: fsync d4/d9/d97/fff 0 2024-09-17T01:41:38.126 INFO:tasks.workunit.client.1.smithi167.stdout:5/832: mknod d0/d24/d93/d99/cfe 0 2024-09-17T01:41:38.130 INFO:tasks.workunit.client.0.smithi082.stdout:8/429: dread d3/dd/f2b [0,4194304] 0 2024-09-17T01:41:38.132 INFO:tasks.workunit.client.0.smithi082.stdout:3/362: truncate d9/f21 2061540 0 2024-09-17T01:41:38.136 INFO:tasks.workunit.client.1.smithi167.stdout:5/833: dread d0/d24/d2b/d49/d4b/dac/f5b [0,4194304] 0 2024-09-17T01:41:38.137 INFO:tasks.workunit.client.0.smithi082.stdout:3/363: rename d9/db/d49/c39 to d9/d35/d71/d69/d79/c7b 0 2024-09-17T01:41:38.138 INFO:tasks.workunit.client.1.smithi167.stdout:8/978: truncate dc/d56/d59/d82/d85/f94 295491 0 2024-09-17T01:41:38.140 INFO:tasks.workunit.client.0.smithi082.stdout:3/364: dread d9/db/d26/f3b [0,4194304] 0 2024-09-17T01:41:38.142 INFO:tasks.workunit.client.1.smithi167.stdout:5/834: rename d0/d24/d2b/d3d/d3b/c9c to d0/d24/d2b/d3d/d3b/db0/db5/cff 0 2024-09-17T01:41:38.145 INFO:tasks.workunit.client.0.smithi082.stdout:3/365: mknod d9/d35/d71/d69/c7c 0 2024-09-17T01:41:38.146 INFO:tasks.workunit.client.1.smithi167.stdout:8/979: link dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/d101/f10e dc/d56/d59/d82/d85/f14e 0 2024-09-17T01:41:38.147 INFO:tasks.workunit.client.0.smithi082.stdout:3/366: creat d9/db/d26/f7d x:0 0 0 2024-09-17T01:41:38.148 INFO:tasks.workunit.client.1.smithi167.stdout:5/835: truncate d0/d24/f38 719081 0 2024-09-17T01:41:38.149 INFO:tasks.workunit.client.1.smithi167.stdout:8/980: symlink dc/d56/d59/d82/dbe/l14f 0 2024-09-17T01:41:38.150 INFO:tasks.workunit.client.1.smithi167.stdout:8/981: read - dc/d56/d57/d7e/dad/fb9 zero size 2024-09-17T01:41:38.150 INFO:tasks.workunit.client.1.smithi167.stdout:8/982: chown dc/f15 196074 1 2024-09-17T01:41:38.152 INFO:tasks.workunit.client.1.smithi167.stdout:8/983: write dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f131 [463451,79234] 0 2024-09-17T01:41:38.153 INFO:tasks.workunit.client.0.smithi082.stdout:3/367: mknod d9/db/d6d/c7e 0 2024-09-17T01:41:38.154 INFO:tasks.workunit.client.0.smithi082.stdout:3/368: fsync d9/f4d 0 2024-09-17T01:41:38.156 INFO:tasks.workunit.client.0.smithi082.stdout:3/369: creat d9/db/d49/d4e/d53/f7f x:0 0 0 2024-09-17T01:41:38.161 INFO:tasks.workunit.client.1.smithi167.stdout:1/889: dwrite d0/d5/d34/f5f [0,4194304] 0 2024-09-17T01:41:38.162 INFO:tasks.workunit.client.0.smithi082.stdout:3/370: dwrite d9/d35/d71/f6e [4194304,4194304] 0 2024-09-17T01:41:38.162 INFO:tasks.workunit.client.1.smithi167.stdout:1/890: chown d0/d9/d16/d48/l82 35134635 1 2024-09-17T01:41:38.164 INFO:tasks.workunit.client.0.smithi082.stdout:0/358: truncate da/d1e/f74 1566317 0 2024-09-17T01:41:38.165 INFO:tasks.workunit.client.1.smithi167.stdout:1/891: fsync d0/d9/d16/d48/d54/d6e/fd2 0 2024-09-17T01:41:38.166 INFO:tasks.workunit.client.0.smithi082.stdout:3/371: symlink d9/db/d49/d4e/d53/l80 0 2024-09-17T01:41:38.167 INFO:tasks.workunit.client.1.smithi167.stdout:5/836: dread d0/f1d [0,4194304] 0 2024-09-17T01:41:38.171 INFO:tasks.workunit.client.1.smithi167.stdout:5/837: dread - d0/d24/d93/d99/ff8 zero size 2024-09-17T01:41:38.174 INFO:tasks.workunit.client.1.smithi167.stdout:1/892: rename d0/d5/c10 to d0/d9/d16/d48/d54/d78/c123 0 2024-09-17T01:41:38.174 INFO:tasks.workunit.client.1.smithi167.stdout:4/867: dwrite d0/d4/d7/da/d10e/d2d/d2e/faa [0,4194304] 0 2024-09-17T01:41:38.176 INFO:tasks.workunit.client.1.smithi167.stdout:7/830: write d0/d2/d14/d19/d26/d83/da5/d70/fbb [1380250,63717] 0 2024-09-17T01:41:38.177 INFO:tasks.workunit.client.0.smithi082.stdout:0/359: getdents da/d1b/d23/d42 0 2024-09-17T01:41:38.178 INFO:tasks.workunit.client.1.smithi167.stdout:5/838: creat d0/d24/d2b/d4e/d63/f100 x:0 0 0 2024-09-17T01:41:38.181 INFO:tasks.workunit.client.1.smithi167.stdout:1/893: dwrite d0/d5/dd7/f114 [4194304,4194304] 0 2024-09-17T01:41:38.181 INFO:tasks.workunit.client.0.smithi082.stdout:0/360: rmdir da/d1b/d23/d4d/d5d 39 2024-09-17T01:41:38.184 INFO:tasks.workunit.client.1.smithi167.stdout:4/868: fsync d0/d4/d7/d6/d2b/d6d/f97 0 2024-09-17T01:41:38.184 INFO:tasks.workunit.client.1.smithi167.stdout:3/919: sync 2024-09-17T01:41:38.185 INFO:tasks.workunit.client.0.smithi082.stdout:7/513: dwrite d0/d3/f4 [0,4194304] 0 2024-09-17T01:41:38.188 INFO:tasks.workunit.client.0.smithi082.stdout:3/372: getdents d9/db 0 2024-09-17T01:41:38.189 INFO:tasks.workunit.client.0.smithi082.stdout:6/512: truncate d1/d3/f72 3448001 0 2024-09-17T01:41:38.192 INFO:tasks.workunit.client.1.smithi167.stdout:4/869: dwrite d0/d4/d7/d6/d2b/d6d/d7e/da8/f100 [0,4194304] 0 2024-09-17T01:41:38.194 INFO:tasks.workunit.client.0.smithi082.stdout:0/361: rename da/d1b/d23/d42/d43/f5f to da/d1b/f7d 0 2024-09-17T01:41:38.197 INFO:tasks.workunit.client.1.smithi167.stdout:0/874: write d5/d6b/d77/d92/fb4 [26378,129630] 0 2024-09-17T01:41:38.199 INFO:tasks.workunit.client.1.smithi167.stdout:0/875: write d5/d8/d5c/fd2 [431298,79778] 0 2024-09-17T01:41:38.200 INFO:tasks.workunit.client.1.smithi167.stdout:3/920: rename d7/d8/d10/d14/d24/d62/d92/fc6 to d7/d8/d10/d14/d66/dc4/d124/f138 0 2024-09-17T01:41:38.201 INFO:tasks.workunit.client.1.smithi167.stdout:3/921: dread - d7/d8/d10/d14/d24/d62/d11d/f121 zero size 2024-09-17T01:41:38.204 INFO:tasks.workunit.client.0.smithi082.stdout:6/513: creat d1/d1f/fba x:0 0 0 2024-09-17T01:41:38.205 INFO:tasks.workunit.client.1.smithi167.stdout:4/870: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f125 x:0 0 0 2024-09-17T01:41:38.213 INFO:tasks.workunit.client.0.smithi082.stdout:8/430: dwrite d3/dd/d18/d2d/d3e/d43/f59 [0,4194304] 0 2024-09-17T01:41:38.213 INFO:tasks.workunit.client.0.smithi082.stdout:7/514: fsync d0/d3/f4 0 2024-09-17T01:41:38.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/514: mkdir d1/d7/d10/d4f/dc/d99/dbb 0 2024-09-17T01:41:38.215 INFO:tasks.workunit.client.0.smithi082.stdout:8/431: stat d3/dd/d18/d34 0 2024-09-17T01:41:38.219 INFO:tasks.workunit.client.0.smithi082.stdout:0/362: link da/df/d2b/f39 da/d1b/f7e 0 2024-09-17T01:41:38.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/515: dread d0/dd/d2c/d55/f9d [0,4194304] 0 2024-09-17T01:41:38.225 INFO:tasks.workunit.client.1.smithi167.stdout:3/922: mknod d7/d8/d10/d14/d25/dc7/dd1/c139 0 2024-09-17T01:41:38.225 INFO:tasks.workunit.client.0.smithi082.stdout:8/432: dwrite d3/dd/d18/d2d/d3b/f69 [4194304,4194304] 0 2024-09-17T01:41:38.230 INFO:tasks.workunit.client.1.smithi167.stdout:5/839: rename d0/d24/c26 to d0/d24/d2b/d3d/d6d/de2/c101 0 2024-09-17T01:41:38.231 INFO:tasks.workunit.client.0.smithi082.stdout:6/515: dread d1/f83 [0,4194304] 0 2024-09-17T01:41:38.232 INFO:tasks.workunit.client.1.smithi167.stdout:3/923: creat d7/d8/d1f/f13a x:0 0 0 2024-09-17T01:41:38.233 INFO:tasks.workunit.client.0.smithi082.stdout:7/516: rmdir d0/dd/d34 39 2024-09-17T01:41:38.233 INFO:tasks.workunit.client.0.smithi082.stdout:6/516: dread - d1/d7/d10/d4f/dc/d2b/d48/f8d zero size 2024-09-17T01:41:38.233 INFO:tasks.workunit.client.1.smithi167.stdout:3/924: chown d7/d8/d10/d14/d24/d9c/da3/ffd 3908 1 2024-09-17T01:41:38.233 INFO:tasks.workunit.client.1.smithi167.stdout:8/984: write dc/d56/d59/f64 [1144402,1913] 0 2024-09-17T01:41:38.235 INFO:tasks.workunit.client.0.smithi082.stdout:3/373: dread d9/db/d26/f27 [0,4194304] 0 2024-09-17T01:41:38.239 INFO:tasks.workunit.client.0.smithi082.stdout:7/517: rename d0/d3/f4 to d0/d3/db/d10/fb0 0 2024-09-17T01:41:38.241 INFO:tasks.workunit.client.0.smithi082.stdout:6/517: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f6c zero size 2024-09-17T01:41:38.242 INFO:tasks.workunit.client.0.smithi082.stdout:3/374: dwrite d9/db/d49/d4e/d53/d5b/f6c [0,4194304] 0 2024-09-17T01:41:38.242 INFO:tasks.workunit.client.1.smithi167.stdout:5/840: creat d0/d24/d2b/d3d/d3b/d92/df3/f102 x:0 0 0 2024-09-17T01:41:38.243 INFO:tasks.workunit.client.0.smithi082.stdout:3/375: chown d9/d35/d71 758303 1 2024-09-17T01:41:38.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/925: creat d7/d8/d10/d14/d25/dc7/dd1/f13b x:0 0 0 2024-09-17T01:41:38.248 INFO:tasks.workunit.client.1.smithi167.stdout:3/926: chown d7/d8/f78 61589325 1 2024-09-17T01:41:38.250 INFO:tasks.workunit.client.1.smithi167.stdout:8/985: creat dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/f150 x:0 0 0 2024-09-17T01:41:38.252 INFO:tasks.workunit.client.0.smithi082.stdout:7/518: rename d0/dd/fab to d0/d3/d36/d37/d86/fb1 0 2024-09-17T01:41:38.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:37 smithi167 ceph-mon[35643]: pgmap v22: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 104 MiB/s rd, 325 MiB/s wr, 588 op/s 2024-09-17T01:41:38.253 INFO:tasks.workunit.client.0.smithi082.stdout:6/518: symlink d1/d7/d10/d4f/d8e/da8/lbc 0 2024-09-17T01:41:38.255 INFO:tasks.workunit.client.0.smithi082.stdout:6/519: fsync d1/d7/d10/d4f/d32/f9b 0 2024-09-17T01:41:38.255 INFO:tasks.workunit.client.1.smithi167.stdout:5/841: creat d0/d24/d2b/d49/d4b/f103 x:0 0 0 2024-09-17T01:41:38.256 INFO:tasks.workunit.client.1.smithi167.stdout:5/842: fdatasync d0/d24/d2b/d49/d4b/dac/d3a/d44/d69/fdd 0 2024-09-17T01:41:38.256 INFO:tasks.workunit.client.0.smithi082.stdout:6/520: chown d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e 625374 1 2024-09-17T01:41:38.257 INFO:tasks.workunit.client.1.smithi167.stdout:3/927: creat d7/d8/d10/d14/d24/d9c/da3/f13c x:0 0 0 2024-09-17T01:41:38.257 INFO:tasks.workunit.client.1.smithi167.stdout:5/843: write d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad [7680834,413] 0 2024-09-17T01:41:38.258 INFO:tasks.workunit.client.0.smithi082.stdout:6/521: dread d1/d7/d10/f84 [0,4194304] 0 2024-09-17T01:41:38.260 INFO:tasks.workunit.client.1.smithi167.stdout:8/986: symlink dc/d56/d59/d82/d8f/de5/dba/l151 0 2024-09-17T01:41:38.261 INFO:tasks.workunit.client.1.smithi167.stdout:8/987: readlink dc/d1a/l1c 0 2024-09-17T01:41:38.263 INFO:tasks.workunit.client.1.smithi167.stdout:0/876: rename d5/d6b/d77/d37/d80/l113 to d5/l123 0 2024-09-17T01:41:38.268 INFO:tasks.workunit.client.1.smithi167.stdout:5/844: creat d0/d24/d2b/d49/d4b/dac/d3a/d4d/f104 x:0 0 0 2024-09-17T01:41:38.270 INFO:tasks.workunit.client.1.smithi167.stdout:8/988: symlink dc/d21/d6b/d113/l152 0 2024-09-17T01:41:38.272 INFO:tasks.workunit.client.1.smithi167.stdout:3/928: dread d7/d8/d10/d14/f53 [0,4194304] 0 2024-09-17T01:41:38.272 INFO:tasks.workunit.client.0.smithi082.stdout:6/522: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/cbd 0 2024-09-17T01:41:38.273 INFO:tasks.workunit.client.0.smithi082.stdout:6/523: write d1/d7/d10/f33 [1260487,81453] 0 2024-09-17T01:41:38.274 INFO:tasks.workunit.client.1.smithi167.stdout:5/845: mknod d0/d24/d2b/d49/d4b/dac/d80/c105 0 2024-09-17T01:41:38.277 INFO:tasks.workunit.client.1.smithi167.stdout:8/989: creat dc/d56/d59/d65/df9/f153 x:0 0 0 2024-09-17T01:41:38.280 INFO:tasks.workunit.client.1.smithi167.stdout:2/856: sync 2024-09-17T01:41:38.280 INFO:tasks.workunit.client.1.smithi167.stdout:3/929: creat d7/d8/d1f/f13d x:0 0 0 2024-09-17T01:41:38.281 INFO:tasks.workunit.client.0.smithi082.stdout:6/524: symlink d1/d7/d10/d4f/d8e/lbe 0 2024-09-17T01:41:38.281 INFO:tasks.workunit.client.1.smithi167.stdout:5/846: truncate d0/f14 5143803 0 2024-09-17T01:41:38.285 INFO:tasks.workunit.client.0.smithi082.stdout:6/525: mkdir d1/d7/d10/d4f/dc/d2b/db2/db3/dbf 0 2024-09-17T01:41:38.285 INFO:tasks.workunit.client.1.smithi167.stdout:8/990: dwrite dc/d56/d59/d82/d8f/de5/dba/dd3/df3/fb7 [0,4194304] 0 2024-09-17T01:41:38.287 INFO:tasks.workunit.client.1.smithi167.stdout:5/847: fsync d0/d24/d2b/d3d/d3b/f98 0 2024-09-17T01:41:38.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/526: dread d1/d7/f24 [0,4194304] 0 2024-09-17T01:41:38.289 INFO:tasks.workunit.client.1.smithi167.stdout:2/857: dwrite d5/dfe/f10f [4194304,4194304] 0 2024-09-17T01:41:38.291 INFO:tasks.workunit.client.1.smithi167.stdout:3/930: mkdir d7/d8/d10/d14/d25/dc7/dd1/dc2/d13e 0 2024-09-17T01:41:38.292 INFO:tasks.workunit.client.1.smithi167.stdout:1/894: truncate d0/d5/d34/d83/d112/f41 168209 0 2024-09-17T01:41:38.297 INFO:tasks.workunit.client.1.smithi167.stdout:3/931: dwrite d7/d8/d10/d14/f8d [0,4194304] 0 2024-09-17T01:41:38.297 INFO:tasks.workunit.client.1.smithi167.stdout:5/848: dread d0/d24/d2b/d4e/f70 [0,4194304] 0 2024-09-17T01:41:38.299 INFO:tasks.workunit.client.1.smithi167.stdout:2/858: symlink d5/d3c/d4c/de2/d45/d6b/l126 0 2024-09-17T01:41:38.300 INFO:tasks.workunit.client.1.smithi167.stdout:8/991: mknod dc/d56/d59/d82/d8f/de5/dba/d134/dea/d110/c154 0 2024-09-17T01:41:38.303 INFO:tasks.workunit.client.1.smithi167.stdout:3/932: readlink d7/d8f/ldb 0 2024-09-17T01:41:38.305 INFO:tasks.workunit.client.1.smithi167.stdout:5/849: mknod d0/d24/d2b/d3d/d3b/d92/c106 0 2024-09-17T01:41:38.305 INFO:tasks.workunit.client.1.smithi167.stdout:3/933: write d7/d8/d10/d14/d66/d6c/dab/dcf/fed [805149,1659] 0 2024-09-17T01:41:38.305 INFO:tasks.workunit.client.1.smithi167.stdout:2/859: mknod d5/d3c/d4c/de2/db8/d5e/d103/c127 0 2024-09-17T01:41:38.308 INFO:tasks.workunit.client.1.smithi167.stdout:5/850: creat d0/d54/d56/f107 x:0 0 0 2024-09-17T01:41:38.309 INFO:tasks.workunit.client.0.smithi082.stdout:3/376: write d9/db/d49/d4e/d53/f54 [855165,6780] 0 2024-09-17T01:41:38.311 INFO:tasks.workunit.client.1.smithi167.stdout:5/851: dread - d0/d24/d2b/d49/d4b/dac/d3a/d4d/f104 zero size 2024-09-17T01:41:38.313 INFO:tasks.workunit.client.1.smithi167.stdout:3/934: dwrite d7/d8/f12c [0,4194304] 0 2024-09-17T01:41:38.313 INFO:tasks.workunit.client.0.smithi082.stdout:3/377: creat d9/db/d26/f81 x:0 0 0 2024-09-17T01:41:38.317 INFO:tasks.workunit.client.1.smithi167.stdout:2/860: rename d5/d3c/d4c/de2/d2e/f8c to d5/f128 0 2024-09-17T01:41:38.318 INFO:tasks.workunit.client.1.smithi167.stdout:8/992: getdents dc/d56/d59/d82/d8f/de5/dba/dd3 0 2024-09-17T01:41:38.319 INFO:tasks.workunit.client.0.smithi082.stdout:3/378: symlink d9/d35/l82 0 2024-09-17T01:41:38.323 INFO:tasks.workunit.client.0.smithi082.stdout:3/379: symlink d9/db/d6d/l83 0 2024-09-17T01:41:38.325 INFO:tasks.workunit.client.0.smithi082.stdout:3/380: readlink d9/l12 0 2024-09-17T01:41:38.325 INFO:tasks.workunit.client.0.smithi082.stdout:3/381: readlink d9/d35/l82 0 2024-09-17T01:41:38.327 INFO:tasks.workunit.client.1.smithi167.stdout:5/852: dwrite d0/d24/d2b/d3d/dd2/d95/fd7 [0,4194304] 0 2024-09-17T01:41:38.327 INFO:tasks.workunit.client.1.smithi167.stdout:8/993: mknod dc/d56/d59/d82/d8f/de5/dba/d134/dea/d110/c155 0 2024-09-17T01:41:38.331 INFO:tasks.workunit.client.0.smithi082.stdout:3/382: rename d9/db/f2f to d9/db/d49/d4e/d53/d5b/f84 0 2024-09-17T01:41:38.332 INFO:tasks.workunit.client.0.smithi082.stdout:3/383: dread - d9/db/d49/d4e/d53/f7f zero size 2024-09-17T01:41:38.333 INFO:tasks.workunit.client.1.smithi167.stdout:2/861: symlink d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f/l129 0 2024-09-17T01:41:38.336 INFO:tasks.workunit.client.1.smithi167.stdout:8/994: rename dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/f150 to dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/df1/f156 0 2024-09-17T01:41:38.337 INFO:tasks.workunit.client.0.smithi082.stdout:7/519: dwrite d0/d3/db/d10/f27 [0,4194304] 0 2024-09-17T01:41:38.338 INFO:tasks.workunit.client.1.smithi167.stdout:2/862: creat d5/d3c/d4c/de2/d45/d8e/d98/f12a x:0 0 0 2024-09-17T01:41:38.340 INFO:tasks.workunit.client.1.smithi167.stdout:5/853: dread d0/d24/d2b/d49/d4b/dac/f52 [0,4194304] 0 2024-09-17T01:41:38.343 INFO:tasks.workunit.client.0.smithi082.stdout:3/384: dwrite d9/d35/f43 [0,4194304] 0 2024-09-17T01:41:38.344 INFO:tasks.workunit.client.1.smithi167.stdout:8/995: dwrite dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/f131 [0,4194304] 0 2024-09-17T01:41:38.346 INFO:tasks.workunit.client.0.smithi082.stdout:7/520: mkdir d0/dd/d2c/d42/d77/db2 0 2024-09-17T01:41:38.348 INFO:tasks.workunit.client.1.smithi167.stdout:2/863: fsync d5/d33/d48/d72/d94/fb7 0 2024-09-17T01:41:38.355 INFO:tasks.workunit.client.0.smithi082.stdout:7/521: unlink d0/d3/d36/d37/d86/ca3 0 2024-09-17T01:41:38.356 INFO:tasks.workunit.client.1.smithi167.stdout:8/996: mknod dc/d56/d59/d82/d8f/de5/dba/dd3/df3/dc0/dc7/c157 0 2024-09-17T01:41:38.357 INFO:tasks.workunit.client.0.smithi082.stdout:6/527: truncate d1/d7/f24 1062463 0 2024-09-17T01:41:38.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/528: chown d1/d7/d10/d4f/dc/d2b/db2/db3/lb4 12 1 2024-09-17T01:41:38.359 INFO:tasks.workunit.client.1.smithi167.stdout:8/997: read dc/ff [1341736,39347] 0 2024-09-17T01:41:38.359 INFO:tasks.workunit.client.0.smithi082.stdout:7/522: symlink d0/dd/d2c/lb3 0 2024-09-17T01:41:38.360 INFO:tasks.workunit.client.1.smithi167.stdout:1/895: write d0/f2e [3834222,54013] 0 2024-09-17T01:41:38.360 INFO:tasks.workunit.client.0.smithi082.stdout:7/523: chown d0/dd/lf 131480 1 2024-09-17T01:41:38.361 INFO:tasks.workunit.client.0.smithi082.stdout:7/524: stat d0/d3/db/l4e 0 2024-09-17T01:41:38.361 INFO:tasks.workunit.client.1.smithi167.stdout:2/864: unlink d5/d3c/d4c/de2/d45/d8e/d98/dfa/f65 0 2024-09-17T01:41:38.363 INFO:tasks.workunit.client.0.smithi082.stdout:3/385: getdents d9/db/d49/d4e/d53 0 2024-09-17T01:41:38.364 INFO:tasks.workunit.client.0.smithi082.stdout:3/386: stat d9/db/f18 0 2024-09-17T01:41:38.365 INFO:tasks.workunit.client.1.smithi167.stdout:1/896: creat d0/d9/d16/d48/d54/d78/f124 x:0 0 0 2024-09-17T01:41:38.367 INFO:tasks.workunit.client.0.smithi082.stdout:6/529: dwrite d1/d7/f5c [8388608,4194304] 0 2024-09-17T01:41:38.367 INFO:tasks.workunit.client.1.smithi167.stdout:8/998: rename dc/d56/d59/d65/fa9 to dc/d56/d59/d82/d8f/de5/dba/f158 0 2024-09-17T01:41:38.369 INFO:tasks.workunit.client.0.smithi082.stdout:7/525: rename d0/dd/d2c/d54/f69 to d0/d3/d36/d37/d71/fb4 0 2024-09-17T01:41:38.370 INFO:tasks.workunit.client.1.smithi167.stdout:2/865: dread - d5/d3c/d4c/de2/d45/d8e/d98/dfa/fe7 zero size 2024-09-17T01:41:38.372 INFO:tasks.workunit.client.1.smithi167.stdout:9/944: sync 2024-09-17T01:41:38.372 INFO:tasks.workunit.client.1.smithi167.stdout:7/831: sync 2024-09-17T01:41:38.374 INFO:tasks.workunit.client.1.smithi167.stdout:9/945: truncate d4/d9/d21/d2d/d33/d3a/f120 621836 0 2024-09-17T01:41:38.375 INFO:tasks.workunit.client.0.smithi082.stdout:6/530: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/fc0 x:0 0 0 2024-09-17T01:41:38.377 INFO:tasks.workunit.client.0.smithi082.stdout:7/526: write d0/d3/db/d10/d3f/f5d [441743,63918] 0 2024-09-17T01:41:38.378 INFO:tasks.workunit.client.0.smithi082.stdout:7/527: chown d0/d3/f8f 0 1 2024-09-17T01:41:38.378 INFO:tasks.workunit.client.1.smithi167.stdout:3/935: write d7/d8/d10/d14/d25/dc7/dd1/dc2/fc5 [287036,15963] 0 2024-09-17T01:41:38.381 INFO:tasks.workunit.client.1.smithi167.stdout:2/866: creat d5/d3c/d4c/de2/db8/d5e/f12b x:0 0 0 2024-09-17T01:41:38.382 INFO:tasks.workunit.client.1.smithi167.stdout:3/936: dread d7/d8/d10/d14/d25/dc7/dd1/dc2/fc5 [0,4194304] 0 2024-09-17T01:41:38.387 INFO:tasks.workunit.client.0.smithi082.stdout:6/531: link d1/d3/l27 d1/d7/d10/d4f/dc/d99/dbb/lc1 0 2024-09-17T01:41:38.389 INFO:tasks.workunit.client.1.smithi167.stdout:7/832: mkdir d0/d2/d14/d19/d26/d11c 0 2024-09-17T01:41:38.390 INFO:tasks.workunit.client.0.smithi082.stdout:6/532: mknod d1/d7/d10/d4f/dc/d1d/d2c/cc2 0 2024-09-17T01:41:38.391 INFO:tasks.workunit.client.0.smithi082.stdout:6/533: write d1/d3/f75 [668017,103141] 0 2024-09-17T01:41:38.393 INFO:tasks.workunit.client.1.smithi167.stdout:5/854: dwrite d0/d24/d2b/d49/d4b/dac/f52 [0,4194304] 0 2024-09-17T01:41:38.394 INFO:tasks.workunit.client.1.smithi167.stdout:5/855: write d0/d24/d93/d99/fbb [2470628,130918] 0 2024-09-17T01:41:38.405 INFO:tasks.workunit.client.1.smithi167.stdout:4/871: sync 2024-09-17T01:41:38.405 INFO:tasks.workunit.client.1.smithi167.stdout:0/877: sync 2024-09-17T01:41:38.406 INFO:tasks.workunit.client.1.smithi167.stdout:4/872: dread - d0/d4/d7/da/d48/f122 zero size 2024-09-17T01:41:38.427 INFO:tasks.workunit.client.1.smithi167.stdout:3/937: unlink d7/d8/d10/d29/d120/lde 0 2024-09-17T01:41:38.428 INFO:tasks.workunit.client.1.smithi167.stdout:3/938: readlink d7/d8/d10/d14/d24/d9c/da3/lb4 0 2024-09-17T01:41:38.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/534: creat d1/d1f/fc3 x:0 0 0 2024-09-17T01:41:38.431 INFO:tasks.workunit.client.0.smithi082.stdout:6/535: chown d1/d7/d10/d4f/dc/d1d/d36/d7a 1558 1 2024-09-17T01:41:38.431 INFO:tasks.workunit.client.0.smithi082.stdout:6/536: chown d1/d7/c34 6149 1 2024-09-17T01:41:38.437 INFO:tasks.workunit.client.1.smithi167.stdout:7/833: chown d0/d2/l69 5 1 2024-09-17T01:41:38.438 INFO:tasks.workunit.client.1.smithi167.stdout:7/834: dread - d0/d2/d14/d19/d26/ff7 zero size 2024-09-17T01:41:38.439 INFO:tasks.workunit.client.0.smithi082.stdout:7/528: write d0/d3/d36/d37/f44 [1746106,88932] 0 2024-09-17T01:41:38.439 INFO:tasks.workunit.client.0.smithi082.stdout:3/387: dwrite d9/db/d49/d4e/d53/f62 [0,4194304] 0 2024-09-17T01:41:38.440 INFO:tasks.workunit.client.1.smithi167.stdout:1/897: dwrite d0/d5/f72 [0,4194304] 0 2024-09-17T01:41:38.441 INFO:tasks.workunit.client.1.smithi167.stdout:1/898: dread - d0/d5/d34/d83/ffa zero size 2024-09-17T01:41:38.442 INFO:tasks.workunit.client.1.smithi167.stdout:0/878: creat d5/d6b/d77/d37/d45/da9/f124 x:0 0 0 2024-09-17T01:41:38.444 INFO:tasks.workunit.client.0.smithi082.stdout:7/529: mkdir d0/d62/d7e/db5 0 2024-09-17T01:41:38.446 INFO:tasks.workunit.client.1.smithi167.stdout:9/946: rename d4/d9/d21/l29 to d4/d9/d21/d81/l12e 0 2024-09-17T01:41:38.447 INFO:tasks.workunit.client.1.smithi167.stdout:2/867: write d5/d3c/f40 [226407,17951] 0 2024-09-17T01:41:38.449 INFO:tasks.workunit.client.1.smithi167.stdout:3/939: unlink d7/d8/d10/d14/d2c/d74/dbb/fe6 0 2024-09-17T01:41:38.449 INFO:tasks.workunit.client.1.smithi167.stdout:5/856: dwrite d0/d24/d2b/d4e/d63/fd6 [0,4194304] 0 2024-09-17T01:41:38.450 INFO:tasks.workunit.client.1.smithi167.stdout:8/999: getdents dc/d56/d59/d82/d8f/de5/dba/d134 0 2024-09-17T01:41:38.453 INFO:tasks.workunit.client.0.smithi082.stdout:3/388: truncate d9/db/d26/f3a 41129 0 2024-09-17T01:41:38.455 INFO:tasks.workunit.client.1.smithi167.stdout:2/868: dread d5/d10/f42 [0,4194304] 0 2024-09-17T01:41:38.455 INFO:tasks.workunit.client.0.smithi082.stdout:6/537: write d1/d7/f86 [3822008,63290] 0 2024-09-17T01:41:38.462 INFO:tasks.workunit.client.0.smithi082.stdout:3/389: creat d9/db/f85 x:0 0 0 2024-09-17T01:41:38.463 INFO:tasks.workunit.client.0.smithi082.stdout:3/390: write d9/db/d26/f7d [431447,129436] 0 2024-09-17T01:41:38.468 INFO:tasks.workunit.client.1.smithi167.stdout:3/940: fsync d7/d8/d10/d29/fa4 0 2024-09-17T01:41:38.469 INFO:tasks.workunit.client.0.smithi082.stdout:3/391: mkdir d9/d35/d71/d69/d79/d86 0 2024-09-17T01:41:38.470 INFO:tasks.workunit.client.1.smithi167.stdout:5/857: dread - d0/d9/fa7 zero size 2024-09-17T01:41:38.473 INFO:tasks.workunit.client.0.smithi082.stdout:6/538: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/cbd to d1/d7/d10/cc4 0 2024-09-17T01:41:38.474 INFO:tasks.workunit.client.1.smithi167.stdout:9/947: rename d4/d9/d21/d81/dbf/lef to d4/d9/d21/df0/l12f 0 2024-09-17T01:41:38.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/530: truncate d0/dd/d2c/d42/f99 280430 0 2024-09-17T01:41:38.475 INFO:tasks.workunit.client.1.smithi167.stdout:9/948: chown f1 1708474277 1 2024-09-17T01:41:38.475 INFO:tasks.workunit.client.1.smithi167.stdout:4/873: write d0/d4/d7/d6/f66 [3821157,129133] 0 2024-09-17T01:41:38.476 INFO:tasks.workunit.client.1.smithi167.stdout:5/858: dwrite d0/d24/d2b/d4e/d63/fd6 [0,4194304] 0 2024-09-17T01:41:38.478 INFO:tasks.workunit.client.1.smithi167.stdout:0/879: write d5/d6b/d77/d37/f69 [954604,99269] 0 2024-09-17T01:41:38.479 INFO:tasks.workunit.client.1.smithi167.stdout:5/859: write d0/d24/d2b/d3d/d6d/de2/fe8 [744510,84078] 0 2024-09-17T01:41:38.480 INFO:tasks.workunit.client.0.smithi082.stdout:3/392: creat d9/d35/d71/d69/d79/d86/f87 x:0 0 0 2024-09-17T01:41:38.482 INFO:tasks.workunit.client.0.smithi082.stdout:7/531: readlink d0/d3/db/d10/l59 0 2024-09-17T01:41:38.483 INFO:tasks.workunit.client.0.smithi082.stdout:7/532: chown d0/d3/d36/l45 4221 1 2024-09-17T01:41:38.484 INFO:tasks.workunit.client.0.smithi082.stdout:6/539: truncate d1/d7/f24 527560 0 2024-09-17T01:41:38.484 INFO:tasks.workunit.client.1.smithi167.stdout:1/899: dwrite d0/d9/d16/d48/d54/d78/f92 [4194304,4194304] 0 2024-09-17T01:41:38.485 INFO:tasks.workunit.client.0.smithi082.stdout:1/549: sync 2024-09-17T01:41:38.488 INFO:tasks.workunit.client.1.smithi167.stdout:3/941: mknod d7/d8/d10/d14/d25/d9e/c13f 0 2024-09-17T01:41:38.489 INFO:tasks.workunit.client.0.smithi082.stdout:3/393: truncate f7 929474 0 2024-09-17T01:41:38.490 INFO:tasks.workunit.client.0.smithi082.stdout:3/394: chown d9/d35/d71/d69/f6a 2960 1 2024-09-17T01:41:38.491 INFO:tasks.workunit.client.0.smithi082.stdout:1/550: symlink d2/df/d46/laf 0 2024-09-17T01:41:38.491 INFO:tasks.workunit.client.1.smithi167.stdout:2/869: chown d5/d3c/d4c/de2/d2e/f51 1645 1 2024-09-17T01:41:38.492 INFO:tasks.workunit.client.0.smithi082.stdout:7/533: rename d0/dd/d34/d58/d6e/fa9 to d0/d50/fb6 0 2024-09-17T01:41:38.493 INFO:tasks.workunit.client.0.smithi082.stdout:7/534: chown d0/d3/d36/d37/l4a 0 1 2024-09-17T01:41:38.494 INFO:tasks.workunit.client.0.smithi082.stdout:6/540: mknod d1/d1f/db0/cc5 0 2024-09-17T01:41:38.495 INFO:tasks.workunit.client.1.smithi167.stdout:0/880: mkdir d5/d6b/d77/d6d/d90/d125 0 2024-09-17T01:41:38.498 INFO:tasks.workunit.client.0.smithi082.stdout:7/535: creat d0/dd/d2c/fb7 x:0 0 0 2024-09-17T01:41:38.499 INFO:tasks.workunit.client.0.smithi082.stdout:3/395: mkdir d9/d78/d88 0 2024-09-17T01:41:38.499 INFO:tasks.workunit.client.1.smithi167.stdout:9/949: getdents d4/d9/d2b/d121 0 2024-09-17T01:41:38.501 INFO:tasks.workunit.client.0.smithi082.stdout:6/541: unlink d1/d7/d10/d4f/dc/d2b/c6e 0 2024-09-17T01:41:38.502 INFO:tasks.workunit.client.1.smithi167.stdout:7/835: getdents d0/d2/d88/d6e/dd8 0 2024-09-17T01:41:38.503 INFO:tasks.workunit.client.0.smithi082.stdout:1/551: mknod d2/da/d80/da3/cb0 0 2024-09-17T01:41:38.504 INFO:tasks.workunit.client.0.smithi082.stdout:7/536: dwrite d0/d3/db/f33 [4194304,4194304] 0 2024-09-17T01:41:38.504 INFO:tasks.workunit.client.0.smithi082.stdout:1/552: readlink d2/da/d16/l65 0 2024-09-17T01:41:38.505 INFO:tasks.workunit.client.1.smithi167.stdout:4/874: rename d0/d4/d7/d10/ff8 to d0/d4/d7/da/d10e/d2d/d2e/d31/d75/f126 0 2024-09-17T01:41:38.507 INFO:tasks.workunit.client.0.smithi082.stdout:3/396: mknod d9/d35/c89 0 2024-09-17T01:41:38.510 INFO:tasks.workunit.client.1.smithi167.stdout:0/881: unlink d5/d6b/d77/d6d/d90/dc4/f107 0 2024-09-17T01:41:38.512 INFO:tasks.workunit.client.1.smithi167.stdout:0/882: chown d5/d6b/d77/d4d/d56/d7b/c10d 83346 1 2024-09-17T01:41:38.512 INFO:tasks.workunit.client.0.smithi082.stdout:7/537: dwrite d0/dd/fa2 [0,4194304] 0 2024-09-17T01:41:38.513 INFO:tasks.workunit.client.1.smithi167.stdout:0/883: write d5/d6b/d77/d92/fc0 [2501392,98361] 0 2024-09-17T01:41:38.514 INFO:tasks.workunit.client.0.smithi082.stdout:6/542: rename d1/d7/d10/d4f/dc/d1d/c2d to d1/d7/d10/d4f/d8e/da8/dae/cc6 0 2024-09-17T01:41:38.517 INFO:tasks.workunit.client.0.smithi082.stdout:1/553: rmdir d2/da/d2f 39 2024-09-17T01:41:38.520 INFO:tasks.workunit.client.1.smithi167.stdout:9/950: fdatasync d4/d9/d21/d43/f69 0 2024-09-17T01:41:38.522 INFO:tasks.workunit.client.0.smithi082.stdout:3/397: creat d9/db/f8a x:0 0 0 2024-09-17T01:41:38.523 INFO:tasks.workunit.client.1.smithi167.stdout:7/836: creat d0/d2/d88/d6e/f11d x:0 0 0 2024-09-17T01:41:38.525 INFO:tasks.workunit.client.1.smithi167.stdout:5/860: creat d0/d24/d2b/d49/d4b/dac/f108 x:0 0 0 2024-09-17T01:41:38.529 INFO:tasks.workunit.client.1.smithi167.stdout:1/900: rename d0/d5/d61/fd0 to d0/f125 0 2024-09-17T01:41:38.529 INFO:tasks.workunit.client.0.smithi082.stdout:3/398: dwrite d9/d35/d71/d69/f6a [0,4194304] 0 2024-09-17T01:41:38.530 INFO:tasks.workunit.client.1.smithi167.stdout:1/901: stat d0/d9/d16/d48/d54/d6f/fd1 0 2024-09-17T01:41:38.531 INFO:tasks.workunit.client.0.smithi082.stdout:7/538: symlink d0/dd/d34/d58/d6e/lb8 0 2024-09-17T01:41:38.532 INFO:tasks.workunit.client.1.smithi167.stdout:4/875: mkdir d0/d4/d7/dff/d127 0 2024-09-17T01:41:38.533 INFO:tasks.workunit.client.0.smithi082.stdout:7/539: write d0/d3/db/f14 [7148672,1484] 0 2024-09-17T01:41:38.533 INFO:tasks.workunit.client.0.smithi082.stdout:6/543: creat d1/d7/d10/d4f/d32/fc7 x:0 0 0 2024-09-17T01:41:38.537 INFO:tasks.workunit.client.1.smithi167.stdout:0/884: truncate d5/d6b/d77/d4d/f9e 669283 0 2024-09-17T01:41:38.540 INFO:tasks.workunit.client.1.smithi167.stdout:3/942: write d7/f54 [4810291,7029] 0 2024-09-17T01:41:38.541 INFO:tasks.workunit.client.1.smithi167.stdout:9/951: rmdir d4/d9/d97/dd6/deb 39 2024-09-17T01:41:38.541 INFO:tasks.workunit.client.1.smithi167.stdout:3/943: fdatasync d7/faf 0 2024-09-17T01:41:38.542 INFO:tasks.workunit.client.0.smithi082.stdout:7/540: mknod d0/dd/d2c/d55/cb9 0 2024-09-17T01:41:38.542 INFO:tasks.workunit.client.1.smithi167.stdout:9/952: fdatasync d4/d9/d21/d2d/d33/d3a/fa0 0 2024-09-17T01:41:38.547 INFO:tasks.workunit.client.0.smithi082.stdout:1/554: mknod d2/da/cb1 0 2024-09-17T01:41:38.547 INFO:tasks.workunit.client.1.smithi167.stdout:1/902: dread d0/d9/d16/d36/f4a [0,4194304] 0 2024-09-17T01:41:38.549 INFO:tasks.workunit.client.1.smithi167.stdout:5/861: rename d0/d24/d2b/d49/d4b/dac/d3a/d44 to d0/d24/d2b/d3d/d3b/db0/db5/d109 0 2024-09-17T01:41:38.550 INFO:tasks.workunit.client.1.smithi167.stdout:5/862: read d0/d24/d2b/d4e/f70 [728487,94024] 0 2024-09-17T01:41:38.553 INFO:tasks.workunit.client.1.smithi167.stdout:4/876: dread - d0/d4/d7/da/d10e/dc3/ff5 zero size 2024-09-17T01:41:38.555 INFO:tasks.workunit.client.1.smithi167.stdout:0/885: unlink d5/d6b/d77/d37/d80/f10e 0 2024-09-17T01:41:38.560 INFO:tasks.workunit.client.0.smithi082.stdout:1/555: dwrite d2/da/d2f/d47/f84 [4194304,4194304] 0 2024-09-17T01:41:38.560 INFO:tasks.workunit.client.0.smithi082.stdout:3/399: dread d9/db/f17 [0,4194304] 0 2024-09-17T01:41:38.569 INFO:tasks.workunit.client.1.smithi167.stdout:1/903: symlink d0/d5/dbf/ddb/de9/l126 0 2024-09-17T01:41:38.572 INFO:tasks.workunit.client.1.smithi167.stdout:5/863: rename d0/d24/d2b/d4e to d0/d24/d2b/d3d/d6d/d10a 0 2024-09-17T01:41:38.573 INFO:tasks.workunit.client.0.smithi082.stdout:3/400: unlink d9/d35/d71/l68 0 2024-09-17T01:41:38.574 INFO:tasks.workunit.client.1.smithi167.stdout:7/837: write d0/f74 [1490187,61041] 0 2024-09-17T01:41:38.575 INFO:tasks.workunit.client.1.smithi167.stdout:0/886: symlink d5/d8/d9/l126 0 2024-09-17T01:41:38.578 INFO:tasks.workunit.client.1.smithi167.stdout:4/877: dread d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/f7b [0,4194304] 0 2024-09-17T01:41:38.580 INFO:tasks.workunit.client.0.smithi082.stdout:6/544: dwrite d1/d7/d10/d4f/dc/d2b/d48/f2a [0,4194304] 0 2024-09-17T01:41:38.582 INFO:tasks.workunit.client.1.smithi167.stdout:1/904: fsync d0/d5/f8d 0 2024-09-17T01:41:38.582 INFO:tasks.workunit.client.1.smithi167.stdout:4/878: truncate d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1/ff6 633628 0 2024-09-17T01:41:38.582 INFO:tasks.workunit.client.1.smithi167.stdout:2/870: sync 2024-09-17T01:41:38.586 INFO:tasks.workunit.client.0.smithi082.stdout:1/556: write d2/d3f/d34/f59 [1046620,46] 0 2024-09-17T01:41:38.587 INFO:tasks.workunit.client.0.smithi082.stdout:7/541: dread d0/dd/d2c/d42/f99 [0,4194304] 0 2024-09-17T01:41:38.587 INFO:tasks.workunit.client.0.smithi082.stdout:1/557: fdatasync d2/f11 0 2024-09-17T01:41:38.588 INFO:tasks.workunit.client.1.smithi167.stdout:3/944: creat d7/d8/d10/d29/f140 x:0 0 0 2024-09-17T01:41:38.588 INFO:tasks.workunit.client.0.smithi082.stdout:1/558: chown d2/df/l61 1 1 2024-09-17T01:41:38.590 INFO:tasks.workunit.client.0.smithi082.stdout:2/526: sync 2024-09-17T01:41:38.590 INFO:tasks.workunit.client.0.smithi082.stdout:6/545: rmdir d1/d7/da0 0 2024-09-17T01:41:38.592 INFO:tasks.workunit.client.1.smithi167.stdout:9/953: link d4/d9/l34 d4/d9/d21/d2d/d33/d3a/d9c/dd0/l130 0 2024-09-17T01:41:38.593 INFO:tasks.workunit.client.1.smithi167.stdout:7/838: dread d0/d2/d14/d6f/d8b/fd1 [0,4194304] 0 2024-09-17T01:41:38.593 INFO:tasks.workunit.client.1.smithi167.stdout:9/954: fdatasync d4/d9/d21/d2d/d33/d3a/ff7 0 2024-09-17T01:41:38.596 INFO:tasks.workunit.client.0.smithi082.stdout:1/559: stat d2/da/d2f/c4b 0 2024-09-17T01:41:38.597 INFO:tasks.workunit.client.0.smithi082.stdout:1/560: write d2/d3f/f88 [2497375,102631] 0 2024-09-17T01:41:38.598 INFO:tasks.workunit.client.0.smithi082.stdout:2/527: symlink d1/d17/d38/d42/d52/d78/da0/laf 0 2024-09-17T01:41:38.599 INFO:tasks.workunit.client.0.smithi082.stdout:6/546: truncate d1/d7/d10/d4f/dc/f29 1234481 0 2024-09-17T01:41:38.602 INFO:tasks.workunit.client.0.smithi082.stdout:2/528: symlink d1/d90/lb0 0 2024-09-17T01:41:38.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/887: mknod d5/d6b/d77/d4d/c127 0 2024-09-17T01:41:38.609 INFO:tasks.workunit.client.1.smithi167.stdout:2/871: mknod d5/d71/dc7/c12c 0 2024-09-17T01:41:38.611 INFO:tasks.workunit.client.0.smithi082.stdout:1/561: creat d2/da/fb2 x:0 0 0 2024-09-17T01:41:38.611 INFO:tasks.workunit.client.0.smithi082.stdout:1/562: chown d2/da/f56 14646 1 2024-09-17T01:41:38.613 INFO:tasks.workunit.client.1.smithi167.stdout:0/888: fsync d5/d6b/d77/d92/fea 0 2024-09-17T01:41:38.614 INFO:tasks.workunit.client.1.smithi167.stdout:1/905: dwrite d0/d5/d34/d83/d112/d74/fe3 [0,4194304] 0 2024-09-17T01:41:38.614 INFO:tasks.workunit.client.1.smithi167.stdout:3/945: mknod d7/c141 0 2024-09-17T01:41:38.615 INFO:tasks.workunit.client.1.smithi167.stdout:4/879: dread d0/d4/d69/f6b [0,4194304] 0 2024-09-17T01:41:38.617 INFO:tasks.workunit.client.0.smithi082.stdout:2/529: rename d1/d66/d7e to d1/d35/db1 0 2024-09-17T01:41:38.618 INFO:tasks.workunit.client.1.smithi167.stdout:1/906: dread - d0/d9/d16/d48/d54/d6f/fd1 zero size 2024-09-17T01:41:38.619 INFO:tasks.workunit.client.1.smithi167.stdout:7/839: symlink d0/d2/d14/d19/d26/d83/l11e 0 2024-09-17T01:41:38.619 INFO:tasks.workunit.client.1.smithi167.stdout:5/864: truncate d0/d9/f2d 8540202 0 2024-09-17T01:41:38.624 INFO:tasks.workunit.client.0.smithi082.stdout:6/547: dwrite d1/d7/d10/f84 [0,4194304] 0 2024-09-17T01:41:38.624 INFO:tasks.workunit.client.0.smithi082.stdout:1/563: fsync d2/da/f35 0 2024-09-17T01:41:38.625 INFO:tasks.workunit.client.0.smithi082.stdout:2/530: dread - d1/d17/d29/d50/fa5 zero size 2024-09-17T01:41:38.625 INFO:tasks.workunit.client.1.smithi167.stdout:2/872: symlink d5/d3c/d4c/de2/db8/da3/dc8/l12d 0 2024-09-17T01:41:38.625 INFO:tasks.workunit.client.1.smithi167.stdout:4/880: creat d0/dce/f128 x:0 0 0 2024-09-17T01:41:38.626 INFO:tasks.workunit.client.1.smithi167.stdout:4/881: dread - d0/d4/d7/da/d48/f103 zero size 2024-09-17T01:41:38.627 INFO:tasks.workunit.client.0.smithi082.stdout:2/531: readlink d1/d17/l47 0 2024-09-17T01:41:38.628 INFO:tasks.workunit.client.1.smithi167.stdout:0/889: rename d5/d6b/d77/f66 to d5/d6b/d77/daa/f128 0 2024-09-17T01:41:38.629 INFO:tasks.workunit.client.0.smithi082.stdout:6/548: dread d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [0,4194304] 0 2024-09-17T01:41:38.629 INFO:tasks.workunit.client.1.smithi167.stdout:4/882: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/de1/ff6 [103677,57942] 0 2024-09-17T01:41:38.629 INFO:tasks.workunit.client.1.smithi167.stdout:0/890: chown d5/d6b/d77/d92 108337 1 2024-09-17T01:41:38.631 INFO:tasks.workunit.client.1.smithi167.stdout:1/907: creat d0/d9/d16/d48/d54/d6e/f127 x:0 0 0 2024-09-17T01:41:38.635 INFO:tasks.workunit.client.1.smithi167.stdout:5/865: mknod d0/d54/d9d/c10b 0 2024-09-17T01:41:38.637 INFO:tasks.workunit.client.1.smithi167.stdout:9/955: link d4/d9/c1c d4/da4/dfe/c131 0 2024-09-17T01:41:38.639 INFO:tasks.workunit.client.1.smithi167.stdout:2/873: unlink d5/d3c/d4c/de2/db8/da3/db0/fd8 0 2024-09-17T01:41:38.645 INFO:tasks.workunit.client.1.smithi167.stdout:3/946: dwrite d7/d8/d10/d14/f6d [0,4194304] 0 2024-09-17T01:41:38.646 INFO:tasks.workunit.client.1.smithi167.stdout:4/883: mknod d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/c129 0 2024-09-17T01:41:38.647 INFO:tasks.workunit.client.1.smithi167.stdout:0/891: creat d5/d6b/d77/daa/f129 x:0 0 0 2024-09-17T01:41:38.653 INFO:tasks.workunit.client.1.smithi167.stdout:5/866: creat d0/d24/d2b/d3d/d3b/db0/db5/d109/f10c x:0 0 0 2024-09-17T01:41:38.656 INFO:tasks.workunit.client.1.smithi167.stdout:4/884: creat d0/d4/d7/dff/df2/f12a x:0 0 0 2024-09-17T01:41:38.658 INFO:tasks.workunit.client.1.smithi167.stdout:5/867: dread d0/d24/d2b/d3d/d6d/de2/fe8 [0,4194304] 0 2024-09-17T01:41:38.659 INFO:tasks.workunit.client.1.smithi167.stdout:5/868: chown d0/d24/d2b/d3d/d6d/de2 24196451 1 2024-09-17T01:41:38.659 INFO:tasks.workunit.client.1.smithi167.stdout:3/947: rename d7/d8/d10/d14/d2c/f6e to d7/d8/d10/d14/d66/dc4/d124/f142 0 2024-09-17T01:41:38.660 INFO:tasks.workunit.client.1.smithi167.stdout:3/948: chown d7/d8/d10/d14/d2c/d6f/cb7 456958972 1 2024-09-17T01:41:38.665 INFO:tasks.workunit.client.1.smithi167.stdout:1/908: creat d0/d5/d61/f128 x:0 0 0 2024-09-17T01:41:38.666 INFO:tasks.workunit.client.1.smithi167.stdout:4/885: creat d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8/f12b x:0 0 0 2024-09-17T01:41:38.667 INFO:tasks.workunit.client.1.smithi167.stdout:4/886: stat d0/dce/f128 0 2024-09-17T01:41:38.668 INFO:tasks.workunit.client.1.smithi167.stdout:4/887: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/db8/f10c [1001692,24704] 0 2024-09-17T01:41:38.669 INFO:tasks.workunit.client.1.smithi167.stdout:3/949: unlink d7/d8/d10/d14/d25/dc7/dd1/dc2/fc5 0 2024-09-17T01:41:38.672 INFO:tasks.workunit.client.1.smithi167.stdout:1/909: mkdir d0/d9/d16/d48/d54/d6e/d7e/d129 0 2024-09-17T01:41:38.673 INFO:tasks.workunit.client.0.smithi082.stdout:1/564: rmdir d2/df/d46/daa 0 2024-09-17T01:41:38.674 INFO:tasks.workunit.client.1.smithi167.stdout:0/892: dread d5/d8/d9/f2c [0,4194304] 0 2024-09-17T01:41:38.676 INFO:tasks.workunit.client.1.smithi167.stdout:7/840: dwrite d0/d2/d14/fad [0,4194304] 0 2024-09-17T01:41:38.676 INFO:tasks.workunit.client.1.smithi167.stdout:4/888: creat d0/d4/d7/da/d10e/d2d/dac/f12c x:0 0 0 2024-09-17T01:41:38.679 INFO:tasks.workunit.client.0.smithi082.stdout:1/565: mknod d2/d3f/cb3 0 2024-09-17T01:41:38.679 INFO:tasks.workunit.client.1.smithi167.stdout:5/869: dread d0/d24/d2b/d3d/dd2/fa1 [0,4194304] 0 2024-09-17T01:41:38.681 INFO:tasks.workunit.client.1.smithi167.stdout:3/950: mkdir d7/d143 0 2024-09-17T01:41:38.686 INFO:tasks.workunit.client.1.smithi167.stdout:7/841: creat d0/d2/d14/d19/d26/d11c/f11f x:0 0 0 2024-09-17T01:41:38.686 INFO:tasks.workunit.client.0.smithi082.stdout:1/566: dwrite d2/d3f/d24/d54/f9f [0,4194304] 0 2024-09-17T01:41:38.687 INFO:tasks.workunit.client.1.smithi167.stdout:1/910: dwrite d0/d9/d16/d48/d54/d6e/d7e/fe5 [0,4194304] 0 2024-09-17T01:41:38.687 INFO:tasks.workunit.client.1.smithi167.stdout:9/956: dwrite d4/d9/d21/d43/d6c/d9e/fbd [0,4194304] 0 2024-09-17T01:41:38.688 INFO:tasks.workunit.client.0.smithi082.stdout:6/549: write d1/d3/f3b [1819584,96527] 0 2024-09-17T01:41:38.692 INFO:tasks.workunit.client.1.smithi167.stdout:3/951: mkdir d7/d8/d10/d14/d25/dfe/d144 0 2024-09-17T01:41:38.695 INFO:tasks.workunit.client.0.smithi082.stdout:2/532: dwrite d1/d10/f2f [0,4194304] 0 2024-09-17T01:41:38.695 INFO:tasks.workunit.client.1.smithi167.stdout:7/842: mkdir d0/d2/d14/d19/d7f/d120 0 2024-09-17T01:41:38.697 INFO:tasks.workunit.client.1.smithi167.stdout:9/957: dread - d4/d9/d21/df0/fd3 zero size 2024-09-17T01:41:38.698 INFO:tasks.workunit.client.1.smithi167.stdout:4/889: fsync d0/d4/d7/d6/d5d/fbd 0 2024-09-17T01:41:38.708 INFO:tasks.workunit.client.0.smithi082.stdout:6/550: link d1/d7/d10/d4f/dc/d2b/d48/faa d1/d7/d10/d4f/dc/d1d/d36/d7a/fc8 0 2024-09-17T01:41:38.709 INFO:tasks.workunit.client.0.smithi082.stdout:6/551: readlink d1/d7/d10/d4f/d8e/lbe 0 2024-09-17T01:41:38.709 INFO:tasks.workunit.client.0.smithi082.stdout:2/533: symlink d1/d17/lb2 0 2024-09-17T01:41:38.712 INFO:tasks.workunit.client.1.smithi167.stdout:9/958: creat d4/d9/d21/d2d/d33/d90/f132 x:0 0 0 2024-09-17T01:41:38.714 INFO:tasks.workunit.client.1.smithi167.stdout:9/959: chown d4/d9/d21/d2d/d33/d3a/f120 4306 1 2024-09-17T01:41:38.716 INFO:tasks.workunit.client.0.smithi082.stdout:2/534: dwrite d1/d10/f86 [0,4194304] 0 2024-09-17T01:41:38.716 INFO:tasks.workunit.client.1.smithi167.stdout:0/893: dwrite d5/f7 [0,4194304] 0 2024-09-17T01:41:38.716 INFO:tasks.workunit.client.0.smithi082.stdout:6/552: creat d1/d7/d10/fc9 x:0 0 0 2024-09-17T01:41:38.719 INFO:tasks.workunit.client.1.smithi167.stdout:1/911: creat d0/d5/d61/f12a x:0 0 0 2024-09-17T01:41:38.721 INFO:tasks.workunit.client.0.smithi082.stdout:6/553: creat d1/d7/d10/d4f/dc/d1d/d36/d56/fca x:0 0 0 2024-09-17T01:41:38.723 INFO:tasks.workunit.client.1.smithi167.stdout:4/890: creat d0/d4/d7/da/d10e/dc3/dd8/f12d x:0 0 0 2024-09-17T01:41:38.723 INFO:tasks.workunit.client.1.smithi167.stdout:3/952: rmdir d7/d8/d1f/df1 0 2024-09-17T01:41:38.724 INFO:tasks.workunit.client.1.smithi167.stdout:2/874: sync 2024-09-17T01:41:38.726 INFO:tasks.workunit.client.0.smithi082.stdout:1/567: dread d2/df/d46/f49 [0,4194304] 0 2024-09-17T01:41:38.728 INFO:tasks.workunit.client.1.smithi167.stdout:1/912: symlink d0/dfc/l12b 0 2024-09-17T01:41:38.728 INFO:tasks.workunit.client.1.smithi167.stdout:2/875: chown d5/d3c/d4c/de2/d45/f68 10 1 2024-09-17T01:41:38.729 INFO:tasks.workunit.client.0.smithi082.stdout:1/568: creat d2/d3f/d24/d54/fb4 x:0 0 0 2024-09-17T01:41:38.731 INFO:tasks.workunit.client.1.smithi167.stdout:9/960: creat d4/d9/d97/dd6/f133 x:0 0 0 2024-09-17T01:41:38.731 INFO:tasks.workunit.client.1.smithi167.stdout:3/953: unlink d7/d8/d10/d14/d24/d62/f77 0 2024-09-17T01:41:38.731 INFO:tasks.workunit.client.0.smithi082.stdout:1/569: rmdir d2/da/d76 39 2024-09-17T01:41:38.734 INFO:tasks.workunit.client.1.smithi167.stdout:4/891: symlink d0/d4/d7/d6/d2b/d6d/d7e/d92/l12e 0 2024-09-17T01:41:38.735 INFO:tasks.workunit.client.1.smithi167.stdout:0/894: dwrite d5/d6b/d77/fef [0,4194304] 0 2024-09-17T01:41:38.736 INFO:tasks.workunit.client.1.smithi167.stdout:5/870: dwrite d0/d24/d2b/d3d/d3b/f98 [0,4194304] 0 2024-09-17T01:41:38.737 INFO:tasks.workunit.client.1.smithi167.stdout:2/876: mknod d5/d3c/d4c/de2/d45/d8e/d98/dca/c12e 0 2024-09-17T01:41:38.737 INFO:tasks.workunit.client.1.smithi167.stdout:0/895: chown d5/d8/d9/fc6 3549 1 2024-09-17T01:41:38.739 INFO:tasks.workunit.client.1.smithi167.stdout:3/954: mknod d7/d8/d10/d14/d24/d62/c145 0 2024-09-17T01:41:38.740 INFO:tasks.workunit.client.1.smithi167.stdout:4/892: unlink d0/d4/d7/d6/d2b/d6d/d7e/d92/d5a/f91 0 2024-09-17T01:41:38.743 INFO:tasks.workunit.client.1.smithi167.stdout:2/877: rmdir d5/d3c/d4c/de2/d45/d8e/d98/dca 39 2024-09-17T01:41:38.745 INFO:tasks.workunit.client.1.smithi167.stdout:0/896: read d5/d8/f96 [481088,4920] 0 2024-09-17T01:41:38.746 INFO:tasks.workunit.client.1.smithi167.stdout:4/893: truncate d0/d4/d7/da/d10e/d2d/d2e/f63 2190259 0 2024-09-17T01:41:38.750 INFO:tasks.workunit.client.1.smithi167.stdout:0/897: creat d5/d6b/dca/f12a x:0 0 0 2024-09-17T01:41:38.750 INFO:tasks.workunit.client.1.smithi167.stdout:3/955: link d7/d1e/f4f d7/d8/d10/d14/d24/d62/d11d/f146 0 2024-09-17T01:41:38.751 INFO:tasks.workunit.client.1.smithi167.stdout:7/843: write d0/f13 [2164328,14038] 0 2024-09-17T01:41:38.752 INFO:tasks.workunit.client.1.smithi167.stdout:2/878: getdents d5/d3c/d4c/de2/d45/d3f/d10c 0 2024-09-17T01:41:38.757 INFO:tasks.workunit.client.1.smithi167.stdout:2/879: read d5/d3c/f81 [749588,26467] 0 2024-09-17T01:41:38.759 INFO:tasks.workunit.client.1.smithi167.stdout:3/956: dwrite d7/d8/d10/d14/d66/f104 [0,4194304] 0 2024-09-17T01:41:38.760 INFO:tasks.workunit.client.1.smithi167.stdout:7/844: dwrite d0/fbe [0,4194304] 0 2024-09-17T01:41:38.762 INFO:tasks.workunit.client.0.smithi082.stdout:6/554: dwrite d1/d7/d10/d4f/dc/d2b/d48/f8d [0,4194304] 0 2024-09-17T01:41:38.763 INFO:tasks.workunit.client.0.smithi082.stdout:1/570: truncate d2/da/d2f/d47/f84 3090136 0 2024-09-17T01:41:38.764 INFO:tasks.workunit.client.1.smithi167.stdout:1/913: write d0/d5/d61/f71 [5006816,48467] 0 2024-09-17T01:41:38.766 INFO:tasks.workunit.client.0.smithi082.stdout:6/555: read d1/d3/f75 [351671,119606] 0 2024-09-17T01:41:38.768 INFO:tasks.workunit.client.0.smithi082.stdout:1/571: readlink d2/d3f/l48 0 2024-09-17T01:41:38.769 INFO:tasks.workunit.client.1.smithi167.stdout:7/845: mknod d0/d2/d14/d19/d32/d62/c121 0 2024-09-17T01:41:38.771 INFO:tasks.workunit.client.1.smithi167.stdout:3/957: rename d7/d8/d10/d14/d25/l49 to d7/d8/d10/d14/d2c/d74/de8/l147 0 2024-09-17T01:41:38.773 INFO:tasks.workunit.client.1.smithi167.stdout:5/871: write d0/d24/f38 [317552,52399] 0 2024-09-17T01:41:38.774 INFO:tasks.workunit.client.0.smithi082.stdout:6/556: mknod d1/d7/d10/d4f/dc/d2b/d48/ccb 0 2024-09-17T01:41:38.777 INFO:tasks.workunit.client.0.smithi082.stdout:1/572: mkdir d2/d3f/d24/db5 0 2024-09-17T01:41:38.777 INFO:tasks.workunit.client.1.smithi167.stdout:3/958: readlink d7/d8/d10/d14/d2c/l38 0 2024-09-17T01:41:38.778 INFO:tasks.workunit.client.1.smithi167.stdout:4/894: write d0/d4/d7/d6/d2b/d6d/d7e/d92/d6a/d81/f8b [997143,76944] 0 2024-09-17T01:41:38.780 INFO:tasks.workunit.client.0.smithi082.stdout:9/425: sync 2024-09-17T01:41:38.781 INFO:tasks.workunit.client.1.smithi167.stdout:1/914: dwrite d0/d9/d16/d36/ff8 [0,4194304] 0 2024-09-17T01:41:38.781 INFO:tasks.workunit.client.1.smithi167.stdout:7/846: mknod d0/d2/d14/d6f/c122 0 2024-09-17T01:41:38.781 INFO:tasks.workunit.client.1.smithi167.stdout:9/961: dwrite d4/d9/d21/d81/db9/fd4 [0,4194304] 0 2024-09-17T01:41:38.782 INFO:tasks.workunit.client.1.smithi167.stdout:1/915: stat d0/l87 0 2024-09-17T01:41:38.783 INFO:tasks.workunit.client.1.smithi167.stdout:1/916: dread - d0/d5/dd7/d102/f10b zero size 2024-09-17T01:41:38.783 INFO:tasks.workunit.client.1.smithi167.stdout:2/880: write d5/d33/f57 [415049,128977] 0 2024-09-17T01:41:38.784 INFO:tasks.workunit.client.0.smithi082.stdout:9/426: mknod d4/d27/d2d/d60/d11/d39/d31/c91 0 2024-09-17T01:41:38.784 INFO:tasks.workunit.client.1.smithi167.stdout:1/917: fdatasync d0/d9/d16/d36/daf/fd3 0 2024-09-17T01:41:38.831 INFO:tasks.workunit.client.1.smithi167.stdout:5/872: rmdir d0/d24/d2b/d49/d66 39 2024-09-17T01:41:38.832 INFO:tasks.workunit.client.0.smithi082.stdout:1/573: rename d2/f10 to d2/da/d76/d93/fb6 0 2024-09-17T01:41:38.834 INFO:tasks.workunit.client.0.smithi082.stdout:9/427: fsync d4/d27/d2d/d60/d11/d39/d29/d6d/f90 0 2024-09-17T01:41:38.836 INFO:tasks.workunit.client.0.smithi082.stdout:9/428: write d4/d27/d2d/d60/d11/d39/f41 [125577,51024] 0 2024-09-17T01:41:38.837 INFO:tasks.workunit.client.1.smithi167.stdout:5/873: dwrite d0/d24/d2b/db1/fb9 [0,4194304] 0 2024-09-17T01:41:38.839 INFO:tasks.workunit.client.1.smithi167.stdout:5/874: truncate d0/d24/d2b/d3d/ffc 450052 0 2024-09-17T01:41:38.841 INFO:tasks.workunit.client.1.smithi167.stdout:9/962: creat d4/d9/d2b/da3/f134 x:0 0 0 2024-09-17T01:41:38.848 INFO:tasks.workunit.client.1.smithi167.stdout:0/898: sync 2024-09-17T01:41:38.848 INFO:tasks.workunit.client.1.smithi167.stdout:4/895: mkdir d0/d12f 0 2024-09-17T01:41:38.850 INFO:tasks.workunit.client.0.smithi082.stdout:9/429: dwrite d4/d27/d2d/d3d/f8c [0,4194304] 0 2024-09-17T01:41:38.850 INFO:tasks.workunit.client.1.smithi167.stdout:0/899: dread d5/d6b/d77/d92/fb4 [0,4194304] 0 2024-09-17T01:41:38.851 INFO:tasks.workunit.client.0.smithi082.stdout:9/430: dread - d4/d27/d2d/d60/d11/f8a zero size 2024-09-17T01:41:38.853 INFO:tasks.workunit.client.0.smithi082.stdout:9/431: chown d4/d27/d2d/d60/d11/d39/d31/c6a 4 1 2024-09-17T01:41:38.858 INFO:tasks.workunit.client.1.smithi167.stdout:5/875: mknod d0/d24/d2b/d3d/d3b/d92/c10d 0 2024-09-17T01:41:38.861 INFO:tasks.workunit.client.0.smithi082.stdout:9/432: dwrite d4/d27/d2d/d60/d11/d39/d44/f72 [0,4194304] 0 2024-09-17T01:41:38.862 INFO:tasks.workunit.client.1.smithi167.stdout:2/881: mkdir d5/d11d/d12f 0 2024-09-17T01:41:38.863 INFO:tasks.workunit.client.0.smithi082.stdout:1/574: creat d2/da/d76/d93/fb7 x:0 0 0 2024-09-17T01:41:38.866 INFO:tasks.workunit.client.1.smithi167.stdout:3/959: truncate d7/d8/d10/f40 219029 0 2024-09-17T01:41:38.868 INFO:tasks.workunit.client.1.smithi167.stdout:3/960: truncate d7/d8/d10/d14/d24/f97 2334559 0 2024-09-17T01:41:38.869 INFO:tasks.workunit.client.0.smithi082.stdout:9/433: rename d4/d27/d2d/d60/fb to d4/d27/d36/d3b/f92 0 2024-09-17T01:41:38.870 INFO:tasks.workunit.client.1.smithi167.stdout:7/847: write d0/f67 [310093,64285] 0 2024-09-17T01:41:38.871 INFO:tasks.workunit.client.1.smithi167.stdout:7/848: write d0/d2/d14/d19/d32/fe5 [48521,44772] 0 2024-09-17T01:41:38.872 INFO:tasks.workunit.client.0.smithi082.stdout:1/575: mkdir d2/da/d76/db8 0 2024-09-17T01:41:38.873 INFO:tasks.workunit.client.0.smithi082.stdout:9/434: symlink d4/d27/d2d/d60/d11/d39/d29/d77/l93 0 2024-09-17T01:41:38.875 INFO:tasks.workunit.client.1.smithi167.stdout:0/900: mknod d5/d8/d9/d2f/d9b/c12b 0 2024-09-17T01:41:38.877 INFO:tasks.workunit.client.1.smithi167.stdout:9/963: mkdir d4/d9/d21/d135 0 2024-09-17T01:41:38.879 INFO:tasks.workunit.client.1.smithi167.stdout:5/876: symlink d0/d24/d2b/d3d/d3b/db0/db5/d109/l10e 0 2024-09-17T01:41:38.880 INFO:tasks.workunit.client.1.smithi167.stdout:2/882: fsync d5/d3c/d4c/de2/db8/da3/f58 0 2024-09-17T01:41:38.880 INFO:tasks.workunit.client.0.smithi082.stdout:9/435: dwrite d4/f8 [4194304,4194304] 0 2024-09-17T01:41:38.883 INFO:tasks.workunit.client.1.smithi167.stdout:3/961: write d7/d8/d10/d14/d2c/f81 [4979869,69135] 0 2024-09-17T01:41:38.883 INFO:tasks.workunit.client.1.smithi167.stdout:1/918: truncate d0/d5/d34/f7d 3512821 0 2024-09-17T01:41:38.885 INFO:tasks.workunit.client.0.smithi082.stdout:1/576: link d2/da/d2d/d6c/f6e d2/da/d16/fb9 0 2024-09-17T01:41:38.885 INFO:tasks.workunit.client.1.smithi167.stdout:4/896: dread - d0/d4/d7/da/d10e/dc3/dd8/f12d zero size 2024-09-17T01:41:38.892 INFO:tasks.workunit.client.0.smithi082.stdout:1/577: chown d2/df/d46/f64 1 1 2024-09-17T01:41:38.894 INFO:tasks.workunit.client.0.smithi082.stdout:9/436: truncate d4/d27/d36/d3b/f92 2468027 0 2024-09-17T01:41:38.895 INFO:tasks.workunit.client.1.smithi167.stdout:5/877: chown d0/d24/l6c 2 1 2024-09-17T01:41:38.896 INFO:tasks.workunit.client.1.smithi167.stdout:3/962: dread d7/d8/d10/d14/d66/d6c/dab/f101 [0,4194304] 0 2024-09-17T01:41:38.896 INFO:tasks.workunit.client.0.smithi082.stdout:1/578: chown d2/da/d16/c2c 125 1 2024-09-17T01:41:38.897 INFO:tasks.workunit.client.1.smithi167.stdout:3/963: write d7/d8/d10/d14/d24/d9c/f12b [342332,70616] 0 2024-09-17T01:41:38.901 INFO:tasks.workunit.client.1.smithi167.stdout:1/919: creat d0/d5/d61/da2/f12c x:0 0 0 2024-09-17T01:41:38.901 INFO:tasks.workunit.client.1.smithi167.stdout:5/878: dwrite d0/d24/d2b/d3d/ffc [0,4194304] 0 2024-09-17T01:41:38.902 INFO:tasks.workunit.client.1.smithi167.stdout:5/879: write d0/d9/f12 [4254921,17283] 0 2024-09-17T01:41:38.903 INFO:tasks.workunit.client.1.smithi167.stdout:0/901: write d5/d6b/d77/d4d/f38 [100948,83528] 0 2024-09-17T01:41:38.904 INFO:tasks.workunit.client.0.smithi082.stdout:1/579: mkdir d2/d3f/d24/dba 0 2024-09-17T01:41:38.905 INFO:tasks.workunit.client.0.smithi082.stdout:1/580: dread - d2/da/d2f/f4c zero size 2024-09-17T01:41:38.907 INFO:tasks.workunit.client.1.smithi167.stdout:5/880: read d0/d24/d2b/d49/d4b/dac/d3a/f7d [3496136,65385] 0 2024-09-17T01:41:38.909 INFO:tasks.workunit.client.0.smithi082.stdout:9/437: creat d4/f94 x:0 0 0 2024-09-17T01:41:38.910 INFO:tasks.workunit.client.0.smithi082.stdout:9/438: readlink d4/d27/d2d/d60/d11/l75 0 2024-09-17T01:41:38.911 INFO:tasks.workunit.client.1.smithi167.stdout:9/964: creat d4/d9/d21/d2d/d33/d90/d119/f136 x:0 0 0 2024-09-17T01:41:38.912 INFO:tasks.workunit.client.1.smithi167.stdout:9/965: stat d4/d9/d21/d43/d6c/d9e/fbd 0 2024-09-17T01:41:38.913 INFO:tasks.workunit.client.1.smithi167.stdout:9/966: chown d4/d9/d21/d2d/c5e 6504725 1 2024-09-17T01:41:38.925 INFO:tasks.workunit.client.1.smithi167.stdout:5/881: dread d0/d24/d2b/d49/d4b/dac/fc9 [0,4194304] 0 2024-09-17T01:41:38.926 INFO:tasks.workunit.client.1.smithi167.stdout:0/902: dread d5/d8/d9/d2f/fa6 [0,4194304] 0 2024-09-17T01:41:38.927 INFO:tasks.workunit.client.1.smithi167.stdout:0/903: stat d5/d8/d9/d2f 0 2024-09-17T01:41:38.966 INFO:tasks.workunit.client.1.smithi167.stdout:7/849: sync 2024-09-17T01:41:38.971 INFO:tasks.workunit.client.1.smithi167.stdout:7/850: dwrite d0/d2/ded/dfd/f105 [0,4194304] 0 2024-09-17T01:41:38.975 INFO:tasks.workunit.client.0.smithi082.stdout:5/557: sync 2024-09-17T01:41:39.002 INFO:tasks.workunit.client.1.smithi167.stdout:2/883: mknod d5/d3c/d4c/de2/d2e/d114/c130 0 2024-09-17T01:41:39.003 INFO:tasks.workunit.client.1.smithi167.stdout:2/884: readlink d5/d3c/d4c/de2/db8/da3/dc8/l12d 0 2024-09-17T01:41:39.004 INFO:tasks.workunit.client.0.smithi082.stdout:1/581: link d2/da/d2d/d79/c8d d2/df/d46/cbb 0 2024-09-17T01:41:39.005 INFO:tasks.workunit.client.0.smithi082.stdout:1/582: write d2/d3f/d24/f9a [457625,102000] 0 2024-09-17T01:41:39.005 INFO:tasks.workunit.client.0.smithi082.stdout:5/558: mkdir db/d1e/d5b/d83/dae 0 2024-09-17T01:41:39.007 INFO:tasks.workunit.client.0.smithi082.stdout:9/439: mkdir d4/d27/d95 0 2024-09-17T01:41:39.008 INFO:tasks.workunit.client.0.smithi082.stdout:9/440: chown d4/d27/d21/l62 2014276 1 2024-09-17T01:41:39.012 INFO:tasks.workunit.client.0.smithi082.stdout:5/559: mknod db/d56/d18/d98/caf 0 2024-09-17T01:41:39.013 INFO:tasks.workunit.client.0.smithi082.stdout:9/441: write d4/f1d [12132358,88065] 0 2024-09-17T01:41:39.016 INFO:tasks.workunit.client.1.smithi167.stdout:9/967: mkdir d4/d9/d21/d43/d6c/d9e/d137 0 2024-09-17T01:41:39.016 INFO:tasks.workunit.client.1.smithi167.stdout:9/968: fdatasync d4/da4/fbe 0 2024-09-17T01:41:39.017 INFO:tasks.workunit.client.0.smithi082.stdout:1/583: creat d2/fbc x:0 0 0 2024-09-17T01:41:39.018 INFO:tasks.workunit.client.1.smithi167.stdout:5/882: creat d0/d24/d2b/d3d/dd2/dc4/f10f x:0 0 0 2024-09-17T01:41:39.023 INFO:tasks.workunit.client.1.smithi167.stdout:7/851: mkdir d0/d2/d14/d19/d26/d11c/d123 0 2024-09-17T01:41:39.029 INFO:tasks.workunit.client.0.smithi082.stdout:1/584: rename d2/da/d2d/d79/c97 to d2/d3f/d24/dba/cbd 0 2024-09-17T01:41:39.029 INFO:tasks.workunit.client.0.smithi082.stdout:5/560: dwrite db/d56/d29/f68 [0,4194304] 0 2024-09-17T01:41:39.030 INFO:tasks.workunit.client.0.smithi082.stdout:5/561: dread - db/d56/d18/d98/fa9 zero size 2024-09-17T01:41:39.032 INFO:tasks.workunit.client.0.smithi082.stdout:5/562: read - db/d1e/d20/d4d/f97 zero size 2024-09-17T01:41:39.032 INFO:tasks.workunit.client.0.smithi082.stdout:9/442: dread d4/d27/d21/f42 [0,4194304] 0 2024-09-17T01:41:39.033 INFO:tasks.workunit.client.0.smithi082.stdout:1/585: read - d2/df/fab zero size 2024-09-17T01:41:39.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/586: rmdir d2/da/d2f/d47 39 2024-09-17T01:41:39.044 INFO:tasks.workunit.client.0.smithi082.stdout:1/587: mknod d2/da/d2d/d6c/cbe 0 2024-09-17T01:41:39.050 INFO:tasks.workunit.client.0.smithi082.stdout:5/563: dwrite db/d1e/d5b/f92 [0,4194304] 0 2024-09-17T01:41:39.057 INFO:tasks.workunit.client.0.smithi082.stdout:5/564: link db/d1e/d5b/la5 db/d56/d29/d4f/d8e/lb0 0 2024-09-17T01:41:39.057 INFO:tasks.workunit.client.0.smithi082.stdout:5/565: readlink db/d1e/d20/l6d 0 2024-09-17T01:41:39.060 INFO:tasks.workunit.client.1.smithi167.stdout:3/964: mknod d7/c148 0 2024-09-17T01:41:39.063 INFO:tasks.workunit.client.1.smithi167.stdout:1/920: creat d0/d5/d34/d83/d112/d85/db5/dc1/d119/f12d x:0 0 0 2024-09-17T01:41:39.065 INFO:tasks.workunit.client.1.smithi167.stdout:4/897: rename d0/d4/d7/d10/ff0 to d0/f130 0 2024-09-17T01:41:39.066 INFO:tasks.workunit.client.1.smithi167.stdout:9/969: fdatasync d4/d9/d21/ffa 0 2024-09-17T01:41:39.068 INFO:tasks.workunit.client.1.smithi167.stdout:0/904: symlink d5/d6b/d77/d6d/l12c 0 2024-09-17T01:41:39.069 INFO:tasks.workunit.client.1.smithi167.stdout:7/852: rmdir d0/d2/d14/d19/d26/d83/da5/d70 39 2024-09-17T01:41:39.070 INFO:tasks.workunit.client.1.smithi167.stdout:2/885: unlink d5/d3c/d4c/de2/d45/d8e/d98/dca/fce 0 2024-09-17T01:41:39.073 INFO:tasks.workunit.client.1.smithi167.stdout:1/921: creat d0/f12e x:0 0 0 2024-09-17T01:41:39.073 INFO:tasks.workunit.client.1.smithi167.stdout:1/922: dread - d0/d5/dd7/d102/ff4 zero size 2024-09-17T01:41:39.077 INFO:tasks.workunit.client.1.smithi167.stdout:9/970: dread d4/d9/d21/d2d/d33/d3a/d9c/faa [0,4194304] 0 2024-09-17T01:41:39.077 INFO:tasks.workunit.client.1.smithi167.stdout:0/905: creat d5/d6b/d77/d4d/d56/d7b/f12d x:0 0 0 2024-09-17T01:41:39.079 INFO:tasks.workunit.client.1.smithi167.stdout:3/965: symlink d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d12a/l149 0 2024-09-17T01:41:39.082 INFO:tasks.workunit.client.1.smithi167.stdout:0/906: rmdir d5/d8/d5c 39 2024-09-17T01:41:39.083 INFO:tasks.workunit.client.1.smithi167.stdout:9/971: read d4/d9/f1d [1758086,36223] 0 2024-09-17T01:41:39.083 INFO:tasks.workunit.client.1.smithi167.stdout:2/886: creat d5/d3c/d4c/de2/d45/d3f/d10c/f131 x:0 0 0 2024-09-17T01:41:39.085 INFO:tasks.workunit.client.1.smithi167.stdout:0/907: unlink d5/d8/d9/f6a 0 2024-09-17T01:41:39.085 INFO:tasks.workunit.client.1.smithi167.stdout:1/923: dread d0/d5/d34/f5b [0,4194304] 0 2024-09-17T01:41:39.086 INFO:tasks.workunit.client.1.smithi167.stdout:0/908: chown d5/d6b/d77/daa/db1/cff 3100 1 2024-09-17T01:41:39.086 INFO:tasks.workunit.client.1.smithi167.stdout:3/966: unlink d7/d1e/f4f 0 2024-09-17T01:41:39.088 INFO:tasks.workunit.client.1.smithi167.stdout:3/967: truncate d7/d8/d10/d14/d25/d9e/fb1 1640842 0 2024-09-17T01:41:39.089 INFO:tasks.workunit.client.1.smithi167.stdout:2/887: creat d5/d3c/d4c/de2/db8/d5e/d103/d108/f132 x:0 0 0 2024-09-17T01:41:39.089 INFO:tasks.workunit.client.1.smithi167.stdout:1/924: read d0/f46 [983286,118701] 0 2024-09-17T01:41:39.089 INFO:tasks.workunit.client.1.smithi167.stdout:2/888: readlink d5/d3c/d4c/de2/db8/da3/dc8/l12d 0 2024-09-17T01:41:39.090 INFO:tasks.workunit.client.1.smithi167.stdout:1/925: mkdir d0/d5/d34/d12f 0 2024-09-17T01:41:39.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/926: chown d0/d9/d16/d48/d54/d78/d90/f113 7 1 2024-09-17T01:41:39.092 INFO:tasks.workunit.client.0.smithi082.stdout:5/566: truncate db/d56/f50 1919077 0 2024-09-17T01:41:39.092 INFO:tasks.workunit.client.1.smithi167.stdout:2/889: mknod d5/d11d/c133 0 2024-09-17T01:41:39.093 INFO:tasks.workunit.client.1.smithi167.stdout:3/968: mkdir d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d7a/d14a 0 2024-09-17T01:41:39.093 INFO:tasks.workunit.client.1.smithi167.stdout:3/969: stat d7/l8a 0 2024-09-17T01:41:39.094 INFO:tasks.workunit.client.0.smithi082.stdout:5/567: symlink db/d56/d18/lb1 0 2024-09-17T01:41:39.095 INFO:tasks.workunit.client.1.smithi167.stdout:4/898: rename d0/d4/d7 to d0/d4/d69/d131 0 2024-09-17T01:41:39.097 INFO:tasks.workunit.client.1.smithi167.stdout:3/970: dwrite d7/d8/d10/d14/f8d [0,4194304] 0 2024-09-17T01:41:39.150 INFO:tasks.workunit.client.0.smithi082.stdout:4/455: sync 2024-09-17T01:41:39.151 INFO:tasks.workunit.client.0.smithi082.stdout:4/456: read d9/d15/d16/d18/d4a/d52/d55/f42 [1627032,48306] 0 2024-09-17T01:41:39.158 INFO:tasks.workunit.client.0.smithi082.stdout:5/568: write db/d2b/f36 [1026929,118095] 0 2024-09-17T01:41:39.159 INFO:tasks.workunit.client.1.smithi167.stdout:0/909: rename d5/d8/d9/d2f/d9b/la8 to d5/d6b/d77/d6d/d90/dc4/l12e 0 2024-09-17T01:41:39.160 INFO:tasks.workunit.client.0.smithi082.stdout:4/457: creat d9/d15/d16/d18/d4a/d52/f9a x:0 0 0 2024-09-17T01:41:39.163 INFO:tasks.workunit.client.0.smithi082.stdout:5/569: creat db/d56/d78/da0/fb2 x:0 0 0 2024-09-17T01:41:39.164 INFO:tasks.workunit.client.1.smithi167.stdout:3/971: creat d7/d8/d10/d14/d66/f14b x:0 0 0 2024-09-17T01:41:39.165 INFO:tasks.workunit.client.0.smithi082.stdout:4/458: mkdir d9/d47/d9b 0 2024-09-17T01:41:39.165 INFO:tasks.workunit.client.1.smithi167.stdout:5/883: write d0/d9/f2d [4313408,96785] 0 2024-09-17T01:41:39.166 INFO:tasks.workunit.client.1.smithi167.stdout:3/972: truncate d7/d8/d10/d14/d25/d9e/f12f 781625 0 2024-09-17T01:41:39.166 INFO:tasks.workunit.client.0.smithi082.stdout:5/570: fsync db/d1e/f55 0 2024-09-17T01:41:39.167 INFO:tasks.workunit.client.1.smithi167.stdout:9/972: sync 2024-09-17T01:41:39.167 INFO:tasks.workunit.client.1.smithi167.stdout:3/973: stat d7/d8/d10/d14/d24/d62/f69 0 2024-09-17T01:41:39.168 INFO:tasks.workunit.client.0.smithi082.stdout:5/571: write db/d56/d29/f68 [1671342,73362] 0 2024-09-17T01:41:39.168 INFO:tasks.workunit.client.0.smithi082.stdout:5/572: chown db/d56/d18 1797 1 2024-09-17T01:41:39.169 INFO:tasks.workunit.client.0.smithi082.stdout:4/459: readlink d9/d15/d16/d3e/d54/l78 0 2024-09-17T01:41:39.171 INFO:tasks.workunit.client.1.smithi167.stdout:1/927: rename d0/d5/d34/d83/d112/d85/df6 to d0/d9/d16/d36/daf/d130 0 2024-09-17T01:41:39.172 INFO:tasks.workunit.client.1.smithi167.stdout:7/853: dwrite d0/d2/d14/d6f/d87/dae/fd4 [4194304,4194304] 0 2024-09-17T01:41:39.174 INFO:tasks.workunit.client.0.smithi082.stdout:5/573: dwrite db/d56/f35 [4194304,4194304] 0 2024-09-17T01:41:39.175 INFO:tasks.workunit.client.0.smithi082.stdout:4/460: dwrite d9/d47/f79 [0,4194304] 0 2024-09-17T01:41:39.185 INFO:tasks.workunit.client.1.smithi167.stdout:9/973: symlink d4/da4/l138 0 2024-09-17T01:41:39.188 INFO:tasks.workunit.client.1.smithi167.stdout:2/890: write d5/f2a [4878581,77070] 0 2024-09-17T01:41:39.189 INFO:tasks.workunit.client.1.smithi167.stdout:3/974: unlink d7/d8f/ld3 0 2024-09-17T01:41:39.190 INFO:tasks.workunit.client.0.smithi082.stdout:5/574: rename db/d1e/d5b/d83/dae to db/da7/db3 0 2024-09-17T01:41:39.192 INFO:tasks.workunit.client.1.smithi167.stdout:2/891: write d5/d3c/d4c/de2/d45/d3f/f10d [124752,100397] 0 2024-09-17T01:41:39.193 INFO:tasks.workunit.client.1.smithi167.stdout:2/892: readlink l2 0 2024-09-17T01:41:39.197 INFO:tasks.workunit.client.1.smithi167.stdout:1/928: mknod d0/d5/dbf/ddb/c131 0 2024-09-17T01:41:39.198 INFO:tasks.workunit.client.1.smithi167.stdout:7/854: rename d0/d2/c100 to d0/d2/ded/c124 0 2024-09-17T01:41:39.200 INFO:tasks.workunit.client.0.smithi082.stdout:5/575: unlink db/d2b/l6e 0 2024-09-17T01:41:39.202 INFO:tasks.workunit.client.0.smithi082.stdout:4/461: creat d9/d15/d16/d44/d84/f9c x:0 0 0 2024-09-17T01:41:39.205 INFO:tasks.workunit.client.1.smithi167.stdout:4/899: dwrite d0/d4/fa5 [0,4194304] 0 2024-09-17T01:41:39.210 INFO:tasks.workunit.client.1.smithi167.stdout:5/884: dwrite d0/f1d [0,4194304] 0 2024-09-17T01:41:39.212 INFO:tasks.workunit.client.1.smithi167.stdout:3/975: symlink d7/d1e/l14c 0 2024-09-17T01:41:39.212 INFO:tasks.workunit.client.1.smithi167.stdout:1/929: rmdir d0/d5/dbf 39 2024-09-17T01:41:39.213 INFO:tasks.workunit.client.1.smithi167.stdout:2/893: write d5/d3c/f81 [5590915,48333] 0 2024-09-17T01:41:39.218 INFO:tasks.workunit.client.1.smithi167.stdout:9/974: dread d4/d9/d21/d43/d6c/f8b [0,4194304] 0 2024-09-17T01:41:39.219 INFO:tasks.workunit.client.1.smithi167.stdout:5/885: readlink d0/d24/d2b/d3d/d3b/d92/df3/lf7 0 2024-09-17T01:41:39.221 INFO:tasks.workunit.client.1.smithi167.stdout:2/894: mkdir d5/d3c/d4c/de2/d45/d6b/d134 0 2024-09-17T01:41:39.223 INFO:tasks.workunit.client.1.smithi167.stdout:3/976: mkdir d7/d8/d10/d14/d25/dc7/dd1/dc2/d10c/d14d 0 2024-09-17T01:41:39.225 INFO:tasks.workunit.client.0.smithi082.stdout:5/576: write db/d1e/d20/d30/f7c [162604,34783] 0 2024-09-17T01:41:39.227 INFO:tasks.workunit.client.1.smithi167.stdout:5/886: rmdir d0/d24/d2b/d49/d4b/dac/d3a 39 2024-09-17T01:41:39.229 INFO:tasks.workunit.client.0.smithi082.stdout:5/577: mkdir db/d1e/d5b/db4 0 2024-09-17T01:41:39.229 INFO:tasks.workunit.client.1.smithi167.stdout:3/977: dwrite d7/f131 [0,4194304] 0 2024-09-17T01:41:39.230 INFO:tasks.workunit.client.0.smithi082.stdout:4/462: dwrite d9/d15/f2e [0,4194304] 0 2024-09-17T01:41:39.230 INFO:tasks.workunit.client.1.smithi167.stdout:2/895: rmdir d5/d3c/d4c/de2/d2e 39 2024-09-17T01:41:39.232 INFO:tasks.workunit.client.1.smithi167.stdout:0/910: truncate d5/d8/d5c/fd2 501260 0 2024-09-17T01:41:39.234 INFO:tasks.workunit.client.0.smithi082.stdout:5/578: rmdir db/d56/d29 39 2024-09-17T01:41:39.235 INFO:tasks.workunit.client.1.smithi167.stdout:4/900: write d0/d4/d69/d131/d6/f43 [1549479,68399] 0 2024-09-17T01:41:39.237 INFO:tasks.workunit.client.1.smithi167.stdout:7/855: dread d0/d2/d14/d19/d26/d83/da5/d70/fbb [0,4194304] 0 2024-09-17T01:41:39.238 INFO:tasks.workunit.client.1.smithi167.stdout:5/887: chown d0/d24/d2b/d3d/f65 3099 1 2024-09-17T01:41:39.239 INFO:tasks.workunit.client.1.smithi167.stdout:3/978: mknod d7/d8/d10/d14/d24/d62/c14e 0 2024-09-17T01:41:39.240 INFO:tasks.workunit.client.1.smithi167.stdout:3/979: chown d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/f95 2 1 2024-09-17T01:41:39.241 INFO:tasks.workunit.client.1.smithi167.stdout:1/930: getdents d0/d5 0 2024-09-17T01:41:39.242 INFO:tasks.workunit.client.1.smithi167.stdout:2/896: rmdir d5/d6d 39 2024-09-17T01:41:39.246 INFO:tasks.workunit.client.1.smithi167.stdout:9/975: write d4/d9/d21/d2d/d33/f70 [93752,111039] 0 2024-09-17T01:41:39.248 INFO:tasks.workunit.client.0.smithi082.stdout:4/463: getdents d9/d15/d16/d18/d4f 0 2024-09-17T01:41:39.248 INFO:tasks.workunit.client.1.smithi167.stdout:7/856: rmdir d0/d2/d88/d6e/da3/dd0 39 2024-09-17T01:41:39.249 INFO:tasks.workunit.client.1.smithi167.stdout:5/888: write d0/d24/d2b/f81 [5196914,119356] 0 2024-09-17T01:41:39.252 INFO:tasks.workunit.client.1.smithi167.stdout:3/980: readlink d7/d8/d10/d14/d2c/d6f/db6/lf8 0 2024-09-17T01:41:39.252 INFO:tasks.workunit.client.0.smithi082.stdout:4/464: read d9/d15/f27 [2145180,95291] 0 2024-09-17T01:41:39.253 INFO:tasks.workunit.client.1.smithi167.stdout:1/931: mkdir d0/d5/d34/d12f/d132 0 2024-09-17T01:41:39.255 INFO:tasks.workunit.client.1.smithi167.stdout:7/857: symlink d0/d2/d14/d19/d26/d11c/d123/l125 0 2024-09-17T01:41:39.255 INFO:tasks.workunit.client.1.smithi167.stdout:0/911: truncate d5/d6b/d77/daa/db1/feb 565333 0 2024-09-17T01:41:39.255 INFO:tasks.workunit.client.1.smithi167.stdout:3/981: truncate d7/d8/d10/d14/d66/f14b 948169 0 2024-09-17T01:41:39.257 INFO:tasks.workunit.client.0.smithi082.stdout:4/465: truncate d9/d15/d16/d18/d4a/d52/d55/d48/f74 789854 0 2024-09-17T01:41:39.258 INFO:tasks.workunit.client.1.smithi167.stdout:5/889: dwrite d0/d54/d56/f107 [0,4194304] 0 2024-09-17T01:41:39.258 INFO:tasks.workunit.client.1.smithi167.stdout:2/897: getdents d5/d3c/d4c/de2/db8/d5e/d103/d108 0 2024-09-17T01:41:39.260 INFO:tasks.workunit.client.1.smithi167.stdout:2/898: chown d5/d3c/d4c/de2/db8/da3/f26 774 1 2024-09-17T01:41:39.261 INFO:tasks.workunit.client.0.smithi082.stdout:5/579: dwrite db/d2b/f93 [0,4194304] 0 2024-09-17T01:41:39.261 INFO:tasks.workunit.client.1.smithi167.stdout:1/932: rename d0/d5/dd7/d102/de7/l120 to d0/d5/d61/da2/l133 0 2024-09-17T01:41:39.270 INFO:tasks.workunit.client.0.smithi082.stdout:4/466: creat d9/d15/d16/d3e/d73/f9d x:0 0 0 2024-09-17T01:41:39.270 INFO:tasks.workunit.client.0.smithi082.stdout:5/580: stat db/d56/d29/f3c 0 2024-09-17T01:41:39.271 INFO:tasks.workunit.client.1.smithi167.stdout:2/899: chown d5/d3c/d4c/de2/d2e 238874120 1 2024-09-17T01:41:39.271 INFO:tasks.workunit.client.0.smithi082.stdout:5/581: dread - db/d1e/d20/d4d/f97 zero size 2024-09-17T01:41:39.272 INFO:tasks.workunit.client.1.smithi167.stdout:2/900: readlink d5/d33/d48/d72/d94/la9 0 2024-09-17T01:41:39.273 INFO:tasks.workunit.client.1.smithi167.stdout:7/858: rename d0/d2/f41 to d0/d2/d88/f126 0 2024-09-17T01:41:39.275 INFO:tasks.workunit.client.0.smithi082.stdout:4/467: creat d9/d15/d16/d18/d4a/d52/d55/f9e x:0 0 0 2024-09-17T01:41:39.277 INFO:tasks.workunit.client.1.smithi167.stdout:7/859: creat d0/d2/d14/d19/d7f/db4/dbf/f127 x:0 0 0 2024-09-17T01:41:39.278 INFO:tasks.workunit.client.1.smithi167.stdout:5/890: getdents d0/d24/d2b/d3d/d3b/db0 0 2024-09-17T01:41:39.279 INFO:tasks.workunit.client.0.smithi082.stdout:4/468: symlink d9/d15/d16/d18/d4a/l9f 0 2024-09-17T01:41:39.280 INFO:tasks.workunit.client.1.smithi167.stdout:9/976: dread d4/da4/fbe [0,4194304] 0 2024-09-17T01:41:39.281 INFO:tasks.workunit.client.1.smithi167.stdout:5/891: mknod d0/d54/d9d/c110 0 2024-09-17T01:41:39.281 INFO:tasks.workunit.client.1.smithi167.stdout:9/977: chown d4/d9/d21/d43/df2 189 1 2024-09-17T01:41:39.282 INFO:tasks.workunit.client.0.smithi082.stdout:4/469: dread - d9/d15/d16/d18/d4a/d52/f6a zero size 2024-09-17T01:41:39.282 INFO:tasks.workunit.client.1.smithi167.stdout:5/892: write d0/d24/d2b/db1/fb9 [4530151,86853] 0 2024-09-17T01:41:39.286 INFO:tasks.workunit.client.1.smithi167.stdout:0/912: dread d5/d6b/d77/d92/fea [0,4194304] 0 2024-09-17T01:41:39.286 INFO:tasks.workunit.client.0.smithi082.stdout:4/470: mkdir d9/d15/d37/d4c/da0 0 2024-09-17T01:41:39.288 INFO:tasks.workunit.client.0.smithi082.stdout:8/433: sync 2024-09-17T01:41:39.288 INFO:tasks.workunit.client.0.smithi082.stdout:7/542: sync 2024-09-17T01:41:39.288 INFO:tasks.workunit.client.0.smithi082.stdout:0/363: sync 2024-09-17T01:41:39.288 INFO:tasks.workunit.client.0.smithi082.stdout:3/401: sync 2024-09-17T01:41:39.288 INFO:tasks.workunit.client.0.smithi082.stdout:4/471: creat d9/d15/d16/d3e/d54/fa1 x:0 0 0 2024-09-17T01:41:39.289 INFO:tasks.workunit.client.0.smithi082.stdout:3/402: write d9/db/f8a [102401,4460] 0 2024-09-17T01:41:39.294 INFO:tasks.workunit.client.0.smithi082.stdout:7/543: dread - d0/dd/d2c/d55/f80 zero size 2024-09-17T01:41:39.294 INFO:tasks.workunit.client.1.smithi167.stdout:1/933: write d0/d5/d34/f49 [40826,16200] 0 2024-09-17T01:41:39.294 INFO:tasks.workunit.client.0.smithi082.stdout:5/582: dread db/f5a [0,4194304] 0 2024-09-17T01:41:39.296 INFO:tasks.workunit.client.1.smithi167.stdout:3/982: dwrite d7/d8/d10/d14/d66/dc4/d124/f142 [0,4194304] 0 2024-09-17T01:41:39.298 INFO:tasks.workunit.client.0.smithi082.stdout:8/434: symlink d3/dd/d18/d2d/d3e/d43/l89 0 2024-09-17T01:41:39.298 INFO:tasks.workunit.client.0.smithi082.stdout:8/435: chown d3/f25 1045612 1 2024-09-17T01:41:39.300 INFO:tasks.workunit.client.1.smithi167.stdout:0/913: getdents d5 0 2024-09-17T01:41:39.300 INFO:tasks.workunit.client.1.smithi167.stdout:2/901: dread d5/d3c/d4c/de2/f31 [0,4194304] 0 2024-09-17T01:41:39.301 INFO:tasks.workunit.client.1.smithi167.stdout:1/934: mkdir d0/d9/d16/d36/d134 0 2024-09-17T01:41:39.302 INFO:tasks.workunit.client.0.smithi082.stdout:4/472: creat d9/d15/d16/d3e/d73/fa2 x:0 0 0 2024-09-17T01:41:39.302 INFO:tasks.workunit.client.1.smithi167.stdout:0/914: stat d5/d6b/d77/daa/db1/feb 0 2024-09-17T01:41:39.302 INFO:tasks.workunit.client.1.smithi167.stdout:7/860: dread d0/d2/d14/fd7 [0,4194304] 0 2024-09-17T01:41:39.303 INFO:tasks.workunit.client.1.smithi167.stdout:0/915: fdatasync d5/d6b/d77/d37/f65 0 2024-09-17T01:41:39.304 INFO:tasks.workunit.client.0.smithi082.stdout:3/403: creat d9/d78/f8b x:0 0 0 2024-09-17T01:41:39.304 INFO:tasks.workunit.client.1.smithi167.stdout:3/983: dread d7/d8/d10/d14/d2c/d74/d11b/f129 [0,4194304] 0 2024-09-17T01:41:39.304 INFO:tasks.workunit.client.1.smithi167.stdout:5/893: write d0/d9/f7a [28316,49097] 0 2024-09-17T01:41:39.305 INFO:tasks.workunit.client.0.smithi082.stdout:5/583: chown db/f96 0 1 2024-09-17T01:41:39.306 INFO:tasks.workunit.client.1.smithi167.stdout:3/984: write d7/d8/d10/d14/d25/d9e/fb1 [1679935,70375] 0 2024-09-17T01:41:39.310 INFO:tasks.workunit.client.0.smithi082.stdout:0/364: rename f7 to da/d1b/d23/d4d/f7f 0 2024-09-17T01:41:39.313 INFO:tasks.workunit.client.0.smithi082.stdout:3/404: chown d9/l4c 28 1 2024-09-17T01:41:39.313 INFO:tasks.workunit.client.1.smithi167.stdout:3/985: dwrite d7/f131 [4194304,4194304] 0 2024-09-17T01:41:39.314 INFO:tasks.workunit.client.1.smithi167.stdout:0/916: rename d5/d6b/d77/fef to d5/dee/f12f 0 2024-09-17T01:41:39.316 INFO:tasks.workunit.client.1.smithi167.stdout:7/861: dwrite d0/d2/d88/fab [0,4194304] 0 2024-09-17T01:41:39.319 INFO:tasks.workunit.client.1.smithi167.stdout:7/862: chown d0/d2/d14/d19/d32/d62/fe1 610011 1 2024-09-17T01:41:39.321 INFO:tasks.workunit.client.1.smithi167.stdout:2/902: creat d5/f135 x:0 0 0 2024-09-17T01:41:39.323 INFO:tasks.workunit.client.1.smithi167.stdout:2/903: read d5/dfe/f10f [1533228,60084] 0 2024-09-17T01:41:39.323 INFO:tasks.workunit.client.0.smithi082.stdout:8/436: dwrite d3/dd/d18/d2d/d3e/d4a/d68/f78 [0,4194304] 0 2024-09-17T01:41:39.325 INFO:tasks.workunit.client.0.smithi082.stdout:7/544: rename d0/d3/db/f29 to d0/d3/d36/d37/d86/fba 0 2024-09-17T01:41:39.330 INFO:tasks.workunit.client.1.smithi167.stdout:0/917: dread d5/d6b/d77/d6d/f81 [0,4194304] 0 2024-09-17T01:41:39.331 INFO:tasks.workunit.client.1.smithi167.stdout:4/901: sync 2024-09-17T01:41:39.333 INFO:tasks.workunit.client.0.smithi082.stdout:5/584: write db/d56/f50 [1627623,42412] 0 2024-09-17T01:41:39.335 INFO:tasks.workunit.client.1.smithi167.stdout:0/918: read d5/d6b/d77/d4d/d56/ff4 [3472779,1505] 0 2024-09-17T01:41:39.335 INFO:tasks.workunit.client.1.smithi167.stdout:0/919: fdatasync d5/d8/d9/f62 0 2024-09-17T01:41:39.336 INFO:tasks.workunit.client.1.smithi167.stdout:5/894: rename d0/d24/d2b/d49/dfd to d0/d24/d2b/d3d/d3b/d5f/d111 0 2024-09-17T01:41:39.336 INFO:tasks.workunit.client.1.smithi167.stdout:0/920: read - d5/d6b/d77/d37/d80/fbd zero size 2024-09-17T01:41:39.338 INFO:tasks.workunit.client.1.smithi167.stdout:7/863: unlink d0/d2/d14/d6f/fdc 0 2024-09-17T01:41:39.340 INFO:tasks.workunit.client.1.smithi167.stdout:1/935: link d0/d9/d16/d36/d8f/l97 d0/d9/d16/d48/d54/d78/d90/da3/l135 0 2024-09-17T01:41:39.341 INFO:tasks.workunit.client.0.smithi082.stdout:8/437: symlink d3/dd/d18/d2d/d3b/l8a 0 2024-09-17T01:41:39.343 INFO:tasks.workunit.client.0.smithi082.stdout:7/545: creat d0/d3/d36/d37/d86/fbb x:0 0 0 2024-09-17T01:41:39.347 INFO:tasks.workunit.client.0.smithi082.stdout:3/405: mkdir d9/d8c 0 2024-09-17T01:41:39.348 INFO:tasks.workunit.client.0.smithi082.stdout:5/585: creat db/d1e/d20/d30/d47/fb5 x:0 0 0 2024-09-17T01:41:39.350 INFO:tasks.workunit.client.0.smithi082.stdout:4/473: getdents d9/d15/d16/d18 0 2024-09-17T01:41:39.351 INFO:tasks.workunit.client.0.smithi082.stdout:7/546: dwrite d0/d3/db/d10/d47/f5c [4194304,4194304] 0 2024-09-17T01:41:39.352 INFO:tasks.workunit.client.1.smithi167.stdout:0/921: dread - d5/d8/d5c/fd0 zero size 2024-09-17T01:41:39.353 INFO:tasks.workunit.client.1.smithi167.stdout:0/922: readlink d5/d6b/d77/d37/l95 0 2024-09-17T01:41:39.354 INFO:tasks.workunit.client.0.smithi082.stdout:3/406: symlink d9/d35/d71/d69/d79/l8d 0 2024-09-17T01:41:39.355 INFO:tasks.workunit.client.0.smithi082.stdout:3/407: stat d9/db/f37 0 2024-09-17T01:41:39.355 INFO:tasks.workunit.client.0.smithi082.stdout:3/408: dread - d9/f6f zero size 2024-09-17T01:41:39.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/409: write d9/db/f85 [500747,53276] 0 2024-09-17T01:41:39.358 INFO:tasks.workunit.client.0.smithi082.stdout:3/410: fdatasync d9/db/d26/f51 0 2024-09-17T01:41:39.358 INFO:tasks.workunit.client.1.smithi167.stdout:1/936: creat d0/d5/dd7/f136 x:0 0 0 2024-09-17T01:41:39.359 INFO:tasks.workunit.client.0.smithi082.stdout:4/474: unlink d9/d15/d37/f8b 0 2024-09-17T01:41:39.359 INFO:tasks.workunit.client.1.smithi167.stdout:7/864: read d0/d2/d14/d19/d22/d40/fb8 [795367,118198] 0 2024-09-17T01:41:39.360 INFO:tasks.workunit.client.1.smithi167.stdout:1/937: readlink d0/d5/d34/d83/d112/d85/lb7 0 2024-09-17T01:41:39.360 INFO:tasks.workunit.client.0.smithi082.stdout:3/411: write d9/db/f18 [186692,28123] 0 2024-09-17T01:41:39.361 INFO:tasks.workunit.client.0.smithi082.stdout:4/475: chown d9/d15/d16/l3b 1669 1 2024-09-17T01:41:39.362 INFO:tasks.workunit.client.0.smithi082.stdout:3/412: write d9/d35/d71/f6e [1611471,60686] 0 2024-09-17T01:41:39.365 INFO:tasks.workunit.client.0.smithi082.stdout:0/365: getdents da/df/d2b/d59 0 2024-09-17T01:41:39.367 INFO:tasks.workunit.client.0.smithi082.stdout:3/413: dread d9/d35/d71/d69/f6a [0,4194304] 0 2024-09-17T01:41:39.368 INFO:tasks.workunit.client.1.smithi167.stdout:3/986: write d7/d1e/ffa [902074,93193] 0 2024-09-17T01:41:39.370 INFO:tasks.workunit.client.1.smithi167.stdout:0/923: creat d5/d6b/d77/d4d/d56/d7b/f130 x:0 0 0 2024-09-17T01:41:39.372 INFO:tasks.workunit.client.1.smithi167.stdout:7/865: unlink d0/d2/d88/f7c 0 2024-09-17T01:41:39.373 INFO:tasks.workunit.client.1.smithi167.stdout:7/866: write d0/d2/d14/d19/d26/d11c/f11f [716028,38709] 0 2024-09-17T01:41:39.375 INFO:tasks.workunit.client.1.smithi167.stdout:1/938: unlink d0/d5/d34/d6d/l9c 0 2024-09-17T01:41:39.376 INFO:tasks.workunit.client.1.smithi167.stdout:9/978: sync 2024-09-17T01:41:39.376 INFO:tasks.workunit.client.0.smithi082.stdout:4/476: rename d9/d15/d16/d44/d8d to d9/d15/d37/d4c/da3 0 2024-09-17T01:41:39.377 INFO:tasks.workunit.client.1.smithi167.stdout:2/904: write d5/d3c/d4c/de2/d45/f79 [19591,7220] 0 2024-09-17T01:41:39.377 INFO:tasks.workunit.client.0.smithi082.stdout:4/477: chown d9/d15/d37/d4c 1944 1 2024-09-17T01:41:39.377 INFO:tasks.workunit.client.0.smithi082.stdout:4/478: chown d9/fd 193094112 1 2024-09-17T01:41:39.378 INFO:tasks.workunit.client.0.smithi082.stdout:4/479: truncate d9/d15/d37/f71 992161 0 2024-09-17T01:41:39.379 INFO:tasks.workunit.client.1.smithi167.stdout:4/902: write d0/d4/d69/d131/da/d10e/d2d/d74/f8c [1485860,79649] 0 2024-09-17T01:41:39.380 INFO:tasks.workunit.client.0.smithi082.stdout:0/366: truncate da/d1b/d23/d42/d43/f57 966538 0 2024-09-17T01:41:39.380 INFO:tasks.workunit.client.1.smithi167.stdout:7/867: dwrite d0/d2/d14/d19/d26/ff7 [0,4194304] 0 2024-09-17T01:41:39.381 INFO:tasks.workunit.client.1.smithi167.stdout:0/924: truncate d5/d8/f20 6705300 0 2024-09-17T01:41:39.383 INFO:tasks.workunit.client.0.smithi082.stdout:3/414: mkdir d9/db/d49/d4e/d53/d5b/d8e 0 2024-09-17T01:41:39.387 INFO:tasks.workunit.client.1.smithi167.stdout:1/939: fsync d0/d9/d16/d22/fbb 0 2024-09-17T01:41:39.389 INFO:tasks.workunit.client.0.smithi082.stdout:8/438: truncate d3/f20 8261923 0 2024-09-17T01:41:39.390 INFO:tasks.workunit.client.1.smithi167.stdout:5/895: rename d0/d24/d2b/d3d/d3b/db0/db5/d109/l10e to d0/d24/d2b/d49/d66/l112 0 2024-09-17T01:41:39.391 INFO:tasks.workunit.client.0.smithi082.stdout:4/480: symlink d9/d15/d16/la4 0 2024-09-17T01:41:39.392 INFO:tasks.workunit.client.0.smithi082.stdout:4/481: stat d9/d15/d16/d18/f97 0 2024-09-17T01:41:39.393 INFO:tasks.workunit.client.0.smithi082.stdout:4/482: truncate d9/d15/d16/d18/f97 1211018 0 2024-09-17T01:41:39.395 INFO:tasks.workunit.client.1.smithi167.stdout:9/979: symlink d4/d9/d2b/da3/l139 0 2024-09-17T01:41:39.396 INFO:tasks.workunit.client.0.smithi082.stdout:3/415: write d9/db/d26/f3b [2408912,118927] 0 2024-09-17T01:41:39.398 INFO:tasks.workunit.client.0.smithi082.stdout:7/547: getdents d0/dd/d2c/d42/d77 0 2024-09-17T01:41:39.398 INFO:tasks.workunit.client.0.smithi082.stdout:7/548: fdatasync d0/d3/f8f 0 2024-09-17T01:41:39.401 INFO:tasks.workunit.client.1.smithi167.stdout:2/905: symlink d5/d3c/d4c/de2/d45/d8e/df4/l136 0 2024-09-17T01:41:39.403 INFO:tasks.workunit.client.0.smithi082.stdout:4/483: rmdir d9/d15/d16/d44 39 2024-09-17T01:41:39.407 INFO:tasks.workunit.client.1.smithi167.stdout:4/903: fdatasync d0/d4/d69/d131/d6/d5d/fbd 0 2024-09-17T01:41:39.408 INFO:tasks.workunit.client.0.smithi082.stdout:3/416: rmdir d9/db/d49/d4e/d53/d5b 39 2024-09-17T01:41:39.409 INFO:tasks.workunit.client.1.smithi167.stdout:1/940: dread d0/d9/d16/d48/d54/d6e/d7e/fd8 [0,4194304] 0 2024-09-17T01:41:39.409 INFO:tasks.workunit.client.0.smithi082.stdout:7/549: fsync d0/d3/f2b 0 2024-09-17T01:41:39.415 INFO:tasks.workunit.client.1.smithi167.stdout:5/896: rmdir d0/d54/d56 39 2024-09-17T01:41:39.416 INFO:tasks.workunit.client.0.smithi082.stdout:0/367: write da/d1b/f52 [3480197,41487] 0 2024-09-17T01:41:39.417 INFO:tasks.workunit.client.1.smithi167.stdout:3/987: truncate d7/d8/d10/d29/d75/fa0 4241328 0 2024-09-17T01:41:39.419 INFO:tasks.workunit.client.1.smithi167.stdout:2/906: chown d5/d3c/d4c/de2/lf3 1 1 2024-09-17T01:41:39.421 INFO:tasks.workunit.client.1.smithi167.stdout:7/868: write d0/d2/d14/d19/d32/f4d [2079946,111369] 0 2024-09-17T01:41:39.422 INFO:tasks.workunit.client.1.smithi167.stdout:7/869: stat d0/d2/d14/d19/d26/fc0 0 2024-09-17T01:41:39.424 INFO:tasks.workunit.client.0.smithi082.stdout:4/484: write d9/d15/d16/d18/f38 [3425787,24113] 0 2024-09-17T01:41:39.429 INFO:tasks.workunit.client.0.smithi082.stdout:8/439: dwrite d3/f20 [0,4194304] 0 2024-09-17T01:41:39.431 INFO:tasks.workunit.client.0.smithi082.stdout:7/550: fsync d0/dd/f1d 0 2024-09-17T01:41:39.431 INFO:tasks.workunit.client.1.smithi167.stdout:1/941: dread d0/d5/d34/f49 [0,4194304] 0 2024-09-17T01:41:39.432 INFO:tasks.workunit.client.0.smithi082.stdout:8/440: truncate d3/f76 334128 0 2024-09-17T01:41:39.433 INFO:tasks.workunit.client.1.smithi167.stdout:5/897: dread d0/d54/f76 [0,4194304] 0 2024-09-17T01:41:39.434 INFO:tasks.workunit.client.0.smithi082.stdout:4/485: read d9/fa [992720,103068] 0 2024-09-17T01:41:39.434 INFO:tasks.workunit.client.0.smithi082.stdout:3/417: dwrite d9/db/f3e [0,4194304] 0 2024-09-17T01:41:39.436 INFO:tasks.workunit.client.1.smithi167.stdout:3/988: dread - d7/d8/d10/d14/d24/d62/d92/fcb zero size 2024-09-17T01:41:39.437 INFO:tasks.workunit.client.1.smithi167.stdout:2/907: rmdir d5/d71/dc7 39 2024-09-17T01:41:39.440 INFO:tasks.workunit.client.0.smithi082.stdout:0/368: getdents da/df/d71 0 2024-09-17T01:41:39.441 INFO:tasks.workunit.client.1.smithi167.stdout:4/904: mkdir d0/d4/d69/d131/dff/d127/d132 0 2024-09-17T01:41:39.443 INFO:tasks.workunit.client.0.smithi082.stdout:4/486: creat d9/d15/d37/d45/fa5 x:0 0 0 2024-09-17T01:41:39.444 INFO:tasks.workunit.client.1.smithi167.stdout:7/870: rename d0/d2/d14/d6f/d87/dae/d104 to d0/d2/d14/d19/d26/d83/da5/d70/d128 0 2024-09-17T01:41:39.445 INFO:tasks.workunit.client.0.smithi082.stdout:3/418: mkdir d9/db/d8f 0 2024-09-17T01:41:39.446 INFO:tasks.workunit.client.1.smithi167.stdout:1/942: readlink d0/d9/d16/d36/d8f/lcb 0 2024-09-17T01:41:39.446 INFO:tasks.workunit.client.0.smithi082.stdout:7/551: mknod d0/cbc 0 2024-09-17T01:41:39.447 INFO:tasks.workunit.client.0.smithi082.stdout:8/441: creat d3/dd/d18/d2d/d60/f8b x:0 0 0 2024-09-17T01:41:39.449 INFO:tasks.workunit.client.1.smithi167.stdout:9/980: creat d4/f13a x:0 0 0 2024-09-17T01:41:39.449 INFO:tasks.workunit.client.0.smithi082.stdout:4/487: fsync d9/d47/f60 0 2024-09-17T01:41:39.451 INFO:tasks.workunit.client.0.smithi082.stdout:7/552: write d0/d3/d36/d37/d86/fb1 [690754,53428] 0 2024-09-17T01:41:39.451 INFO:tasks.workunit.client.0.smithi082.stdout:8/442: rmdir d3/dd/d18 39 2024-09-17T01:41:39.457 INFO:tasks.workunit.client.1.smithi167.stdout:4/905: mknod d0/d4/d69/d131/de2/c133 0 2024-09-17T01:41:39.457 INFO:tasks.workunit.client.1.smithi167.stdout:0/925: link d5/d6b/c11c d5/d6b/dd1/c131 0 2024-09-17T01:41:39.458 INFO:tasks.workunit.client.1.smithi167.stdout:4/906: chown d0/d4/d69/d131/d6/l2f 125 1 2024-09-17T01:41:39.458 INFO:tasks.workunit.client.1.smithi167.stdout:0/926: dread - d5/d6b/d77/d4d/d56/d7b/f12d zero size 2024-09-17T01:41:39.458 INFO:tasks.workunit.client.1.smithi167.stdout:0/927: chown d5/d6b/d77/d4d/fc8 68 1 2024-09-17T01:41:39.459 INFO:tasks.workunit.client.0.smithi082.stdout:0/369: rename da/d1b/d23/d42/d4b to da/d80 0 2024-09-17T01:41:39.460 INFO:tasks.workunit.client.0.smithi082.stdout:4/488: dread d9/fc [0,4194304] 0 2024-09-17T01:41:39.460 INFO:tasks.workunit.client.0.smithi082.stdout:4/489: chown d9/d47/d9b 336 1 2024-09-17T01:41:39.461 INFO:tasks.workunit.client.0.smithi082.stdout:4/490: chown d9/f46 10013385 1 2024-09-17T01:41:39.462 INFO:tasks.workunit.client.0.smithi082.stdout:8/443: creat d3/dd/d18/d2d/d3e/d4a/d66/f8c x:0 0 0 2024-09-17T01:41:39.463 INFO:tasks.workunit.client.0.smithi082.stdout:8/444: readlink d3/dd/d18/d34/l5a 0 2024-09-17T01:41:39.464 INFO:tasks.workunit.client.0.smithi082.stdout:8/445: chown d3/dd/d18/d51/l6b 133 1 2024-09-17T01:41:39.465 INFO:tasks.workunit.client.0.smithi082.stdout:0/370: creat da/d1e/f81 x:0 0 0 2024-09-17T01:41:39.468 INFO:tasks.workunit.client.1.smithi167.stdout:0/928: creat d5/d6b/d77/d6d/d90/f132 x:0 0 0 2024-09-17T01:41:39.468 INFO:tasks.workunit.client.1.smithi167.stdout:9/981: symlink d4/d9/d2b/d121/l13b 0 2024-09-17T01:41:39.469 INFO:tasks.workunit.client.0.smithi082.stdout:8/446: symlink d3/dd/d18/d34/l8d 0 2024-09-17T01:41:39.470 INFO:tasks.workunit.client.1.smithi167.stdout:9/982: fsync d4/d9/d21/d2d/d33/d3a/fa0 0 2024-09-17T01:41:39.470 INFO:tasks.workunit.client.0.smithi082.stdout:7/553: write d0/f32 [1236538,97647] 0 2024-09-17T01:41:39.471 INFO:tasks.workunit.client.0.smithi082.stdout:0/371: stat da/d1b/d23/d4d/c34 0 2024-09-17T01:41:39.471 INFO:tasks.workunit.client.1.smithi167.stdout:7/871: write d0/d2/d14/d19/fd6 [342265,98174] 0 2024-09-17T01:41:39.472 INFO:tasks.workunit.client.1.smithi167.stdout:7/872: readlink d0/d2/l8f 0 2024-09-17T01:41:39.473 INFO:tasks.workunit.client.1.smithi167.stdout:2/908: dwrite d5/d3c/d4c/de2/db8/da3/f58 [0,4194304] 0 2024-09-17T01:41:39.474 INFO:tasks.workunit.client.1.smithi167.stdout:1/943: rename d0/f46 to d0/d9/d16/f137 0 2024-09-17T01:41:39.474 INFO:tasks.workunit.client.1.smithi167.stdout:1/944: read - d0/f12e zero size 2024-09-17T01:41:39.475 INFO:tasks.workunit.client.0.smithi082.stdout:4/491: creat d9/d15/d16/d18/d4a/d8f/d91/fa6 x:0 0 0 2024-09-17T01:41:39.475 INFO:tasks.workunit.client.1.smithi167.stdout:1/945: fsync d0/d9/f37 0 2024-09-17T01:41:39.476 INFO:tasks.workunit.client.1.smithi167.stdout:0/929: mkdir d5/d6b/d77/d4d/dfa/d133 0 2024-09-17T01:41:39.476 INFO:tasks.workunit.client.1.smithi167.stdout:1/946: readlink d0/d5/dd7/l11a 0 2024-09-17T01:41:39.478 INFO:tasks.workunit.client.0.smithi082.stdout:7/554: dwrite d0/d3/db/d10/f27 [0,4194304] 0 2024-09-17T01:41:39.478 INFO:tasks.workunit.client.0.smithi082.stdout:8/447: mknod d3/dd/d18/d2d/d60/c8e 0 2024-09-17T01:41:39.478 INFO:tasks.workunit.client.1.smithi167.stdout:3/989: link d7/c1d d7/c14f 0 2024-09-17T01:41:39.481 INFO:tasks.workunit.client.0.smithi082.stdout:3/419: rename d9/d35/c5e to d9/db/d49/d4e/c90 0 2024-09-17T01:41:39.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/492: dread - d9/d15/d16/f4b zero size 2024-09-17T01:41:39.483 INFO:tasks.workunit.client.0.smithi082.stdout:3/420: fsync d9/f4d 0 2024-09-17T01:41:39.485 INFO:tasks.workunit.client.1.smithi167.stdout:5/898: rename d0/d24/l6c to d0/d54/d56/de1/l113 0 2024-09-17T01:41:39.486 INFO:tasks.workunit.client.0.smithi082.stdout:8/448: unlink d3/dd/f30 0 2024-09-17T01:41:39.488 INFO:tasks.workunit.client.0.smithi082.stdout:7/555: dwrite d0/d62/d7e/f91 [0,4194304] 0 2024-09-17T01:41:39.488 INFO:tasks.workunit.client.1.smithi167.stdout:2/909: rmdir d5/d3c/d4c/de2/d2e 39 2024-09-17T01:41:39.496 INFO:tasks.workunit.client.0.smithi082.stdout:8/449: dwrite d3/dd/d18/d2d/d3e/d4a/d66/f77 [0,4194304] 0 2024-09-17T01:41:39.498 INFO:tasks.workunit.client.0.smithi082.stdout:8/450: dread - d3/dd/d18/d2d/d3e/d4a/f81 zero size 2024-09-17T01:41:39.503 INFO:tasks.workunit.client.0.smithi082.stdout:3/421: creat d9/d35/f91 x:0 0 0 2024-09-17T01:41:39.505 INFO:tasks.workunit.client.1.smithi167.stdout:9/983: mknod d4/d9/d21/d2d/d33/d3a/d9c/dd0/c13c 0 2024-09-17T01:41:39.505 INFO:tasks.workunit.client.0.smithi082.stdout:8/451: dread d3/dd/d18/d2d/d3e/d4a/d66/f77 [0,4194304] 0 2024-09-17T01:41:39.505 INFO:tasks.workunit.client.0.smithi082.stdout:3/422: chown d9/db/d49/c59 0 1 2024-09-17T01:41:39.505 INFO:tasks.workunit.client.0.smithi082.stdout:8/452: chown d3/f20 0 1 2024-09-17T01:41:39.505 INFO:tasks.workunit.client.1.smithi167.stdout:9/984: chown d4/d9/d21/ffa 844 1 2024-09-17T01:41:39.508 INFO:tasks.workunit.client.0.smithi082.stdout:4/493: mknod d9/d15/ca7 0 2024-09-17T01:41:39.508 INFO:tasks.workunit.client.0.smithi082.stdout:4/494: chown d9/d15/d16 25 1 2024-09-17T01:41:39.509 INFO:tasks.workunit.client.0.smithi082.stdout:4/495: dread - d9/d15/d16/f4b zero size 2024-09-17T01:41:39.509 INFO:tasks.workunit.client.1.smithi167.stdout:4/907: rename d0/d4/d69/d131/da/d48/fc8 to d0/d4/d69/d131/da/d10e/dc3/dd8/f134 0 2024-09-17T01:41:39.510 INFO:tasks.workunit.client.0.smithi082.stdout:2/535: sync 2024-09-17T01:41:39.514 INFO:tasks.workunit.client.1.smithi167.stdout:2/910: mknod d5/d3c/d4c/de2/db8/da3/dc8/dea/c137 0 2024-09-17T01:41:39.520 INFO:tasks.workunit.client.0.smithi082.stdout:3/423: write d9/db/d49/d4e/d53/d5b/f70 [254019,72276] 0 2024-09-17T01:41:39.520 INFO:tasks.workunit.client.1.smithi167.stdout:0/930: creat d5/d6b/d77/d4d/dfa/d133/f134 x:0 0 0 2024-09-17T01:41:39.522 INFO:tasks.workunit.client.1.smithi167.stdout:1/947: link d0/d5/d61/da2/fe8 d0/d5/d34/d6d/de1/f138 0 2024-09-17T01:41:39.524 INFO:tasks.workunit.client.0.smithi082.stdout:4/496: rename f7 to d9/d15/d16/d18/d4a/d8f/fa8 0 2024-09-17T01:41:39.525 INFO:tasks.workunit.client.1.smithi167.stdout:0/931: dwrite d5/d6b/d77/f54 [0,4194304] 0 2024-09-17T01:41:39.525 INFO:tasks.workunit.client.1.smithi167.stdout:3/990: fsync d7/d8/d10/f64 0 2024-09-17T01:41:39.526 INFO:tasks.workunit.client.0.smithi082.stdout:4/497: truncate d9/d15/d16/d18/d4a/d52/f59 1486935 0 2024-09-17T01:41:39.527 INFO:tasks.workunit.client.1.smithi167.stdout:0/932: chown d5/d6b/d77/d37/d80/f82 97 1 2024-09-17T01:41:39.528 INFO:tasks.workunit.client.1.smithi167.stdout:0/933: stat d5/d6b/d77/d6d/d90/lf5 0 2024-09-17T01:41:39.530 INFO:tasks.workunit.client.0.smithi082.stdout:7/556: link d0/dd/f1d d0/dd/d2c/d55/fbd 0 2024-09-17T01:41:39.530 INFO:tasks.workunit.client.1.smithi167.stdout:7/873: creat d0/d2/d14/f129 x:0 0 0 2024-09-17T01:41:39.531 INFO:tasks.workunit.client.1.smithi167.stdout:7/874: chown d0/d2/d88 171976 1 2024-09-17T01:41:39.531 INFO:tasks.workunit.client.0.smithi082.stdout:7/557: read - d0/d3/d36/d37/d86/fa8 zero size 2024-09-17T01:41:39.531 INFO:tasks.workunit.client.1.smithi167.stdout:4/908: mkdir d0/d4/d69/d131/dff/d127/d135 0 2024-09-17T01:41:39.532 INFO:tasks.workunit.client.1.smithi167.stdout:4/909: chown d0/d4/d69/d131/da/d10e/d2d/d2e/d31/d75/dfb 818 1 2024-09-17T01:41:39.534 INFO:tasks.workunit.client.1.smithi167.stdout:5/899: creat d0/d24/d2b/d49/d4b/dac/d3a/dd1/f114 x:0 0 0 2024-09-17T01:41:39.535 INFO:tasks.workunit.client.1.smithi167.stdout:7/875: dread d0/d2/f10d [0,4194304] 0 2024-09-17T01:41:39.536 INFO:tasks.workunit.client.1.smithi167.stdout:5/900: read d0/d24/d2b/d49/d4b/dac/f5b [1941348,99658] 0 2024-09-17T01:41:39.538 INFO:tasks.workunit.client.1.smithi167.stdout:5/901: chown d0/d24/d2b/d49/d66/l79 28891278 1 2024-09-17T01:41:39.540 INFO:tasks.workunit.client.0.smithi082.stdout:4/498: symlink d9/d15/d16/d18/d4a/d8f/la9 0 2024-09-17T01:41:39.542 INFO:tasks.workunit.client.1.smithi167.stdout:9/985: write d4/d9/d21/d2d/d33/d80/f9f [1805481,101302] 0 2024-09-17T01:41:39.542 INFO:tasks.workunit.client.0.smithi082.stdout:2/536: creat d1/d35/db1/d9c/fb3 x:0 0 0 2024-09-17T01:41:39.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/537: dread d1/d10/f2f [0,4194304] 0 2024-09-17T01:41:39.547 INFO:tasks.workunit.client.0.smithi082.stdout:8/453: creat d3/dd/d18/f8f x:0 0 0 2024-09-17T01:41:39.549 INFO:tasks.workunit.client.1.smithi167.stdout:0/934: rmdir d5/d6b/d77/d6d/d90 39 2024-09-17T01:41:39.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/454: write d3/f7 [4088947,107921] 0 2024-09-17T01:41:39.552 INFO:tasks.workunit.client.1.smithi167.stdout:4/910: mknod d0/d4/d69/d131/da/d10e/d2d/d2e/d31/d75/c136 0 2024-09-17T01:41:39.552 INFO:tasks.workunit.client.0.smithi082.stdout:3/424: dread d9/f40 [0,4194304] 0 2024-09-17T01:41:39.553 INFO:tasks.workunit.client.0.smithi082.stdout:3/425: fsync d9/db/f3e 0 2024-09-17T01:41:39.555 INFO:tasks.workunit.client.0.smithi082.stdout:2/538: dwrite d1/d17/d38/d5c/f64 [0,4194304] 0 2024-09-17T01:41:39.557 INFO:tasks.workunit.client.0.smithi082.stdout:7/558: rmdir d0/d3/db/d7d 0 2024-09-17T01:41:39.557 INFO:tasks.workunit.client.1.smithi167.stdout:1/948: fdatasync d0/d9/d16/d48/f58 0 2024-09-17T01:41:39.558 INFO:tasks.workunit.client.0.smithi082.stdout:8/455: readlink d3/dd/d18/l36 0 2024-09-17T01:41:39.558 INFO:tasks.workunit.client.0.smithi082.stdout:4/499: dread d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:39.559 INFO:tasks.workunit.client.1.smithi167.stdout:1/949: write d0/d5/d34/d83/d112/d74/fe3 [3908951,17757] 0 2024-09-17T01:41:39.560 INFO:tasks.workunit.client.1.smithi167.stdout:5/902: dread d0/d9/f2d [4194304,4194304] 0 2024-09-17T01:41:39.560 INFO:tasks.workunit.client.0.smithi082.stdout:4/500: dread - d9/d15/d37/d4c/da3/f92 zero size 2024-09-17T01:41:39.561 INFO:tasks.workunit.client.0.smithi082.stdout:2/539: unlink d1/d10/c13 0 2024-09-17T01:41:39.562 INFO:tasks.workunit.client.1.smithi167.stdout:3/991: mkdir d7/d8f/d9b/d116/d150 0 2024-09-17T01:41:39.563 INFO:tasks.workunit.client.0.smithi082.stdout:8/456: read d3/dd/d18/d2d/d3e/d4a/f88 [317259,77737] 0 2024-09-17T01:41:39.563 INFO:tasks.workunit.client.1.smithi167.stdout:3/992: readlink d7/d8/d10/d14/d25/lb 0 2024-09-17T01:41:39.563 INFO:tasks.workunit.client.1.smithi167.stdout:3/993: fsync d7/d8/d10/d14/f5a 0 2024-09-17T01:41:39.564 INFO:tasks.workunit.client.0.smithi082.stdout:2/540: creat d1/d17/d60/fb4 x:0 0 0 2024-09-17T01:41:39.571 INFO:tasks.workunit.client.0.smithi082.stdout:8/457: dwrite d3/dd/d18/d2d/d3e/d4a/d66/f8c [0,4194304] 0 2024-09-17T01:41:39.573 INFO:tasks.workunit.client.0.smithi082.stdout:2/541: dwrite d1/d17/d38/d42/d52/d78/d82/f9a [0,4194304] 0 2024-09-17T01:41:39.575 INFO:tasks.workunit.client.1.smithi167.stdout:5/903: fsync d0/d24/d2b/d49/d4b/dac/f5b 0 2024-09-17T01:41:39.577 INFO:tasks.workunit.client.1.smithi167.stdout:0/935: symlink d5/d6b/d77/d4d/d56/d108/d118/l135 0 2024-09-17T01:41:39.579 INFO:tasks.workunit.client.0.smithi082.stdout:8/458: readlink d3/dd/d18/d2d/d3e/d4a/d6a/l80 0 2024-09-17T01:41:39.582 INFO:tasks.workunit.client.0.smithi082.stdout:2/542: symlink d1/d35/db1/lb5 0 2024-09-17T01:41:39.585 INFO:tasks.workunit.client.0.smithi082.stdout:8/459: creat d3/dd/d18/d2d/d3e/d4a/f90 x:0 0 0 2024-09-17T01:41:39.587 INFO:tasks.workunit.client.1.smithi167.stdout:2/911: rename d5/d3c/d4c/de2/d2e/f59 to d5/d3c/d4c/de2/d2e/f138 0 2024-09-17T01:41:39.587 INFO:tasks.workunit.client.0.smithi082.stdout:2/543: symlink d1/d35/db1/lb6 0 2024-09-17T01:41:39.589 INFO:tasks.workunit.client.1.smithi167.stdout:4/911: rename d0/d4/d69/d131/da/d10e/c45 to d0/d4/d69/d131/da/d10e/dc3/dd8/c137 0 2024-09-17T01:41:39.591 INFO:tasks.workunit.client.0.smithi082.stdout:8/460: symlink d3/dd/d18/d3a/l91 0 2024-09-17T01:41:39.591 INFO:tasks.workunit.client.1.smithi167.stdout:7/876: truncate d0/d2/d14/d6f/d8b/fd1 3267271 0 2024-09-17T01:41:39.592 INFO:tasks.workunit.client.1.smithi167.stdout:7/877: rename d0 to d0/d2/d14/d19/d26/d83/da5/d70/d12a 22 2024-09-17T01:41:39.593 INFO:tasks.workunit.client.0.smithi082.stdout:2/544: mknod d1/d17/d38/d42/cb7 0 2024-09-17T01:41:39.594 INFO:tasks.workunit.client.1.smithi167.stdout:9/986: truncate d4/f4e 312456 0 2024-09-17T01:41:39.596 INFO:tasks.workunit.client.0.smithi082.stdout:2/545: symlink d1/d5a/d6d/lb8 0 2024-09-17T01:41:39.597 INFO:tasks.workunit.client.1.smithi167.stdout:3/994: symlink d7/d8/d10/d14/d2c/l151 0 2024-09-17T01:41:39.597 INFO:tasks.workunit.client.0.smithi082.stdout:8/461: mknod d3/dd/d18/d2d/d3e/d4a/d68/c92 0 2024-09-17T01:41:39.602 INFO:tasks.workunit.client.1.smithi167.stdout:3/995: mkdir d7/d8/d10/d14/d2c/d74/dbb/dfb/d152 0 2024-09-17T01:41:39.605 INFO:tasks.workunit.client.0.smithi082.stdout:8/462: dwrite d3/dd/d18/d51/f6f [0,4194304] 0 2024-09-17T01:41:39.605 INFO:tasks.workunit.client.1.smithi167.stdout:5/904: creat d0/d24/d2b/f115 x:0 0 0 2024-09-17T01:41:39.608 INFO:tasks.workunit.client.1.smithi167.stdout:2/912: dread d5/d33/d48/f7b [0,4194304] 0 2024-09-17T01:41:39.609 INFO:tasks.workunit.client.0.smithi082.stdout:8/463: unlink d3/f25 0 2024-09-17T01:41:39.611 INFO:tasks.workunit.client.1.smithi167.stdout:3/996: fdatasync d7/d8/d10/d14/d66/d6c/dab/f101 0 2024-09-17T01:41:39.614 INFO:tasks.workunit.client.1.smithi167.stdout:0/936: dread d5/d6b/d77/d37/d45/f8c [0,4194304] 0 2024-09-17T01:41:39.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/937: chown d5/l123 338102 1 2024-09-17T01:41:39.617 INFO:tasks.workunit.client.1.smithi167.stdout:0/938: write d5/d6b/d77/d92/fea [538362,130989] 0 2024-09-17T01:41:39.618 INFO:tasks.workunit.client.1.smithi167.stdout:5/905: creat d0/d24/d2b/d3d/d6d/f116 x:0 0 0 2024-09-17T01:41:39.620 INFO:tasks.workunit.client.1.smithi167.stdout:9/987: rename d4/d9/d21/d43/f77 to d4/d9/d21/d43/d6c/d9e/d137/f13d 0 2024-09-17T01:41:39.622 INFO:tasks.workunit.client.0.smithi082.stdout:8/464: symlink d3/dd/d18/l93 0 2024-09-17T01:41:39.628 INFO:tasks.workunit.client.1.smithi167.stdout:4/912: link d0/d4/d69/d131/d6/d2b/d6d/lfc d0/d4/d69/d131/d6/d2b/d6d/d7e/da8/ddf/l138 0 2024-09-17T01:41:39.630 INFO:tasks.workunit.client.1.smithi167.stdout:0/939: dread d5/d6b/d77/d4d/f9e [0,4194304] 0 2024-09-17T01:41:39.632 INFO:tasks.workunit.client.1.smithi167.stdout:5/906: mknod d0/d24/d2b/d49/d4b/c117 0 2024-09-17T01:41:39.633 INFO:tasks.workunit.client.1.smithi167.stdout:3/997: dread d7/faf [0,4194304] 0 2024-09-17T01:41:39.634 INFO:tasks.workunit.client.1.smithi167.stdout:0/940: dread d5/dee/f12f [0,4194304] 0 2024-09-17T01:41:39.635 INFO:tasks.workunit.client.1.smithi167.stdout:9/988: creat d4/d9/d21/d2d/d33/d3a/d9c/dd0/f13e x:0 0 0 2024-09-17T01:41:39.635 INFO:tasks.workunit.client.1.smithi167.stdout:3/998: chown d7/d8/d10/d14/d2c/d74/dbb/dfb/da9/d119/d4e/f94 70072 1 2024-09-17T01:41:39.636 INFO:tasks.workunit.client.1.smithi167.stdout:7/878: link d0/d2/c3d d0/d2/ded/dfd/c12b 0 2024-09-17T01:41:39.636 INFO:tasks.workunit.client.1.smithi167.stdout:9/989: truncate d4/da4/dfe/f102 957208 0 2024-09-17T01:41:39.637 INFO:tasks.workunit.client.1.smithi167.stdout:7/879: truncate d0/d2/d88/d6e/f71 4331643 0 2024-09-17T01:41:39.639 INFO:tasks.workunit.client.1.smithi167.stdout:4/913: unlink d0/d4/d69/d131/da/d10e/d2d/dac/ce0 0 2024-09-17T01:41:39.641 INFO:tasks.workunit.client.1.smithi167.stdout:0/941: symlink d5/d8/d9/d2f/d9b/l136 0 2024-09-17T01:41:39.642 INFO:tasks.workunit.client.1.smithi167.stdout:3/999: mknod d7/d8/d10/d14/d25/c153 0 2024-09-17T01:41:39.643 INFO:tasks.workunit.client.1.smithi167.stdout:2/913: dwrite d5/d3c/d4c/de2/db8/da3/fb4 [0,4194304] 0 2024-09-17T01:41:39.644 INFO:tasks.workunit.client.1.smithi167.stdout:2/914: chown d5/d3c/d4c/de2/d2e 276784 1 2024-09-17T01:41:39.645 INFO:tasks.workunit.client.1.smithi167.stdout:9/990: stat d4/d9/d21/d43/d6c/d9e/da1/f116 0 2024-09-17T01:41:39.646 INFO:tasks.workunit.client.1.smithi167.stdout:5/907: mknod d0/d24/d2b/d3d/d3b/c118 0 2024-09-17T01:41:39.647 INFO:tasks.workunit.client.1.smithi167.stdout:4/914: creat d0/d4/d69/d131/dff/f139 x:0 0 0 2024-09-17T01:41:39.649 INFO:tasks.workunit.client.1.smithi167.stdout:0/942: symlink d5/d6b/d77/d4d/d56/d108/d118/l137 0 2024-09-17T01:41:39.649 INFO:tasks.workunit.client.1.smithi167.stdout:5/908: truncate d0/d24/d2b/d49/d4b/dac/d3a/dd1/f114 721242 0 2024-09-17T01:41:39.651 INFO:tasks.workunit.client.1.smithi167.stdout:7/880: rename d0/c2b to d0/d2/d88/df5/c12c 0 2024-09-17T01:41:39.653 INFO:tasks.workunit.client.1.smithi167.stdout:9/991: mknod d4/d9/d21/d43/d6c/d9e/da1/dbc/c13f 0 2024-09-17T01:41:39.657 INFO:tasks.workunit.client.1.smithi167.stdout:5/909: creat d0/d24/d2b/d49/d4b/dac/d3a/dd1/f119 x:0 0 0 2024-09-17T01:41:39.657 INFO:tasks.workunit.client.1.smithi167.stdout:5/910: readlink d0/d24/d2b/d49/d4b/dac/d3a/dd1/l68 0 2024-09-17T01:41:39.658 INFO:tasks.workunit.client.1.smithi167.stdout:5/911: write d0/d24/f38 [90668,44926] 0 2024-09-17T01:41:39.660 INFO:tasks.workunit.client.1.smithi167.stdout:9/992: rename d4/d9/l54 to d4/d9/d21/d81/dbf/l140 0 2024-09-17T01:41:39.660 INFO:tasks.workunit.client.1.smithi167.stdout:5/912: truncate d0/d24/d2b/d3d/d6d/f116 652945 0 2024-09-17T01:41:39.664 INFO:tasks.workunit.client.1.smithi167.stdout:2/915: getdents d5/d33/d48/d72 0 2024-09-17T01:41:39.669 INFO:tasks.workunit.client.1.smithi167.stdout:5/913: creat d0/d24/d2b/d3d/d3b/db0/db5/d109/f11a x:0 0 0 2024-09-17T01:41:39.670 INFO:tasks.workunit.client.0.smithi082.stdout:8/465: creat d3/dd/d18/d2d/f94 x:0 0 0 2024-09-17T01:41:39.672 INFO:tasks.workunit.client.1.smithi167.stdout:2/916: mkdir d5/d3c/d4c/de2/d45/d6b/d134/d139 0 2024-09-17T01:41:39.674 INFO:tasks.workunit.client.0.smithi082.stdout:8/466: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/f95 x:0 0 0 2024-09-17T01:41:39.676 INFO:tasks.workunit.client.1.smithi167.stdout:2/917: symlink d5/d3c/d4c/de2/db8/d5e/d103/d11a/l13a 0 2024-09-17T01:41:39.677 INFO:tasks.workunit.client.1.smithi167.stdout:2/918: dread - d5/d3c/d4c/de2/db8/d5e/f12b zero size 2024-09-17T01:41:39.677 INFO:tasks.workunit.client.0.smithi082.stdout:8/467: read d3/dd/d18/d34/f4f [1059962,32596] 0 2024-09-17T01:41:39.678 INFO:tasks.workunit.client.0.smithi082.stdout:8/468: rmdir d3 39 2024-09-17T01:41:39.679 INFO:tasks.workunit.client.1.smithi167.stdout:2/919: truncate d5/d3c/d4c/de2/db8/da3/f26 3755466 0 2024-09-17T01:41:39.681 INFO:tasks.workunit.client.1.smithi167.stdout:2/920: mkdir d5/d3c/d4c/de2/db8/d5e/d103/d13b 0 2024-09-17T01:41:39.682 INFO:tasks.workunit.client.0.smithi082.stdout:8/469: creat d3/dd/d18/d2d/d3e/d4a/f96 x:0 0 0 2024-09-17T01:41:39.684 INFO:tasks.workunit.client.1.smithi167.stdout:2/921: unlink d5/d3c/d4c/de2/f31 0 2024-09-17T01:41:39.685 INFO:tasks.workunit.client.1.smithi167.stdout:2/922: fdatasync d5/d3c/d4c/de2/fa7 0 2024-09-17T01:41:39.685 INFO:tasks.workunit.client.0.smithi082.stdout:8/470: mknod d3/dd/d18/d2d/d60/c97 0 2024-09-17T01:41:39.686 INFO:tasks.workunit.client.0.smithi082.stdout:8/471: readlink d3/dd/d18/l93 0 2024-09-17T01:41:39.689 INFO:tasks.workunit.client.0.smithi082.stdout:8/472: unlink d3/dd/d18/d2d/d3e/d43/l89 0 2024-09-17T01:41:39.690 INFO:tasks.workunit.client.1.smithi167.stdout:2/923: mknod d5/d3c/d4c/de2/d45/d6b/d134/d139/c13c 0 2024-09-17T01:41:39.690 INFO:tasks.workunit.client.1.smithi167.stdout:2/924: stat d5/d3c/d4c/de2 0 2024-09-17T01:41:39.691 INFO:tasks.workunit.client.0.smithi082.stdout:8/473: mknod d3/dd/d18/d2d/d3e/d4a/d6a/c98 0 2024-09-17T01:41:39.692 INFO:tasks.workunit.client.0.smithi082.stdout:8/474: write d3/f7 [2598403,109223] 0 2024-09-17T01:41:39.693 INFO:tasks.workunit.client.0.smithi082.stdout:8/475: read - d3/dd/f84 zero size 2024-09-17T01:41:39.694 INFO:tasks.workunit.client.1.smithi167.stdout:2/925: getdents d5/d3c/d10a 0 2024-09-17T01:41:39.696 INFO:tasks.workunit.client.1.smithi167.stdout:0/943: truncate d5/dee/f12f 1986466 0 2024-09-17T01:41:39.697 INFO:tasks.workunit.client.0.smithi082.stdout:8/476: dread d3/dd/f26 [0,4194304] 0 2024-09-17T01:41:39.698 INFO:tasks.workunit.client.1.smithi167.stdout:9/993: write d4/d9/d21/d2d/d33/d90/dac/f68 [2900604,84363] 0 2024-09-17T01:41:39.700 INFO:tasks.workunit.client.1.smithi167.stdout:0/944: chown d5/d8/l14 3 1 2024-09-17T01:41:39.701 INFO:tasks.workunit.client.1.smithi167.stdout:0/945: stat d5/d6b/fb9 0 2024-09-17T01:41:39.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/477: unlink d3/dd/c50 0 2024-09-17T01:41:39.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/478: chown d3/dd/d18/d34/f4f 30 1 2024-09-17T01:41:39.706 INFO:tasks.workunit.client.1.smithi167.stdout:9/994: creat d4/d9/d21/d43/dc4/d103/d112/f141 x:0 0 0 2024-09-17T01:41:39.707 INFO:tasks.workunit.client.1.smithi167.stdout:2/926: dread d5/d33/d48/d72/d94/de3/fe9 [0,4194304] 0 2024-09-17T01:41:39.709 INFO:tasks.workunit.client.1.smithi167.stdout:9/995: dread d4/da4/dfe/f102 [0,4194304] 0 2024-09-17T01:41:39.709 INFO:tasks.workunit.client.1.smithi167.stdout:5/914: dwrite d0/f18 [4194304,4194304] 0 2024-09-17T01:41:39.710 INFO:tasks.workunit.client.1.smithi167.stdout:0/946: getdents d5/d6b/d77/d37/d45/da9 0 2024-09-17T01:41:39.710 INFO:tasks.workunit.client.1.smithi167.stdout:5/915: readlink d0/d9/lee 0 2024-09-17T01:41:39.711 INFO:tasks.workunit.client.1.smithi167.stdout:2/927: unlink d5/d3c/f67 0 2024-09-17T01:41:39.712 INFO:tasks.workunit.client.1.smithi167.stdout:2/928: dread - d5/d3c/d4c/de2/f100 zero size 2024-09-17T01:41:39.712 INFO:tasks.workunit.client.1.smithi167.stdout:0/947: write d5/d6b/d77/d37/d80/fbd [162037,89309] 0 2024-09-17T01:41:39.713 INFO:tasks.workunit.client.1.smithi167.stdout:5/916: chown d0/c7 156448 1 2024-09-17T01:41:39.718 INFO:tasks.workunit.client.1.smithi167.stdout:0/948: creat d5/d6b/d77/d37/d45/f138 x:0 0 0 2024-09-17T01:41:39.719 INFO:tasks.workunit.client.1.smithi167.stdout:5/917: creat d0/d54/d56/de1/f11b x:0 0 0 2024-09-17T01:41:39.720 INFO:tasks.workunit.client.1.smithi167.stdout:5/918: read - d0/d24/d93/d99/ff9 zero size 2024-09-17T01:41:39.721 INFO:tasks.workunit.client.1.smithi167.stdout:2/929: mkdir d5/d3c/d4c/d4d/d91/d13d 0 2024-09-17T01:41:39.722 INFO:tasks.workunit.client.1.smithi167.stdout:5/919: chown d0/d24/d2b/d3d/d3b/db0/db5/d109/f5e 48623184 1 2024-09-17T01:41:39.723 INFO:tasks.workunit.client.1.smithi167.stdout:9/996: rename d4/d9/d21/d2d/d33/d90/dac/ccd to d4/d9/d21/d43/c142 0 2024-09-17T01:41:39.726 INFO:tasks.workunit.client.1.smithi167.stdout:0/949: symlink d5/d6b/d77/d6d/d90/dc4/de3/l139 0 2024-09-17T01:41:39.730 INFO:tasks.workunit.client.1.smithi167.stdout:9/997: dwrite d4/d9/d21/d43/d6c/d9e/da1/dbc/fd1 [0,4194304] 0 2024-09-17T01:41:39.731 INFO:tasks.workunit.client.1.smithi167.stdout:9/998: chown d4/d9/d21/d135 25 1 2024-09-17T01:41:39.732 INFO:tasks.workunit.client.1.smithi167.stdout:2/930: write d5/d10/f22 [1934305,75571] 0 2024-09-17T01:41:39.732 INFO:tasks.workunit.client.1.smithi167.stdout:9/999: dread - d4/d9/d21/d2d/d33/d90/f132 zero size 2024-09-17T01:41:39.738 INFO:tasks.workunit.client.1.smithi167.stdout:5/920: dread d0/f18 [0,4194304] 0 2024-09-17T01:41:39.747 INFO:tasks.workunit.client.1.smithi167.stdout:5/921: write d0/d24/d2b/d3d/d6d/fba [6105932,99774] 0 2024-09-17T01:41:39.751 INFO:tasks.workunit.client.1.smithi167.stdout:5/922: rename d0/d24/d2b/d3d/d3b/db0/db5/d109/d69/cda to d0/d54/d56/de1/c11c 0 2024-09-17T01:41:39.752 INFO:tasks.workunit.client.1.smithi167.stdout:5/923: write d0/d24/d2b/d49/d4b/dac/d80/fe7 [1059917,27245] 0 2024-09-17T01:41:39.754 INFO:tasks.workunit.client.1.smithi167.stdout:1/950: sync 2024-09-17T01:41:39.756 INFO:tasks.workunit.client.1.smithi167.stdout:1/951: creat d0/d5/d34/d12f/d132/f139 x:0 0 0 2024-09-17T01:41:39.757 INFO:tasks.workunit.client.1.smithi167.stdout:1/952: write d0/d5/d61/da2/f12c [98588,50680] 0 2024-09-17T01:41:39.760 INFO:tasks.workunit.client.1.smithi167.stdout:1/953: truncate d0/d9/d16/d36/f3e 3019065 0 2024-09-17T01:41:39.761 INFO:tasks.workunit.client.1.smithi167.stdout:1/954: mkdir d0/d5/d34/d83/d112/d74/d13a 0 2024-09-17T01:41:39.762 INFO:tasks.workunit.client.1.smithi167.stdout:1/955: truncate d0/f12e 46147 0 2024-09-17T01:41:39.763 INFO:tasks.workunit.client.1.smithi167.stdout:1/956: mkdir d0/d9/d16/d48/d54/d6e/d13b 0 2024-09-17T01:41:39.766 INFO:tasks.workunit.client.1.smithi167.stdout:1/957: creat d0/d5/d34/d83/d112/f13c x:0 0 0 2024-09-17T01:41:39.768 INFO:tasks.workunit.client.1.smithi167.stdout:5/924: dread d0/d9/f12 [0,4194304] 0 2024-09-17T01:41:39.769 INFO:tasks.workunit.client.1.smithi167.stdout:5/925: read d0/d24/d2b/d3d/ffc [2682267,127171] 0 2024-09-17T01:41:39.773 INFO:tasks.workunit.client.1.smithi167.stdout:5/926: mkdir d0/d24/d2b/d3d/dd2/d11d 0 2024-09-17T01:41:39.777 INFO:tasks.workunit.client.1.smithi167.stdout:5/927: creat d0/d24/d2b/d3d/f11e x:0 0 0 2024-09-17T01:41:39.786 INFO:tasks.workunit.client.0.smithi082.stdout:6/557: sync 2024-09-17T01:41:39.786 INFO:tasks.workunit.client.0.smithi082.stdout:1/588: sync 2024-09-17T01:41:39.786 INFO:tasks.workunit.client.0.smithi082.stdout:9/443: sync 2024-09-17T01:41:39.789 INFO:tasks.workunit.client.0.smithi082.stdout:9/444: symlink d4/d59/d63/l96 0 2024-09-17T01:41:39.790 INFO:tasks.workunit.client.0.smithi082.stdout:6/558: mkdir d1/d1f/da7/dcc 0 2024-09-17T01:41:39.791 INFO:tasks.workunit.client.0.smithi082.stdout:6/559: truncate d1/d7/d10/fc9 459432 0 2024-09-17T01:41:39.791 INFO:tasks.workunit.client.0.smithi082.stdout:1/589: write d2/d3f/f19 [401689,37718] 0 2024-09-17T01:41:39.792 INFO:tasks.workunit.client.0.smithi082.stdout:9/445: mknod d4/d27/d95/c97 0 2024-09-17T01:41:39.793 INFO:tasks.workunit.client.0.smithi082.stdout:1/590: fsync d2/d3f/d24/f69 0 2024-09-17T01:41:39.794 INFO:tasks.workunit.client.0.smithi082.stdout:9/446: write d4/d27/d2d/d3d/f47 [2029697,66617] 0 2024-09-17T01:41:39.796 INFO:tasks.workunit.client.0.smithi082.stdout:1/591: unlink d2/df/lad 0 2024-09-17T01:41:39.799 INFO:tasks.workunit.client.0.smithi082.stdout:1/592: dread - d2/d3f/f7f zero size 2024-09-17T01:41:39.800 INFO:tasks.workunit.client.0.smithi082.stdout:1/593: chown d2/da/d2f/l60 1 1 2024-09-17T01:41:39.800 INFO:tasks.workunit.client.0.smithi082.stdout:9/447: rename d4/d27/d2d/d60/d11/d39/l69 to d4/d27/d2d/d60/d11/d39/d31/l98 0 2024-09-17T01:41:39.802 INFO:tasks.workunit.client.0.smithi082.stdout:9/448: write d4/f1d [11205401,4842] 0 2024-09-17T01:41:39.803 INFO:tasks.workunit.client.0.smithi082.stdout:1/594: chown d2/da/d2d/d6c/f6e 637711826 1 2024-09-17T01:41:39.804 INFO:tasks.workunit.client.0.smithi082.stdout:6/560: dwrite d1/d7/d10/f38 [0,4194304] 0 2024-09-17T01:41:39.805 INFO:tasks.workunit.client.0.smithi082.stdout:1/595: write d2/da/d2d/f3e [74729,72091] 0 2024-09-17T01:41:39.806 INFO:tasks.workunit.client.0.smithi082.stdout:9/449: creat d4/f99 x:0 0 0 2024-09-17T01:41:39.808 INFO:tasks.workunit.client.0.smithi082.stdout:9/450: chown d4/d27/d36/f4e 3510 1 2024-09-17T01:41:39.809 INFO:tasks.workunit.client.0.smithi082.stdout:9/451: dread - d4/d27/d2d/d3d/f85 zero size 2024-09-17T01:41:39.810 INFO:tasks.workunit.client.0.smithi082.stdout:1/596: creat d2/da/d2d/d79/fbf x:0 0 0 2024-09-17T01:41:39.811 INFO:tasks.workunit.client.0.smithi082.stdout:9/452: write d4/d27/d2d/d60/d11/d37/f38 [4506881,49866] 0 2024-09-17T01:41:39.814 INFO:tasks.workunit.client.0.smithi082.stdout:6/561: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/lcd 0 2024-09-17T01:41:39.817 INFO:tasks.workunit.client.0.smithi082.stdout:6/562: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fce x:0 0 0 2024-09-17T01:41:39.818 INFO:tasks.workunit.client.0.smithi082.stdout:6/563: write d1/d7/d10/d4f/d32/fc7 [279100,58807] 0 2024-09-17T01:41:39.818 INFO:tasks.workunit.client.0.smithi082.stdout:1/597: rmdir d2/da/d2f/da8 0 2024-09-17T01:41:39.819 INFO:tasks.workunit.client.0.smithi082.stdout:6/564: write d1/f98 [2243987,49345] 0 2024-09-17T01:41:39.820 INFO:tasks.workunit.client.0.smithi082.stdout:9/453: link d4/d27/d2d/d60/d11/d39/d29/l6c d4/d27/d2d/d60/d11/l9a 0 2024-09-17T01:41:39.821 INFO:tasks.workunit.client.0.smithi082.stdout:6/565: rmdir d1/d7/d10/d4f/d8e 39 2024-09-17T01:41:39.822 INFO:tasks.workunit.client.1.smithi167.stdout:1/958: write d0/d5/d34/f5b [2254888,97397] 0 2024-09-17T01:41:39.823 INFO:tasks.workunit.client.0.smithi082.stdout:9/454: symlink d4/d27/d2d/d60/d11/d39/d31/l9b 0 2024-09-17T01:41:39.823 INFO:tasks.workunit.client.1.smithi167.stdout:5/928: dread - d0/d24/d2b/d3d/d6d/ff1 zero size 2024-09-17T01:41:39.823 INFO:tasks.workunit.client.1.smithi167.stdout:1/959: readlink d0/d5/d34/d83/d112/d74/lb6 0 2024-09-17T01:41:39.824 INFO:tasks.workunit.client.0.smithi082.stdout:6/566: read d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 [2197877,124429] 0 2024-09-17T01:41:39.826 INFO:tasks.workunit.client.0.smithi082.stdout:9/455: creat d4/f9c x:0 0 0 2024-09-17T01:41:39.829 INFO:tasks.workunit.client.1.smithi167.stdout:5/929: rename d0/d24/d2b/d3d/d3b/c84 to d0/d54/d56/c11f 0 2024-09-17T01:41:39.830 INFO:tasks.workunit.client.1.smithi167.stdout:5/930: fdatasync d0/d24/d2b/d3d/d6d/d10a/d63/f100 0 2024-09-17T01:41:39.831 INFO:tasks.workunit.client.0.smithi082.stdout:6/567: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf 0 2024-09-17T01:41:39.834 INFO:tasks.workunit.client.1.smithi167.stdout:5/931: mknod d0/d24/d2b/d3d/c120 0 2024-09-17T01:41:39.836 INFO:tasks.workunit.client.0.smithi082.stdout:6/568: creat d1/d1f/db0/fd0 x:0 0 0 2024-09-17T01:41:39.836 INFO:tasks.workunit.client.1.smithi167.stdout:1/960: link d0/d9/d16/d48/d54/d78/c123 d0/d5/c13d 0 2024-09-17T01:41:39.837 INFO:tasks.workunit.client.0.smithi082.stdout:9/456: rename d4/c5 to d4/c9d 0 2024-09-17T01:41:39.840 INFO:tasks.workunit.client.0.smithi082.stdout:9/457: symlink d4/d27/d2d/d60/d11/l9e 0 2024-09-17T01:41:39.842 INFO:tasks.workunit.client.0.smithi082.stdout:9/458: getdents d4/d27/d2d/d60/d11/d8d 0 2024-09-17T01:41:39.845 INFO:tasks.workunit.client.1.smithi167.stdout:5/932: dread d0/d24/fab [0,4194304] 0 2024-09-17T01:41:39.847 INFO:tasks.workunit.client.1.smithi167.stdout:5/933: chown d0/d24/d2b/d49/d66/l112 3472707 1 2024-09-17T01:41:39.847 INFO:tasks.workunit.client.1.smithi167.stdout:5/934: dread - d0/d24/d2b/d3d/d6d/d10a/d63/f100 zero size 2024-09-17T01:41:39.849 INFO:tasks.workunit.client.0.smithi082.stdout:9/459: dwrite d4/d27/d2d/d60/d11/d39/d29/d35/f61 [0,4194304] 0 2024-09-17T01:41:39.851 INFO:tasks.workunit.client.1.smithi167.stdout:5/935: creat d0/d24/d2b/d3d/d6d/d10a/dd4/f121 x:0 0 0 2024-09-17T01:41:39.852 INFO:tasks.workunit.client.1.smithi167.stdout:5/936: chown d0/d24/d2b/d49/d4b/dac/d3a/dd1/lec 113940028 1 2024-09-17T01:41:39.854 INFO:tasks.workunit.client.1.smithi167.stdout:5/937: write d0/d24/d93/d99/fbb [3970014,105409] 0 2024-09-17T01:41:39.855 INFO:tasks.workunit.client.0.smithi082.stdout:6/569: write d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/fac [944253,5741] 0 2024-09-17T01:41:39.857 INFO:tasks.workunit.client.1.smithi167.stdout:1/961: dread d0/d5/d34/f49 [0,4194304] 0 2024-09-17T01:41:39.857 INFO:tasks.workunit.client.1.smithi167.stdout:5/938: creat d0/d54/d9d/f122 x:0 0 0 2024-09-17T01:41:39.858 INFO:tasks.workunit.client.0.smithi082.stdout:6/570: mknod d1/d7/d10/d4f/dc/d1d/cd1 0 2024-09-17T01:41:39.859 INFO:tasks.workunit.client.1.smithi167.stdout:1/962: rmdir d0/d9/d16/d48 39 2024-09-17T01:41:39.860 INFO:tasks.workunit.client.1.smithi167.stdout:1/963: chown d0/d5/d34/d83/d112/d74/fe3 301123407 1 2024-09-17T01:41:39.861 INFO:tasks.workunit.client.1.smithi167.stdout:5/939: mknod d0/d24/d2b/db1/c123 0 2024-09-17T01:41:39.861 INFO:tasks.workunit.client.0.smithi082.stdout:6/571: dread - d1/d7/d10/d4f/dc/d1d/d36/f8b zero size 2024-09-17T01:41:39.864 INFO:tasks.workunit.client.0.smithi082.stdout:6/572: chown d1/d7/d10/d4f/dc/d99/ca1 20466598 1 2024-09-17T01:41:39.864 INFO:tasks.workunit.client.1.smithi167.stdout:1/964: dread d0/d9/d16/d36/ff8 [0,4194304] 0 2024-09-17T01:41:39.866 INFO:tasks.workunit.client.1.smithi167.stdout:5/940: link d0/d24/d2b/d49/d4b/dac/d3a/f7d d0/d24/d93/f124 0 2024-09-17T01:41:39.867 INFO:tasks.workunit.client.1.smithi167.stdout:5/941: chown d0/d24/d2b/d49/d4b/dac/d3a/dd1/f60 7680012 1 2024-09-17T01:41:39.868 INFO:tasks.workunit.client.0.smithi082.stdout:9/460: dwrite d4/d27/d36/d3b/f92 [0,4194304] 0 2024-09-17T01:41:39.869 INFO:tasks.workunit.client.0.smithi082.stdout:0/372: sync 2024-09-17T01:41:39.869 INFO:tasks.workunit.client.0.smithi082.stdout:5/586: sync 2024-09-17T01:41:39.870 INFO:tasks.workunit.client.0.smithi082.stdout:6/573: mknod d1/d7/d10/d4f/dc/d2b/db2/db3/dbf/cd2 0 2024-09-17T01:41:39.870 INFO:tasks.workunit.client.0.smithi082.stdout:6/574: chown d1/d7/f86 57 1 2024-09-17T01:41:39.871 INFO:tasks.workunit.client.0.smithi082.stdout:5/587: dread - db/d1e/d20/d4d/f97 zero size 2024-09-17T01:41:39.871 INFO:tasks.workunit.client.1.smithi167.stdout:1/965: getdents d0/d5/d34/d83/d112/d85 0 2024-09-17T01:41:39.873 INFO:tasks.workunit.client.1.smithi167.stdout:5/942: unlink d0/d24/d2b/d49/d66/l112 0 2024-09-17T01:41:39.873 INFO:tasks.workunit.client.0.smithi082.stdout:6/575: dread - d1/d7/d10/f6f zero size 2024-09-17T01:41:39.874 INFO:tasks.workunit.client.0.smithi082.stdout:9/461: mkdir d4/d27/d2d/d60/d11/d8d/d9f 0 2024-09-17T01:41:39.874 INFO:tasks.workunit.client.1.smithi167.stdout:5/943: stat d0/d24/d2b/d3d/d3b/f5c 0 2024-09-17T01:41:39.875 INFO:tasks.workunit.client.0.smithi082.stdout:6/576: read d1/d3/f3b [372539,54199] 0 2024-09-17T01:41:39.876 INFO:tasks.workunit.client.0.smithi082.stdout:5/588: rename db/d2b/f93 to db/d1e/d20/d30/d47/fb6 0 2024-09-17T01:41:39.877 INFO:tasks.workunit.client.0.smithi082.stdout:0/373: mknod da/c82 0 2024-09-17T01:41:39.879 INFO:tasks.workunit.client.1.smithi167.stdout:5/944: dwrite d0/f19 [4194304,4194304] 0 2024-09-17T01:41:39.881 INFO:tasks.workunit.client.1.smithi167.stdout:5/945: readlink d0/d24/d2b/d49/d4b/dac/d3a/d4d/l8a 0 2024-09-17T01:41:39.884 INFO:tasks.workunit.client.1.smithi167.stdout:5/946: symlink d0/d24/d2b/d3d/d3b/db0/db5/d109/d69/l125 0 2024-09-17T01:41:39.887 INFO:tasks.workunit.client.1.smithi167.stdout:5/947: getdents d0/d54 0 2024-09-17T01:41:39.889 INFO:tasks.workunit.client.1.smithi167.stdout:5/948: mkdir d0/d24/d2b/d3d/d6d/d10a/d63/d126 0 2024-09-17T01:41:39.889 INFO:tasks.workunit.client.1.smithi167.stdout:5/949: chown d0/d24/d2b/d3d/d3b/db0/db5/lcc 54127 1 2024-09-17T01:41:39.890 INFO:tasks.workunit.client.1.smithi167.stdout:5/950: stat d0/d24/d2b/d49/d4b/c117 0 2024-09-17T01:41:39.890 INFO:tasks.workunit.client.1.smithi167.stdout:5/951: dread - d0/d54/d56/de1/f11b zero size 2024-09-17T01:41:39.893 INFO:tasks.workunit.client.1.smithi167.stdout:5/952: creat d0/d24/d2b/d49/d4b/dac/f127 x:0 0 0 2024-09-17T01:41:39.895 INFO:tasks.workunit.client.1.smithi167.stdout:5/953: symlink d0/d24/d2b/d3d/d3b/db0/db5/d109/d69/l128 0 2024-09-17T01:41:39.907 INFO:tasks.workunit.client.0.smithi082.stdout:6/577: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/ld3 0 2024-09-17T01:41:39.907 INFO:tasks.workunit.client.0.smithi082.stdout:9/462: chown d4/d27/c73 342775 1 2024-09-17T01:41:39.908 INFO:tasks.workunit.client.0.smithi082.stdout:0/374: chown da/d1e/d69/f7b 107337679 1 2024-09-17T01:41:39.910 INFO:tasks.workunit.client.0.smithi082.stdout:0/375: chown da/c82 7196668 1 2024-09-17T01:41:39.910 INFO:tasks.workunit.client.0.smithi082.stdout:9/463: readlink d4/d27/d2d/d60/d11/d39/d7d/l7e 0 2024-09-17T01:41:39.915 INFO:tasks.workunit.client.0.smithi082.stdout:0/376: dread da/df/d71/f25 [0,4194304] 0 2024-09-17T01:41:39.916 INFO:tasks.workunit.client.1.smithi167.stdout:4/915: sync 2024-09-17T01:41:39.930 INFO:tasks.workunit.client.0.smithi082.stdout:9/464: dread d4/d27/d2d/d60/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:39.982 INFO:tasks.workunit.client.1.smithi167.stdout:7/881: sync 2024-09-17T01:41:39.983 INFO:tasks.workunit.client.1.smithi167.stdout:7/882: write d0/d2/d88/d6e/da3/f11a [446991,19847] 0 2024-09-17T01:41:39.984 INFO:tasks.workunit.client.1.smithi167.stdout:7/883: fdatasync d0/d2/d14/d19/d26/f1c 0 2024-09-17T01:41:40.005 INFO:tasks.workunit.client.1.smithi167.stdout:7/884: creat d0/d2/d14/d6f/f12d x:0 0 0 2024-09-17T01:41:40.008 INFO:tasks.workunit.client.0.smithi082.stdout:0/377: rename da/d1b/d23/d42/d43/d6b/c78 to da/d1e/c83 0 2024-09-17T01:41:40.009 INFO:tasks.workunit.client.0.smithi082.stdout:6/578: truncate d1/d7/d10/f38 2468121 0 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.0.smithi082.stdout:9/465: write d4/d27/d2d/d60/d11/f70 [135316,72452] 0 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.1.smithi167.stdout:1/966: sync 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.1.smithi167.stdout:2/931: sync 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.1.smithi167.stdout:0/950: sync 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.1.smithi167.stdout:5/954: dwrite d0/d24/d2b/d3d/dd2/fa1 [0,4194304] 0 2024-09-17T01:41:40.012 INFO:tasks.workunit.client.0.smithi082.stdout:0/378: symlink da/d1b/d23/l84 0 2024-09-17T01:41:40.013 INFO:tasks.workunit.client.1.smithi167.stdout:0/951: dread - d5/d6b/d7e/f11f zero size 2024-09-17T01:41:40.014 INFO:tasks.workunit.client.1.smithi167.stdout:5/955: dread - d0/d24/d2b/d49/d4b/dac/d3a/fe0 zero size 2024-09-17T01:41:40.016 INFO:tasks.workunit.client.0.smithi082.stdout:9/466: mknod d4/d27/d2d/d3d/d81/ca0 0 2024-09-17T01:41:40.021 INFO:tasks.workunit.client.0.smithi082.stdout:6/579: getdents d1/d7/d10/d4f/dc/d2b 0 2024-09-17T01:41:40.023 INFO:tasks.workunit.client.0.smithi082.stdout:9/467: dwrite d4/f49 [0,4194304] 0 2024-09-17T01:41:40.027 INFO:tasks.workunit.client.0.smithi082.stdout:6/580: mknod d1/d7/d10/d4f/d8e/da8/cd4 0 2024-09-17T01:41:40.028 INFO:tasks.workunit.client.0.smithi082.stdout:0/379: dread da/d1b/f52 [0,4194304] 0 2024-09-17T01:41:40.034 INFO:tasks.workunit.client.0.smithi082.stdout:0/380: creat da/df/d2b/f85 x:0 0 0 2024-09-17T01:41:40.036 INFO:tasks.workunit.client.0.smithi082.stdout:6/581: chown d1/d7/d10/f38 4440738 1 2024-09-17T01:41:40.038 INFO:tasks.workunit.client.0.smithi082.stdout:0/381: rename da/d1b/d23 to da/d1b/d23/d4d/d86 22 2024-09-17T01:41:40.055 INFO:tasks.workunit.client.0.smithi082.stdout:9/468: truncate d4/f5f 5476364 0 2024-09-17T01:41:40.060 INFO:tasks.workunit.client.0.smithi082.stdout:9/469: dwrite d4/d27/d2d/d60/d11/d39/d44/f72 [0,4194304] 0 2024-09-17T01:41:40.062 INFO:tasks.workunit.client.0.smithi082.stdout:9/470: write d4/d27/d2d/d60/d11/d39/d44/f83 [795534,112998] 0 2024-09-17T01:41:40.063 INFO:tasks.workunit.client.1.smithi167.stdout:7/885: chown d0/d2/d14/d19/d26/ff 8008492 1 2024-09-17T01:41:40.068 INFO:tasks.workunit.client.0.smithi082.stdout:0/382: write da/d1b/d23/d42/f58 [503960,10289] 0 2024-09-17T01:41:40.069 INFO:tasks.workunit.client.0.smithi082.stdout:9/471: readlink d4/d27/d2d/d60/d11/l9a 0 2024-09-17T01:41:40.069 INFO:tasks.workunit.client.1.smithi167.stdout:1/967: chown d0/d9/d16/d48/d80 1234 1 2024-09-17T01:41:40.070 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:39 smithi167 ceph-mon[35643]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 212 MiB/s wr, 408 op/s 2024-09-17T01:41:40.071 INFO:tasks.workunit.client.0.smithi082.stdout:6/582: dwrite d1/d7/d10/d4f/f78 [0,4194304] 0 2024-09-17T01:41:40.071 INFO:tasks.workunit.client.1.smithi167.stdout:0/952: creat d5/d6b/d77/d6d/d90/dc4/dc7/f13a x:0 0 0 2024-09-17T01:41:40.072 INFO:tasks.workunit.client.1.smithi167.stdout:0/953: chown d5/d6b/d77/d4d/d56/d7b/lcb 1205154187 1 2024-09-17T01:41:40.077 INFO:tasks.workunit.client.0.smithi082.stdout:0/383: rename da/df/d71/f50 to da/df/d2b/d59/d6f/f87 0 2024-09-17T01:41:40.081 INFO:tasks.workunit.client.1.smithi167.stdout:2/932: truncate d5/d33/d48/d72/d94/faf 226157 0 2024-09-17T01:41:40.082 INFO:tasks.workunit.client.0.smithi082.stdout:0/384: creat da/d1b/d23/d42/f88 x:0 0 0 2024-09-17T01:41:40.083 INFO:tasks.workunit.client.0.smithi082.stdout:0/385: fdatasync da/d1b/d23/d42/f58 0 2024-09-17T01:41:40.085 INFO:tasks.workunit.client.0.smithi082.stdout:6/583: creat d1/fd5 x:0 0 0 2024-09-17T01:41:40.087 INFO:tasks.workunit.client.1.smithi167.stdout:4/916: getdents d0/d4/d69 0 2024-09-17T01:41:40.088 INFO:tasks.workunit.client.0.smithi082.stdout:0/386: creat da/df/d2b/f89 x:0 0 0 2024-09-17T01:41:40.090 INFO:tasks.workunit.client.1.smithi167.stdout:0/954: truncate d5/d8/d9/f3f 4621885 0 2024-09-17T01:41:40.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:39 smithi082 ceph-mon[28077]: pgmap v23: 65 pgs: 65 active+clean; 2.6 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 77 MiB/s rd, 212 MiB/s wr, 408 op/s 2024-09-17T01:41:40.091 INFO:tasks.workunit.client.1.smithi167.stdout:1/968: fdatasync d0/d5/d61/da2/fc7 0 2024-09-17T01:41:40.092 INFO:tasks.workunit.client.0.smithi082.stdout:6/584: creat d1/d7/d10/d4f/dc/d99/fd6 x:0 0 0 2024-09-17T01:41:40.092 INFO:tasks.workunit.client.1.smithi167.stdout:2/933: dread - d5/d3c/d4c/de2/db8/da3/dc8/dea/fee zero size 2024-09-17T01:41:40.094 INFO:tasks.workunit.client.1.smithi167.stdout:2/934: readlink d5/d3c/d4c/de2/db8/d5e/led 0 2024-09-17T01:41:40.094 INFO:tasks.workunit.client.1.smithi167.stdout:1/969: truncate d0/d9/d16/d48/d54/d6e/f127 976658 0 2024-09-17T01:41:40.095 INFO:tasks.workunit.client.1.smithi167.stdout:1/970: write d0/d5/d61/f71 [2628637,70692] 0 2024-09-17T01:41:40.098 INFO:tasks.workunit.client.1.smithi167.stdout:4/917: dread d0/d4/d69/d131/d6/d2b/d6d/d7e/d92/d5a/de1/ff6 [0,4194304] 0 2024-09-17T01:41:40.098 INFO:tasks.workunit.client.1.smithi167.stdout:7/886: creat d0/f12e x:0 0 0 2024-09-17T01:41:40.106 INFO:tasks.workunit.client.0.smithi082.stdout:6/585: dread d1/d7/d10/d4f/dc/f29 [0,4194304] 0 2024-09-17T01:41:40.106 INFO:tasks.workunit.client.1.smithi167.stdout:7/887: dwrite d0/d2/f66 [0,4194304] 0 2024-09-17T01:41:40.106 INFO:tasks.workunit.client.1.smithi167.stdout:1/971: write d0/d5/f12 [2090636,10018] 0 2024-09-17T01:41:40.107 INFO:tasks.workunit.client.1.smithi167.stdout:0/955: mknod d5/d8/c13b 0 2024-09-17T01:41:40.108 INFO:tasks.workunit.client.1.smithi167.stdout:4/918: dwrite d0/d4/d69/d131/d6/d2b/d6d/d7e/da8/f100 [0,4194304] 0 2024-09-17T01:41:40.109 INFO:tasks.workunit.client.0.smithi082.stdout:6/586: fdatasync d1/d7/d10/d4f/dc/d1d/d36/d3e/f58 0 2024-09-17T01:41:40.109 INFO:tasks.workunit.client.0.smithi082.stdout:6/587: dread - d1/d1f/fba zero size 2024-09-17T01:41:40.110 INFO:tasks.workunit.client.1.smithi167.stdout:7/888: write d0/d2/d88/d6e/f11d [713662,32058] 0 2024-09-17T01:41:40.112 INFO:tasks.workunit.client.1.smithi167.stdout:7/889: readlink d0/d2/d14/d19/d26/l76 0 2024-09-17T01:41:40.116 INFO:tasks.workunit.client.1.smithi167.stdout:2/935: creat d5/d3c/d4c/f13e x:0 0 0 2024-09-17T01:41:40.117 INFO:tasks.workunit.client.1.smithi167.stdout:5/956: dwrite d0/d24/d2b/d3d/d3b/db0/db5/d109/fa5 [0,4194304] 0 2024-09-17T01:41:40.119 INFO:tasks.workunit.client.0.smithi082.stdout:6/588: fsync d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 0 2024-09-17T01:41:40.120 INFO:tasks.workunit.client.1.smithi167.stdout:4/919: rmdir d0/d4/d69/d131/da/d10e 39 2024-09-17T01:41:40.128 INFO:tasks.workunit.client.1.smithi167.stdout:5/957: dwrite d0/d24/d2b/d3d/d6d/ff1 [0,4194304] 0 2024-09-17T01:41:40.130 INFO:tasks.workunit.client.1.smithi167.stdout:0/956: creat d5/d6b/d77/d6d/d90/d125/f13c x:0 0 0 2024-09-17T01:41:40.131 INFO:tasks.workunit.client.1.smithi167.stdout:5/958: dread d0/f18 [0,4194304] 0 2024-09-17T01:41:40.132 INFO:tasks.workunit.client.1.smithi167.stdout:7/890: fdatasync d0/d2/d14/f1b 0 2024-09-17T01:41:40.132 INFO:tasks.workunit.client.0.smithi082.stdout:9/472: dwrite d4/f5f [0,4194304] 0 2024-09-17T01:41:40.133 INFO:tasks.workunit.client.1.smithi167.stdout:5/959: write d0/d9/fb [5071636,11973] 0 2024-09-17T01:41:40.135 INFO:tasks.workunit.client.0.smithi082.stdout:9/473: chown d4/d27/d2d/d3d/f8c 2 1 2024-09-17T01:41:40.136 INFO:tasks.workunit.client.0.smithi082.stdout:9/474: write d4/f49 [1327815,16335] 0 2024-09-17T01:41:40.137 INFO:tasks.workunit.client.0.smithi082.stdout:0/387: dwrite da/df/d71/f51 [8388608,4194304] 0 2024-09-17T01:41:40.137 INFO:tasks.workunit.client.1.smithi167.stdout:1/972: getdents d0/d9/d16/d48/d54/d78/d90 0 2024-09-17T01:41:40.138 INFO:tasks.workunit.client.1.smithi167.stdout:2/936: creat d5/d3c/d4c/d4d/d91/d13d/f13f x:0 0 0 2024-09-17T01:41:40.141 INFO:tasks.workunit.client.1.smithi167.stdout:0/957: creat d5/d6b/d77/d6d/d90/d125/f13d x:0 0 0 2024-09-17T01:41:40.142 INFO:tasks.workunit.client.1.smithi167.stdout:0/958: chown d5/f1d 320 1 2024-09-17T01:41:40.143 INFO:tasks.workunit.client.1.smithi167.stdout:0/959: readlink d5/d6b/d77/d6d/d90/dc4/dc7/ldc 0 2024-09-17T01:41:40.147 INFO:tasks.workunit.client.0.smithi082.stdout:9/475: unlink d4/d27/d2d/d60/d11/d39/d31/c91 0 2024-09-17T01:41:40.149 INFO:tasks.workunit.client.1.smithi167.stdout:0/960: read d5/d6b/dca/fd7 [2458558,114786] 0 2024-09-17T01:41:40.152 INFO:tasks.workunit.client.0.smithi082.stdout:6/589: dwrite d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:40.153 INFO:tasks.workunit.client.1.smithi167.stdout:1/973: write d0/d5/d34/d83/d112/f4e [3331700,89997] 0 2024-09-17T01:41:40.155 INFO:tasks.workunit.client.1.smithi167.stdout:2/937: creat d5/d33/d48/d72/d94/de3/f140 x:0 0 0 2024-09-17T01:41:40.158 INFO:tasks.workunit.client.0.smithi082.stdout:0/388: rename da/df/d71/c54 to da/d1b/d23/d4d/d5d/c8a 0 2024-09-17T01:41:40.159 INFO:tasks.workunit.client.1.smithi167.stdout:5/960: truncate d0/d24/d2b/d49/d4b/dac/d3a/f7d 3277952 0 2024-09-17T01:41:40.159 INFO:tasks.workunit.client.0.smithi082.stdout:0/389: truncate da/df/d2b/f85 284480 0 2024-09-17T01:41:40.160 INFO:tasks.workunit.client.1.smithi167.stdout:4/920: creat d0/d4/d69/d131/da/d10e/d2d/d11f/f13a x:0 0 0 2024-09-17T01:41:40.161 INFO:tasks.workunit.client.1.smithi167.stdout:0/961: creat d5/d6b/d77/d6d/d90/dc4/dc7/f13e x:0 0 0 2024-09-17T01:41:40.163 INFO:tasks.workunit.client.0.smithi082.stdout:6/590: rename d1/d7/d10/d4f/dc/d2b/db6 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7 0 2024-09-17T01:41:40.164 INFO:tasks.workunit.client.0.smithi082.stdout:0/390: fsync da/df/d2b/f39 0 2024-09-17T01:41:40.166 INFO:tasks.workunit.client.1.smithi167.stdout:2/938: creat d5/d3c/d4c/de2/db8/d5e/f141 x:0 0 0 2024-09-17T01:41:40.167 INFO:tasks.workunit.client.1.smithi167.stdout:5/961: creat d0/d24/d2b/d3d/d6d/d10a/f129 x:0 0 0 2024-09-17T01:41:40.170 INFO:tasks.workunit.client.1.smithi167.stdout:0/962: rename d5/dee/d103 to d5/d6b/d77/d4d/d56/d13f 0 2024-09-17T01:41:40.172 INFO:tasks.workunit.client.1.smithi167.stdout:4/921: mkdir d0/d4/d69/d131/d6/d2b/d6d/d7e/d92/d5a/d13b 0 2024-09-17T01:41:40.174 INFO:tasks.workunit.client.1.smithi167.stdout:2/939: dwrite d5/d3c/d4c/de2/d45/d8e/d98/f12a [0,4194304] 0 2024-09-17T01:41:40.174 INFO:tasks.workunit.client.0.smithi082.stdout:6/591: creat d1/d7/d10/d4f/fd8 x:0 0 0 2024-09-17T01:41:40.179 INFO:tasks.workunit.client.1.smithi167.stdout:4/922: mkdir d0/d4/d69/d131/d6/d2b/d13c 0 2024-09-17T01:41:40.180 INFO:tasks.workunit.client.1.smithi167.stdout:7/891: write d0/d2/d14/d6f/d75/fdf [360214,64326] 0 2024-09-17T01:41:40.180 INFO:tasks.workunit.client.1.smithi167.stdout:2/940: mknod d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f/c142 0 2024-09-17T01:41:40.182 INFO:tasks.workunit.client.1.smithi167.stdout:5/962: creat d0/d24/d2b/d3d/d6d/de6/f12a x:0 0 0 2024-09-17T01:41:40.183 INFO:tasks.workunit.client.1.smithi167.stdout:0/963: fdatasync d5/d6b/d77/d37/f117 0 2024-09-17T01:41:40.183 INFO:tasks.workunit.client.1.smithi167.stdout:5/963: read - d0/d24/d2b/d3d/dd2/dc4/f10f zero size 2024-09-17T01:41:40.184 INFO:tasks.workunit.client.1.smithi167.stdout:5/964: dread - d0/d54/d56/de1/f11b zero size 2024-09-17T01:41:40.185 INFO:tasks.workunit.client.1.smithi167.stdout:2/941: truncate d5/ff8 416515 0 2024-09-17T01:41:40.186 INFO:tasks.workunit.client.1.smithi167.stdout:2/942: fsync d5/f135 0 2024-09-17T01:41:40.186 INFO:tasks.workunit.client.1.smithi167.stdout:5/965: chown d0/d24/d2b/d3d/ffc 57399 1 2024-09-17T01:41:40.187 INFO:tasks.workunit.client.1.smithi167.stdout:5/966: write d0/d24/d2b/d3d/d6d/d10a/f129 [909111,63709] 0 2024-09-17T01:41:40.187 INFO:tasks.workunit.client.0.smithi082.stdout:9/476: dwrite d4/d27/d2d/d60/d11/d39/d31/f40 [4194304,4194304] 0 2024-09-17T01:41:40.188 INFO:tasks.workunit.client.1.smithi167.stdout:5/967: read d0/d54/d56/f107 [2660610,36857] 0 2024-09-17T01:41:40.189 INFO:tasks.workunit.client.1.smithi167.stdout:5/968: dread - d0/d24/d2b/d3d/dd2/dc4/f10f zero size 2024-09-17T01:41:40.253 INFO:tasks.workunit.client.0.smithi082.stdout:3/426: sync 2024-09-17T01:41:40.302 INFO:tasks.workunit.client.1.smithi167.stdout:7/892: fsync d0/d2/d14/d19/d26/ff 0 2024-09-17T01:41:40.310 INFO:tasks.workunit.client.0.smithi082.stdout:9/477: creat d4/d27/d2d/d60/d11/d39/d29/d6d/fa1 x:0 0 0 2024-09-17T01:41:40.311 INFO:tasks.workunit.client.1.smithi167.stdout:1/974: write d0/d5/d34/d83/d112/d85/fff [9005483,34639] 0 2024-09-17T01:41:40.311 INFO:tasks.workunit.client.0.smithi082.stdout:0/391: write da/fe [448804,3723] 0 2024-09-17T01:41:40.312 INFO:tasks.workunit.client.0.smithi082.stdout:9/478: stat d4/d27/d2d/d60/d11/d39/d29/d77/c80 0 2024-09-17T01:41:40.313 INFO:tasks.workunit.client.0.smithi082.stdout:3/427: truncate d9/db/d26/f46 803797 0 2024-09-17T01:41:40.313 INFO:tasks.workunit.client.0.smithi082.stdout:3/428: fsync d9/db/f85 0 2024-09-17T01:41:40.317 INFO:tasks.workunit.client.1.smithi167.stdout:5/969: mknod d0/d24/d2b/d3d/d6d/d10a/c12b 0 2024-09-17T01:41:40.318 INFO:tasks.workunit.client.0.smithi082.stdout:9/479: symlink d4/d27/d36/d3b/la2 0 2024-09-17T01:41:40.318 INFO:tasks.workunit.client.1.smithi167.stdout:5/970: write d0/d9/f7a [662344,38886] 0 2024-09-17T01:41:40.319 INFO:tasks.workunit.client.0.smithi082.stdout:9/480: chown d4/d27/d2d/d60/d11/d39/d29 381253 1 2024-09-17T01:41:40.322 INFO:tasks.workunit.client.1.smithi167.stdout:7/893: rmdir d0/d2/d14/d6f 39 2024-09-17T01:41:40.325 INFO:tasks.workunit.client.0.smithi082.stdout:0/392: getdents da/d80/d77 0 2024-09-17T01:41:40.327 INFO:tasks.workunit.client.1.smithi167.stdout:7/894: dread d0/d2/f66 [0,4194304] 0 2024-09-17T01:41:40.328 INFO:tasks.workunit.client.1.smithi167.stdout:0/964: getdents d5/d6b/d77/d37/d45/d112 0 2024-09-17T01:41:40.328 INFO:tasks.workunit.client.0.smithi082.stdout:0/393: dread - da/d1b/d23/d42/d43/d6b/f6c zero size 2024-09-17T01:41:40.329 INFO:tasks.workunit.client.0.smithi082.stdout:6/592: dwrite d1/d7/d10/d4f/fb [0,4194304] 0 2024-09-17T01:41:40.330 INFO:tasks.workunit.client.0.smithi082.stdout:3/429: link d9/db/f85 d9/d35/d71/f92 0 2024-09-17T01:41:40.331 INFO:tasks.workunit.client.1.smithi167.stdout:1/975: mknod d0/d5/d34/d12f/d132/c13e 0 2024-09-17T01:41:40.334 INFO:tasks.workunit.client.0.smithi082.stdout:6/593: dread d1/d3/f75 [0,4194304] 0 2024-09-17T01:41:40.335 INFO:tasks.workunit.client.0.smithi082.stdout:0/394: fsync da/fd 0 2024-09-17T01:41:40.339 INFO:tasks.workunit.client.0.smithi082.stdout:9/481: creat d4/d27/d2d/d60/fa3 x:0 0 0 2024-09-17T01:41:40.340 INFO:tasks.workunit.client.0.smithi082.stdout:9/482: chown d4/d27/d2d/d60/d11/d39/d7d 1960456 1 2024-09-17T01:41:40.341 INFO:tasks.workunit.client.1.smithi167.stdout:5/971: dread d0/d24/d2b/d3d/dd2/fc5 [0,4194304] 0 2024-09-17T01:41:40.342 INFO:tasks.workunit.client.1.smithi167.stdout:4/923: dwrite d0/d4/d69/d131/d6/f83 [0,4194304] 0 2024-09-17T01:41:40.342 INFO:tasks.workunit.client.0.smithi082.stdout:0/395: write da/d1b/f7d [278854,56874] 0 2024-09-17T01:41:40.343 INFO:tasks.workunit.client.1.smithi167.stdout:5/972: dread - d0/d24/d2b/d49/d4b/f103 zero size 2024-09-17T01:41:40.346 INFO:tasks.workunit.client.0.smithi082.stdout:3/430: unlink d9/c14 0 2024-09-17T01:41:40.347 INFO:tasks.workunit.client.0.smithi082.stdout:3/431: write d9/d35/f43 [902216,20520] 0 2024-09-17T01:41:40.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/483: creat d4/d27/d2d/d60/d11/d39/d29/d77/fa4 x:0 0 0 2024-09-17T01:41:40.349 INFO:tasks.workunit.client.1.smithi167.stdout:7/895: dwrite d0/d2/d14/d23/fef [0,4194304] 0 2024-09-17T01:41:40.350 INFO:tasks.workunit.client.0.smithi082.stdout:9/484: chown d4/d27/c73 48711096 1 2024-09-17T01:41:40.350 INFO:tasks.workunit.client.0.smithi082.stdout:9/485: readlink d4/d27/d21/l62 0 2024-09-17T01:41:40.351 INFO:tasks.workunit.client.1.smithi167.stdout:1/976: mknod d0/d5/d34/d83/d112/d85/db5/dc1/d119/c13f 0 2024-09-17T01:41:40.352 INFO:tasks.workunit.client.0.smithi082.stdout:0/396: symlink da/d1b/d23/d42/l8b 0 2024-09-17T01:41:40.359 INFO:tasks.workunit.client.0.smithi082.stdout:9/486: creat d4/d27/d2d/d3d/fa5 x:0 0 0 2024-09-17T01:41:40.360 INFO:tasks.workunit.client.1.smithi167.stdout:5/973: mkdir d0/d24/d2b/db1/d12c 0 2024-09-17T01:41:40.360 INFO:tasks.workunit.client.0.smithi082.stdout:0/397: creat da/d80/f8c x:0 0 0 2024-09-17T01:41:40.362 INFO:tasks.workunit.client.1.smithi167.stdout:5/974: readlink d0/d24/d2b/d3d/d3b/lc1 0 2024-09-17T01:41:40.365 INFO:tasks.workunit.client.1.smithi167.stdout:2/943: dwrite d5/d6d/f8f [0,4194304] 0 2024-09-17T01:41:40.366 INFO:tasks.workunit.client.0.smithi082.stdout:6/594: write d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [2258783,42706] 0 2024-09-17T01:41:40.368 INFO:tasks.workunit.client.0.smithi082.stdout:0/398: symlink da/df/d2b/d59/d6f/d70/l8d 0 2024-09-17T01:41:40.368 INFO:tasks.workunit.client.0.smithi082.stdout:9/487: fsync d4/d27/d2d/d60/d11/d39/d29/d77/fa4 0 2024-09-17T01:41:40.371 INFO:tasks.workunit.client.0.smithi082.stdout:3/432: link d9/db/c1d d9/d78/d88/c93 0 2024-09-17T01:41:40.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/399: rmdir da/d1b 39 2024-09-17T01:41:40.374 INFO:tasks.workunit.client.0.smithi082.stdout:0/400: chown da/df/d27/f21 113078 1 2024-09-17T01:41:40.374 INFO:tasks.workunit.client.1.smithi167.stdout:7/896: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:40.374 INFO:tasks.workunit.client.1.smithi167.stdout:5/975: creat d0/d24/f12d x:0 0 0 2024-09-17T01:41:40.375 INFO:tasks.workunit.client.0.smithi082.stdout:0/401: fsync da/df/d71/f51 0 2024-09-17T01:41:40.375 INFO:tasks.workunit.client.1.smithi167.stdout:7/897: chown d0/d2/d14/d19/d22/d40 1018 1 2024-09-17T01:41:40.376 INFO:tasks.workunit.client.1.smithi167.stdout:5/976: chown d0/d24/d2b/d3d/d3b/d92/df3 225 1 2024-09-17T01:41:40.376 INFO:tasks.workunit.client.0.smithi082.stdout:9/488: rmdir d4/d27/d2d/d60/d11/d39/d29/d77 39 2024-09-17T01:41:40.377 INFO:tasks.workunit.client.0.smithi082.stdout:0/402: dread da/df/d71/f25 [0,4194304] 0 2024-09-17T01:41:40.378 INFO:tasks.workunit.client.1.smithi167.stdout:2/944: creat d5/d33/d48/d72/d94/f143 x:0 0 0 2024-09-17T01:41:40.380 INFO:tasks.workunit.client.0.smithi082.stdout:3/433: stat d9/db/d26/f31 0 2024-09-17T01:41:40.380 INFO:tasks.workunit.client.1.smithi167.stdout:7/898: readlink d0/d2/d14/d6f/lb2 0 2024-09-17T01:41:40.381 INFO:tasks.workunit.client.0.smithi082.stdout:9/489: dread d4/d27/d2d/d60/d11/d39/d29/d35/f61 [0,4194304] 0 2024-09-17T01:41:40.384 INFO:tasks.workunit.client.1.smithi167.stdout:2/945: creat d5/d3c/d4c/de2/d45/d6b/d134/d139/f144 x:0 0 0 2024-09-17T01:41:40.385 INFO:tasks.workunit.client.1.smithi167.stdout:5/977: symlink d0/d24/d2b/l12e 0 2024-09-17T01:41:40.386 INFO:tasks.workunit.client.1.smithi167.stdout:7/899: symlink d0/d2/d88/d6e/da3/l12f 0 2024-09-17T01:41:40.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/403: creat da/df/d2b/d59/d6f/d70/f8e x:0 0 0 2024-09-17T01:41:40.389 INFO:tasks.workunit.client.1.smithi167.stdout:1/977: dread d0/d5/f73 [0,4194304] 0 2024-09-17T01:41:40.389 INFO:tasks.workunit.client.0.smithi082.stdout:3/434: mknod d9/d35/d71/c94 0 2024-09-17T01:41:40.389 INFO:tasks.workunit.client.1.smithi167.stdout:5/978: truncate d0/d24/d2b/d3d/d3b/db0/db5/d109/f10c 449728 0 2024-09-17T01:41:40.390 INFO:tasks.workunit.client.1.smithi167.stdout:2/946: creat d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f/f145 x:0 0 0 2024-09-17T01:41:40.392 INFO:tasks.workunit.client.0.smithi082.stdout:6/595: truncate d1/d7/d10/d4f/f78 2937535 0 2024-09-17T01:41:40.392 INFO:tasks.workunit.client.1.smithi167.stdout:4/924: dread d0/d4/d69/d131/da/d10e/f3a [0,4194304] 0 2024-09-17T01:41:40.394 INFO:tasks.workunit.client.0.smithi082.stdout:6/596: dread d1/d7/d10/d4f/f12 [0,4194304] 0 2024-09-17T01:41:40.396 INFO:tasks.workunit.client.0.smithi082.stdout:3/435: mkdir d9/db/d95 0 2024-09-17T01:41:40.397 INFO:tasks.workunit.client.0.smithi082.stdout:6/597: dread d1/d7/d10/d4f/d32/f9b [0,4194304] 0 2024-09-17T01:41:40.398 INFO:tasks.workunit.client.0.smithi082.stdout:9/490: mkdir d4/da6 0 2024-09-17T01:41:40.399 INFO:tasks.workunit.client.1.smithi167.stdout:7/900: mknod d0/d2/d14/d19/d32/d10b/c130 0 2024-09-17T01:41:40.400 INFO:tasks.workunit.client.1.smithi167.stdout:2/947: mkdir d5/d33/d48/d72/d94/de3/d146 0 2024-09-17T01:41:40.401 INFO:tasks.workunit.client.0.smithi082.stdout:0/404: dread da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:40.402 INFO:tasks.workunit.client.1.smithi167.stdout:4/925: fsync d0/f130 0 2024-09-17T01:41:40.403 INFO:tasks.workunit.client.1.smithi167.stdout:2/948: dread - d5/d3c/d4c/de2/db8/da3/dc8/dea/fee zero size 2024-09-17T01:41:40.405 INFO:tasks.workunit.client.1.smithi167.stdout:7/901: dwrite d0/d2/d88/df5/ffe [0,4194304] 0 2024-09-17T01:41:40.406 INFO:tasks.workunit.client.0.smithi082.stdout:6/598: mknod d1/d7/d10/d4f/dc/d1d/d36/d56/cd9 0 2024-09-17T01:41:40.407 INFO:tasks.workunit.client.1.smithi167.stdout:4/926: write d0/d4/d69/d131/d6/d2b/d6d/d7e/d92/d6a/d81/f85 [2568150,42227] 0 2024-09-17T01:41:40.409 INFO:tasks.workunit.client.1.smithi167.stdout:7/902: chown d0/d2/d88/c98 1026823 1 2024-09-17T01:41:40.409 INFO:tasks.workunit.client.0.smithi082.stdout:0/405: dwrite da/fc [4194304,4194304] 0 2024-09-17T01:41:40.412 INFO:tasks.workunit.client.0.smithi082.stdout:9/491: rmdir d4/d27/d2d/d60/d11/d8d/d9f 0 2024-09-17T01:41:40.413 INFO:tasks.workunit.client.0.smithi082.stdout:3/436: dread d9/f4d [0,4194304] 0 2024-09-17T01:41:40.414 INFO:tasks.workunit.client.1.smithi167.stdout:5/979: write d0/d24/d2b/d3d/dd2/f89 [1428358,128956] 0 2024-09-17T01:41:40.415 INFO:tasks.workunit.client.0.smithi082.stdout:6/599: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/fda x:0 0 0 2024-09-17T01:41:40.415 INFO:tasks.workunit.client.1.smithi167.stdout:2/949: dwrite d5/d3c/d4c/f13e [0,4194304] 0 2024-09-17T01:41:40.419 INFO:tasks.workunit.client.1.smithi167.stdout:1/978: dwrite d0/d5/d61/da2/fe8 [0,4194304] 0 2024-09-17T01:41:40.421 INFO:tasks.workunit.client.0.smithi082.stdout:9/492: creat d4/d27/d2d/d60/d11/d8d/fa7 x:0 0 0 2024-09-17T01:41:40.422 INFO:tasks.workunit.client.0.smithi082.stdout:0/406: dread da/df/d2b/d59/d6f/f87 [0,4194304] 0 2024-09-17T01:41:40.424 INFO:tasks.workunit.client.0.smithi082.stdout:3/437: unlink d9/d35/d71/l5c 0 2024-09-17T01:41:40.425 INFO:tasks.workunit.client.1.smithi167.stdout:7/903: creat d0/d2/ded/dfd/f131 x:0 0 0 2024-09-17T01:41:40.426 INFO:tasks.workunit.client.1.smithi167.stdout:5/980: unlink d0/d24/f62 0 2024-09-17T01:41:40.428 INFO:tasks.workunit.client.1.smithi167.stdout:1/979: readlink d0/d5/l62 0 2024-09-17T01:41:40.429 INFO:tasks.workunit.client.1.smithi167.stdout:4/927: creat d0/d4/d69/d131/d6/f13d x:0 0 0 2024-09-17T01:41:40.430 INFO:tasks.workunit.client.0.smithi082.stdout:0/407: stat da/d1b/f52 0 2024-09-17T01:41:40.431 INFO:tasks.workunit.client.0.smithi082.stdout:9/493: symlink d4/d27/d2d/d60/d11/d37/la8 0 2024-09-17T01:41:40.432 INFO:tasks.workunit.client.0.smithi082.stdout:3/438: creat d9/db/d26/f96 x:0 0 0 2024-09-17T01:41:40.434 INFO:tasks.workunit.client.1.smithi167.stdout:5/981: mknod d0/d24/d2b/c12f 0 2024-09-17T01:41:40.435 INFO:tasks.workunit.client.0.smithi082.stdout:0/408: rename da/d1e to da/df/d2b/d59/d8f 0 2024-09-17T01:41:40.435 INFO:tasks.workunit.client.1.smithi167.stdout:1/980: dread - d0/d5/dd7/f136 zero size 2024-09-17T01:41:40.435 INFO:tasks.workunit.client.0.smithi082.stdout:9/494: mkdir d4/d27/d36/d3b/da9 0 2024-09-17T01:41:40.436 INFO:tasks.workunit.client.0.smithi082.stdout:6/600: creat d1/fdb x:0 0 0 2024-09-17T01:41:40.436 INFO:tasks.workunit.client.1.smithi167.stdout:7/904: dwrite d0/d2/d14/d19/d32/fe5 [0,4194304] 0 2024-09-17T01:41:40.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/495: read d4/d27/d2d/d60/d11/d39/d44/f72 [2630297,83276] 0 2024-09-17T01:41:40.438 INFO:tasks.workunit.client.1.smithi167.stdout:2/950: dwrite d5/d6d/fbd [0,4194304] 0 2024-09-17T01:41:40.439 INFO:tasks.workunit.client.1.smithi167.stdout:1/981: write d0/d5/d61/f7f [591384,99466] 0 2024-09-17T01:41:40.441 INFO:tasks.workunit.client.1.smithi167.stdout:4/928: rename d0/d4/d69/d131/d6/d2b/d6d to d0/d4/d69/d13e 0 2024-09-17T01:41:40.442 INFO:tasks.workunit.client.1.smithi167.stdout:1/982: write d0/d9/f37 [1815398,43850] 0 2024-09-17T01:41:40.443 INFO:tasks.workunit.client.0.smithi082.stdout:6/601: mknod d1/d7/d10/d4f/d8e/da8/cdc 0 2024-09-17T01:41:40.444 INFO:tasks.workunit.client.1.smithi167.stdout:7/905: write d0/d2/f21 [2616302,91782] 0 2024-09-17T01:41:40.446 INFO:tasks.workunit.client.0.smithi082.stdout:3/439: link d9/d35/d71/d69/f6a d9/d35/d63/f97 0 2024-09-17T01:41:40.447 INFO:tasks.workunit.client.1.smithi167.stdout:0/965: sync 2024-09-17T01:41:40.451 INFO:tasks.workunit.client.1.smithi167.stdout:2/951: symlink d5/d3c/d4c/de2/l147 0 2024-09-17T01:41:40.453 INFO:tasks.workunit.client.0.smithi082.stdout:7/559: sync 2024-09-17T01:41:40.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/496: link d4/d27/d2d/d60/d11/l9a d4/d27/d21/laa 0 2024-09-17T01:41:40.454 INFO:tasks.workunit.client.1.smithi167.stdout:7/906: mkdir d0/d2/d14/d6f/d8b/d132 0 2024-09-17T01:41:40.456 INFO:tasks.workunit.client.1.smithi167.stdout:5/982: dwrite d0/d24/d2b/d3d/d6d/d10a/d63/fd6 [0,4194304] 0 2024-09-17T01:41:40.457 INFO:tasks.workunit.client.0.smithi082.stdout:7/560: creat d0/dd/d2c/d42/d77/fbe x:0 0 0 2024-09-17T01:41:40.458 INFO:tasks.workunit.client.0.smithi082.stdout:7/561: chown d0/d3/d36/d37/d71 197 1 2024-09-17T01:41:40.458 INFO:tasks.workunit.client.1.smithi167.stdout:1/983: dwrite d0/d9/d16/d48/d54/d78/f124 [0,4194304] 0 2024-09-17T01:41:40.459 INFO:tasks.workunit.client.1.smithi167.stdout:4/929: truncate d0/d4/d69/d131/da/d10e/d2d/d11f/f13a 733984 0 2024-09-17T01:41:40.460 INFO:tasks.workunit.client.0.smithi082.stdout:3/440: rename d9/db/d26/f51 to d9/db/d49/d4e/d53/f98 0 2024-09-17T01:41:40.460 INFO:tasks.workunit.client.1.smithi167.stdout:4/930: readlink d0/d4/d69/d131/da/d10e/d2d/l7c 0 2024-09-17T01:41:40.462 INFO:tasks.workunit.client.1.smithi167.stdout:5/983: dread d0/f18 [4194304,4194304] 0 2024-09-17T01:41:40.464 INFO:tasks.workunit.client.1.smithi167.stdout:0/966: truncate d5/d8/d9/f2c 2176457 0 2024-09-17T01:41:40.466 INFO:tasks.workunit.client.0.smithi082.stdout:3/441: dread d9/d35/d71/f92 [0,4194304] 0 2024-09-17T01:41:40.467 INFO:tasks.workunit.client.1.smithi167.stdout:2/952: mknod d5/d71/c148 0 2024-09-17T01:41:40.468 INFO:tasks.workunit.client.0.smithi082.stdout:3/442: dread - d9/f6f zero size 2024-09-17T01:41:40.469 INFO:tasks.workunit.client.1.smithi167.stdout:2/953: write d5/d33/d48/d72/d94/f143 [573758,113468] 0 2024-09-17T01:41:40.471 INFO:tasks.workunit.client.0.smithi082.stdout:6/602: rename d1/d7/d10/d4f/dc/d2b/db2/db3 to d1/d1f/da7/ddd 0 2024-09-17T01:41:40.476 INFO:tasks.workunit.client.0.smithi082.stdout:6/603: dread d1/f83 [0,4194304] 0 2024-09-17T01:41:40.477 INFO:tasks.workunit.client.1.smithi167.stdout:1/984: rename d0/d9/d16/d48/d54/la9 to d0/d9/d16/d48/d54/d6e/d7e/d129/l140 0 2024-09-17T01:41:40.479 INFO:tasks.workunit.client.0.smithi082.stdout:0/409: dwrite da/df/f4a [4194304,4194304] 0 2024-09-17T01:41:40.482 INFO:tasks.workunit.client.1.smithi167.stdout:2/954: rmdir d5/d3c/d4c/de2/d2e 39 2024-09-17T01:41:40.483 INFO:tasks.workunit.client.0.smithi082.stdout:3/443: rename d9/d35/d71/d69/c7c to d9/d35/d71/c99 0 2024-09-17T01:41:40.484 INFO:tasks.workunit.client.0.smithi082.stdout:3/444: fdatasync d9/db/d26/f96 0 2024-09-17T01:41:40.488 INFO:tasks.workunit.client.1.smithi167.stdout:0/967: mkdir d5/d6b/d77/d6d/d140 0 2024-09-17T01:41:40.489 INFO:tasks.workunit.client.1.smithi167.stdout:0/968: fdatasync d5/d6b/d77/d4d/dfa/d133/f134 0 2024-09-17T01:41:40.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/410: rename da/d1b/d23/d42/d43/l55 to da/df/d27/l90 0 2024-09-17T01:41:40.495 INFO:tasks.workunit.client.1.smithi167.stdout:7/907: dwrite d0/d2/f7a [0,4194304] 0 2024-09-17T01:41:40.499 INFO:tasks.workunit.client.0.smithi082.stdout:7/562: dwrite d0/d3/db/d10/d47/f6c [4194304,4194304] 0 2024-09-17T01:41:40.500 INFO:tasks.workunit.client.1.smithi167.stdout:0/969: rename d5/d6b/d77/d6d/d90/dc4/de3/f119 to d5/d6b/d77/d4d/d56/d108/f141 0 2024-09-17T01:41:40.503 INFO:tasks.workunit.client.1.smithi167.stdout:4/931: creat d0/d4/d69/d131/d10/d70/f13f x:0 0 0 2024-09-17T01:41:40.503 INFO:tasks.workunit.client.0.smithi082.stdout:3/445: truncate d9/db/d26/f3a 788202 0 2024-09-17T01:41:40.504 INFO:tasks.workunit.client.1.smithi167.stdout:0/970: dread d5/d6b/d77/d37/d45/f8c [0,4194304] 0 2024-09-17T01:41:40.506 INFO:tasks.workunit.client.1.smithi167.stdout:2/955: link d5/d3c/d4c/de2/d45/d6b/l126 d5/d33/d48/d72/l149 0 2024-09-17T01:41:40.508 INFO:tasks.workunit.client.1.smithi167.stdout:0/971: dread d5/d6b/d77/d37/d80/fbd [0,4194304] 0 2024-09-17T01:41:40.509 INFO:tasks.workunit.client.0.smithi082.stdout:6/604: write d1/d7/d10/d4f/dc/d1d/d36/f91 [860702,130548] 0 2024-09-17T01:41:40.510 INFO:tasks.workunit.client.1.smithi167.stdout:0/972: write d5/d6b/d77/d92/fea [3105482,94944] 0 2024-09-17T01:41:40.511 INFO:tasks.workunit.client.0.smithi082.stdout:3/446: symlink d9/d35/d71/d69/d79/d86/l9a 0 2024-09-17T01:41:40.511 INFO:tasks.workunit.client.1.smithi167.stdout:0/973: chown d5/d6b/d77/d4d/cda 6515798 1 2024-09-17T01:41:40.513 INFO:tasks.workunit.client.1.smithi167.stdout:0/974: dread d5/d6b/d77/d37/d80/fbd [0,4194304] 0 2024-09-17T01:41:40.514 INFO:tasks.workunit.client.1.smithi167.stdout:0/975: chown d5/d6b/d77/d6d/d90/d125/f13d 31295495 1 2024-09-17T01:41:40.514 INFO:tasks.workunit.client.1.smithi167.stdout:7/908: mknod d0/d2/d14/d19/d26/d83/c133 0 2024-09-17T01:41:40.515 INFO:tasks.workunit.client.1.smithi167.stdout:7/909: chown d0/d2/d14/d19/d26/l76 18494 1 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:6/605: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fde x:0 0 0 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/501: sync 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:2/546: sync 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:1/598: sync 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:5/589: sync 2024-09-17T01:41:40.516 INFO:tasks.workunit.client.0.smithi082.stdout:8/479: sync 2024-09-17T01:41:40.517 INFO:tasks.workunit.client.0.smithi082.stdout:8/480: write d3/f74 [539548,92788] 0 2024-09-17T01:41:40.517 INFO:tasks.workunit.client.0.smithi082.stdout:1/599: chown d2/d3f/d24 1 1 2024-09-17T01:41:40.517 INFO:tasks.workunit.client.0.smithi082.stdout:3/447: unlink d9/d35/f4b 0 2024-09-17T01:41:40.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/448: stat d9/d35/d71/f75 0 2024-09-17T01:41:40.519 INFO:tasks.workunit.client.1.smithi167.stdout:4/932: mkdir d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/d140 0 2024-09-17T01:41:40.520 INFO:tasks.workunit.client.0.smithi082.stdout:3/449: chown d9/db/f37 4 1 2024-09-17T01:41:40.522 INFO:tasks.workunit.client.1.smithi167.stdout:0/976: dwrite d5/d6b/d77/d6d/d90/dc4/f104 [0,4194304] 0 2024-09-17T01:41:40.525 INFO:tasks.workunit.client.0.smithi082.stdout:4/502: creat d9/d2b/faa x:0 0 0 2024-09-17T01:41:40.527 INFO:tasks.workunit.client.0.smithi082.stdout:4/503: stat d9/f14 0 2024-09-17T01:41:40.528 INFO:tasks.workunit.client.1.smithi167.stdout:4/933: dwrite d0/d4/d69/d131/dff/f139 [0,4194304] 0 2024-09-17T01:41:40.529 INFO:tasks.workunit.client.0.smithi082.stdout:6/606: creat d1/d7/d10/d4f/d32/fdf x:0 0 0 2024-09-17T01:41:40.530 INFO:tasks.workunit.client.0.smithi082.stdout:8/481: dread d3/dd/d18/d51/f6f [0,4194304] 0 2024-09-17T01:41:40.530 INFO:tasks.workunit.client.0.smithi082.stdout:4/504: chown d9/d15/d16/l3b 29978983 1 2024-09-17T01:41:40.531 INFO:tasks.workunit.client.1.smithi167.stdout:4/934: fdatasync d0/f3 0 2024-09-17T01:41:40.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/600: dwrite d2/da/fb2 [0,4194304] 0 2024-09-17T01:41:40.535 INFO:tasks.workunit.client.0.smithi082.stdout:5/590: mkdir db/d1e/d5b/db7 0 2024-09-17T01:41:40.542 INFO:tasks.workunit.client.0.smithi082.stdout:7/563: truncate d0/dd/f1f 836256 0 2024-09-17T01:41:40.545 INFO:tasks.workunit.client.0.smithi082.stdout:1/601: mknod d2/da/d76/cc0 0 2024-09-17T01:41:40.546 INFO:tasks.workunit.client.0.smithi082.stdout:5/591: dwrite db/d2b/f36 [0,4194304] 0 2024-09-17T01:41:40.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/482: creat d3/dd/d18/d2d/d3e/d4a/d6a/f99 x:0 0 0 2024-09-17T01:41:40.549 INFO:tasks.workunit.client.0.smithi082.stdout:4/505: mkdir d9/d15/d16/d3e/d54/dab 0 2024-09-17T01:41:40.551 INFO:tasks.workunit.client.1.smithi167.stdout:2/956: dwrite d5/d3c/d4c/de2/d45/d8e/d98/dfa/f29 [0,4194304] 0 2024-09-17T01:41:40.554 INFO:tasks.workunit.client.0.smithi082.stdout:6/607: stat d1/d7/d10/f38 0 2024-09-17T01:41:40.557 INFO:tasks.workunit.client.0.smithi082.stdout:3/450: symlink d9/db/d49/d4e/d53/d5b/d8e/l9b 0 2024-09-17T01:41:40.558 INFO:tasks.workunit.client.1.smithi167.stdout:7/910: dread d0/d2/d14/d23/f38 [0,4194304] 0 2024-09-17T01:41:40.559 INFO:tasks.workunit.client.0.smithi082.stdout:7/564: dwrite d0/d3/f2b [0,4194304] 0 2024-09-17T01:41:40.561 INFO:tasks.workunit.client.1.smithi167.stdout:0/977: rename d5/d6b/d77/d37/d80/fbd to d5/d6b/d77/f142 0 2024-09-17T01:41:40.565 INFO:tasks.workunit.client.1.smithi167.stdout:7/911: dwrite d0/d2/d14/d19/d26/d11c/f11f [0,4194304] 0 2024-09-17T01:41:40.566 INFO:tasks.workunit.client.1.smithi167.stdout:7/912: chown d0/d2/d14/d19/d26/d11c/f11f 27231172 1 2024-09-17T01:41:40.566 INFO:tasks.workunit.client.0.smithi082.stdout:5/592: dwrite db/d1e/d20/d4d/f97 [0,4194304] 0 2024-09-17T01:41:40.566 INFO:tasks.workunit.client.0.smithi082.stdout:1/602: mkdir d2/d3f/d24/dc1 0 2024-09-17T01:41:40.566 INFO:tasks.workunit.client.0.smithi082.stdout:5/593: write db/d56/f35 [4713241,11189] 0 2024-09-17T01:41:40.570 INFO:tasks.workunit.client.1.smithi167.stdout:2/957: creat d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f/f14a x:0 0 0 2024-09-17T01:41:40.573 INFO:tasks.workunit.client.0.smithi082.stdout:8/483: unlink d3/dd/d18/f8f 0 2024-09-17T01:41:40.575 INFO:tasks.workunit.client.1.smithi167.stdout:4/935: rmdir d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad/d11b 0 2024-09-17T01:41:40.579 INFO:tasks.workunit.client.0.smithi082.stdout:4/506: creat d9/d15/d16/d3e/d54/fac x:0 0 0 2024-09-17T01:41:40.580 INFO:tasks.workunit.client.0.smithi082.stdout:4/507: read d9/d47/f79 [2936694,123620] 0 2024-09-17T01:41:40.580 INFO:tasks.workunit.client.1.smithi167.stdout:7/913: truncate d0/d2/f9d 957899 0 2024-09-17T01:41:40.582 INFO:tasks.workunit.client.1.smithi167.stdout:2/958: fsync d5/d6d/fdb 0 2024-09-17T01:41:40.584 INFO:tasks.workunit.client.1.smithi167.stdout:4/936: rmdir d0/d4/d69/d131/dff 39 2024-09-17T01:41:40.585 INFO:tasks.workunit.client.0.smithi082.stdout:7/565: creat d0/dd/d2c/d55/fbf x:0 0 0 2024-09-17T01:41:40.585 INFO:tasks.workunit.client.1.smithi167.stdout:4/937: stat d0/d4/d69/d13e/d7e/d92/d6a/c76 0 2024-09-17T01:41:40.585 INFO:tasks.workunit.client.1.smithi167.stdout:0/978: mknod d5/d6b/d77/d37/d45/d112/c143 0 2024-09-17T01:41:40.586 INFO:tasks.workunit.client.1.smithi167.stdout:4/938: chown d0/d4/d69/d13e/d7e/d92/d5a/de1/ff6 1348936 1 2024-09-17T01:41:40.587 INFO:tasks.workunit.client.1.smithi167.stdout:2/959: fsync d5/d6d/ff5 0 2024-09-17T01:41:40.588 INFO:tasks.workunit.client.0.smithi082.stdout:8/484: truncate d3/f33 1066542 0 2024-09-17T01:41:40.590 INFO:tasks.workunit.client.1.smithi167.stdout:0/979: read d5/d6b/d7e/f86 [50667,50394] 0 2024-09-17T01:41:40.593 INFO:tasks.workunit.client.0.smithi082.stdout:7/566: mknod d0/dd/d2c/cc0 0 2024-09-17T01:41:40.596 INFO:tasks.workunit.client.0.smithi082.stdout:8/485: dwrite d3/dd/d18/d2d/d3e/d4a/f96 [0,4194304] 0 2024-09-17T01:41:40.597 INFO:tasks.workunit.client.1.smithi167.stdout:0/980: mkdir d5/d6b/d77/d4d/d56/d108/d118/d144 0 2024-09-17T01:41:40.597 INFO:tasks.workunit.client.1.smithi167.stdout:2/960: dwrite d5/d71/dc7/f119 [0,4194304] 0 2024-09-17T01:41:40.597 INFO:tasks.workunit.client.0.smithi082.stdout:7/567: write d0/d3/d36/d37/d86/fb1 [1710500,91033] 0 2024-09-17T01:41:40.599 INFO:tasks.workunit.client.1.smithi167.stdout:2/961: write d5/d3c/d4c/d4d/d91/d13d/f13f [703114,116299] 0 2024-09-17T01:41:40.601 INFO:tasks.workunit.client.1.smithi167.stdout:7/914: getdents d0/d2 0 2024-09-17T01:41:40.603 INFO:tasks.workunit.client.1.smithi167.stdout:5/984: sync 2024-09-17T01:41:40.603 INFO:tasks.workunit.client.1.smithi167.stdout:0/981: readlink d5/d6b/dd1/ldd 0 2024-09-17T01:41:40.605 INFO:tasks.workunit.client.1.smithi167.stdout:5/985: truncate d0/d24/d2b/f115 1042147 0 2024-09-17T01:41:40.606 INFO:tasks.workunit.client.0.smithi082.stdout:8/486: dwrite d3/f20 [0,4194304] 0 2024-09-17T01:41:40.607 INFO:tasks.workunit.client.1.smithi167.stdout:2/962: unlink d5/d3c/d4c/d4d/fa6 0 2024-09-17T01:41:40.609 INFO:tasks.workunit.client.1.smithi167.stdout:5/986: dread d0/d24/d2b/d49/d4b/dac/d3a/d4d/fad [4194304,4194304] 0 2024-09-17T01:41:40.611 INFO:tasks.workunit.client.0.smithi082.stdout:3/451: rename d9/db/d49/d4e/d53/d5b/d8e to d9/d35/d71/d69/d9c 0 2024-09-17T01:41:40.613 INFO:tasks.workunit.client.1.smithi167.stdout:7/915: creat d0/d2/d88/f134 x:0 0 0 2024-09-17T01:41:40.614 INFO:tasks.workunit.client.0.smithi082.stdout:3/452: write d9/db/f13 [8580292,124871] 0 2024-09-17T01:41:40.615 INFO:tasks.workunit.client.1.smithi167.stdout:0/982: creat d5/d6b/d77/d4d/dfa/f145 x:0 0 0 2024-09-17T01:41:40.616 INFO:tasks.workunit.client.1.smithi167.stdout:0/983: chown d5/d6b/d77/d37/lba 7607438 1 2024-09-17T01:41:40.617 INFO:tasks.workunit.client.1.smithi167.stdout:2/963: symlink d5/d3c/d4c/de2/d45/d8e/df4/l14b 0 2024-09-17T01:41:40.618 INFO:tasks.workunit.client.0.smithi082.stdout:8/487: dwrite d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e [0,4194304] 0 2024-09-17T01:41:40.618 INFO:tasks.workunit.client.1.smithi167.stdout:0/984: write d5/d6b/d77/d37/f65 [2354363,85388] 0 2024-09-17T01:41:40.621 INFO:tasks.workunit.client.1.smithi167.stdout:5/987: write d0/d24/d2b/d3d/d3b/f5c [579263,63413] 0 2024-09-17T01:41:40.623 INFO:tasks.workunit.client.0.smithi082.stdout:5/594: rename db/d56/d29/f68 to db/d1e/d5b/fb8 0 2024-09-17T01:41:40.627 INFO:tasks.workunit.client.1.smithi167.stdout:0/985: mknod d5/d8/d5c/c146 0 2024-09-17T01:41:40.631 INFO:tasks.workunit.client.1.smithi167.stdout:5/988: truncate d0/d24/d2b/d49/d4b/dac/fc9 2798358 0 2024-09-17T01:41:40.632 INFO:tasks.workunit.client.0.smithi082.stdout:6/608: write d1/d7/d10/d4f/dc/d1d/d36/f67 [2593311,116538] 0 2024-09-17T01:41:40.633 INFO:tasks.workunit.client.0.smithi082.stdout:8/488: dread - d3/dd/d18/d3a/f46 zero size 2024-09-17T01:41:40.634 INFO:tasks.workunit.client.1.smithi167.stdout:5/989: dread d0/d54/f76 [0,4194304] 0 2024-09-17T01:41:40.635 INFO:tasks.workunit.client.0.smithi082.stdout:8/489: fdatasync d3/dd/d18/d2d/d58/f83 0 2024-09-17T01:41:40.642 INFO:tasks.workunit.client.1.smithi167.stdout:7/916: creat d0/d2/d14/f135 x:0 0 0 2024-09-17T01:41:40.643 INFO:tasks.workunit.client.0.smithi082.stdout:6/609: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fce [0,4194304] 0 2024-09-17T01:41:40.644 INFO:tasks.workunit.client.0.smithi082.stdout:1/603: write d2/d3f/d24/f81 [1346153,73064] 0 2024-09-17T01:41:40.644 INFO:tasks.workunit.client.1.smithi167.stdout:5/990: dread - d0/d24/f83 zero size 2024-09-17T01:41:40.646 INFO:tasks.workunit.client.1.smithi167.stdout:4/939: dwrite d0/d4/d69/d131/da/d10e/d2d/d2e/f34 [0,4194304] 0 2024-09-17T01:41:40.646 INFO:tasks.workunit.client.1.smithi167.stdout:2/964: dread d5/d3c/d4c/de2/db8/da3/db0/ffd [0,4194304] 0 2024-09-17T01:41:40.647 INFO:tasks.workunit.client.0.smithi082.stdout:4/508: dwrite d9/d15/d16/d18/d4a/d8f/d91/f95 [0,4194304] 0 2024-09-17T01:41:40.648 INFO:tasks.workunit.client.0.smithi082.stdout:6/610: fdatasync d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/f82 0 2024-09-17T01:41:40.648 INFO:tasks.workunit.client.1.smithi167.stdout:2/965: dread - d5/d3c/d4c/de2/d45/d8e/d98/dca/fd9 zero size 2024-09-17T01:41:40.654 INFO:tasks.workunit.client.0.smithi082.stdout:7/568: write d0/d50/fb6 [2928552,104620] 0 2024-09-17T01:41:40.658 INFO:tasks.workunit.client.0.smithi082.stdout:4/509: dwrite d9/d2b/faa [0,4194304] 0 2024-09-17T01:41:40.662 INFO:tasks.workunit.client.1.smithi167.stdout:1/985: sync 2024-09-17T01:41:40.663 INFO:tasks.workunit.client.1.smithi167.stdout:7/917: rename d0/d2/d88/d6e/da3/dd0/c50 to d0/d2/d14/d6f/c136 0 2024-09-17T01:41:40.670 INFO:tasks.workunit.client.1.smithi167.stdout:0/986: write d5/d6b/d77/d4d/d56/d7b/fdb [84668,123755] 0 2024-09-17T01:41:40.671 INFO:tasks.workunit.client.0.smithi082.stdout:3/453: dwrite d9/db/f11 [0,4194304] 0 2024-09-17T01:41:40.672 INFO:tasks.workunit.client.0.smithi082.stdout:3/454: dread - d9/f6f zero size 2024-09-17T01:41:40.672 INFO:tasks.workunit.client.1.smithi167.stdout:2/966: rename d5/d3c/d4c/de2/d45/d8e/f64 to d5/d33/d48/d72/f14c 0 2024-09-17T01:41:40.673 INFO:tasks.workunit.client.1.smithi167.stdout:0/987: fdatasync d5/d6b/d77/d6d/f102 0 2024-09-17T01:41:40.674 INFO:tasks.workunit.client.1.smithi167.stdout:7/918: rmdir d0/d2/d14/d6f 39 2024-09-17T01:41:40.677 INFO:tasks.workunit.client.1.smithi167.stdout:5/991: creat d0/d9/f130 x:0 0 0 2024-09-17T01:41:40.684 INFO:tasks.workunit.client.1.smithi167.stdout:7/919: unlink d0/fbe 0 2024-09-17T01:41:40.686 INFO:tasks.workunit.client.1.smithi167.stdout:5/992: symlink d0/d24/d2b/d3d/d6d/de6/l131 0 2024-09-17T01:41:40.687 INFO:tasks.workunit.client.1.smithi167.stdout:2/967: symlink d5/d71/l14d 0 2024-09-17T01:41:40.689 INFO:tasks.workunit.client.1.smithi167.stdout:1/986: write d0/d9/d16/d48/d54/d78/f9f [1814823,20995] 0 2024-09-17T01:41:40.690 INFO:tasks.workunit.client.1.smithi167.stdout:4/940: dread d0/d4/d69/d131/da/f6e [0,4194304] 0 2024-09-17T01:41:40.693 INFO:tasks.workunit.client.1.smithi167.stdout:5/993: rename d0/d24/d2b/d49/d4b/dac/d3a to d0/d24/d2b/d3d/d6d/de6/d132 0 2024-09-17T01:41:40.695 INFO:tasks.workunit.client.1.smithi167.stdout:2/968: symlink d5/d3c/d4c/de2/db8/d5e/d103/d11a/l14e 0 2024-09-17T01:41:40.710 INFO:tasks.workunit.client.1.smithi167.stdout:5/994: dread d0/d24/d2b/d3d/d6d/de6/d132/f7d [0,4194304] 0 2024-09-17T01:41:40.806 INFO:tasks.workunit.client.1.smithi167.stdout:0/988: sync 2024-09-17T01:41:40.806 INFO:tasks.workunit.client.1.smithi167.stdout:0/989: readlink d5/d8/d9/d2f/d9b/lf2 0 2024-09-17T01:41:40.822 INFO:tasks.workunit.client.1.smithi167.stdout:7/920: link d0/d2/d14/f18 d0/d2/d14/d23/f137 0 2024-09-17T01:41:40.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/490: unlink d3/dd/d18/d2d/d3e/c52 0 2024-09-17T01:41:40.825 INFO:tasks.workunit.client.1.smithi167.stdout:1/987: rename d0/d5/dbf/ddb/cf0 to d0/d5/d34/d83/d112/c141 0 2024-09-17T01:41:40.830 INFO:tasks.workunit.client.1.smithi167.stdout:5/995: creat d0/d24/d2b/d3d/d6d/de6/d132/d4d/dfb/f133 x:0 0 0 2024-09-17T01:41:40.831 INFO:tasks.workunit.client.1.smithi167.stdout:7/921: dread - d0/d2/d14/d19/d32/d62/fd3 zero size 2024-09-17T01:41:40.834 INFO:tasks.workunit.client.1.smithi167.stdout:1/988: symlink d0/d9/d16/d22/l142 0 2024-09-17T01:41:40.838 INFO:tasks.workunit.client.1.smithi167.stdout:4/941: dwrite d0/d4/d69/d131/d6/d5d/fbd [0,4194304] 0 2024-09-17T01:41:40.841 INFO:tasks.workunit.client.1.smithi167.stdout:1/989: fdatasync d0/d5/d61/da2/fd6 0 2024-09-17T01:41:40.849 INFO:tasks.workunit.client.1.smithi167.stdout:7/922: fdatasync d0/d2/d14/d6f/fe0 0 2024-09-17T01:41:40.851 INFO:tasks.workunit.client.0.smithi082.stdout:4/510: write d9/d2b/f7b [2850515,71523] 0 2024-09-17T01:41:40.853 INFO:tasks.workunit.client.1.smithi167.stdout:0/990: rename d5/d8/d9/lb5 to d5/d6b/d77/l147 0 2024-09-17T01:41:40.853 INFO:tasks.workunit.client.1.smithi167.stdout:1/990: dread d0/d5/d34/d6d/fe0 [0,4194304] 0 2024-09-17T01:41:40.854 INFO:tasks.workunit.client.1.smithi167.stdout:4/942: rmdir d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad 39 2024-09-17T01:41:40.854 INFO:tasks.workunit.client.1.smithi167.stdout:5/996: write d0/d24/d2b/d49/d4b/f55 [3433238,24057] 0 2024-09-17T01:41:40.855 INFO:tasks.workunit.client.1.smithi167.stdout:2/969: sync 2024-09-17T01:41:40.857 INFO:tasks.workunit.client.1.smithi167.stdout:7/923: chown d0/f4f 13231 1 2024-09-17T01:41:40.858 INFO:tasks.workunit.client.0.smithi082.stdout:3/455: symlink d9/d35/d63/l9d 0 2024-09-17T01:41:40.858 INFO:tasks.workunit.client.0.smithi082.stdout:3/456: stat d9/db/d6d/c7e 0 2024-09-17T01:41:40.859 INFO:tasks.workunit.client.1.smithi167.stdout:0/991: unlink d5/d6b/d77/d37/f65 0 2024-09-17T01:41:40.859 INFO:tasks.workunit.client.0.smithi082.stdout:3/457: readlink d9/d35/d63/l9d 0 2024-09-17T01:41:40.861 INFO:tasks.workunit.client.0.smithi082.stdout:4/511: symlink d9/d15/d16/d18/d4a/d52/lad 0 2024-09-17T01:41:40.863 INFO:tasks.workunit.client.1.smithi167.stdout:2/970: dread - d5/feb zero size 2024-09-17T01:41:40.864 INFO:tasks.workunit.client.0.smithi082.stdout:1/604: rename d2/df/f70 to d2/da/d2f/fc2 0 2024-09-17T01:41:40.866 INFO:tasks.workunit.client.1.smithi167.stdout:5/997: rename d0/d24/d2b/d3d/d3b/db0/db5 to d0/d54/d56/d134 0 2024-09-17T01:41:40.866 INFO:tasks.workunit.client.0.smithi082.stdout:1/605: chown d2/d3f/d34/la2 93236197 1 2024-09-17T01:41:40.866 INFO:tasks.workunit.client.0.smithi082.stdout:8/491: dwrite d3/dd/d18/d34/f4f [0,4194304] 0 2024-09-17T01:41:40.867 INFO:tasks.workunit.client.0.smithi082.stdout:8/492: readlink d3/dd/d18/d2d/d3e/d4a/d6a/l80 0 2024-09-17T01:41:40.867 INFO:tasks.workunit.client.0.smithi082.stdout:7/569: link d0/d3/d36/d37/l67 d0/dd/d34/d58/d6e/d8a/lc1 0 2024-09-17T01:41:40.870 INFO:tasks.workunit.client.1.smithi167.stdout:7/924: fdatasync d0/d2/d14/d19/d32/d62/fd3 0 2024-09-17T01:41:40.870 INFO:tasks.workunit.client.0.smithi082.stdout:5/595: link db/d56/d29/d4f/f53 db/d1e/fb9 0 2024-09-17T01:41:40.872 INFO:tasks.workunit.client.0.smithi082.stdout:3/458: rename d9/db/f18 to d9/db/d26/f9e 0 2024-09-17T01:41:40.873 INFO:tasks.workunit.client.0.smithi082.stdout:3/459: chown d9/db/d26/f96 137963 1 2024-09-17T01:41:40.874 INFO:tasks.workunit.client.0.smithi082.stdout:3/460: chown d9/db/d49/d4e/d53/f62 2 1 2024-09-17T01:41:40.874 INFO:tasks.workunit.client.0.smithi082.stdout:6/611: getdents d1/d7/d10/d4f/dc/d99/dbb 0 2024-09-17T01:41:40.875 INFO:tasks.workunit.client.0.smithi082.stdout:9/497: sync 2024-09-17T01:41:40.875 INFO:tasks.workunit.client.1.smithi167.stdout:0/992: read d5/d8/d9/f3f [419170,60386] 0 2024-09-17T01:41:40.876 INFO:tasks.workunit.client.1.smithi167.stdout:1/991: dread d0/d5/d34/d83/d112/f2b [4194304,4194304] 0 2024-09-17T01:41:40.879 INFO:tasks.workunit.client.1.smithi167.stdout:5/998: mkdir d0/d24/d2b/d3d/d3b/d5f/d135 0 2024-09-17T01:41:40.881 INFO:tasks.workunit.client.0.smithi082.stdout:4/512: symlink d9/d15/d16/d18/d4a/lae 0 2024-09-17T01:41:40.884 INFO:tasks.workunit.client.1.smithi167.stdout:7/925: fdatasync d0/d2/d14/d19/d7f/fce 0 2024-09-17T01:41:40.888 INFO:tasks.workunit.client.1.smithi167.stdout:7/926: dread - d0/d2/d14/d19/d7f/db4/dbf/f127 zero size 2024-09-17T01:41:40.888 INFO:tasks.workunit.client.1.smithi167.stdout:2/971: write d5/d3c/d4c/de2/d45/d8e/d98/dfa/f1b [3775666,24855] 0 2024-09-17T01:41:40.891 INFO:tasks.workunit.client.1.smithi167.stdout:4/943: truncate d0/d4/d69/d13e/d7e/d92/d5a/de1/ff6 133584 0 2024-09-17T01:41:40.893 INFO:tasks.workunit.client.0.smithi082.stdout:9/498: creat d4/d27/d36/fab x:0 0 0 2024-09-17T01:41:40.895 INFO:tasks.workunit.client.0.smithi082.stdout:6/612: dread - d1/d7/d10/d4f/d32/f97 zero size 2024-09-17T01:41:40.896 INFO:tasks.workunit.client.1.smithi167.stdout:7/927: symlink d0/d2/d88/d6e/dd8/l138 0 2024-09-17T01:41:40.897 INFO:tasks.workunit.client.0.smithi082.stdout:1/606: dwrite d2/da/d16/f8f [4194304,4194304] 0 2024-09-17T01:41:40.898 INFO:tasks.workunit.client.0.smithi082.stdout:6/613: write d1/d7/d10/d4f/fb [2770014,101489] 0 2024-09-17T01:41:40.898 INFO:tasks.workunit.client.1.smithi167.stdout:1/992: write d0/d5/d61/fac [39139,77550] 0 2024-09-17T01:41:40.898 INFO:tasks.workunit.client.1.smithi167.stdout:1/993: chown d0/d5/dd7/l11a 46 1 2024-09-17T01:41:40.899 INFO:tasks.workunit.client.1.smithi167.stdout:2/972: rmdir d5/d3c/d4c/de2/db8/d5e 39 2024-09-17T01:41:40.900 INFO:tasks.workunit.client.0.smithi082.stdout:6/614: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7 0 1 2024-09-17T01:41:40.901 INFO:tasks.workunit.client.0.smithi082.stdout:8/493: rename d3/dd/d18/d2d/d3b/l62 to d3/dd/d18/d2d/d3e/d4a/d66/d7b/l9a 0 2024-09-17T01:41:40.901 INFO:tasks.workunit.client.1.smithi167.stdout:0/993: dwrite d5/f83 [0,4194304] 0 2024-09-17T01:41:40.908 INFO:tasks.workunit.client.0.smithi082.stdout:7/570: truncate d0/d3/d36/d37/d71/f94 198066 0 2024-09-17T01:41:40.909 INFO:tasks.workunit.client.0.smithi082.stdout:7/571: dread d0/d3/f5e [0,4194304] 0 2024-09-17T01:41:40.910 INFO:tasks.workunit.client.0.smithi082.stdout:7/572: write d0/dd/f17 [977622,103358] 0 2024-09-17T01:41:40.911 INFO:tasks.workunit.client.1.smithi167.stdout:2/973: rmdir d5/d3c/d4c/de2/d45/d6b/d134/d139 39 2024-09-17T01:41:40.914 INFO:tasks.workunit.client.1.smithi167.stdout:4/944: rename d0/d4/d69/d131/fec to d0/d4/d69/d131/dff/f141 0 2024-09-17T01:41:40.916 INFO:tasks.workunit.client.1.smithi167.stdout:5/999: creat d0/d24/d2b/d49/f136 x:0 0 0 2024-09-17T01:41:40.916 INFO:tasks.workunit.client.0.smithi082.stdout:8/494: write d3/dd/d18/d2d/d3e/d4a/d66/f77 [2387441,57186] 0 2024-09-17T01:41:40.917 INFO:tasks.workunit.client.1.smithi167.stdout:1/994: dwrite d0/d5/f11c [0,4194304] 0 2024-09-17T01:41:40.920 INFO:tasks.workunit.client.0.smithi082.stdout:1/607: mknod d2/da/cc3 0 2024-09-17T01:41:40.920 INFO:tasks.workunit.client.0.smithi082.stdout:1/608: chown d2/d3f/d24/f68 948789 1 2024-09-17T01:41:40.921 INFO:tasks.workunit.client.0.smithi082.stdout:7/573: symlink d0/d62/d7e/lc2 0 2024-09-17T01:41:40.922 INFO:tasks.workunit.client.0.smithi082.stdout:5/596: getdents db/d56/d78 0 2024-09-17T01:41:40.925 INFO:tasks.workunit.client.1.smithi167.stdout:7/928: rename d0/d2/d14/d19/d22/d40 to d0/d2/d14/d6f/d139 0 2024-09-17T01:41:40.925 INFO:tasks.workunit.client.0.smithi082.stdout:3/461: getdents d9/d35/d71 0 2024-09-17T01:41:40.926 INFO:tasks.workunit.client.0.smithi082.stdout:9/499: creat d4/d27/d2d/d60/d11/d39/d29/fac x:0 0 0 2024-09-17T01:41:40.928 INFO:tasks.workunit.client.0.smithi082.stdout:9/500: read - d4/d27/d2d/d60/d11/d39/d29/d6d/fa1 zero size 2024-09-17T01:41:40.929 INFO:tasks.workunit.client.0.smithi082.stdout:7/574: mknod d0/d3/db/d10/d3f/cc3 0 2024-09-17T01:41:40.930 INFO:tasks.workunit.client.0.smithi082.stdout:5/597: mkdir db/d56/d78/dba 0 2024-09-17T01:41:40.930 INFO:tasks.workunit.client.0.smithi082.stdout:9/501: chown d4/d27/d2d/d60/d11/d39/d31/f40 442495 1 2024-09-17T01:41:40.930 INFO:tasks.workunit.client.0.smithi082.stdout:5/598: chown db/f9d 182512971 1 2024-09-17T01:41:40.932 INFO:tasks.workunit.client.0.smithi082.stdout:4/513: rename d9/d15/d37/f68 to d9/d15/d16/d18/d4a/faf 0 2024-09-17T01:41:40.934 INFO:tasks.workunit.client.0.smithi082.stdout:7/575: mknod d0/d3/db/cc4 0 2024-09-17T01:41:40.935 INFO:tasks.workunit.client.0.smithi082.stdout:6/615: rename d1/d7/d10/d4f/dc/d2b/d48/c81 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/ce0 0 2024-09-17T01:41:40.939 INFO:tasks.workunit.client.0.smithi082.stdout:5/599: creat db/d1e/d5b/db7/fbb x:0 0 0 2024-09-17T01:41:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:2/547: sync 2024-09-17T01:41:40.940 INFO:tasks.workunit.client.0.smithi082.stdout:0/411: sync 2024-09-17T01:41:40.941 INFO:tasks.workunit.client.0.smithi082.stdout:7/576: chown d0/dd/f1f 894550164 1 2024-09-17T01:41:40.942 INFO:tasks.workunit.client.0.smithi082.stdout:6/616: fsync d1/d7/d10/f4a 0 2024-09-17T01:41:40.942 INFO:tasks.workunit.client.0.smithi082.stdout:2/548: write d1/d17/d60/fb4 [157405,88950] 0 2024-09-17T01:41:40.943 INFO:tasks.workunit.client.0.smithi082.stdout:3/462: link f0 d9/d35/f9f 0 2024-09-17T01:41:40.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/617: readlink d1/d1f/da7/ddd/lb4 0 2024-09-17T01:41:40.946 INFO:tasks.workunit.client.0.smithi082.stdout:1/609: getdents d2/da/d2d 0 2024-09-17T01:41:40.947 INFO:tasks.workunit.client.0.smithi082.stdout:5/600: rmdir db/da7 39 2024-09-17T01:41:40.948 INFO:tasks.workunit.client.1.smithi167.stdout:2/974: write d5/d3c/d4c/de2/db8/f53 [783261,74993] 0 2024-09-17T01:41:40.949 INFO:tasks.workunit.client.1.smithi167.stdout:0/994: dwrite d5/d8/d5c/fd0 [0,4194304] 0 2024-09-17T01:41:40.951 INFO:tasks.workunit.client.0.smithi082.stdout:9/502: dread d4/f57 [4194304,4194304] 0 2024-09-17T01:41:40.952 INFO:tasks.workunit.client.0.smithi082.stdout:2/549: dwrite d1/d17/d29/d50/fa5 [0,4194304] 0 2024-09-17T01:41:40.954 INFO:tasks.workunit.client.1.smithi167.stdout:1/995: write d0/d5/d34/d83/d112/f89 [295017,123627] 0 2024-09-17T01:41:40.958 INFO:tasks.workunit.client.1.smithi167.stdout:1/996: read d0/f2e [3922827,1785] 0 2024-09-17T01:41:40.959 INFO:tasks.workunit.client.0.smithi082.stdout:6/618: fdatasync d1/d3/f7b 0 2024-09-17T01:41:40.959 INFO:tasks.workunit.client.1.smithi167.stdout:4/945: dwrite d0/d4/d69/d131/f26 [0,4194304] 0 2024-09-17T01:41:40.963 INFO:tasks.workunit.client.1.smithi167.stdout:2/975: creat d5/d3c/d4c/de2/db8/d5e/d103/d11a/f14f x:0 0 0 2024-09-17T01:41:40.963 INFO:tasks.workunit.client.0.smithi082.stdout:8/495: rename d3/dd/c22 to d3/dd/d18/c9b 0 2024-09-17T01:41:40.964 INFO:tasks.workunit.client.1.smithi167.stdout:4/946: write d0/d4/d69/d13e/d7e/da8/f100 [2327506,7349] 0 2024-09-17T01:41:40.967 INFO:tasks.workunit.client.1.smithi167.stdout:1/997: mknod d0/d5/dd7/d102/de7/c143 0 2024-09-17T01:41:40.968 INFO:tasks.workunit.client.0.smithi082.stdout:0/412: creat da/d80/d77/f91 x:0 0 0 2024-09-17T01:41:40.969 INFO:tasks.workunit.client.1.smithi167.stdout:7/929: dwrite d0/d2/d14/d19/d26/fc0 [0,4194304] 0 2024-09-17T01:41:40.972 INFO:tasks.workunit.client.1.smithi167.stdout:1/998: write d0/d5/d34/d83/fd5 [418653,29786] 0 2024-09-17T01:41:40.972 INFO:tasks.workunit.client.1.smithi167.stdout:4/947: write d0/d4/d69/d131/f26 [2211732,114085] 0 2024-09-17T01:41:40.974 INFO:tasks.workunit.client.1.smithi167.stdout:2/976: creat d5/d33/f150 x:0 0 0 2024-09-17T01:41:40.975 INFO:tasks.workunit.client.0.smithi082.stdout:7/577: write d0/d3/db/f14 [1007097,104619] 0 2024-09-17T01:41:40.978 INFO:tasks.workunit.client.1.smithi167.stdout:0/995: write d5/d6b/d77/d92/fb4 [75135,33630] 0 2024-09-17T01:41:40.979 INFO:tasks.workunit.client.0.smithi082.stdout:4/514: getdents d9/d15/d16 0 2024-09-17T01:41:40.981 INFO:tasks.workunit.client.0.smithi082.stdout:2/550: creat d1/d90/fb9 x:0 0 0 2024-09-17T01:41:40.981 INFO:tasks.workunit.client.1.smithi167.stdout:1/999: symlink d0/d9/d16/d22/l144 0 2024-09-17T01:41:40.982 INFO:tasks.workunit.client.0.smithi082.stdout:2/551: readlink d1/d35/db1/lb6 0 2024-09-17T01:41:40.983 INFO:tasks.workunit.client.0.smithi082.stdout:6/619: rmdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7 39 2024-09-17T01:41:40.984 INFO:tasks.workunit.client.0.smithi082.stdout:2/552: chown d1/d10/l81 0 1 2024-09-17T01:41:40.985 INFO:tasks.workunit.client.0.smithi082.stdout:3/463: dwrite d9/db/f85 [0,4194304] 0 2024-09-17T01:41:40.986 INFO:tasks.workunit.client.0.smithi082.stdout:6/620: chown d1/d7/d10/d4f/d32/fc7 158173 1 2024-09-17T01:41:40.987 INFO:tasks.workunit.client.0.smithi082.stdout:1/610: rename d2/df/d46/c6b to d2/df/d46/cc4 0 2024-09-17T01:41:40.988 INFO:tasks.workunit.client.0.smithi082.stdout:1/611: chown d2/da/d2d/l7d 11 1 2024-09-17T01:41:40.989 INFO:tasks.workunit.client.0.smithi082.stdout:6/621: chown d1/d7/d10/d4f/dc/d1d/d36/d56/f70 142098 1 2024-09-17T01:41:40.989 INFO:tasks.workunit.client.1.smithi167.stdout:0/996: rename d5/d6b/d77/d4d/f5a to d5/d8/d9/d2f/d9b/f148 0 2024-09-17T01:41:40.990 INFO:tasks.workunit.client.1.smithi167.stdout:0/997: fdatasync d5/d6b/d77/d6d/d90/ffc 0 2024-09-17T01:41:40.993 INFO:tasks.workunit.client.0.smithi082.stdout:8/496: mknod d3/dd/d18/d2d/d60/c9c 0 2024-09-17T01:41:40.994 INFO:tasks.workunit.client.0.smithi082.stdout:1/612: dwrite d2/d3f/f26 [4194304,4194304] 0 2024-09-17T01:41:40.995 INFO:tasks.workunit.client.1.smithi167.stdout:7/930: mkdir d0/d13a 0 2024-09-17T01:41:40.997 INFO:tasks.workunit.client.0.smithi082.stdout:5/601: mkdir db/d56/d29/d4f/d8e/dbc 0 2024-09-17T01:41:41.002 INFO:tasks.workunit.client.1.smithi167.stdout:2/977: mkdir d5/d3c/d4c/de2/d45/d8e/df4/d151 0 2024-09-17T01:41:41.003 INFO:tasks.workunit.client.1.smithi167.stdout:0/998: creat d5/d6b/d77/d6d/d90/dc4/f149 x:0 0 0 2024-09-17T01:41:41.003 INFO:tasks.workunit.client.1.smithi167.stdout:7/931: dread d0/d2/d14/d19/d26/f78 [0,4194304] 0 2024-09-17T01:41:41.004 INFO:tasks.workunit.client.1.smithi167.stdout:4/948: creat d0/d4/d69/d131/da/d10e/d2d/d2e/f142 x:0 0 0 2024-09-17T01:41:41.006 INFO:tasks.workunit.client.1.smithi167.stdout:2/978: write d5/d3c/d4c/de2/db8/da3/dc8/dea/d11f/f145 [649265,67190] 0 2024-09-17T01:41:41.009 INFO:tasks.workunit.client.0.smithi082.stdout:3/464: creat d9/db/d49/d4e/d53/d5b/fa0 x:0 0 0 2024-09-17T01:41:41.010 INFO:tasks.workunit.client.1.smithi167.stdout:7/932: dwrite d0/d2/d14/d6f/d87/dae/fd4 [4194304,4194304] 0 2024-09-17T01:41:41.011 INFO:tasks.workunit.client.0.smithi082.stdout:2/553: dread d1/d10/f2f [0,4194304] 0 2024-09-17T01:41:41.014 INFO:tasks.workunit.client.0.smithi082.stdout:6/622: truncate d1/d7/f85 225142 0 2024-09-17T01:41:41.016 INFO:tasks.workunit.client.0.smithi082.stdout:6/623: dread d1/d7/d10/d4f/f12 [0,4194304] 0 2024-09-17T01:41:41.017 INFO:tasks.workunit.client.0.smithi082.stdout:8/497: readlink d3/dd/d18/d34/l37 0 2024-09-17T01:41:41.018 INFO:tasks.workunit.client.0.smithi082.stdout:6/624: fsync d1/d7/d10/d4f/fb 0 2024-09-17T01:41:41.023 INFO:tasks.workunit.client.0.smithi082.stdout:1/613: mkdir d2/d3f/d34/dc5 0 2024-09-17T01:41:41.026 INFO:tasks.workunit.client.0.smithi082.stdout:9/503: creat d4/d27/d2d/fad x:0 0 0 2024-09-17T01:41:41.026 INFO:tasks.workunit.client.0.smithi082.stdout:9/504: chown d4/d59/d63 26065 1 2024-09-17T01:41:41.028 INFO:tasks.workunit.client.0.smithi082.stdout:9/505: write d4/d27/d2d/d60/f34 [5609216,121898] 0 2024-09-17T01:41:41.029 INFO:tasks.workunit.client.0.smithi082.stdout:9/506: write d4/d27/d2d/d3d/f8c [3143510,26163] 0 2024-09-17T01:41:41.036 INFO:tasks.workunit.client.0.smithi082.stdout:7/578: dwrite d0/dd/d2c/d42/f57 [0,4194304] 0 2024-09-17T01:41:41.038 INFO:tasks.workunit.client.0.smithi082.stdout:2/554: mkdir d1/d17/d38/d42/d52/d78/da0/dba 0 2024-09-17T01:41:41.040 INFO:tasks.workunit.client.0.smithi082.stdout:9/507: dwrite d4/d27/d2d/d3d/f47 [8388608,4194304] 0 2024-09-17T01:41:41.042 INFO:tasks.workunit.client.0.smithi082.stdout:7/579: stat d0/d3/db/d10/d47/fa1 0 2024-09-17T01:41:41.042 INFO:tasks.workunit.client.0.smithi082.stdout:8/498: symlink d3/dd/d18/d2d/d3b/l9d 0 2024-09-17T01:41:41.042 INFO:tasks.workunit.client.0.smithi082.stdout:9/508: fsync d4/d27/d2d/d60/d11/d37/f38 0 2024-09-17T01:41:41.044 INFO:tasks.workunit.client.0.smithi082.stdout:8/499: write d3/dd/ff [1067843,14498] 0 2024-09-17T01:41:41.051 INFO:tasks.workunit.client.0.smithi082.stdout:4/515: rmdir d9/d15/d37/d4c/da0 0 2024-09-17T01:41:41.055 INFO:tasks.workunit.client.0.smithi082.stdout:9/509: fsync d4/d27/d2d/d60/d11/d37/f3c 0 2024-09-17T01:41:41.061 INFO:tasks.workunit.client.0.smithi082.stdout:5/602: link db/f8f db/d1e/d5b/db4/fbd 0 2024-09-17T01:41:41.064 INFO:tasks.workunit.client.0.smithi082.stdout:2/555: dread d1/d17/d38/d42/f45 [0,4194304] 0 2024-09-17T01:41:41.065 INFO:tasks.workunit.client.0.smithi082.stdout:6/625: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/faf [0,4194304] 0 2024-09-17T01:41:41.075 INFO:tasks.workunit.client.0.smithi082.stdout:5/603: symlink db/d2b/d59/lbe 0 2024-09-17T01:41:41.080 INFO:tasks.workunit.client.0.smithi082.stdout:2/556: rmdir d1/d17/d38/d42/d52 39 2024-09-17T01:41:41.084 INFO:tasks.workunit.client.0.smithi082.stdout:6/626: fdatasync d1/d7/d10/d4f/dc/d1d/d36/f8b 0 2024-09-17T01:41:41.088 INFO:tasks.workunit.client.0.smithi082.stdout:1/614: getdents d2/df/d46 0 2024-09-17T01:41:41.089 INFO:tasks.workunit.client.0.smithi082.stdout:5/604: rmdir db 39 2024-09-17T01:41:41.091 INFO:tasks.workunit.client.0.smithi082.stdout:8/500: link d3/dd/d18/d2d/d3e/l82 d3/dd/d18/d2d/d60/l9e 0 2024-09-17T01:41:41.094 INFO:tasks.workunit.client.0.smithi082.stdout:4/516: rename d9/d15/d16/d18/d4a/lae to d9/d15/lb0 0 2024-09-17T01:41:41.096 INFO:tasks.workunit.client.0.smithi082.stdout:4/517: chown d9/d2b/f7b 57 1 2024-09-17T01:41:41.096 INFO:tasks.workunit.client.0.smithi082.stdout:2/557: creat d1/d66/d85/fbb x:0 0 0 2024-09-17T01:41:41.100 INFO:tasks.workunit.client.0.smithi082.stdout:3/465: dwrite d9/db/d26/f3a [0,4194304] 0 2024-09-17T01:41:41.102 INFO:tasks.workunit.client.0.smithi082.stdout:8/501: dwrite d3/dd/d18/d2d/d3e/f71 [0,4194304] 0 2024-09-17T01:41:41.102 INFO:tasks.workunit.client.0.smithi082.stdout:3/466: fdatasync d9/db/d26/f81 0 2024-09-17T01:41:41.111 INFO:tasks.workunit.client.0.smithi082.stdout:8/502: dwrite d3/dd/d18/d2d/d3b/f69 [8388608,4194304] 0 2024-09-17T01:41:41.114 INFO:tasks.workunit.client.1.smithi167.stdout:4/949: symlink d0/d4/d69/d13e/d7e/da8/ddf/l143 0 2024-09-17T01:41:41.117 INFO:tasks.workunit.client.1.smithi167.stdout:2/979: rename d5/d3c to d5/d71/dc7/d152 0 2024-09-17T01:41:41.117 INFO:tasks.workunit.client.0.smithi082.stdout:2/558: read d1/d5a/f63 [795405,83665] 0 2024-09-17T01:41:41.118 INFO:tasks.workunit.client.0.smithi082.stdout:1/615: getdents d2/da/d76/db8 0 2024-09-17T01:41:41.118 INFO:tasks.workunit.client.0.smithi082.stdout:9/510: dwrite d4/f57 [4194304,4194304] 0 2024-09-17T01:41:41.119 INFO:tasks.workunit.client.1.smithi167.stdout:7/933: truncate d0/d2/d14/f1b 4496248 0 2024-09-17T01:41:41.128 INFO:tasks.workunit.client.1.smithi167.stdout:2/980: creat d5/d33/d48/d72/f153 x:0 0 0 2024-09-17T01:41:41.128 INFO:tasks.workunit.client.0.smithi082.stdout:8/503: dwrite d3/dd/d18/d2d/d60/f8b [0,4194304] 0 2024-09-17T01:41:41.129 INFO:tasks.workunit.client.1.smithi167.stdout:2/981: stat d5/d71/dc7/d152/d4c/de2/d45/d6b/l78 0 2024-09-17T01:41:41.130 INFO:tasks.workunit.client.1.smithi167.stdout:7/934: mkdir d0/d2/d14/d19/d26/d83/da5/d5b/d13b 0 2024-09-17T01:41:41.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/605: mknod db/d56/d29/d4f/d8e/cbf 0 2024-09-17T01:41:41.131 INFO:tasks.workunit.client.0.smithi082.stdout:5/606: chown db/d56/d78/da0/fb2 14650628 1 2024-09-17T01:41:41.136 INFO:tasks.workunit.client.1.smithi167.stdout:2/982: truncate d5/d71/dc7/d152/d4c/de2/d46/fb6 3501649 0 2024-09-17T01:41:41.136 INFO:tasks.workunit.client.0.smithi082.stdout:4/518: dread d9/d15/f62 [0,4194304] 0 2024-09-17T01:41:41.137 INFO:tasks.workunit.client.0.smithi082.stdout:4/519: stat d9/d15/d16/d18/f32 0 2024-09-17T01:41:41.138 INFO:tasks.workunit.client.1.smithi167.stdout:2/983: read - d5/d71/dc7/d152/d4c/de2/f100 zero size 2024-09-17T01:41:41.139 INFO:tasks.workunit.client.0.smithi082.stdout:4/520: truncate d9/d15/d37/f90 864065 0 2024-09-17T01:41:41.140 INFO:tasks.workunit.client.0.smithi082.stdout:6/627: write d1/d1f/f9d [880062,123083] 0 2024-09-17T01:41:41.145 INFO:tasks.workunit.client.1.smithi167.stdout:0/999: dread d5/d6b/dca/fd7 [0,4194304] 0 2024-09-17T01:41:41.149 INFO:tasks.workunit.client.0.smithi082.stdout:4/521: mkdir d9/d15/d16/d18/d4f/db1 0 2024-09-17T01:41:41.149 INFO:tasks.workunit.client.0.smithi082.stdout:4/522: dread - d9/d47/f60 zero size 2024-09-17T01:41:41.151 INFO:tasks.workunit.client.0.smithi082.stdout:6/628: stat d1/d7/d10/d4f/f78 0 2024-09-17T01:41:41.154 INFO:tasks.workunit.client.0.smithi082.stdout:8/504: truncate d3/dd/d18/f24 976178 0 2024-09-17T01:41:41.156 INFO:tasks.workunit.client.0.smithi082.stdout:8/505: dread - d3/dd/d18/d3a/f46 zero size 2024-09-17T01:41:41.156 INFO:tasks.workunit.client.0.smithi082.stdout:1/616: rmdir d2/d3f/d24/dc1 0 2024-09-17T01:41:41.156 INFO:tasks.workunit.client.1.smithi167.stdout:4/950: dread d0/d4/d69/d131/d6/f66 [0,4194304] 0 2024-09-17T01:41:41.157 INFO:tasks.workunit.client.0.smithi082.stdout:3/467: write d9/db/d49/d4e/d53/f58 [1115914,53040] 0 2024-09-17T01:41:41.157 INFO:tasks.workunit.client.1.smithi167.stdout:4/951: dread - d0/d4/d69/d13e/f97 zero size 2024-09-17T01:41:41.158 INFO:tasks.workunit.client.0.smithi082.stdout:3/468: write d9/db/d49/d4e/d53/d5b/f6c [4277797,111050] 0 2024-09-17T01:41:41.159 INFO:tasks.workunit.client.0.smithi082.stdout:4/523: fdatasync d9/d15/d16/d44/f80 0 2024-09-17T01:41:41.161 INFO:tasks.workunit.client.0.smithi082.stdout:2/559: getdents d1/d35/db1 0 2024-09-17T01:41:41.164 INFO:tasks.workunit.client.0.smithi082.stdout:9/511: dread d4/d27/d21/f5a [0,4194304] 0 2024-09-17T01:41:41.165 INFO:tasks.workunit.client.1.smithi167.stdout:2/984: dread d5/d71/dc7/d152/d4c/de2/d45/d3f/f7e [0,4194304] 0 2024-09-17T01:41:41.168 INFO:tasks.workunit.client.0.smithi082.stdout:4/524: dwrite d9/d15/d16/d18/d4a/d52/d55/f9e [0,4194304] 0 2024-09-17T01:41:41.170 INFO:tasks.workunit.client.0.smithi082.stdout:4/525: write d9/d15/d16/d18/f38 [4680768,88177] 0 2024-09-17T01:41:41.170 INFO:tasks.workunit.client.1.smithi167.stdout:7/935: dwrite d0/d2/d14/d19/d22/f8d [0,4194304] 0 2024-09-17T01:41:41.171 INFO:tasks.workunit.client.0.smithi082.stdout:4/526: write d9/d15/d16/d3e/f94 [72896,58644] 0 2024-09-17T01:41:41.171 INFO:tasks.workunit.client.1.smithi167.stdout:7/936: fsync d0/d2/d14/d19/d32/d62/f64 0 2024-09-17T01:41:41.172 INFO:tasks.workunit.client.0.smithi082.stdout:5/607: rename db/fc to db/d1e/d20/fc0 0 2024-09-17T01:41:41.173 INFO:tasks.workunit.client.1.smithi167.stdout:2/985: mknod d5/d71/dc7/d152/d4c/d4d/c154 0 2024-09-17T01:41:41.187 INFO:tasks.workunit.client.1.smithi167.stdout:4/952: dwrite d0/d4/d69/d131/da/d10e/dc3/dd8/f134 [0,4194304] 0 2024-09-17T01:41:41.187 INFO:tasks.workunit.client.0.smithi082.stdout:1/617: unlink c1 0 2024-09-17T01:41:41.188 INFO:tasks.workunit.client.0.smithi082.stdout:1/618: fdatasync d2/fbc 0 2024-09-17T01:41:41.188 INFO:tasks.workunit.client.1.smithi167.stdout:4/953: write d0/d4/d69/d131/da/d10e/d2d/d11f/f13a [1109848,74245] 0 2024-09-17T01:41:41.189 INFO:tasks.workunit.client.1.smithi167.stdout:4/954: fdatasync d0/d4/d69/d13e/d7e/d92/d6a/d81/f8b 0 2024-09-17T01:41:41.192 INFO:tasks.workunit.client.1.smithi167.stdout:4/955: chown d0/d4/d69/d131/da/c36 0 1 2024-09-17T01:41:41.193 INFO:tasks.workunit.client.1.smithi167.stdout:2/986: symlink d5/d71/dc7/d152/d10a/l155 0 2024-09-17T01:41:41.193 INFO:tasks.workunit.client.1.smithi167.stdout:4/956: dread - d0/d4/d69/d131/da/d48/f103 zero size 2024-09-17T01:41:41.194 INFO:tasks.workunit.client.1.smithi167.stdout:4/957: chown d0/d4/d69/d131/da/c49 498007200 1 2024-09-17T01:41:41.195 INFO:tasks.workunit.client.1.smithi167.stdout:4/958: chown d0/ca9 274999 1 2024-09-17T01:41:41.200 INFO:tasks.workunit.client.0.smithi082.stdout:9/512: dwrite d4/d27/d2d/d60/d11/d39/d29/d77/fa4 [0,4194304] 0 2024-09-17T01:41:41.202 INFO:tasks.workunit.client.1.smithi167.stdout:2/987: creat d5/d71/dc7/d152/d4c/d4d/f156 x:0 0 0 2024-09-17T01:41:41.204 INFO:tasks.workunit.client.1.smithi167.stdout:4/959: fdatasync d0/f64 0 2024-09-17T01:41:41.206 INFO:tasks.workunit.client.0.smithi082.stdout:1/619: mkdir d2/da/d80/dc6 0 2024-09-17T01:41:41.207 INFO:tasks.workunit.client.1.smithi167.stdout:7/937: getdents d0/d2/d14/d19/d32 0 2024-09-17T01:41:41.208 INFO:tasks.workunit.client.0.smithi082.stdout:8/506: creat d3/dd/f9f x:0 0 0 2024-09-17T01:41:41.209 INFO:tasks.workunit.client.1.smithi167.stdout:7/938: write d0/d2/d14/d19/d32/f110 [37451,84617] 0 2024-09-17T01:41:41.211 INFO:tasks.workunit.client.0.smithi082.stdout:4/527: write d9/d15/d16/f2f [779805,130173] 0 2024-09-17T01:41:41.213 INFO:tasks.workunit.client.1.smithi167.stdout:2/988: getdents d5/d71/dc7/d152/d4c/de2/db8/d5e/d103/d108 0 2024-09-17T01:41:41.214 INFO:tasks.workunit.client.0.smithi082.stdout:2/560: creat d1/fbc x:0 0 0 2024-09-17T01:41:41.215 INFO:tasks.workunit.client.0.smithi082.stdout:6/629: getdents d1/d7/d10/d4f/dc/d1d/d36/d7a/d87 0 2024-09-17T01:41:41.216 INFO:tasks.workunit.client.1.smithi167.stdout:4/960: dread d0/d4/d69/d131/da/d10e/d2d/d2e/d31/fb6 [0,4194304] 0 2024-09-17T01:41:41.217 INFO:tasks.workunit.client.1.smithi167.stdout:7/939: creat d0/d2/d14/d19/d26/d11c/d123/f13c x:0 0 0 2024-09-17T01:41:41.218 INFO:tasks.workunit.client.0.smithi082.stdout:3/469: dwrite d9/f21 [0,4194304] 0 2024-09-17T01:41:41.226 INFO:tasks.workunit.client.0.smithi082.stdout:8/507: mknod d3/dd/d18/d2d/d3e/d4a/d6a/ca0 0 2024-09-17T01:41:41.227 INFO:tasks.workunit.client.1.smithi167.stdout:7/940: creat d0/d2/d14/d6f/d87/dae/f13d x:0 0 0 2024-09-17T01:41:41.227 INFO:tasks.workunit.client.0.smithi082.stdout:4/528: truncate d9/fd 4705004 0 2024-09-17T01:41:41.229 INFO:tasks.workunit.client.0.smithi082.stdout:2/561: readlink d1/l22 0 2024-09-17T01:41:41.230 INFO:tasks.workunit.client.0.smithi082.stdout:2/562: chown d1/d17/d38/d5c 194 1 2024-09-17T01:41:41.234 INFO:tasks.workunit.client.1.smithi167.stdout:2/989: write d5/d71/dc7/d152/d4c/de2/d46/fb6 [660281,77302] 0 2024-09-17T01:41:41.236 INFO:tasks.workunit.client.1.smithi167.stdout:2/990: readlink d5/d71/dc7/d152/d4c/de2/d45/d8e/d98/ld2 0 2024-09-17T01:41:41.238 INFO:tasks.workunit.client.0.smithi082.stdout:1/620: symlink d2/da/lc7 0 2024-09-17T01:41:41.238 INFO:tasks.workunit.client.1.smithi167.stdout:4/961: getdents d0/d4/d69/d131/d10/d70/dc7/d112 0 2024-09-17T01:41:41.239 INFO:tasks.workunit.client.1.smithi167.stdout:7/941: dwrite d0/d2/d14/d19/d22/fee [0,4194304] 0 2024-09-17T01:41:41.240 INFO:tasks.workunit.client.0.smithi082.stdout:8/508: rename d3/dd/f2b to d3/dd/d18/d2d/d3e/d4a/d66/d6e/fa1 0 2024-09-17T01:41:41.245 INFO:tasks.workunit.client.1.smithi167.stdout:7/942: unlink d0/d2/d14/d19/d22/fee 0 2024-09-17T01:41:41.246 INFO:tasks.workunit.client.0.smithi082.stdout:6/630: dwrite d1/d7/f2e [0,4194304] 0 2024-09-17T01:41:41.247 INFO:tasks.workunit.client.1.smithi167.stdout:2/991: write d5/d71/dc7/d152/d4c/de2/d2e/f138 [3852400,119882] 0 2024-09-17T01:41:41.249 INFO:tasks.workunit.client.0.smithi082.stdout:6/631: readlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/lcd 0 2024-09-17T01:41:41.249 INFO:tasks.workunit.client.1.smithi167.stdout:4/962: dwrite d0/d4/d69/d131/da/f2c [0,4194304] 0 2024-09-17T01:41:41.250 INFO:tasks.workunit.client.0.smithi082.stdout:9/513: creat d4/fae x:0 0 0 2024-09-17T01:41:41.253 INFO:tasks.workunit.client.1.smithi167.stdout:7/943: creat d0/d2/d14/d19/d32/d9c/f13e x:0 0 0 2024-09-17T01:41:41.253 INFO:tasks.workunit.client.1.smithi167.stdout:2/992: dread - d5/d71/dc7/d152/d4c/d4d/d91/fd1 zero size 2024-09-17T01:41:41.254 INFO:tasks.workunit.client.1.smithi167.stdout:4/963: rmdir d0/d4/d69/d131/de2 39 2024-09-17T01:41:41.256 INFO:tasks.workunit.client.0.smithi082.stdout:8/509: creat d3/dd/d18/d2d/d3e/d4a/fa2 x:0 0 0 2024-09-17T01:41:41.257 INFO:tasks.workunit.client.0.smithi082.stdout:8/510: readlink d3/dd/d18/d34/l5a 0 2024-09-17T01:41:41.260 INFO:tasks.workunit.client.1.smithi167.stdout:2/993: unlink d5/d71/dc7/d152/d4c/de2/db8/da3/l2b 0 2024-09-17T01:41:41.261 INFO:tasks.workunit.client.0.smithi082.stdout:2/563: dread d1/ff [0,4194304] 0 2024-09-17T01:41:41.263 INFO:tasks.workunit.client.0.smithi082.stdout:4/529: mknod d9/d15/cb2 0 2024-09-17T01:41:41.263 INFO:tasks.workunit.client.0.smithi082.stdout:9/514: creat d4/d27/d36/d3b/faf x:0 0 0 2024-09-17T01:41:41.264 INFO:tasks.workunit.client.0.smithi082.stdout:6/632: rename d1/d7/d10/d4f/dc/d1d/d36/f67 to d1/d1f/fe1 0 2024-09-17T01:41:41.265 INFO:tasks.workunit.client.0.smithi082.stdout:4/530: dread - d9/d15/d16/d3e/d54/fa1 zero size 2024-09-17T01:41:41.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/515: dread - d4/d27/d36/f7b zero size 2024-09-17T01:41:41.267 INFO:tasks.workunit.client.0.smithi082.stdout:1/621: write d2/d3f/d24/f81 [243017,114416] 0 2024-09-17T01:41:41.268 INFO:tasks.workunit.client.0.smithi082.stdout:6/633: dread d1/d7/d10/d4f/dc/f29 [0,4194304] 0 2024-09-17T01:41:41.268 INFO:tasks.workunit.client.1.smithi167.stdout:2/994: rename d5/d71/dc7/d152/d4c/de2/d2e/f51 to d5/d33/d48/d72/f157 0 2024-09-17T01:41:41.270 INFO:tasks.workunit.client.0.smithi082.stdout:8/511: symlink d3/dd/d18/d2d/la3 0 2024-09-17T01:41:41.271 INFO:tasks.workunit.client.0.smithi082.stdout:3/470: truncate f7 626345 0 2024-09-17T01:41:41.271 INFO:tasks.workunit.client.0.smithi082.stdout:1/622: truncate d2/da/d76/d93/fb7 120052 0 2024-09-17T01:41:41.273 INFO:tasks.workunit.client.0.smithi082.stdout:1/623: stat d2/d3f/d24/d54/f74 0 2024-09-17T01:41:41.273 INFO:tasks.workunit.client.0.smithi082.stdout:2/564: write d1/d17/d38/d42/d52/f76 [673770,83210] 0 2024-09-17T01:41:41.273 INFO:tasks.workunit.client.1.smithi167.stdout:2/995: dread - d5/d71/dc7/d152/d4c/de2/d45/d8e/fe0 zero size 2024-09-17T01:41:41.273 INFO:tasks.workunit.client.0.smithi082.stdout:2/565: fdatasync d1/f16 0 2024-09-17T01:41:41.276 INFO:tasks.workunit.client.0.smithi082.stdout:6/634: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/le2 0 2024-09-17T01:41:41.277 INFO:tasks.workunit.client.0.smithi082.stdout:8/512: rmdir d3 39 2024-09-17T01:41:41.277 INFO:tasks.workunit.client.1.smithi167.stdout:2/996: dread d5/d71/dc7/d152/d4c/de2/db8/d5e/fb1 [0,4194304] 0 2024-09-17T01:41:41.280 INFO:tasks.workunit.client.0.smithi082.stdout:3/471: creat d9/db/d26/fa1 x:0 0 0 2024-09-17T01:41:41.282 INFO:tasks.workunit.client.0.smithi082.stdout:1/624: mkdir d2/d3f/d24/dc8 0 2024-09-17T01:41:41.285 INFO:tasks.workunit.client.0.smithi082.stdout:6/635: dwrite d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [0,4194304] 0 2024-09-17T01:41:41.286 INFO:tasks.workunit.client.1.smithi167.stdout:2/997: rename d5/d71/dc7/d152/d4c/de2/d46/c11e to d5/d33/df9/c158 0 2024-09-17T01:41:41.287 INFO:tasks.workunit.client.0.smithi082.stdout:6/636: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fde zero size 2024-09-17T01:41:41.289 INFO:tasks.workunit.client.1.smithi167.stdout:4/964: dread d0/d4/d69/f6b [0,4194304] 0 2024-09-17T01:41:41.289 INFO:tasks.workunit.client.1.smithi167.stdout:7/944: write d0/d2/f9d [49357,116978] 0 2024-09-17T01:41:41.291 INFO:tasks.workunit.client.0.smithi082.stdout:2/566: creat d1/d17/d38/d42/d52/fbd x:0 0 0 2024-09-17T01:41:41.293 INFO:tasks.workunit.client.0.smithi082.stdout:2/567: chown d1/d17/d38/d42/d52/d78/d82/c97 6888 1 2024-09-17T01:41:41.296 INFO:tasks.workunit.client.0.smithi082.stdout:4/531: link d9/d15/d16/d18/l87 d9/d2b/lb3 0 2024-09-17T01:41:41.296 INFO:tasks.workunit.client.0.smithi082.stdout:2/568: read d1/d17/d29/d50/fa5 [3379275,65642] 0 2024-09-17T01:41:41.296 INFO:tasks.workunit.client.0.smithi082.stdout:8/513: truncate d3/dd/d18/d2d/d3b/f48 2195985 0 2024-09-17T01:41:41.297 INFO:tasks.workunit.client.1.smithi167.stdout:7/945: truncate d0/d2/d14/d6f/d8b/fd1 2792198 0 2024-09-17T01:41:41.297 INFO:tasks.workunit.client.0.smithi082.stdout:9/516: dread d4/f4c [0,4194304] 0 2024-09-17T01:41:41.298 INFO:tasks.workunit.client.0.smithi082.stdout:8/514: readlink d3/dd/d18/d2d/la3 0 2024-09-17T01:41:41.298 INFO:tasks.workunit.client.0.smithi082.stdout:9/517: chown d4/d59/d63/l96 0 1 2024-09-17T01:41:41.299 INFO:tasks.workunit.client.0.smithi082.stdout:1/625: unlink d2/l71 0 2024-09-17T01:41:41.303 INFO:tasks.workunit.client.0.smithi082.stdout:9/518: dread d4/d27/d2d/d60/f34 [0,4194304] 0 2024-09-17T01:41:41.304 INFO:tasks.workunit.client.0.smithi082.stdout:9/519: write d4/d27/d2d/d3d/fa5 [436334,61555] 0 2024-09-17T01:41:41.307 INFO:tasks.workunit.client.1.smithi167.stdout:4/965: getdents d0/d4/d69/d131/dff/df2 0 2024-09-17T01:41:41.310 INFO:tasks.workunit.client.1.smithi167.stdout:7/946: unlink d0/d2/d14/d23/f39 0 2024-09-17T01:41:41.310 INFO:tasks.workunit.client.1.smithi167.stdout:7/947: readlink d0/d2/d14/d19/la1 0 2024-09-17T01:41:41.312 INFO:tasks.workunit.client.1.smithi167.stdout:4/966: creat d0/d4/d69/d131/dff/f144 x:0 0 0 2024-09-17T01:41:41.316 INFO:tasks.workunit.client.1.smithi167.stdout:7/948: dwrite d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:41.317 INFO:tasks.workunit.client.0.smithi082.stdout:8/515: creat d3/dd/d18/d2d/d3e/d4a/d6a/fa4 x:0 0 0 2024-09-17T01:41:41.318 INFO:tasks.workunit.client.0.smithi082.stdout:1/626: rename d2/da/d2f/f4c to d2/d3f/d24/dc8/fc9 0 2024-09-17T01:41:41.318 INFO:tasks.workunit.client.0.smithi082.stdout:8/516: write d3/dd/d18/d2d/d60/f8b [457188,115907] 0 2024-09-17T01:41:41.320 INFO:tasks.workunit.client.1.smithi167.stdout:4/967: dwrite d0/d4/d69/d13e/f10d [0,4194304] 0 2024-09-17T01:41:41.322 INFO:tasks.workunit.client.0.smithi082.stdout:3/472: truncate d9/db/d26/f9e 3983115 0 2024-09-17T01:41:41.329 INFO:tasks.workunit.client.1.smithi167.stdout:4/968: dwrite d0/d4/d69/d131/da/d10e/d2d/d2e/f142 [0,4194304] 0 2024-09-17T01:41:41.330 INFO:tasks.workunit.client.0.smithi082.stdout:6/637: getdents d1/d1f/da7/ddd 0 2024-09-17T01:41:41.332 INFO:tasks.workunit.client.0.smithi082.stdout:3/473: symlink d9/d35/d71/d69/d9c/la2 0 2024-09-17T01:41:41.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/569: dread d1/d17/d29/d50/f6c [0,4194304] 0 2024-09-17T01:41:41.334 INFO:tasks.workunit.client.0.smithi082.stdout:6/638: fdatasync d1/d7/d10/d4f/dc/d1d/d36/d56/fca 0 2024-09-17T01:41:41.335 INFO:tasks.workunit.client.1.smithi167.stdout:4/969: stat d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad 0 2024-09-17T01:41:41.337 INFO:tasks.workunit.client.1.smithi167.stdout:4/970: read d0/d4/d69/f6b [4142997,99301] 0 2024-09-17T01:41:41.339 INFO:tasks.workunit.client.0.smithi082.stdout:3/474: creat d9/db/d26/fa3 x:0 0 0 2024-09-17T01:41:41.340 INFO:tasks.workunit.client.0.smithi082.stdout:8/517: dwrite d3/dd/d18/d51/f6f [4194304,4194304] 0 2024-09-17T01:41:41.341 INFO:tasks.workunit.client.1.smithi167.stdout:4/971: dread d0/d4/d69/d131/d6/f66 [0,4194304] 0 2024-09-17T01:41:41.342 INFO:tasks.workunit.client.0.smithi082.stdout:1/627: creat d2/da/d2f/fca x:0 0 0 2024-09-17T01:41:41.344 INFO:tasks.workunit.client.0.smithi082.stdout:2/570: creat d1/d90/fbe x:0 0 0 2024-09-17T01:41:41.346 INFO:tasks.workunit.client.0.smithi082.stdout:6/639: symlink d1/d7/d10/d4f/dc/d1d/d36/d56/le3 0 2024-09-17T01:41:41.347 INFO:tasks.workunit.client.0.smithi082.stdout:6/640: chown d1/d7/d10/d4f/f20 396 1 2024-09-17T01:41:41.348 INFO:tasks.workunit.client.1.smithi167.stdout:4/972: dwrite d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad/f113 [0,4194304] 0 2024-09-17T01:41:41.349 INFO:tasks.workunit.client.0.smithi082.stdout:6/641: stat d1/d7/d10/d4f/dc/l15 0 2024-09-17T01:41:41.349 INFO:tasks.workunit.client.0.smithi082.stdout:2/571: read d1/d17/d29/d50/f77 [1442150,92775] 0 2024-09-17T01:41:41.351 INFO:tasks.workunit.client.0.smithi082.stdout:8/518: creat d3/dd/d18/d51/fa5 x:0 0 0 2024-09-17T01:41:41.351 INFO:tasks.workunit.client.0.smithi082.stdout:8/519: fsync d3/f7 0 2024-09-17T01:41:41.352 INFO:tasks.workunit.client.0.smithi082.stdout:1/628: creat d2/da/d76/d93/fcb x:0 0 0 2024-09-17T01:41:41.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/642: mknod d1/d7/d10/d4f/dc/d99/ce4 0 2024-09-17T01:41:41.359 INFO:tasks.workunit.client.0.smithi082.stdout:6/643: write d1/d7/f46 [1190776,27907] 0 2024-09-17T01:41:41.364 INFO:tasks.workunit.client.1.smithi167.stdout:7/949: write d0/d2/d14/f107 [2657416,83228] 0 2024-09-17T01:41:41.365 INFO:tasks.workunit.client.1.smithi167.stdout:4/973: creat d0/d4/d69/d13e/d7e/d92/f145 x:0 0 0 2024-09-17T01:41:41.366 INFO:tasks.workunit.client.0.smithi082.stdout:2/572: symlink d1/d17/lbf 0 2024-09-17T01:41:41.366 INFO:tasks.workunit.client.0.smithi082.stdout:4/532: truncate d9/d15/d37/f90 839646 0 2024-09-17T01:41:41.370 INFO:tasks.workunit.client.0.smithi082.stdout:2/573: symlink d1/d5a/lc0 0 2024-09-17T01:41:41.372 INFO:tasks.workunit.client.1.smithi167.stdout:4/974: dwrite d0/d4/d69/d131/da/d10e/dc3/dd8/f12d [0,4194304] 0 2024-09-17T01:41:41.373 INFO:tasks.workunit.client.0.smithi082.stdout:4/533: creat d9/d15/d16/d44/d84/fb4 x:0 0 0 2024-09-17T01:41:41.373 INFO:tasks.workunit.client.0.smithi082.stdout:3/475: dread d9/f40 [0,4194304] 0 2024-09-17T01:41:41.375 INFO:tasks.workunit.client.0.smithi082.stdout:3/476: write d9/db/d26/f7d [1400592,33148] 0 2024-09-17T01:41:41.377 INFO:tasks.workunit.client.1.smithi167.stdout:4/975: creat d0/d4/d69/d131/da/d10e/d2d/dac/f146 x:0 0 0 2024-09-17T01:41:41.378 INFO:tasks.workunit.client.0.smithi082.stdout:1/629: creat d2/da/fcc x:0 0 0 2024-09-17T01:41:41.378 INFO:tasks.workunit.client.1.smithi167.stdout:4/976: chown d0/d4/d69/d131/da/d10e 577607 1 2024-09-17T01:41:41.379 INFO:tasks.workunit.client.0.smithi082.stdout:1/630: stat d2/df/d46/cc4 0 2024-09-17T01:41:41.380 INFO:tasks.workunit.client.0.smithi082.stdout:2/574: creat d1/d66/d85/fc1 x:0 0 0 2024-09-17T01:41:41.381 INFO:tasks.workunit.client.0.smithi082.stdout:4/534: write d9/d15/f27 [3298740,63260] 0 2024-09-17T01:41:41.383 INFO:tasks.workunit.client.1.smithi167.stdout:7/950: link d0/d2/d14/d19/d22/c29 d0/d2/d14/d19/d32/d9c/c13f 0 2024-09-17T01:41:41.386 INFO:tasks.workunit.client.0.smithi082.stdout:8/520: getdents d3/dd/d18/d2d/d60 0 2024-09-17T01:41:41.387 INFO:tasks.workunit.client.0.smithi082.stdout:2/575: dwrite d1/d17/d38/d5c/f64 [4194304,4194304] 0 2024-09-17T01:41:41.387 INFO:tasks.workunit.client.0.smithi082.stdout:3/477: mkdir d9/db/d49/da4 0 2024-09-17T01:41:41.388 INFO:tasks.workunit.client.1.smithi167.stdout:4/977: creat d0/d4/d69/d131/da/d10e/d2d/d2e/f147 x:0 0 0 2024-09-17T01:41:41.389 INFO:tasks.workunit.client.0.smithi082.stdout:2/576: chown d1/d17/d38/d42/c5f 34107 1 2024-09-17T01:41:41.389 INFO:tasks.workunit.client.0.smithi082.stdout:1/631: rmdir d2/df 39 2024-09-17T01:41:41.393 INFO:tasks.workunit.client.0.smithi082.stdout:4/535: dread - d9/d15/d16/d18/d4a/faf zero size 2024-09-17T01:41:41.394 INFO:tasks.workunit.client.0.smithi082.stdout:4/536: chown d9/d15/d16/d18/d4a/d52/f59 10993 1 2024-09-17T01:41:41.395 INFO:tasks.workunit.client.0.smithi082.stdout:3/478: unlink f7 0 2024-09-17T01:41:41.397 INFO:tasks.workunit.client.0.smithi082.stdout:8/521: symlink d3/dd/d18/d2d/d3e/d4a/d6a/la6 0 2024-09-17T01:41:41.397 INFO:tasks.workunit.client.0.smithi082.stdout:8/522: chown d3/c8 15 1 2024-09-17T01:41:41.399 INFO:tasks.workunit.client.0.smithi082.stdout:2/577: chown d1/d17/d38/d42/d52/c87 50 1 2024-09-17T01:41:41.401 INFO:tasks.workunit.client.0.smithi082.stdout:1/632: truncate d2/da/d2d/d6c/f6e 1526938 0 2024-09-17T01:41:41.402 INFO:tasks.workunit.client.1.smithi167.stdout:4/978: rmdir d0/d4/d69/d131/dff/d127/d135 0 2024-09-17T01:41:41.403 INFO:tasks.workunit.client.0.smithi082.stdout:4/537: readlink d9/d15/d16/d18/d4a/l57 0 2024-09-17T01:41:41.404 INFO:tasks.workunit.client.0.smithi082.stdout:4/538: read d9/d15/d16/d18/d4a/d8f/d91/f95 [79122,95852] 0 2024-09-17T01:41:41.404 INFO:tasks.workunit.client.0.smithi082.stdout:3/479: chown d9/l77 405 1 2024-09-17T01:41:41.409 INFO:tasks.workunit.client.1.smithi167.stdout:4/979: mknod d0/d4/d69/d13e/d7e/d92/c148 0 2024-09-17T01:41:41.412 INFO:tasks.workunit.client.0.smithi082.stdout:6/644: dwrite d1/d7/f24 [0,4194304] 0 2024-09-17T01:41:41.412 INFO:tasks.workunit.client.1.smithi167.stdout:4/980: fdatasync d0/d4/d69/fd7 0 2024-09-17T01:41:41.415 INFO:tasks.workunit.client.0.smithi082.stdout:6/645: readlink d1/d7/d10/d4f/dc/la3 0 2024-09-17T01:41:41.415 INFO:tasks.workunit.client.0.smithi082.stdout:4/539: dwrite d9/d15/d16/d3e/f50 [0,4194304] 0 2024-09-17T01:41:41.417 INFO:tasks.workunit.client.0.smithi082.stdout:2/578: dread d1/d17/d29/d50/fa5 [0,4194304] 0 2024-09-17T01:41:41.421 INFO:tasks.workunit.client.0.smithi082.stdout:8/523: truncate d3/f64 3231773 0 2024-09-17T01:41:41.429 INFO:tasks.workunit.client.0.smithi082.stdout:6/646: mkdir d1/d7/d10/d4f/d8e/da8/de5 0 2024-09-17T01:41:41.430 INFO:tasks.workunit.client.0.smithi082.stdout:6/647: stat d1/l2 0 2024-09-17T01:41:41.431 INFO:tasks.workunit.client.0.smithi082.stdout:8/524: symlink d3/dd/d18/d2d/d58/la7 0 2024-09-17T01:41:41.435 INFO:tasks.workunit.client.0.smithi082.stdout:3/480: creat d9/db/d49/d4e/fa5 x:0 0 0 2024-09-17T01:41:41.436 INFO:tasks.workunit.client.0.smithi082.stdout:6/648: mknod d1/d1f/da7/ce6 0 2024-09-17T01:41:41.438 INFO:tasks.workunit.client.0.smithi082.stdout:6/649: read d1/d7/d10/d4f/dc/d1d/d36/f91 [720244,41596] 0 2024-09-17T01:41:41.438 INFO:tasks.workunit.client.1.smithi167.stdout:4/981: write d0/d4/d69/d131/da/d48/fb3 [3871350,67651] 0 2024-09-17T01:41:41.439 INFO:tasks.workunit.client.0.smithi082.stdout:4/540: link d9/d15/c40 d9/d2b/cb5 0 2024-09-17T01:41:41.439 INFO:tasks.workunit.client.0.smithi082.stdout:4/541: chown d9/f14 393368 1 2024-09-17T01:41:41.444 INFO:tasks.workunit.client.0.smithi082.stdout:4/542: dread d9/d15/d16/d3e/f3f [0,4194304] 0 2024-09-17T01:41:41.446 INFO:tasks.workunit.client.0.smithi082.stdout:4/543: dread - d9/d15/d16/d18/d4a/d52/f82 zero size 2024-09-17T01:41:41.446 INFO:tasks.workunit.client.0.smithi082.stdout:1/633: truncate d2/d3f/d34/f59 583240 0 2024-09-17T01:41:41.447 INFO:tasks.workunit.client.0.smithi082.stdout:4/544: stat d9/d15/d37/f71 0 2024-09-17T01:41:41.447 INFO:tasks.workunit.client.0.smithi082.stdout:2/579: dread d1/d17/d38/d42/f83 [0,4194304] 0 2024-09-17T01:41:41.449 INFO:tasks.workunit.client.1.smithi167.stdout:4/982: rmdir d0/d4/d69/d131/dff/d127/d132 0 2024-09-17T01:41:41.451 INFO:tasks.workunit.client.1.smithi167.stdout:4/983: fdatasync d0/d4/d69/d131/d10/fed 0 2024-09-17T01:41:41.451 INFO:tasks.workunit.client.0.smithi082.stdout:2/580: mkdir d1/d5a/d6d/dc2 0 2024-09-17T01:41:41.452 INFO:tasks.workunit.client.0.smithi082.stdout:4/545: readlink d9/d15/d16/d18/d4a/d52/l93 0 2024-09-17T01:41:41.453 INFO:tasks.workunit.client.0.smithi082.stdout:2/581: fsync d1/d17/d38/d5c/f79 0 2024-09-17T01:41:41.458 INFO:tasks.workunit.client.1.smithi167.stdout:4/984: mkdir d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/d149 0 2024-09-17T01:41:41.459 INFO:tasks.workunit.client.1.smithi167.stdout:4/985: chown d0/d4/d69/d131/da/d10e/d2d/dac/fef 20 1 2024-09-17T01:41:41.459 INFO:tasks.workunit.client.0.smithi082.stdout:4/546: creat d9/d15/d37/d4c/fb6 x:0 0 0 2024-09-17T01:41:41.461 INFO:tasks.workunit.client.0.smithi082.stdout:2/582: mknod d1/d17/d38/d42/d52/d78/da0/cc3 0 2024-09-17T01:41:41.461 INFO:tasks.workunit.client.0.smithi082.stdout:4/547: read d9/d15/d16/d18/f97 [46079,97498] 0 2024-09-17T01:41:41.463 INFO:tasks.workunit.client.1.smithi167.stdout:4/986: mknod d0/d4/d69/d131/dff/df2/c14a 0 2024-09-17T01:41:41.463 INFO:tasks.workunit.client.0.smithi082.stdout:1/634: getdents d2/d3f/d24/dba 0 2024-09-17T01:41:41.465 INFO:tasks.workunit.client.0.smithi082.stdout:3/481: dread d9/db/d49/d4e/f57 [0,4194304] 0 2024-09-17T01:41:41.466 INFO:tasks.workunit.client.0.smithi082.stdout:2/583: creat d1/d35/db1/d9c/fc4 x:0 0 0 2024-09-17T01:41:41.468 INFO:tasks.workunit.client.0.smithi082.stdout:2/584: write d1/d35/db1/d9c/fc4 [166623,39309] 0 2024-09-17T01:41:41.468 INFO:tasks.workunit.client.0.smithi082.stdout:3/482: chown d9/db/d49/d4e/d53/d5b/l67 94738 1 2024-09-17T01:41:41.469 INFO:tasks.workunit.client.1.smithi167.stdout:4/987: mkdir d0/d4/d69/d131/da/d10e/d14b 0 2024-09-17T01:41:41.469 INFO:tasks.workunit.client.0.smithi082.stdout:3/483: chown d9/db/l25 3730681 1 2024-09-17T01:41:41.472 INFO:tasks.workunit.client.0.smithi082.stdout:2/585: rename d1/d17/f18 to d1/d17/d29/d50/fc5 0 2024-09-17T01:41:41.473 INFO:tasks.workunit.client.0.smithi082.stdout:1/635: getdents d2/da/d80/dc6 0 2024-09-17T01:41:41.476 INFO:tasks.workunit.client.0.smithi082.stdout:2/586: mkdir d1/d17/d60/dc6 0 2024-09-17T01:41:41.478 INFO:tasks.workunit.client.0.smithi082.stdout:1/636: creat d2/da/d80/da3/fcd x:0 0 0 2024-09-17T01:41:41.480 INFO:tasks.workunit.client.0.smithi082.stdout:3/484: link d9/db/f3e d9/db/d49/da4/fa6 0 2024-09-17T01:41:41.480 INFO:tasks.workunit.client.1.smithi167.stdout:4/988: link d0/d4/d69/d131/d10/c4c d0/d4/d69/d131/da/d10e/d2d/d2e/d31/d75/dfb/c14c 0 2024-09-17T01:41:41.481 INFO:tasks.workunit.client.0.smithi082.stdout:2/587: creat d1/d17/d38/d42/d52/d78/d82/fc7 x:0 0 0 2024-09-17T01:41:41.483 INFO:tasks.workunit.client.0.smithi082.stdout:4/548: dwrite d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:41.484 INFO:tasks.workunit.client.0.smithi082.stdout:2/588: write d1/d17/d38/d5c/f79 [213780,11069] 0 2024-09-17T01:41:41.485 INFO:tasks.workunit.client.0.smithi082.stdout:1/637: creat d2/df/fce x:0 0 0 2024-09-17T01:41:41.488 INFO:tasks.workunit.client.0.smithi082.stdout:3/485: creat d9/d35/d71/d69/d9c/fa7 x:0 0 0 2024-09-17T01:41:41.488 INFO:tasks.workunit.client.0.smithi082.stdout:3/486: readlink d9/db/d26/l2c 0 2024-09-17T01:41:41.490 INFO:tasks.workunit.client.1.smithi167.stdout:4/989: rmdir d0/d4/d69/d13e/d7e/d92/d6a/d109 0 2024-09-17T01:41:41.492 INFO:tasks.workunit.client.0.smithi082.stdout:4/549: mknod d9/d15/cb7 0 2024-09-17T01:41:41.494 INFO:tasks.workunit.client.0.smithi082.stdout:2/589: rename d1/d17/c36 to d1/d17/d38/d5c/d7d/cc8 0 2024-09-17T01:41:41.497 INFO:tasks.workunit.client.1.smithi167.stdout:2/998: sync 2024-09-17T01:41:41.498 INFO:tasks.workunit.client.0.smithi082.stdout:3/487: creat d9/d35/d71/fa8 x:0 0 0 2024-09-17T01:41:41.500 INFO:tasks.workunit.client.0.smithi082.stdout:4/550: rename d9/d15/d16/d18/c24 to d9/d15/d16/d18/d4f/db1/cb8 0 2024-09-17T01:41:41.502 INFO:tasks.workunit.client.1.smithi167.stdout:4/990: mknod d0/d4/d69/d131/da/c14d 0 2024-09-17T01:41:41.502 INFO:tasks.workunit.client.0.smithi082.stdout:2/590: dwrite d1/d35/fa1 [0,4194304] 0 2024-09-17T01:41:41.506 INFO:tasks.workunit.client.1.smithi167.stdout:4/991: rename d0/d4/d69/d131/d6/d5d/da2 to d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad/d14e 0 2024-09-17T01:41:41.507 INFO:tasks.workunit.client.0.smithi082.stdout:3/488: creat d9/db/fa9 x:0 0 0 2024-09-17T01:41:41.509 INFO:tasks.workunit.client.1.smithi167.stdout:2/999: creat d5/d71/dc7/d152/d4c/de2/db8/d5e/d103/d13b/f159 x:0 0 0 2024-09-17T01:41:41.510 INFO:tasks.workunit.client.0.smithi082.stdout:2/591: mkdir d1/d17/d29/dc9 0 2024-09-17T01:41:41.513 INFO:tasks.workunit.client.1.smithi167.stdout:4/992: symlink d0/d4/l14f 0 2024-09-17T01:41:41.514 INFO:tasks.workunit.client.1.smithi167.stdout:4/993: dread - d0/d4/d69/d131/da/d10e/dc3/ff5 zero size 2024-09-17T01:41:41.514 INFO:tasks.workunit.client.0.smithi082.stdout:1/638: dread d2/da/d2f/f31 [4194304,4194304] 0 2024-09-17T01:41:41.515 INFO:tasks.workunit.client.0.smithi082.stdout:3/489: dwrite d9/db/f85 [0,4194304] 0 2024-09-17T01:41:41.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/490: chown d9/db/d49/d4e/d53/d5b/c61 250612 1 2024-09-17T01:41:41.521 INFO:tasks.workunit.client.0.smithi082.stdout:1/639: mkdir d2/d3f/d24/dcf 0 2024-09-17T01:41:41.523 INFO:tasks.workunit.client.0.smithi082.stdout:3/491: mkdir d9/db/daa 0 2024-09-17T01:41:41.524 INFO:tasks.workunit.client.0.smithi082.stdout:2/592: getdents d1/d66/d85 0 2024-09-17T01:41:41.526 INFO:tasks.workunit.client.0.smithi082.stdout:3/492: read - d9/db/d26/fa3 zero size 2024-09-17T01:41:41.530 INFO:tasks.workunit.client.0.smithi082.stdout:3/493: chown d9/f6f 70 1 2024-09-17T01:41:41.530 INFO:tasks.workunit.client.0.smithi082.stdout:1/640: dwrite d2/da/d2d/d79/fbf [0,4194304] 0 2024-09-17T01:41:41.533 INFO:tasks.workunit.client.0.smithi082.stdout:1/641: chown d2/fbc 277 1 2024-09-17T01:41:41.533 INFO:tasks.workunit.client.0.smithi082.stdout:3/494: dread - d9/d35/d71/f75 zero size 2024-09-17T01:41:41.535 INFO:tasks.workunit.client.1.smithi167.stdout:4/994: dread d0/d4/d69/d13e/d7e/d92/d6a/d81/dcb/dad/fd3 [0,4194304] 0 2024-09-17T01:41:41.536 INFO:tasks.workunit.client.0.smithi082.stdout:1/642: readlink d2/d3f/l48 0 2024-09-17T01:41:41.538 INFO:tasks.workunit.client.0.smithi082.stdout:4/551: dwrite d9/d15/f6b [0,4194304] 0 2024-09-17T01:41:41.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/643: creat d2/da/d2d/d79/fd0 x:0 0 0 2024-09-17T01:41:41.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/593: dwrite d1/f9 [0,4194304] 0 2024-09-17T01:41:41.547 INFO:tasks.workunit.client.0.smithi082.stdout:3/495: getdents d9/db/d49/d4e/d53 0 2024-09-17T01:41:41.549 INFO:tasks.workunit.client.0.smithi082.stdout:4/552: dread d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:41.550 INFO:tasks.workunit.client.0.smithi082.stdout:1/644: symlink d2/d3f/d24/dba/ld1 0 2024-09-17T01:41:41.551 INFO:tasks.workunit.client.0.smithi082.stdout:3/496: chown d9/db/lc 2743 1 2024-09-17T01:41:41.551 INFO:tasks.workunit.client.0.smithi082.stdout:4/553: readlink d9/d15/d37/l8a 0 2024-09-17T01:41:41.552 INFO:tasks.workunit.client.0.smithi082.stdout:4/554: readlink d9/l10 0 2024-09-17T01:41:41.552 INFO:tasks.workunit.client.0.smithi082.stdout:1/645: dread - d2/da/d2d/d79/fd0 zero size 2024-09-17T01:41:41.553 INFO:tasks.workunit.client.0.smithi082.stdout:2/594: readlink d1/d17/d29/l46 0 2024-09-17T01:41:41.553 INFO:tasks.workunit.client.0.smithi082.stdout:4/555: chown d9/d15/d16/d3e/d54/c58 3740 1 2024-09-17T01:41:41.554 INFO:tasks.workunit.client.0.smithi082.stdout:2/595: stat d1/d10/l2c 0 2024-09-17T01:41:41.554 INFO:tasks.workunit.client.0.smithi082.stdout:3/497: creat d9/d35/d71/d69/d79/fab x:0 0 0 2024-09-17T01:41:41.556 INFO:tasks.workunit.client.0.smithi082.stdout:4/556: chown d9/d15/d37/d4c/da3/f92 5 1 2024-09-17T01:41:41.558 INFO:tasks.workunit.client.0.smithi082.stdout:2/596: read d1/d17/d29/f6e [1901867,88021] 0 2024-09-17T01:41:41.560 INFO:tasks.workunit.client.0.smithi082.stdout:4/557: write d9/d15/d16/d18/d4a/d8f/d91/fa6 [66503,79168] 0 2024-09-17T01:41:41.562 INFO:tasks.workunit.client.0.smithi082.stdout:1/646: dwrite d2/df/d46/f64 [0,4194304] 0 2024-09-17T01:41:41.564 INFO:tasks.workunit.client.0.smithi082.stdout:2/597: link d1/d17/f7a d1/d5a/d6d/fca 0 2024-09-17T01:41:41.565 INFO:tasks.workunit.client.0.smithi082.stdout:4/558: fdatasync d9/d15/d16/d18/d4a/d8f/d91/f95 0 2024-09-17T01:41:41.567 INFO:tasks.workunit.client.0.smithi082.stdout:3/498: dwrite d9/db/d49/d4e/d53/d5b/f6c [0,4194304] 0 2024-09-17T01:41:41.568 INFO:tasks.workunit.client.0.smithi082.stdout:2/598: rmdir d1/d66/d85 39 2024-09-17T01:41:41.577 INFO:tasks.workunit.client.0.smithi082.stdout:3/499: getdents d9/d78/d88 0 2024-09-17T01:41:41.580 INFO:tasks.workunit.client.0.smithi082.stdout:2/599: dwrite d1/f9 [4194304,4194304] 0 2024-09-17T01:41:41.580 INFO:tasks.workunit.client.0.smithi082.stdout:3/500: creat d9/db/d26/fac x:0 0 0 2024-09-17T01:41:41.582 INFO:tasks.workunit.client.0.smithi082.stdout:2/600: readlink d1/d5a/d6d/l96 0 2024-09-17T01:41:41.584 INFO:tasks.workunit.client.0.smithi082.stdout:3/501: mkdir d9/db/d26/dad 0 2024-09-17T01:41:41.586 INFO:tasks.workunit.client.0.smithi082.stdout:1/647: dread d2/df/d46/f52 [0,4194304] 0 2024-09-17T01:41:41.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/559: dwrite d9/d15/d16/d3e/f4e [4194304,4194304] 0 2024-09-17T01:41:41.589 INFO:tasks.workunit.client.0.smithi082.stdout:4/560: chown d9/d15/d16/d44/d84/f9c 13812 1 2024-09-17T01:41:41.594 INFO:tasks.workunit.client.0.smithi082.stdout:1/648: chown d2/da/d2f/d47/l99 7810744 1 2024-09-17T01:41:41.602 INFO:tasks.workunit.client.0.smithi082.stdout:2/601: dwrite d1/d17/f53 [0,4194304] 0 2024-09-17T01:41:41.603 INFO:tasks.workunit.client.0.smithi082.stdout:2/602: readlink d1/d17/d38/d42/d52/d78/da0/laf 0 2024-09-17T01:41:41.606 INFO:tasks.workunit.client.0.smithi082.stdout:2/603: chown d1/c5b 1120124507 1 2024-09-17T01:41:41.610 INFO:tasks.workunit.client.0.smithi082.stdout:2/604: creat d1/d5a/fcb x:0 0 0 2024-09-17T01:41:41.612 INFO:tasks.workunit.client.0.smithi082.stdout:3/502: dwrite d9/db/d26/f9e [0,4194304] 0 2024-09-17T01:41:41.613 INFO:tasks.workunit.client.1.smithi167.stdout:7/951: sync 2024-09-17T01:41:41.613 INFO:tasks.workunit.client.0.smithi082.stdout:1/649: dwrite d2/d3f/d24/d54/f74 [0,4194304] 0 2024-09-17T01:41:41.620 INFO:tasks.workunit.client.0.smithi082.stdout:3/503: creat d9/db/d6d/fae x:0 0 0 2024-09-17T01:41:41.621 INFO:tasks.workunit.client.0.smithi082.stdout:1/650: truncate d2/d3f/d24/f7e 431565 0 2024-09-17T01:41:41.625 INFO:tasks.workunit.client.0.smithi082.stdout:4/561: dread d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:41.626 INFO:tasks.workunit.client.0.smithi082.stdout:1/651: creat d2/da/d76/db8/fd2 x:0 0 0 2024-09-17T01:41:41.627 INFO:tasks.workunit.client.0.smithi082.stdout:4/562: rmdir d9/d15/d16/d44/d84 39 2024-09-17T01:41:41.629 INFO:tasks.workunit.client.0.smithi082.stdout:4/563: symlink d9/d15/d16/d18/d4f/db1/lb9 0 2024-09-17T01:41:41.637 INFO:tasks.workunit.client.0.smithi082.stdout:4/564: unlink d9/d15/c40 0 2024-09-17T01:41:41.638 INFO:tasks.workunit.client.0.smithi082.stdout:1/652: dwrite d2/d3f/d24/d54/f9f [0,4194304] 0 2024-09-17T01:41:41.638 INFO:tasks.workunit.client.0.smithi082.stdout:3/504: write d9/db/d26/f31 [1423323,66605] 0 2024-09-17T01:41:41.642 INFO:tasks.workunit.client.0.smithi082.stdout:3/505: dread - d9/db/d6d/fae zero size 2024-09-17T01:41:41.646 INFO:tasks.workunit.client.0.smithi082.stdout:2/605: dwrite d1/d10/f12 [4194304,4194304] 0 2024-09-17T01:41:41.655 INFO:tasks.workunit.client.1.smithi167.stdout:4/995: sync 2024-09-17T01:41:41.655 INFO:tasks.workunit.client.0.smithi082.stdout:4/565: readlink d9/d2b/lb3 0 2024-09-17T01:41:41.656 INFO:tasks.workunit.client.1.smithi167.stdout:4/996: readlink d0/d4/d69/d131/d6/l120 0 2024-09-17T01:41:41.656 INFO:tasks.workunit.client.0.smithi082.stdout:1/653: mknod d2/df/d46/cd3 0 2024-09-17T01:41:41.656 INFO:tasks.workunit.client.0.smithi082.stdout:4/566: chown d9/l10 57 1 2024-09-17T01:41:41.658 INFO:tasks.workunit.client.0.smithi082.stdout:2/606: unlink d1/d17/d29/f6e 0 2024-09-17T01:41:41.658 INFO:tasks.workunit.client.0.smithi082.stdout:4/567: write d9/d15/d16/d3e/d54/fac [882259,7319] 0 2024-09-17T01:41:41.659 INFO:tasks.workunit.client.0.smithi082.stdout:2/607: chown d1/d10/l81 98 1 2024-09-17T01:41:41.660 INFO:tasks.workunit.client.0.smithi082.stdout:2/608: readlink d1/d5a/d6d/lab 0 2024-09-17T01:41:41.661 INFO:tasks.workunit.client.1.smithi167.stdout:4/997: mknod d0/d4/d69/d131/da/d48/c150 0 2024-09-17T01:41:41.662 INFO:tasks.workunit.client.0.smithi082.stdout:1/654: write d2/d3f/f26 [8311840,19388] 0 2024-09-17T01:41:41.662 INFO:tasks.workunit.client.1.smithi167.stdout:4/998: write d0/d4/d69/d13e/d7e/d92/d6a/d81/f8b [351967,86338] 0 2024-09-17T01:41:41.664 INFO:tasks.workunit.client.0.smithi082.stdout:2/609: fdatasync d1/d35/f30 0 2024-09-17T01:41:41.666 INFO:tasks.workunit.client.1.smithi167.stdout:4/999: dread d0/d4/d69/d131/dff/f139 [0,4194304] 0 2024-09-17T01:41:41.667 INFO:tasks.workunit.client.0.smithi082.stdout:4/568: link d9/d15/d16/d3e/f50 d9/d15/d37/d4c/fba 0 2024-09-17T01:41:41.670 INFO:tasks.workunit.client.0.smithi082.stdout:1/655: symlink d2/d3f/ld4 0 2024-09-17T01:41:41.672 INFO:tasks.workunit.client.0.smithi082.stdout:4/569: creat d9/d15/d16/d3e/fbb x:0 0 0 2024-09-17T01:41:41.673 INFO:tasks.workunit.client.0.smithi082.stdout:1/656: rename d2/da/d80/da3/fcd to d2/d3f/d24/dcf/fd5 0 2024-09-17T01:41:41.678 INFO:tasks.workunit.client.0.smithi082.stdout:1/657: creat d2/fd6 x:0 0 0 2024-09-17T01:41:41.678 INFO:tasks.workunit.client.0.smithi082.stdout:4/570: link d9/d15/c29 d9/d15/d16/d18/d4a/d52/cbc 0 2024-09-17T01:41:41.679 INFO:tasks.workunit.client.0.smithi082.stdout:4/571: stat d9/d15/d16/d18/d4a/d52/f6a 0 2024-09-17T01:41:41.681 INFO:tasks.workunit.client.0.smithi082.stdout:1/658: symlink d2/da/d2f/ld7 0 2024-09-17T01:41:41.682 INFO:tasks.workunit.client.0.smithi082.stdout:4/572: mkdir d9/dbd 0 2024-09-17T01:41:41.684 INFO:tasks.workunit.client.0.smithi082.stdout:1/659: creat d2/da/d80/dc6/fd8 x:0 0 0 2024-09-17T01:41:41.688 INFO:tasks.workunit.client.0.smithi082.stdout:1/660: creat d2/da/d2f/d47/fd9 x:0 0 0 2024-09-17T01:41:41.692 INFO:tasks.workunit.client.0.smithi082.stdout:1/661: write d2/da/d2d/f3e [2182844,9352] 0 2024-09-17T01:41:41.693 INFO:tasks.workunit.client.0.smithi082.stdout:3/506: dwrite d9/d35/f9f [0,4194304] 0 2024-09-17T01:41:41.696 INFO:tasks.workunit.client.1.smithi167.stdout:7/952: sync 2024-09-17T01:41:41.699 INFO:tasks.workunit.client.0.smithi082.stdout:1/662: creat d2/d3f/d24/d54/fda x:0 0 0 2024-09-17T01:41:41.700 INFO:tasks.workunit.client.1.smithi167.stdout:7/953: creat d0/d2/d14/d19/d32/d108/f140 x:0 0 0 2024-09-17T01:41:41.701 INFO:tasks.workunit.client.1.smithi167.stdout:7/954: write d0/d2/d14/d19/d32/d62/f64 [1466445,12377] 0 2024-09-17T01:41:41.704 INFO:tasks.workunit.client.1.smithi167.stdout:7/955: write d0/d2/f7a [8798218,31819] 0 2024-09-17T01:41:41.705 INFO:tasks.workunit.client.1.smithi167.stdout:7/956: stat d0/c57 0 2024-09-17T01:41:41.705 INFO:tasks.workunit.client.1.smithi167.stdout:7/957: write d0/d2/d88/d6e/f11d [1485807,52629] 0 2024-09-17T01:41:41.706 INFO:tasks.workunit.client.0.smithi082.stdout:2/610: dwrite d1/d35/f65 [0,4194304] 0 2024-09-17T01:41:41.709 INFO:tasks.workunit.client.0.smithi082.stdout:3/507: dwrite d9/f6f [0,4194304] 0 2024-09-17T01:41:41.710 INFO:tasks.workunit.client.0.smithi082.stdout:2/611: stat d1/d10/l44 0 2024-09-17T01:41:41.713 INFO:tasks.workunit.client.0.smithi082.stdout:4/573: dwrite d9/d15/d16/d18/d4a/d8f/d91/f95 [0,4194304] 0 2024-09-17T01:41:41.713 INFO:tasks.workunit.client.0.smithi082.stdout:3/508: dread - d9/db/d26/fa1 zero size 2024-09-17T01:41:41.715 INFO:tasks.workunit.client.0.smithi082.stdout:3/509: chown d9/db/daa 11418 1 2024-09-17T01:41:41.725 INFO:tasks.workunit.client.0.smithi082.stdout:1/663: dwrite d2/fd6 [0,4194304] 0 2024-09-17T01:41:41.725 INFO:tasks.workunit.client.0.smithi082.stdout:4/574: dread d9/d15/d16/d18/d4a/d52/d55/f9e [0,4194304] 0 2024-09-17T01:41:41.725 INFO:tasks.workunit.client.0.smithi082.stdout:3/510: rename d9/d35/d71 to d9/db/daf 0 2024-09-17T01:41:41.728 INFO:tasks.workunit.client.0.smithi082.stdout:1/664: stat d2/d3f/d24/d54/f9b 0 2024-09-17T01:41:41.729 INFO:tasks.workunit.client.0.smithi082.stdout:4/575: fsync d9/d15/f62 0 2024-09-17T01:41:41.732 INFO:tasks.workunit.client.0.smithi082.stdout:3/511: link d9/db/d49/d4e/d53/f62 d9/db/daf/d69/d79/d86/fb0 0 2024-09-17T01:41:41.733 INFO:tasks.workunit.client.1.smithi167.stdout:7/958: write d0/d2/d14/f18 [109055,98511] 0 2024-09-17T01:41:41.734 INFO:tasks.workunit.client.0.smithi082.stdout:4/576: write d9/d15/d16/d18/d4a/d52/d55/f9e [4561625,61264] 0 2024-09-17T01:41:41.735 INFO:tasks.workunit.client.0.smithi082.stdout:3/512: mknod d9/db/d8f/cb1 0 2024-09-17T01:41:41.738 INFO:tasks.workunit.client.1.smithi167.stdout:7/959: creat d0/d2/d14/d19/d26/d83/da5/f141 x:0 0 0 2024-09-17T01:41:41.740 INFO:tasks.workunit.client.0.smithi082.stdout:4/577: rename d9/d15/d16/c77 to d9/d15/d16/d3e/cbe 0 2024-09-17T01:41:41.743 INFO:tasks.workunit.client.1.smithi167.stdout:7/960: mkdir d0/d2/d14/d19/d26/d83/da5/d70/d128/d142 0 2024-09-17T01:41:41.744 INFO:tasks.workunit.client.1.smithi167.stdout:7/961: readlink d0/d2/d14/d6f/d87/le3 0 2024-09-17T01:41:41.747 INFO:tasks.workunit.client.1.smithi167.stdout:7/962: rename d0/d2/d88/d6e/da3/dd0/fa4 to d0/d2/d14/d19/d26/d83/da5/d70/d128/d142/f143 0 2024-09-17T01:41:41.748 INFO:tasks.workunit.client.0.smithi082.stdout:3/513: link d9/db/daf/d69/c74 d9/cb2 0 2024-09-17T01:41:41.748 INFO:tasks.workunit.client.1.smithi167.stdout:7/963: read - d0/d2/d88/f118 zero size 2024-09-17T01:41:41.749 INFO:tasks.workunit.client.0.smithi082.stdout:2/612: dwrite d1/f1b [0,4194304] 0 2024-09-17T01:41:41.749 INFO:tasks.workunit.client.1.smithi167.stdout:7/964: dread - d0/d2/d14/d6f/d87/dae/f113 zero size 2024-09-17T01:41:41.750 INFO:tasks.workunit.client.1.smithi167.stdout:7/965: fdatasync d0/d2/d14/d19/d26/d83/f115 0 2024-09-17T01:41:41.750 INFO:tasks.workunit.client.0.smithi082.stdout:3/514: fdatasync d9/d78/f8b 0 2024-09-17T01:41:41.752 INFO:tasks.workunit.client.1.smithi167.stdout:7/966: truncate d0/d2/d14/d19/d7f/db4/dbf/f127 94036 0 2024-09-17T01:41:41.752 INFO:tasks.workunit.client.0.smithi082.stdout:2/613: mknod d1/d17/d38/d42/d52/ccc 0 2024-09-17T01:41:41.753 INFO:tasks.workunit.client.1.smithi167.stdout:7/967: write d0/d2/d14/d19/d26/d83/da5/d70/fbb [1859525,121324] 0 2024-09-17T01:41:41.754 INFO:tasks.workunit.client.0.smithi082.stdout:3/515: unlink d9/db/d49/d4e/d53/d5b/l5d 0 2024-09-17T01:41:41.757 INFO:tasks.workunit.client.0.smithi082.stdout:2/614: creat d1/d17/d38/d42/d52/fcd x:0 0 0 2024-09-17T01:41:41.758 INFO:tasks.workunit.client.1.smithi167.stdout:7/968: creat d0/d2/d14/d19/d26/d83/da5/d70/d128/d142/f144 x:0 0 0 2024-09-17T01:41:41.758 INFO:tasks.workunit.client.0.smithi082.stdout:3/516: mknod d9/db/d8f/cb3 0 2024-09-17T01:41:41.760 INFO:tasks.workunit.client.0.smithi082.stdout:1/665: dread d2/da/f6a [0,4194304] 0 2024-09-17T01:41:41.761 INFO:tasks.workunit.client.0.smithi082.stdout:2/615: mknod d1/d17/d29/dc9/cce 0 2024-09-17T01:41:41.762 INFO:tasks.workunit.client.0.smithi082.stdout:1/666: read - d2/df/d46/f9c zero size 2024-09-17T01:41:41.762 INFO:tasks.workunit.client.0.smithi082.stdout:4/578: dread d9/d47/f79 [0,4194304] 0 2024-09-17T01:41:41.763 INFO:tasks.workunit.client.1.smithi167.stdout:7/969: symlink d0/d2/d14/d19/d7f/l145 0 2024-09-17T01:41:41.767 INFO:tasks.workunit.client.0.smithi082.stdout:1/667: symlink d2/df/ldb 0 2024-09-17T01:41:41.775 INFO:tasks.workunit.client.0.smithi082.stdout:1/668: mkdir d2/d3f/d24/d54/ddc 0 2024-09-17T01:41:41.777 INFO:tasks.workunit.client.1.smithi167.stdout:7/970: link d0/d2/d14/d6f/c117 d0/d2/d14/d19/d7f/db4/dbf/c146 0 2024-09-17T01:41:41.778 INFO:tasks.workunit.client.1.smithi167.stdout:7/971: write d0/d2/d14/d6f/d87/dae/f13d [958747,47020] 0 2024-09-17T01:41:41.780 INFO:tasks.workunit.client.0.smithi082.stdout:1/669: creat d2/d3f/d34/fdd x:0 0 0 2024-09-17T01:41:41.782 INFO:tasks.workunit.client.0.smithi082.stdout:1/670: dread - d2/df/d46/f9c zero size 2024-09-17T01:41:41.782 INFO:tasks.workunit.client.0.smithi082.stdout:4/579: creat d9/d15/d16/d18/d4f/fbf x:0 0 0 2024-09-17T01:41:41.783 INFO:tasks.workunit.client.1.smithi167.stdout:7/972: unlink d0/d2/d14/d19/d26/fc0 0 2024-09-17T01:41:41.785 INFO:tasks.workunit.client.0.smithi082.stdout:4/580: chown d9/d15/d16/d3e 1330132 1 2024-09-17T01:41:41.787 INFO:tasks.workunit.client.1.smithi167.stdout:7/973: mknod d0/d2/d88/d6e/da3/c147 0 2024-09-17T01:41:41.787 INFO:tasks.workunit.client.0.smithi082.stdout:2/616: dwrite d1/d10/f28 [0,4194304] 0 2024-09-17T01:41:41.788 INFO:tasks.workunit.client.0.smithi082.stdout:3/517: dread d9/d35/f43 [0,4194304] 0 2024-09-17T01:41:41.789 INFO:tasks.workunit.client.0.smithi082.stdout:4/581: write d9/d15/d37/d45/fa5 [115005,115551] 0 2024-09-17T01:41:41.789 INFO:tasks.workunit.client.1.smithi167.stdout:7/974: dread d0/d2/d14/d19/f3e [0,4194304] 0 2024-09-17T01:41:41.793 INFO:tasks.workunit.client.1.smithi167.stdout:7/975: read d0/d2/d14/d19/d26/f35 [2282526,103642] 0 2024-09-17T01:41:41.794 INFO:tasks.workunit.client.0.smithi082.stdout:1/671: link d2/df/d46/l77 d2/da/d76/db8/lde 0 2024-09-17T01:41:41.796 INFO:tasks.workunit.client.1.smithi167.stdout:7/976: dread d0/d2/d14/d19/d26/ff [0,4194304] 0 2024-09-17T01:41:41.798 INFO:tasks.workunit.client.1.smithi167.stdout:7/977: read d0/d2/d14/d6f/d87/f93 [3109532,31852] 0 2024-09-17T01:41:41.800 INFO:tasks.workunit.client.1.smithi167.stdout:7/978: read d0/d2/d14/d19/d26/fa6 [139233,114198] 0 2024-09-17T01:41:41.801 INFO:tasks.workunit.client.0.smithi082.stdout:1/672: fsync d2/d3f/d24/dcf/fd5 0 2024-09-17T01:41:41.804 INFO:tasks.workunit.client.0.smithi082.stdout:4/582: truncate d9/d15/d16/d18/d4a/d52/d55/f42 3482957 0 2024-09-17T01:41:41.807 INFO:tasks.workunit.client.0.smithi082.stdout:1/673: unlink d2/d3f/d24/d54/fae 0 2024-09-17T01:41:41.810 INFO:tasks.workunit.client.0.smithi082.stdout:2/617: dread d1/f16 [0,4194304] 0 2024-09-17T01:41:41.810 INFO:tasks.workunit.client.0.smithi082.stdout:4/583: symlink d9/d15/d16/d18/d4a/d8f/d91/lc0 0 2024-09-17T01:41:41.812 INFO:tasks.workunit.client.0.smithi082.stdout:2/618: rename d1/d17/d38/d42/d52/d78 to d1/d17/d38/d42/d52/d78/dcf 22 2024-09-17T01:41:41.812 INFO:tasks.workunit.client.0.smithi082.stdout:1/674: write d2/df/d46/f49 [358683,50807] 0 2024-09-17T01:41:41.813 INFO:tasks.workunit.client.0.smithi082.stdout:3/518: getdents d9/db/daf/d69/d79 0 2024-09-17T01:41:41.816 INFO:tasks.workunit.client.1.smithi167.stdout:7/979: dread d0/d2/d14/d19/d32/d62/fb0 [0,4194304] 0 2024-09-17T01:41:41.817 INFO:tasks.workunit.client.0.smithi082.stdout:2/619: rename d1/d10/f2f to d1/d10/fd0 0 2024-09-17T01:41:41.817 INFO:tasks.workunit.client.0.smithi082.stdout:3/519: mknod d9/d78/cb4 0 2024-09-17T01:41:41.818 INFO:tasks.workunit.client.0.smithi082.stdout:1/675: chown d2/da/d2d/d79/l82 18314 1 2024-09-17T01:41:41.821 INFO:tasks.workunit.client.0.smithi082.stdout:2/620: rmdir d1/d5a/d6d 39 2024-09-17T01:41:41.821 INFO:tasks.workunit.client.1.smithi167.stdout:7/980: read d0/d2/d14/d19/d22/fc6 [1275677,57513] 0 2024-09-17T01:41:41.822 INFO:tasks.workunit.client.0.smithi082.stdout:2/621: truncate d1/d10/f28 4359205 0 2024-09-17T01:41:41.822 INFO:tasks.workunit.client.0.smithi082.stdout:3/520: truncate d9/db/d26/f27 2357158 0 2024-09-17T01:41:41.822 INFO:tasks.workunit.client.0.smithi082.stdout:1/676: rmdir d2/da/d2f 39 2024-09-17T01:41:41.824 INFO:tasks.workunit.client.1.smithi167.stdout:7/981: fdatasync d0/d2/d14/d6f/fe0 0 2024-09-17T01:41:41.825 INFO:tasks.workunit.client.0.smithi082.stdout:2/622: mknod d1/d90/cd1 0 2024-09-17T01:41:41.826 INFO:tasks.workunit.client.0.smithi082.stdout:1/677: mkdir d2/da/d80/ddf 0 2024-09-17T01:41:41.827 INFO:tasks.workunit.client.0.smithi082.stdout:3/521: mkdir d9/db/daf/d69/d79/d86/db5 0 2024-09-17T01:41:41.829 INFO:tasks.workunit.client.0.smithi082.stdout:4/584: link d9/d15/d16/d18/f32 d9/d15/fc1 0 2024-09-17T01:41:41.833 INFO:tasks.workunit.client.1.smithi167.stdout:7/982: mkdir d0/d148 0 2024-09-17T01:41:41.834 INFO:tasks.workunit.client.0.smithi082.stdout:1/678: mkdir d2/d3f/d24/dc8/de0 0 2024-09-17T01:41:41.836 INFO:tasks.workunit.client.0.smithi082.stdout:3/522: symlink d9/db/daf/d69/d9c/lb6 0 2024-09-17T01:41:41.838 INFO:tasks.workunit.client.0.smithi082.stdout:4/585: mkdir d9/d47/dc2 0 2024-09-17T01:41:41.844 INFO:tasks.workunit.client.0.smithi082.stdout:3/523: creat d9/db/daf/d69/d79/d86/fb7 x:0 0 0 2024-09-17T01:41:41.847 INFO:tasks.workunit.client.1.smithi167.stdout:7/983: getdents d0/d2/d14/d19/d26/d83/da5 0 2024-09-17T01:41:41.849 INFO:tasks.workunit.client.0.smithi082.stdout:3/524: read d9/f21 [204941,122720] 0 2024-09-17T01:41:41.850 INFO:tasks.workunit.client.0.smithi082.stdout:3/525: write d9/db/d49/d4e/d53/d5b/f6c [2905399,80342] 0 2024-09-17T01:41:41.854 INFO:tasks.workunit.client.0.smithi082.stdout:2/623: write d1/d17/f7a [556648,41560] 0 2024-09-17T01:41:41.856 INFO:tasks.workunit.client.0.smithi082.stdout:4/586: rename d9/d15/d16/d18/d4a/d8f/d91/lc0 to d9/d15/lc3 0 2024-09-17T01:41:41.857 INFO:tasks.workunit.client.0.smithi082.stdout:4/587: readlink d9/d15/d16/d18/d4a/d52/lad 0 2024-09-17T01:41:41.857 INFO:tasks.workunit.client.0.smithi082.stdout:3/526: symlink d9/db/daf/d69/lb8 0 2024-09-17T01:41:41.859 INFO:tasks.workunit.client.0.smithi082.stdout:1/679: link d2/da/d2d/f41 d2/d3f/fe1 0 2024-09-17T01:41:41.860 INFO:tasks.workunit.client.0.smithi082.stdout:1/680: stat d2/da/d2d/d79 0 2024-09-17T01:41:41.860 INFO:tasks.workunit.client.0.smithi082.stdout:4/588: truncate d9/d15/d16/d18/d4a/d8f/d91/fa6 729350 0 2024-09-17T01:41:41.861 INFO:tasks.workunit.client.1.smithi167.stdout:7/984: write d0/d2/d14/d6f/fa0 [209797,99723] 0 2024-09-17T01:41:41.862 INFO:tasks.workunit.client.1.smithi167.stdout:7/985: readlink d0/d2/d14/d19/d32/lec 0 2024-09-17T01:41:41.866 INFO:tasks.workunit.client.0.smithi082.stdout:3/527: dwrite d9/db/d26/f96 [0,4194304] 0 2024-09-17T01:41:41.869 INFO:tasks.workunit.client.0.smithi082.stdout:4/589: chown d9/d15/d16/d18/d4a/d52/c65 1037863799 1 2024-09-17T01:41:41.871 INFO:tasks.workunit.client.1.smithi167.stdout:7/986: dread d0/d2/d88/d6e/f11d [0,4194304] 0 2024-09-17T01:41:41.871 INFO:tasks.workunit.client.0.smithi082.stdout:3/528: write d9/db/d26/f3a [1147785,48163] 0 2024-09-17T01:41:41.871 INFO:tasks.workunit.client.0.smithi082.stdout:2/624: write d1/d10/f41 [805215,55163] 0 2024-09-17T01:41:41.871 INFO:tasks.workunit.client.0.smithi082.stdout:1/681: dwrite d2/da/d76/d93/fb7 [0,4194304] 0 2024-09-17T01:41:41.881 INFO:tasks.workunit.client.0.smithi082.stdout:4/590: rename d9/d15/d37/c43 to d9/d15/d37/d4c/cc4 0 2024-09-17T01:41:41.885 INFO:tasks.workunit.client.0.smithi082.stdout:1/682: dwrite d2/d3f/d24/dcf/fd5 [0,4194304] 0 2024-09-17T01:41:41.885 INFO:tasks.workunit.client.0.smithi082.stdout:4/591: dread - d9/d15/d16/d18/d4a/faf zero size 2024-09-17T01:41:41.885 INFO:tasks.workunit.client.1.smithi167.stdout:7/987: dread d0/d2/d14/f107 [0,4194304] 0 2024-09-17T01:41:41.887 INFO:tasks.workunit.client.0.smithi082.stdout:3/529: rename d9/db/daf/d69/d9c/l9b to d9/db/d26/lb9 0 2024-09-17T01:41:41.888 INFO:tasks.workunit.client.0.smithi082.stdout:4/592: dread d9/d15/d16/d3e/f3f [0,4194304] 0 2024-09-17T01:41:41.890 INFO:tasks.workunit.client.0.smithi082.stdout:1/683: rename d2/da/d2d/d6c/f9d to d2/da/d76/d93/fe2 0 2024-09-17T01:41:41.895 INFO:tasks.workunit.client.0.smithi082.stdout:2/625: truncate d1/d17/d38/d5c/f79 130224 0 2024-09-17T01:41:41.898 INFO:tasks.workunit.client.0.smithi082.stdout:3/530: link d9/db/l25 d9/db/d49/da4/lba 0 2024-09-17T01:41:41.899 INFO:tasks.workunit.client.0.smithi082.stdout:1/684: truncate d2/da/d2f/d47/f50 758108 0 2024-09-17T01:41:41.900 INFO:tasks.workunit.client.0.smithi082.stdout:1/685: chown d2/da/d76/d93/fcb 2942 1 2024-09-17T01:41:41.902 INFO:tasks.workunit.client.1.smithi167.stdout:7/988: dwrite d0/d2/d14/d19/f77 [0,4194304] 0 2024-09-17T01:41:41.902 INFO:tasks.workunit.client.0.smithi082.stdout:2/626: creat d1/d35/fd2 x:0 0 0 2024-09-17T01:41:41.909 INFO:tasks.workunit.client.0.smithi082.stdout:3/531: dwrite d9/db/d49/d4e/d53/f58 [0,4194304] 0 2024-09-17T01:41:41.909 INFO:tasks.workunit.client.0.smithi082.stdout:3/532: chown d9/db/l7a 10089762 1 2024-09-17T01:41:41.909 INFO:tasks.workunit.client.1.smithi167.stdout:7/989: rmdir d0/d2/d14/d6f/d87/dae 39 2024-09-17T01:41:41.909 INFO:tasks.workunit.client.1.smithi167.stdout:7/990: chown d0/d2/d14/d19/d7f/db4/dbf 32 1 2024-09-17T01:41:41.913 INFO:tasks.workunit.client.1.smithi167.stdout:7/991: dread d0/d2/d88/df5/ffe [0,4194304] 0 2024-09-17T01:41:41.913 INFO:tasks.workunit.client.1.smithi167.stdout:7/992: chown d0/d2/f9d 1634 1 2024-09-17T01:41:41.914 INFO:tasks.workunit.client.0.smithi082.stdout:3/533: creat d9/db/d26/dad/fbb x:0 0 0 2024-09-17T01:41:41.914 INFO:tasks.workunit.client.0.smithi082.stdout:4/593: dwrite d9/d15/d37/f90 [0,4194304] 0 2024-09-17T01:41:41.919 INFO:tasks.workunit.client.0.smithi082.stdout:4/594: chown d9/d15/d16/d3e/d54/c58 164805179 1 2024-09-17T01:41:41.920 INFO:tasks.workunit.client.0.smithi082.stdout:3/534: mkdir d9/db/daf/d69/dbc 0 2024-09-17T01:41:41.922 INFO:tasks.workunit.client.0.smithi082.stdout:2/627: write d1/d10/f7f [56209,3783] 0 2024-09-17T01:41:41.926 INFO:tasks.workunit.client.0.smithi082.stdout:1/686: dwrite d2/da/f58 [0,4194304] 0 2024-09-17T01:41:41.926 INFO:tasks.workunit.client.0.smithi082.stdout:2/628: fdatasync d1/d35/f65 0 2024-09-17T01:41:41.926 INFO:tasks.workunit.client.0.smithi082.stdout:3/535: mkdir d9/db/d26/dbd 0 2024-09-17T01:41:41.930 INFO:tasks.workunit.client.0.smithi082.stdout:1/687: fsync d2/da/d2d/f45 0 2024-09-17T01:41:41.934 INFO:tasks.workunit.client.1.smithi167.stdout:7/993: truncate d0/d2/d14/d6f/d8b/fe6 50659 0 2024-09-17T01:41:41.934 INFO:tasks.workunit.client.0.smithi082.stdout:2/629: truncate d1/d5a/d6d/fca 1391196 0 2024-09-17T01:41:41.935 INFO:tasks.workunit.client.0.smithi082.stdout:4/595: dwrite d9/d15/d16/d18/d4a/d52/f82 [0,4194304] 0 2024-09-17T01:41:41.937 INFO:tasks.workunit.client.0.smithi082.stdout:1/688: symlink d2/df/le3 0 2024-09-17T01:41:41.937 INFO:tasks.workunit.client.0.smithi082.stdout:1/689: chown d2/df/d46/f9c 128089385 1 2024-09-17T01:41:41.938 INFO:tasks.workunit.client.0.smithi082.stdout:2/630: creat d1/d17/d29/dc9/fd3 x:0 0 0 2024-09-17T01:41:41.939 INFO:tasks.workunit.client.0.smithi082.stdout:2/631: readlink d1/d10/l81 0 2024-09-17T01:41:41.943 INFO:tasks.workunit.client.0.smithi082.stdout:1/690: fdatasync d2/da/d2f/d47/f4d 0 2024-09-17T01:41:41.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/413: sync 2024-09-17T01:41:41.944 INFO:tasks.workunit.client.0.smithi082.stdout:1/691: stat d2/da/d16/c7a 0 2024-09-17T01:41:41.946 INFO:tasks.workunit.client.0.smithi082.stdout:4/596: getdents d9/d15/d16/d18 0 2024-09-17T01:41:41.949 INFO:tasks.workunit.client.0.smithi082.stdout:3/536: write f6 [2435022,20823] 0 2024-09-17T01:41:41.950 INFO:tasks.workunit.client.0.smithi082.stdout:1/692: getdents d2/d3f/d24/dc8/de0 0 2024-09-17T01:41:41.950 INFO:tasks.workunit.client.0.smithi082.stdout:3/537: stat d9/db/daf/fa8 0 2024-09-17T01:41:41.951 INFO:tasks.workunit.client.0.smithi082.stdout:4/597: mknod d9/d15/d16/cc5 0 2024-09-17T01:41:41.952 INFO:tasks.workunit.client.0.smithi082.stdout:3/538: fsync d9/db/daf/d69/d79/fab 0 2024-09-17T01:41:41.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/539: creat d9/db/d8f/fbe x:0 0 0 2024-09-17T01:41:41.959 INFO:tasks.workunit.client.0.smithi082.stdout:3/540: write d9/db/d49/d4e/d53/d5b/f84 [562706,32170] 0 2024-09-17T01:41:41.960 INFO:tasks.workunit.client.0.smithi082.stdout:2/632: dread d1/d17/d29/f33 [0,4194304] 0 2024-09-17T01:41:41.962 INFO:tasks.workunit.client.1.smithi167.stdout:7/994: truncate d0/d2/d14/d19/d22/f8d 3772486 0 2024-09-17T01:41:41.964 INFO:tasks.workunit.client.0.smithi082.stdout:0/414: write da/fd [4902413,53748] 0 2024-09-17T01:41:41.965 INFO:tasks.workunit.client.1.smithi167.stdout:7/995: creat d0/d2/d14/d19/d26/d83/da5/d5b/f149 x:0 0 0 2024-09-17T01:41:41.967 INFO:tasks.workunit.client.0.smithi082.stdout:1/693: write d2/da/d2f/f31 [799894,124773] 0 2024-09-17T01:41:41.967 INFO:tasks.workunit.client.1.smithi167.stdout:7/996: chown d0/d2/d14/d6f/d87/dae 8242377 1 2024-09-17T01:41:41.968 INFO:tasks.workunit.client.0.smithi082.stdout:3/541: dwrite d9/db/d26/fac [0,4194304] 0 2024-09-17T01:41:41.971 INFO:tasks.workunit.client.1.smithi167.stdout:7/997: creat d0/d2/d14/d19/d26/d83/da5/d70/d128/f14a x:0 0 0 2024-09-17T01:41:41.975 INFO:tasks.workunit.client.0.smithi082.stdout:2/633: dwrite d1/d17/d60/fb4 [0,4194304] 0 2024-09-17T01:41:41.978 INFO:tasks.workunit.client.0.smithi082.stdout:0/415: truncate da/df/d71/f2e 559312 0 2024-09-17T01:41:41.980 INFO:tasks.workunit.client.0.smithi082.stdout:4/598: dwrite d9/d15/d16/d18/d4a/d52/f6a [0,4194304] 0 2024-09-17T01:41:41.981 INFO:tasks.workunit.client.0.smithi082.stdout:1/694: symlink d2/da/d16/le4 0 2024-09-17T01:41:41.984 INFO:tasks.workunit.client.0.smithi082.stdout:2/634: symlink d1/d35/db1/ld4 0 2024-09-17T01:41:41.984 INFO:tasks.workunit.client.0.smithi082.stdout:0/416: dread - da/df/d2b/f89 zero size 2024-09-17T01:41:41.985 INFO:tasks.workunit.client.0.smithi082.stdout:3/542: dread d9/db/d49/d4e/d53/f58 [0,4194304] 0 2024-09-17T01:41:41.989 INFO:tasks.workunit.client.0.smithi082.stdout:1/695: creat d2/da/d80/da3/fe5 x:0 0 0 2024-09-17T01:41:41.990 INFO:tasks.workunit.client.1.smithi167.stdout:7/998: dread d0/d2/d14/d19/d22/fe7 [0,4194304] 0 2024-09-17T01:41:41.990 INFO:tasks.workunit.client.1.smithi167.stdout:7/999: fsync d0/d2/d14/d6f/fa0 0 2024-09-17T01:41:41.991 INFO:tasks.workunit.client.0.smithi082.stdout:3/543: unlink d9/d35/f91 0 2024-09-17T01:41:41.992 INFO:tasks.workunit.client.0.smithi082.stdout:4/599: chown d9/d15/d16/d3e/cbe 181568 1 2024-09-17T01:41:41.992 INFO:tasks.workunit.client.0.smithi082.stdout:3/544: chown d9/db/d6d/fae 32255 1 2024-09-17T01:41:41.994 INFO:tasks.workunit.client.0.smithi082.stdout:4/600: dread - d9/d15/d16/d18/d4a/d52/f9a zero size 2024-09-17T01:41:41.994 INFO:tasks.workunit.client.1.smithi167.stderr:+ rm -rf -- ./tmp.kJFn5dBISa 2024-09-17T01:41:41.995 INFO:tasks.workunit.client.0.smithi082.stdout:0/417: fsync da/df/d2b/d59/d8f/f81 0 2024-09-17T01:41:41.995 INFO:tasks.workunit.client.0.smithi082.stdout:1/696: stat d2/d3f/f5a 0 2024-09-17T01:41:41.997 INFO:tasks.workunit.client.0.smithi082.stdout:1/697: fdatasync d2/df/d46/f49 0 2024-09-17T01:41:41.998 INFO:tasks.workunit.client.0.smithi082.stdout:0/418: chown da/d1b/c79 24 1 2024-09-17T01:41:41.999 INFO:tasks.workunit.client.0.smithi082.stdout:0/419: chown da/df/f15 334764 1 2024-09-17T01:41:42.002 INFO:tasks.workunit.client.0.smithi082.stdout:4/601: dwrite d9/d15/d16/d3e/f4e [0,4194304] 0 2024-09-17T01:41:42.003 INFO:tasks.workunit.client.0.smithi082.stdout:1/698: rename d2/d3f/d24/d54/ddc to d2/d3f/d24/db5/de6 0 2024-09-17T01:41:42.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:41 smithi167 ceph-mon[35643]: pgmap v24: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 116 MiB/s rd, 310 MiB/s wr, 616 op/s 2024-09-17T01:41:42.004 INFO:tasks.workunit.client.0.smithi082.stdout:0/420: mkdir da/df/d71/d92 0 2024-09-17T01:41:42.007 INFO:tasks.workunit.client.0.smithi082.stdout:4/602: fdatasync d9/d15/f7a 0 2024-09-17T01:41:42.009 INFO:tasks.workunit.client.0.smithi082.stdout:1/699: unlink d2/df/d46/cd3 0 2024-09-17T01:41:42.009 INFO:tasks.workunit.client.0.smithi082.stdout:1/700: readlink d2/df/ldb 0 2024-09-17T01:41:42.013 INFO:tasks.workunit.client.0.smithi082.stdout:1/701: dread d2/da/f35 [0,4194304] 0 2024-09-17T01:41:42.017 INFO:tasks.workunit.client.0.smithi082.stdout:4/603: mknod d9/d47/cc6 0 2024-09-17T01:41:42.020 INFO:tasks.workunit.client.0.smithi082.stdout:1/702: dwrite d2/d3f/f26 [4194304,4194304] 0 2024-09-17T01:41:42.021 INFO:tasks.workunit.client.0.smithi082.stdout:3/545: dread d9/db/f11 [0,4194304] 0 2024-09-17T01:41:42.027 INFO:tasks.workunit.client.0.smithi082.stdout:4/604: rename d9/d15/d16/d18/d4f/f6e to d9/d15/d37/d45/fc7 0 2024-09-17T01:41:42.028 INFO:tasks.workunit.client.0.smithi082.stdout:2/635: truncate d1/d35/fa1 3235695 0 2024-09-17T01:41:42.030 INFO:tasks.workunit.client.0.smithi082.stdout:1/703: read d2/da/d16/fb9 [960891,100131] 0 2024-09-17T01:41:42.031 INFO:tasks.workunit.client.0.smithi082.stdout:3/546: mkdir d9/db/daf/dbf 0 2024-09-17T01:41:42.032 INFO:tasks.workunit.client.0.smithi082.stdout:4/605: rmdir d9/d15/d37/d45 39 2024-09-17T01:41:42.033 INFO:tasks.workunit.client.0.smithi082.stdout:2/636: symlink d1/d17/d60/ld5 0 2024-09-17T01:41:42.035 INFO:tasks.workunit.client.0.smithi082.stdout:1/704: creat d2/d3f/d24/d54/fe7 x:0 0 0 2024-09-17T01:41:42.037 INFO:tasks.workunit.client.0.smithi082.stdout:4/606: creat d9/d15/d16/d18/d4f/fc8 x:0 0 0 2024-09-17T01:41:42.039 INFO:tasks.workunit.client.0.smithi082.stdout:4/607: write d9/d15/d16/d18/d4a/d52/d55/f9e [631142,91995] 0 2024-09-17T01:41:42.040 INFO:tasks.workunit.client.0.smithi082.stdout:3/547: creat d9/db/d26/dbd/fc0 x:0 0 0 2024-09-17T01:41:42.044 INFO:tasks.workunit.client.0.smithi082.stdout:3/548: rmdir d9/db/d26 39 2024-09-17T01:41:42.046 INFO:tasks.workunit.client.0.smithi082.stdout:1/705: rename d2/d3f/f7f to d2/d3f/d34/fe8 0 2024-09-17T01:41:42.047 INFO:tasks.workunit.client.0.smithi082.stdout:4/608: fdatasync d9/d15/fc1 0 2024-09-17T01:41:42.049 INFO:tasks.workunit.client.0.smithi082.stdout:4/609: read d9/d15/d16/d18/d4a/d52/f82 [2683896,59685] 0 2024-09-17T01:41:42.049 INFO:tasks.workunit.client.0.smithi082.stdout:1/706: creat d2/da/d80/dc6/fe9 x:0 0 0 2024-09-17T01:41:42.051 INFO:tasks.workunit.client.0.smithi082.stdout:3/549: creat d9/db/daa/fc1 x:0 0 0 2024-09-17T01:41:42.053 INFO:tasks.workunit.client.0.smithi082.stdout:4/610: creat d9/d15/d16/d18/d4a/d52/fc9 x:0 0 0 2024-09-17T01:41:42.053 INFO:tasks.workunit.client.0.smithi082.stdout:4/611: chown d9/f46 1561877040 1 2024-09-17T01:41:42.056 INFO:tasks.workunit.client.0.smithi082.stdout:3/550: mkdir d9/db/daf/d69/d9c/dc2 0 2024-09-17T01:41:42.056 INFO:tasks.workunit.client.0.smithi082.stdout:3/551: chown d9/db/f37 1891488451 1 2024-09-17T01:41:42.057 INFO:tasks.workunit.client.0.smithi082.stdout:4/612: creat d9/d47/fca x:0 0 0 2024-09-17T01:41:42.058 INFO:tasks.workunit.client.0.smithi082.stdout:4/613: chown d9/d15/d16/d18/d4a/d52/l93 100090638 1 2024-09-17T01:41:42.058 INFO:tasks.workunit.client.0.smithi082.stdout:3/552: fdatasync d9/db/d26/f96 0 2024-09-17T01:41:42.062 INFO:tasks.workunit.client.0.smithi082.stdout:3/553: creat d9/db/daf/d69/d79/fc3 x:0 0 0 2024-09-17T01:41:42.065 INFO:tasks.workunit.client.0.smithi082.stdout:3/554: readlink d9/db/daf/d69/d79/d86/l9a 0 2024-09-17T01:41:42.067 INFO:tasks.workunit.client.0.smithi082.stdout:4/614: dwrite d9/d15/d37/d45/fa5 [0,4194304] 0 2024-09-17T01:41:42.068 INFO:tasks.workunit.client.0.smithi082.stdout:3/555: rmdir d9/db/daf/d69/d79 39 2024-09-17T01:41:42.069 INFO:tasks.workunit.client.0.smithi082.stdout:3/556: dread - d9/db/daf/f75 zero size 2024-09-17T01:41:42.070 INFO:tasks.workunit.client.0.smithi082.stdout:4/615: stat d9/d15/d16/l28 0 2024-09-17T01:41:42.076 INFO:tasks.workunit.client.0.smithi082.stdout:4/616: dread d9/fa [0,4194304] 0 2024-09-17T01:41:42.077 INFO:tasks.workunit.client.0.smithi082.stdout:4/617: chown d9/d47 32 1 2024-09-17T01:41:42.080 INFO:tasks.workunit.client.0.smithi082.stdout:4/618: symlink d9/lcb 0 2024-09-17T01:41:42.081 INFO:tasks.workunit.client.0.smithi082.stdout:3/557: dread d9/db/f13 [0,4194304] 0 2024-09-17T01:41:42.083 INFO:tasks.workunit.client.0.smithi082.stdout:4/619: mknod d9/d15/d16/d3e/d54/ccc 0 2024-09-17T01:41:42.086 INFO:tasks.workunit.client.0.smithi082.stdout:3/558: mknod d9/db/daf/d69/d9c/dc2/cc4 0 2024-09-17T01:41:42.087 INFO:tasks.workunit.client.0.smithi082.stdout:4/620: stat d9/d2b/faa 0 2024-09-17T01:41:42.088 INFO:tasks.workunit.client.0.smithi082.stdout:3/559: mknod d9/d35/d63/cc5 0 2024-09-17T01:41:42.092 INFO:tasks.workunit.client.0.smithi082.stdout:3/560: rename f6 to d9/db/d8f/fc6 0 2024-09-17T01:41:42.093 INFO:tasks.workunit.client.0.smithi082.stdout:4/621: dread - d9/d15/d16/d44/f80 zero size 2024-09-17T01:41:42.093 INFO:tasks.workunit.client.0.smithi082.stdout:3/561: fsync d9/db/d49/d4e/d53/f54 0 2024-09-17T01:41:42.095 INFO:tasks.workunit.client.0.smithi082.stdout:4/622: readlink d9/d15/d16/la4 0 2024-09-17T01:41:42.100 INFO:tasks.workunit.client.0.smithi082.stdout:4/623: creat d9/d15/d16/d18/d4a/d52/fcd x:0 0 0 2024-09-17T01:41:42.100 INFO:tasks.workunit.client.0.smithi082.stdout:3/562: dwrite d9/db/d26/dad/fbb [0,4194304] 0 2024-09-17T01:41:42.102 INFO:tasks.workunit.client.0.smithi082.stdout:3/563: chown d9/db/fa9 0 1 2024-09-17T01:41:42.109 INFO:tasks.workunit.client.0.smithi082.stdout:3/564: write d9/db/f11 [3363915,92120] 0 2024-09-17T01:41:42.116 INFO:tasks.workunit.client.0.smithi082.stdout:4/624: dread d9/d15/f1e [0,4194304] 0 2024-09-17T01:41:42.116 INFO:tasks.workunit.client.0.smithi082.stdout:0/421: write da/d1b/d23/d4d/f2a [44726,110444] 0 2024-09-17T01:41:42.117 INFO:tasks.workunit.client.0.smithi082.stdout:3/565: creat d9/db/daf/d69/d9c/dc2/fc7 x:0 0 0 2024-09-17T01:41:42.119 INFO:tasks.workunit.client.0.smithi082.stdout:0/422: stat da/df/d27/c2c 0 2024-09-17T01:41:42.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/566: creat d9/db/daf/d69/dbc/fc8 x:0 0 0 2024-09-17T01:41:42.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/567: chown d9/db/d26/f31 227979825 1 2024-09-17T01:41:42.127 INFO:tasks.workunit.client.0.smithi082.stdout:4/625: creat d9/d15/d37/fce x:0 0 0 2024-09-17T01:41:42.131 INFO:tasks.workunit.client.0.smithi082.stdout:3/568: creat d9/db/daf/d69/dbc/fc9 x:0 0 0 2024-09-17T01:41:42.136 INFO:tasks.workunit.client.0.smithi082.stdout:4/626: dwrite d9/d15/d16/d18/d4a/d52/fcd [0,4194304] 0 2024-09-17T01:41:42.139 INFO:tasks.workunit.client.0.smithi082.stdout:3/569: rename d9/db/cd to d9/db/daf/d69/d9c/cca 0 2024-09-17T01:41:42.151 INFO:tasks.workunit.client.0.smithi082.stdout:2/637: write d1/d17/d38/d5c/f79 [356783,128481] 0 2024-09-17T01:41:42.154 INFO:tasks.workunit.client.0.smithi082.stdout:2/638: chown d1/d66/d85/fad 246098198 1 2024-09-17T01:41:42.161 INFO:tasks.workunit.client.0.smithi082.stdout:2/639: creat d1/d66/fd6 x:0 0 0 2024-09-17T01:41:42.162 INFO:tasks.workunit.client.0.smithi082.stdout:3/570: dread d9/db/d26/f3a [0,4194304] 0 2024-09-17T01:41:42.172 INFO:tasks.workunit.client.0.smithi082.stdout:2/640: rename d1/d17/d29/c9b to d1/d35/cd7 0 2024-09-17T01:41:42.173 INFO:tasks.workunit.client.0.smithi082.stdout:2/641: stat d1/d35/db1/ld4 0 2024-09-17T01:41:42.178 INFO:tasks.workunit.client.0.smithi082.stdout:3/571: dread d9/db/daf/f6e [0,4194304] 0 2024-09-17T01:41:42.185 INFO:tasks.workunit.client.0.smithi082.stdout:2/642: creat d1/d17/d38/d42/fd8 x:0 0 0 2024-09-17T01:41:42.185 INFO:tasks.workunit.client.0.smithi082.stdout:3/572: symlink d9/db/d49/d4e/lcb 0 2024-09-17T01:41:42.187 INFO:tasks.workunit.client.0.smithi082.stdout:2/643: write d1/d17/d38/f99 [2381363,23886] 0 2024-09-17T01:41:42.187 INFO:tasks.workunit.client.0.smithi082.stdout:3/573: fdatasync d9/d35/f43 0 2024-09-17T01:41:42.190 INFO:tasks.workunit.client.0.smithi082.stdout:2/644: creat d1/d17/d29/d50/fd9 x:0 0 0 2024-09-17T01:41:42.193 INFO:tasks.workunit.client.0.smithi082.stdout:2/645: mknod d1/d17/cda 0 2024-09-17T01:41:42.198 INFO:tasks.workunit.client.0.smithi082.stdout:2/646: dwrite d1/d10/f41 [0,4194304] 0 2024-09-17T01:41:42.201 INFO:tasks.workunit.client.0.smithi082.stdout:2/647: symlink d1/d17/d60/ldb 0 2024-09-17T01:41:42.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:41 smithi082 ceph-mon[28077]: pgmap v24: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 116 MiB/s rd, 310 MiB/s wr, 616 op/s 2024-09-17T01:41:42.216 INFO:tasks.workunit.client.0.smithi082.stdout:4/627: write d9/d15/d16/d18/d4a/d52/d55/f42 [1910919,48019] 0 2024-09-17T01:41:42.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/628: dwrite d9/d15/d16/d18/d4a/d8f/d91/f95 [0,4194304] 0 2024-09-17T01:41:42.229 INFO:tasks.workunit.client.0.smithi082.stdout:4/629: creat d9/d15/d37/fcf x:0 0 0 2024-09-17T01:41:42.230 INFO:tasks.workunit.client.0.smithi082.stdout:4/630: stat d9/d15/d16/d18/d4a/d8f/la9 0 2024-09-17T01:41:42.232 INFO:tasks.workunit.client.0.smithi082.stdout:2/648: write d1/d17/d60/f6f [496878,95529] 0 2024-09-17T01:41:42.236 INFO:tasks.workunit.client.0.smithi082.stdout:2/649: mkdir d1/d17/d29/ddc 0 2024-09-17T01:41:42.239 INFO:tasks.workunit.client.0.smithi082.stdout:2/650: dread d1/d17/d60/f6f [0,4194304] 0 2024-09-17T01:41:42.241 INFO:tasks.workunit.client.0.smithi082.stdout:4/631: truncate d9/d2b/f7b 326798 0 2024-09-17T01:41:42.246 INFO:tasks.workunit.client.0.smithi082.stdout:4/632: creat d9/d15/d16/d18/d4a/d8f/fd0 x:0 0 0 2024-09-17T01:41:42.247 INFO:tasks.workunit.client.0.smithi082.stdout:4/633: chown d9/d15/d16/d18/d4a/d8f/d91/fa6 14668 1 2024-09-17T01:41:42.250 INFO:tasks.workunit.client.0.smithi082.stdout:2/651: creat d1/d66/fdd x:0 0 0 2024-09-17T01:41:42.253 INFO:tasks.workunit.client.0.smithi082.stdout:2/652: mkdir d1/d66/d85/dde 0 2024-09-17T01:41:42.254 INFO:tasks.workunit.client.0.smithi082.stdout:4/634: dwrite d9/d15/d16/d3e/f4e [4194304,4194304] 0 2024-09-17T01:41:42.255 INFO:tasks.workunit.client.0.smithi082.stdout:7/580: sync 2024-09-17T01:41:42.255 INFO:tasks.workunit.client.0.smithi082.stdout:2/653: mkdir d1/d35/db1/ddf 0 2024-09-17T01:41:42.256 INFO:tasks.workunit.client.0.smithi082.stdout:2/654: readlink d1/d17/lb2 0 2024-09-17T01:41:42.262 INFO:tasks.workunit.client.0.smithi082.stdout:7/581: rename d0/d62/d7e/fa4 to d0/dd/d34/fc5 0 2024-09-17T01:41:42.266 INFO:tasks.workunit.client.0.smithi082.stdout:7/582: readlink d0/l3e 0 2024-09-17T01:41:42.266 INFO:tasks.workunit.client.0.smithi082.stdout:7/583: chown d0/d3/db/fe 1892 1 2024-09-17T01:41:42.267 INFO:tasks.workunit.client.0.smithi082.stdout:4/635: fsync d9/d15/d16/d18/d4a/d8f/fd0 0 2024-09-17T01:41:42.271 INFO:tasks.workunit.client.0.smithi082.stdout:2/655: getdents d1/d17/d29/d50 0 2024-09-17T01:41:42.271 INFO:tasks.workunit.client.0.smithi082.stdout:2/656: chown d1/d17/d60/ldb 22 1 2024-09-17T01:41:42.272 INFO:tasks.workunit.client.0.smithi082.stdout:4/636: stat d9/d15/lb0 0 2024-09-17T01:41:42.277 INFO:tasks.workunit.client.0.smithi082.stdout:7/584: rename d0/dd/d2c/d42/d77/fbe to d0/dd/d2c/d42/d77/db2/fc6 0 2024-09-17T01:41:42.278 INFO:tasks.workunit.client.0.smithi082.stdout:7/585: fdatasync d0/dd/f1f 0 2024-09-17T01:41:42.278 INFO:tasks.workunit.client.0.smithi082.stdout:4/637: dread d9/fc [0,4194304] 0 2024-09-17T01:41:42.279 INFO:tasks.workunit.client.0.smithi082.stdout:7/586: chown d0/l3e 96990 1 2024-09-17T01:41:42.286 INFO:tasks.workunit.client.0.smithi082.stdout:4/638: creat d9/d15/d16/d3e/d54/dab/fd1 x:0 0 0 2024-09-17T01:41:42.287 INFO:tasks.workunit.client.0.smithi082.stdout:4/639: read - d9/d15/d16/d3e/d73/fa2 zero size 2024-09-17T01:41:42.291 INFO:tasks.workunit.client.0.smithi082.stdout:7/587: rename d0/d62/d7e/f91 to d0/dd/fc7 0 2024-09-17T01:41:42.297 INFO:tasks.workunit.client.0.smithi082.stdout:7/588: dwrite d0/d3/db/f33 [4194304,4194304] 0 2024-09-17T01:41:42.300 INFO:tasks.workunit.client.0.smithi082.stdout:7/589: read d0/d3/d36/d37/d86/fba [1409338,81581] 0 2024-09-17T01:41:42.303 INFO:tasks.workunit.client.0.smithi082.stdout:7/590: unlink d0/dd/d2c/f40 0 2024-09-17T01:41:42.306 INFO:tasks.workunit.client.0.smithi082.stdout:4/640: truncate d9/d15/d37/f71 1727187 0 2024-09-17T01:41:42.308 INFO:tasks.workunit.client.0.smithi082.stdout:7/591: rename d0/d3/db/d10/d47/fa1 to d0/d3/db/fc8 0 2024-09-17T01:41:42.311 INFO:tasks.workunit.client.0.smithi082.stdout:4/641: creat d9/d15/d16/d18/fd2 x:0 0 0 2024-09-17T01:41:42.313 INFO:tasks.workunit.client.0.smithi082.stdout:7/592: rename d0/d3/d36/l4b to d0/d3/d36/d37/lc9 0 2024-09-17T01:41:42.314 INFO:tasks.workunit.client.0.smithi082.stdout:4/642: fdatasync d9/d15/d16/d44/d84/fb4 0 2024-09-17T01:41:42.316 INFO:tasks.workunit.client.0.smithi082.stdout:4/643: truncate d9/d15/f1e 1179634 0 2024-09-17T01:41:42.320 INFO:tasks.workunit.client.0.smithi082.stdout:4/644: symlink d9/d15/d16/ld3 0 2024-09-17T01:41:42.322 INFO:tasks.workunit.client.0.smithi082.stdout:4/645: mkdir d9/d15/d37/d45/dd4 0 2024-09-17T01:41:42.324 INFO:tasks.workunit.client.0.smithi082.stdout:4/646: fdatasync d9/d15/f6f 0 2024-09-17T01:41:42.325 INFO:tasks.workunit.client.0.smithi082.stdout:4/647: fdatasync d9/d15/d16/d18/d4a/d52/f59 0 2024-09-17T01:41:42.336 INFO:tasks.workunit.client.0.smithi082.stdout:4/648: truncate d9/d15/f2e 564755 0 2024-09-17T01:41:42.338 INFO:tasks.workunit.client.0.smithi082.stdout:4/649: rename d9/d15/d37/d4c/da3 to d9/d47/d9b/dd5 0 2024-09-17T01:41:42.340 INFO:tasks.workunit.client.0.smithi082.stdout:4/650: rmdir d9/d15/d37 39 2024-09-17T01:41:42.342 INFO:tasks.workunit.client.0.smithi082.stdout:4/651: chown d9/d15/d16/d3e/d73/c8c 9097 1 2024-09-17T01:41:42.362 INFO:tasks.workunit.client.0.smithi082.stdout:4/652: write d9/d15/d37/d45/fc7 [878690,117197] 0 2024-09-17T01:41:42.366 INFO:tasks.workunit.client.0.smithi082.stdout:4/653: dread d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:42.369 INFO:tasks.workunit.client.0.smithi082.stdout:4/654: symlink d9/d15/d37/d45/dd4/ld6 0 2024-09-17T01:41:42.371 INFO:tasks.workunit.client.0.smithi082.stdout:4/655: write d9/d15/d16/d18/d4a/d8f/fa8 [573216,130862] 0 2024-09-17T01:41:42.379 INFO:tasks.workunit.client.0.smithi082.stdout:4/656: dwrite d9/d15/d16/d3e/d54/fac [0,4194304] 0 2024-09-17T01:41:42.381 INFO:tasks.workunit.client.0.smithi082.stdout:4/657: symlink d9/d15/d37/d45/dd4/ld7 0 2024-09-17T01:41:42.385 INFO:tasks.workunit.client.0.smithi082.stdout:4/658: creat d9/d15/d16/d18/d4a/d52/fd8 x:0 0 0 2024-09-17T01:41:42.407 INFO:tasks.workunit.client.0.smithi082.stdout:4/659: dread d9/d15/d16/d18/d4a/f83 [0,4194304] 0 2024-09-17T01:41:42.410 INFO:tasks.workunit.client.0.smithi082.stdout:4/660: creat d9/d15/d16/d3e/d54/fd9 x:0 0 0 2024-09-17T01:41:42.414 INFO:tasks.workunit.client.0.smithi082.stdout:4/661: rename d9/d15/d37/d45 to d9/d47/dc2/dda 0 2024-09-17T01:41:42.416 INFO:tasks.workunit.client.0.smithi082.stdout:4/662: read - d9/d15/d16/f4b zero size 2024-09-17T01:41:42.417 INFO:tasks.workunit.client.0.smithi082.stdout:4/663: chown d9/d15/d16/d18/d4f/fc8 18308187 1 2024-09-17T01:41:42.418 INFO:tasks.workunit.client.0.smithi082.stdout:4/664: chown d9/d15/d16/d18/d4a/d8f 7056201 1 2024-09-17T01:41:42.418 INFO:tasks.workunit.client.0.smithi082.stdout:4/665: dread - d9/d15/d16/d18/d4a/d52/fd8 zero size 2024-09-17T01:41:42.419 INFO:tasks.workunit.client.0.smithi082.stdout:4/666: fsync d9/d15/d16/d18/fd2 0 2024-09-17T01:41:42.425 INFO:tasks.workunit.client.0.smithi082.stdout:4/667: dread d9/f46 [0,4194304] 0 2024-09-17T01:41:42.803 INFO:tasks.workunit.client.0.smithi082.stdout:5/608: sync 2024-09-17T01:41:42.875 INFO:tasks.workunit.client.0.smithi082.stdout:5/609: dwrite db/d56/d29/f6a [0,4194304] 0 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:4/668: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:0/423: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:5/610: mkdir db/d1e/d5b/d83/d94/dc1 0 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:6/650: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:8/525: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:2/657: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:3/574: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:7/593: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:9/520: sync 2024-09-17T01:41:42.880 INFO:tasks.workunit.client.0.smithi082.stdout:1/707: sync 2024-09-17T01:41:42.889 INFO:tasks.workunit.client.0.smithi082.stdout:4/669: creat d9/d47/d9b/fdb x:0 0 0 2024-09-17T01:41:42.890 INFO:tasks.workunit.client.0.smithi082.stdout:3/575: dread d9/db/d49/d4e/d53/f54 [0,4194304] 0 2024-09-17T01:41:42.891 INFO:tasks.workunit.client.0.smithi082.stdout:7/594: write d0/dd/fa2 [2269593,1802] 0 2024-09-17T01:41:42.891 INFO:tasks.workunit.client.0.smithi082.stdout:8/526: write d3/dd/d18/d51/f6f [7171783,120200] 0 2024-09-17T01:41:42.892 INFO:tasks.workunit.client.0.smithi082.stdout:9/521: mkdir d4/d27/d36/d3b/db0 0 2024-09-17T01:41:42.895 INFO:tasks.workunit.client.0.smithi082.stdout:8/527: stat d3/f74 0 2024-09-17T01:41:42.896 INFO:tasks.workunit.client.0.smithi082.stdout:4/670: chown d9/d15/d37/d4c 204 1 2024-09-17T01:41:42.897 INFO:tasks.workunit.client.0.smithi082.stdout:1/708: mkdir d2/d3f/d24/db5/dea 0 2024-09-17T01:41:42.897 INFO:tasks.workunit.client.0.smithi082.stdout:7/595: readlink d0/dd/d2c/d42/l90 0 2024-09-17T01:41:42.897 INFO:tasks.workunit.client.0.smithi082.stdout:3/576: fsync d9/f4d 0 2024-09-17T01:41:42.899 INFO:tasks.workunit.client.0.smithi082.stdout:2/658: unlink d1/d17/d60/fb4 0 2024-09-17T01:41:42.902 INFO:tasks.workunit.client.0.smithi082.stdout:3/577: truncate d9/db/daa/fc1 793698 0 2024-09-17T01:41:42.904 INFO:tasks.workunit.client.0.smithi082.stdout:8/528: truncate d3/dd/d18/d2d/d3e/d4a/d6a/f42 4531270 0 2024-09-17T01:41:42.905 INFO:tasks.workunit.client.0.smithi082.stdout:7/596: dread - d0/dd/d34/d58/f6a zero size 2024-09-17T01:41:42.906 INFO:tasks.workunit.client.0.smithi082.stdout:7/597: chown d0/l9 4 1 2024-09-17T01:41:42.906 INFO:tasks.workunit.client.0.smithi082.stdout:7/598: chown d0/dd/f1f 7905 1 2024-09-17T01:41:42.907 INFO:tasks.workunit.client.0.smithi082.stdout:7/599: truncate d0/d3/db/f83 67191 0 2024-09-17T01:41:42.908 INFO:tasks.workunit.client.0.smithi082.stdout:7/600: chown d0/dd/d2c/d55/l8c 18623640 1 2024-09-17T01:41:42.908 INFO:tasks.workunit.client.0.smithi082.stdout:4/671: symlink d9/d47/dc2/dda/ldc 0 2024-09-17T01:41:42.917 INFO:tasks.workunit.client.0.smithi082.stdout:6/651: write d1/d7/d10/d4f/dc/d1d/d36/d3e/f73 [59418,47812] 0 2024-09-17T01:41:42.919 INFO:tasks.workunit.client.0.smithi082.stdout:3/578: creat d9/db/d6d/fcc x:0 0 0 2024-09-17T01:41:42.922 INFO:tasks.workunit.client.0.smithi082.stdout:9/522: write d4/d27/d2d/d60/d11/d39/d31/f7a [557701,112157] 0 2024-09-17T01:41:42.923 INFO:tasks.workunit.client.0.smithi082.stdout:4/672: dwrite d9/d47/d9b/dd5/f92 [0,4194304] 0 2024-09-17T01:41:42.927 INFO:tasks.workunit.client.0.smithi082.stdout:7/601: dwrite d0/f32 [0,4194304] 0 2024-09-17T01:41:42.932 INFO:tasks.workunit.client.0.smithi082.stdout:2/659: dwrite d1/d17/d29/d50/f77 [4194304,4194304] 0 2024-09-17T01:41:42.937 INFO:tasks.workunit.client.0.smithi082.stdout:8/529: unlink d3/dd/d18/l67 0 2024-09-17T01:41:42.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/709: mkdir d2/d3f/d34/dc5/deb 0 2024-09-17T01:41:42.942 INFO:tasks.workunit.client.0.smithi082.stdout:2/660: rename d1/f16 to d1/d90/fe0 0 2024-09-17T01:41:42.943 INFO:tasks.workunit.client.0.smithi082.stdout:9/523: symlink d4/d27/d21/lb1 0 2024-09-17T01:41:42.943 INFO:tasks.workunit.client.0.smithi082.stdout:0/424: getdents da/d1b/d23/d42/d43/d6b 0 2024-09-17T01:41:42.945 INFO:tasks.workunit.client.0.smithi082.stdout:6/652: dread d1/d7/d10/d4f/dc/d2b/d48/f76 [0,4194304] 0 2024-09-17T01:41:42.946 INFO:tasks.workunit.client.0.smithi082.stdout:5/611: dwrite db/d56/d78/f8a [0,4194304] 0 2024-09-17T01:41:42.949 INFO:tasks.workunit.client.0.smithi082.stdout:4/673: mkdir d9/d47/d9b/dd5/ddd 0 2024-09-17T01:41:42.950 INFO:tasks.workunit.client.0.smithi082.stdout:0/425: read - da/df/d2b/d59/d8f/d69/f7b zero size 2024-09-17T01:41:42.955 INFO:tasks.workunit.client.0.smithi082.stdout:8/530: dwrite d3/dd/d18/d51/f6f [8388608,4194304] 0 2024-09-17T01:41:42.958 INFO:tasks.workunit.client.0.smithi082.stdout:7/602: rename d0/d3/d36/c38 to d0/d3/db/cca 0 2024-09-17T01:41:42.964 INFO:tasks.workunit.client.0.smithi082.stdout:4/674: write d9/d15/d16/d44/d84/fb4 [598337,105023] 0 2024-09-17T01:41:42.964 INFO:tasks.workunit.client.0.smithi082.stdout:9/524: chown d4/d27/d2d/d60/d11/d39/d44/c8e 785117 1 2024-09-17T01:41:42.965 INFO:tasks.workunit.client.0.smithi082.stdout:2/661: truncate d1/d17/f21 6058846 0 2024-09-17T01:41:42.968 INFO:tasks.workunit.client.0.smithi082.stdout:5/612: fsync db/d56/d29/d4f/f57 0 2024-09-17T01:41:42.969 INFO:tasks.workunit.client.0.smithi082.stdout:2/662: fsync d1/d66/d85/fc1 0 2024-09-17T01:41:42.969 INFO:tasks.workunit.client.0.smithi082.stdout:6/653: dwrite d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:42.980 INFO:tasks.workunit.client.0.smithi082.stdout:4/675: creat d9/d15/d16/d18/d4a/d8f/d91/fde x:0 0 0 2024-09-17T01:41:42.980 INFO:tasks.workunit.client.0.smithi082.stdout:8/531: truncate d3/dd/d18/d3a/f46 440932 0 2024-09-17T01:41:42.984 INFO:tasks.workunit.client.0.smithi082.stdout:4/676: chown d9/d15/d16/l28 39932184 1 2024-09-17T01:41:42.986 INFO:tasks.workunit.client.0.smithi082.stdout:3/579: link d9/db/daf/d69/d79/d86/fb7 d9/db/d26/dad/fcd 0 2024-09-17T01:41:42.989 INFO:tasks.workunit.client.0.smithi082.stdout:0/426: dwrite da/df/d2b/d59/d6f/d70/f8e [0,4194304] 0 2024-09-17T01:41:42.991 INFO:tasks.workunit.client.0.smithi082.stdout:2/663: rename d1/d35/f57 to d1/d5a/d6d/fe1 0 2024-09-17T01:41:42.997 INFO:tasks.workunit.client.0.smithi082.stdout:6/654: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/ce7 0 2024-09-17T01:41:43.001 INFO:tasks.workunit.client.0.smithi082.stdout:6/655: dread - d1/d7/d10/d4f/d32/fdf zero size 2024-09-17T01:41:43.006 INFO:tasks.workunit.client.0.smithi082.stdout:7/603: link d0/dd/f17 d0/d3/db/d10/d3f/fcb 0 2024-09-17T01:41:43.008 INFO:tasks.workunit.client.0.smithi082.stdout:1/710: dwrite d2/d3f/d24/f7e [0,4194304] 0 2024-09-17T01:41:43.009 INFO:tasks.workunit.client.0.smithi082.stdout:4/677: fdatasync d9/d15/d16/d18/f32 0 2024-09-17T01:41:43.011 INFO:tasks.workunit.client.0.smithi082.stdout:9/525: dwrite d4/d59/d63/f67 [0,4194304] 0 2024-09-17T01:41:43.013 INFO:tasks.workunit.client.0.smithi082.stdout:3/580: symlink d9/d78/d88/lce 0 2024-09-17T01:41:43.013 INFO:tasks.workunit.client.0.smithi082.stdout:5/613: dread db/d1e/d20/d30/f3b [0,4194304] 0 2024-09-17T01:41:43.013 INFO:tasks.workunit.client.0.smithi082.stdout:6/656: readlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/l6a 0 2024-09-17T01:41:43.034 INFO:tasks.workunit.client.0.smithi082.stdout:0/427: mknod da/d1b/d23/c93 0 2024-09-17T01:41:43.037 INFO:tasks.workunit.client.0.smithi082.stdout:2/664: creat d1/d5a/d6d/dc2/fe2 x:0 0 0 2024-09-17T01:41:43.038 INFO:tasks.workunit.client.0.smithi082.stdout:2/665: dread - d1/d17/d29/d50/fd9 zero size 2024-09-17T01:41:43.040 INFO:tasks.workunit.client.0.smithi082.stdout:6/657: symlink d1/d7/d10/d4f/dc/d2b/db2/le8 0 2024-09-17T01:41:43.045 INFO:tasks.workunit.client.0.smithi082.stdout:3/581: write d9/db/d49/d4e/d53/f62 [2272889,77736] 0 2024-09-17T01:41:43.046 INFO:tasks.workunit.client.0.smithi082.stdout:2/666: dwrite d1/d17/d38/d42/d52/d78/d82/fc7 [0,4194304] 0 2024-09-17T01:41:43.051 INFO:tasks.workunit.client.0.smithi082.stdout:6/658: dwrite d1/d1f/f9d [0,4194304] 0 2024-09-17T01:41:43.051 INFO:tasks.workunit.client.0.smithi082.stdout:9/526: unlink d4/d27/d2d/d60/f51 0 2024-09-17T01:41:43.057 INFO:tasks.workunit.client.0.smithi082.stdout:0/428: truncate da/df/d2b/d59/d8f/f6d 353880 0 2024-09-17T01:41:43.059 INFO:tasks.workunit.client.0.smithi082.stdout:5/614: rename db/d56/d29/d4f/d8e/lb0 to db/d1e/d5b/d83/d94/dc1/lc2 0 2024-09-17T01:41:43.061 INFO:tasks.workunit.client.0.smithi082.stdout:4/678: write d9/d15/f2e [763560,58536] 0 2024-09-17T01:41:43.063 INFO:tasks.workunit.client.0.smithi082.stdout:8/532: getdents d3/dd/d18/d34 0 2024-09-17T01:41:43.063 INFO:tasks.workunit.client.0.smithi082.stdout:4/679: read - d9/d15/d16/d18/d4f/fc8 zero size 2024-09-17T01:41:43.064 INFO:tasks.workunit.client.0.smithi082.stdout:4/680: read d9/d15/d16/d3e/f3f [202051,130670] 0 2024-09-17T01:41:43.068 INFO:tasks.workunit.client.0.smithi082.stdout:2/667: unlink d1/d17/d60/ld5 0 2024-09-17T01:41:43.072 INFO:tasks.workunit.client.0.smithi082.stdout:0/429: rename da/c82 to da/d1b/c94 0 2024-09-17T01:41:43.079 INFO:tasks.workunit.client.0.smithi082.stdout:3/582: dread d9/db/d49/da4/fa6 [0,4194304] 0 2024-09-17T01:41:43.087 INFO:tasks.workunit.client.0.smithi082.stdout:6/659: mkdir d1/d7/d10/d4f/d8e/da8/de5/de9 0 2024-09-17T01:41:43.090 INFO:tasks.workunit.client.0.smithi082.stdout:0/430: creat da/df/d2b/f95 x:0 0 0 2024-09-17T01:41:43.091 INFO:tasks.workunit.client.0.smithi082.stdout:0/431: chown da/df/f4a 61986 1 2024-09-17T01:41:43.091 INFO:tasks.workunit.client.0.smithi082.stdout:6/660: read d1/d7/d10/d4f/dc/f88 [1929772,74592] 0 2024-09-17T01:41:43.093 INFO:tasks.workunit.client.0.smithi082.stdout:6/661: write d1/f98 [2741776,18367] 0 2024-09-17T01:41:43.094 INFO:tasks.workunit.client.0.smithi082.stdout:4/681: dread d9/d15/d16/d18/f38 [0,4194304] 0 2024-09-17T01:41:43.098 INFO:tasks.workunit.client.0.smithi082.stdout:9/527: dwrite d4/f1d [8388608,4194304] 0 2024-09-17T01:41:43.099 INFO:tasks.workunit.client.0.smithi082.stdout:3/583: creat d9/db/d49/d4e/d53/fcf x:0 0 0 2024-09-17T01:41:43.103 INFO:tasks.workunit.client.0.smithi082.stdout:3/584: readlink d9/db/d26/l2c 0 2024-09-17T01:41:43.105 INFO:tasks.workunit.client.0.smithi082.stdout:9/528: truncate d4/d27/d2d/d3d/f85 659189 0 2024-09-17T01:41:43.106 INFO:tasks.workunit.client.0.smithi082.stdout:2/668: write d1/d17/d29/d50/fc5 [2272814,40251] 0 2024-09-17T01:41:43.107 INFO:tasks.workunit.client.0.smithi082.stdout:6/662: dwrite d1/d7/d10/d4f/fd8 [0,4194304] 0 2024-09-17T01:41:43.108 INFO:tasks.workunit.client.0.smithi082.stdout:5/615: dwrite db/d56/d18/f4a [0,4194304] 0 2024-09-17T01:41:43.113 INFO:tasks.workunit.client.0.smithi082.stdout:0/432: rename da/df/d2b/d59/d8f/f5b to da/d1b/d23/d42/f96 0 2024-09-17T01:41:43.114 INFO:tasks.workunit.client.0.smithi082.stdout:6/663: write d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [2619684,33390] 0 2024-09-17T01:41:43.127 INFO:tasks.workunit.client.0.smithi082.stdout:2/669: mknod d1/d17/d38/d42/d52/ce3 0 2024-09-17T01:41:43.129 INFO:tasks.workunit.client.0.smithi082.stdout:4/682: mkdir d9/ddf 0 2024-09-17T01:41:43.130 INFO:tasks.workunit.client.0.smithi082.stdout:8/533: link d3/dd/d18/d2d/d3e/d4a/d66/d7b/l9a d3/dd/d18/d2d/d60/la8 0 2024-09-17T01:41:43.131 INFO:tasks.workunit.client.0.smithi082.stdout:8/534: fsync d3/dd/d18/d2d/d3e/d4a/fa2 0 2024-09-17T01:41:43.136 INFO:tasks.workunit.client.0.smithi082.stdout:0/433: creat da/d1b/d23/d42/d43/f97 x:0 0 0 2024-09-17T01:41:43.137 INFO:tasks.workunit.client.0.smithi082.stdout:6/664: symlink d1/d1f/da7/lea 0 2024-09-17T01:41:43.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/616: mknod db/cc3 0 2024-09-17T01:41:43.140 INFO:tasks.workunit.client.0.smithi082.stdout:6/665: fdatasync d1/d7/d10/d4f/d8e/da8/fb9 0 2024-09-17T01:41:43.143 INFO:tasks.workunit.client.0.smithi082.stdout:0/434: dwrite da/df/d2b/d59/d8f/f81 [0,4194304] 0 2024-09-17T01:41:43.143 INFO:tasks.workunit.client.0.smithi082.stdout:2/670: symlink d1/d66/d85/le4 0 2024-09-17T01:41:43.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/529: dread d4/d27/d2d/d60/f34 [0,4194304] 0 2024-09-17T01:41:43.148 INFO:tasks.workunit.client.0.smithi082.stdout:3/585: dread d9/db/d49/d4e/d53/d5b/f70 [0,4194304] 0 2024-09-17T01:41:43.155 INFO:tasks.workunit.client.0.smithi082.stdout:5/617: symlink db/d1e/d5b/d83/lc4 0 2024-09-17T01:41:43.156 INFO:tasks.workunit.client.0.smithi082.stdout:3/586: dwrite d9/db/daa/fc1 [0,4194304] 0 2024-09-17T01:41:43.159 INFO:tasks.workunit.client.0.smithi082.stdout:6/666: truncate d1/d7/d10/d4f/f12 122187 0 2024-09-17T01:41:43.164 INFO:tasks.workunit.client.0.smithi082.stdout:2/671: mkdir d1/d17/d38/d42/d52/de5 0 2024-09-17T01:41:43.166 INFO:tasks.workunit.client.0.smithi082.stdout:6/667: dwrite d1/d7/f46 [0,4194304] 0 2024-09-17T01:41:43.176 INFO:tasks.workunit.client.0.smithi082.stdout:3/587: creat d9/db/daf/d69/d79/fd0 x:0 0 0 2024-09-17T01:41:43.183 INFO:tasks.workunit.client.0.smithi082.stdout:5/618: dwrite db/d1e/d20/d30/d47/fb6 [0,4194304] 0 2024-09-17T01:41:43.188 INFO:tasks.workunit.client.0.smithi082.stdout:2/672: mkdir d1/d17/d38/de6 0 2024-09-17T01:41:43.193 INFO:tasks.workunit.client.0.smithi082.stdout:6/668: fsync d1/d7/d10/d4f/d32/f97 0 2024-09-17T01:41:43.197 INFO:tasks.workunit.client.0.smithi082.stdout:4/683: getdents d9/d15 0 2024-09-17T01:41:43.198 INFO:tasks.workunit.client.0.smithi082.stdout:2/673: dwrite d1/d10/f7f [0,4194304] 0 2024-09-17T01:41:43.198 INFO:tasks.workunit.client.0.smithi082.stdout:5/619: unlink db/d1e/d20/d30/c49 0 2024-09-17T01:41:43.204 INFO:tasks.workunit.client.0.smithi082.stdout:0/435: truncate da/fd 130622 0 2024-09-17T01:41:43.204 INFO:tasks.workunit.client.0.smithi082.stdout:8/535: link d3/dd/d18/d2d/d60/la8 d3/dd/d18/d2d/d3e/d4a/d66/la9 0 2024-09-17T01:41:43.206 INFO:tasks.workunit.client.0.smithi082.stdout:0/436: truncate da/d80/d77/f91 110720 0 2024-09-17T01:41:43.208 INFO:tasks.workunit.client.0.smithi082.stdout:0/437: dread - da/d1b/d23/d42/d43/f97 zero size 2024-09-17T01:41:43.211 INFO:tasks.workunit.client.0.smithi082.stdout:3/588: unlink d9/db/c1d 0 2024-09-17T01:41:43.212 INFO:tasks.workunit.client.0.smithi082.stdout:3/589: dread - d9/db/d26/fa1 zero size 2024-09-17T01:41:43.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/669: creat d1/d7/d10/d4f/d8e/feb x:0 0 0 2024-09-17T01:41:43.217 INFO:tasks.workunit.client.0.smithi082.stdout:9/530: link d4/f4c d4/d27/d2d/d60/d11/d39/d29/fb2 0 2024-09-17T01:41:43.218 INFO:tasks.workunit.client.0.smithi082.stdout:5/620: read db/d1e/d5b/db4/fbd [2300621,32778] 0 2024-09-17T01:41:43.218 INFO:tasks.workunit.client.0.smithi082.stdout:9/531: write d4/f49 [4150358,8702] 0 2024-09-17T01:41:43.220 INFO:tasks.workunit.client.0.smithi082.stdout:8/536: chown d3/dd/d18/d2d/d3e/d4a/d66/d7b/l9a 199297 1 2024-09-17T01:41:43.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/438: symlink da/d80/l98 0 2024-09-17T01:41:43.223 INFO:tasks.workunit.client.0.smithi082.stdout:3/590: mknod d9/db/d26/dbd/cd1 0 2024-09-17T01:41:43.223 INFO:tasks.workunit.client.0.smithi082.stdout:6/670: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/faf [0,4194304] 0 2024-09-17T01:41:43.225 INFO:tasks.workunit.client.0.smithi082.stdout:2/674: dread d1/d10/f12 [0,4194304] 0 2024-09-17T01:41:43.232 INFO:tasks.workunit.client.0.smithi082.stdout:9/532: mknod d4/d27/d2d/d3d/d81/cb3 0 2024-09-17T01:41:43.232 INFO:tasks.workunit.client.0.smithi082.stdout:3/591: mknod d9/db/d49/cd2 0 2024-09-17T01:41:43.234 INFO:tasks.workunit.client.0.smithi082.stdout:6/671: mkdir d1/d1f/da7/ddd/dec 0 2024-09-17T01:41:43.236 INFO:tasks.workunit.client.0.smithi082.stdout:0/439: dwrite da/df/d2b/f89 [0,4194304] 0 2024-09-17T01:41:43.237 INFO:tasks.workunit.client.0.smithi082.stdout:2/675: write d1/d66/f8d [5136248,56966] 0 2024-09-17T01:41:43.249 INFO:tasks.workunit.client.0.smithi082.stdout:8/537: link d3/dd/d18/d34/f4f d3/dd/d18/d2d/d3e/faa 0 2024-09-17T01:41:43.251 INFO:tasks.workunit.client.0.smithi082.stdout:8/538: write d3/dd/d18/d2d/d3e/d43/f45 [4987268,85475] 0 2024-09-17T01:41:43.251 INFO:tasks.workunit.client.0.smithi082.stdout:2/676: fdatasync d1/d17/d38/f9e 0 2024-09-17T01:41:43.252 INFO:tasks.workunit.client.0.smithi082.stdout:4/684: write d9/d15/f6b [1059916,40397] 0 2024-09-17T01:41:43.254 INFO:tasks.workunit.client.0.smithi082.stdout:4/685: stat d9/d15/d16/d18/l87 0 2024-09-17T01:41:43.256 INFO:tasks.workunit.client.0.smithi082.stdout:5/621: rename db/d1e/d20/d30/c45 to db/d2b/cc5 0 2024-09-17T01:41:43.259 INFO:tasks.workunit.client.0.smithi082.stdout:3/592: fdatasync d9/db/d49/d4e/d53/f98 0 2024-09-17T01:41:43.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/539: dwrite d3/dd/f9f [0,4194304] 0 2024-09-17T01:41:43.270 INFO:tasks.workunit.client.0.smithi082.stdout:9/533: dread d4/f4c [0,4194304] 0 2024-09-17T01:41:43.272 INFO:tasks.workunit.client.0.smithi082.stdout:9/534: chown d4/d27/d2d/d60/d11/d39/d29/fac 84755029 1 2024-09-17T01:41:43.276 INFO:tasks.workunit.client.0.smithi082.stdout:0/440: rename da/d1b/d23/d4d/d5d to da/d80/d99 0 2024-09-17T01:41:43.277 INFO:tasks.workunit.client.0.smithi082.stdout:0/441: chown da/df/f4a 15 1 2024-09-17T01:41:43.278 INFO:tasks.workunit.client.0.smithi082.stdout:4/686: mkdir d9/d15/d16/d18/d4a/d8f/d91/de0 0 2024-09-17T01:41:43.282 INFO:tasks.workunit.client.0.smithi082.stdout:8/540: chown d3/dd/d18/c9b 133102920 1 2024-09-17T01:41:43.288 INFO:tasks.workunit.client.0.smithi082.stdout:2/677: mknod d1/d66/ce7 0 2024-09-17T01:41:43.288 INFO:tasks.workunit.client.0.smithi082.stdout:2/678: stat d1/d66/fd6 0 2024-09-17T01:41:43.289 INFO:tasks.workunit.client.0.smithi082.stdout:9/535: creat d4/d27/d2d/d60/d11/d8d/fb4 x:0 0 0 2024-09-17T01:41:43.291 INFO:tasks.workunit.client.0.smithi082.stdout:0/442: mkdir da/df/d2b/d9a 0 2024-09-17T01:41:43.293 INFO:tasks.workunit.client.0.smithi082.stdout:0/443: fsync da/df/d71/f51 0 2024-09-17T01:41:43.295 INFO:tasks.workunit.client.0.smithi082.stdout:9/536: dread d4/f5f [0,4194304] 0 2024-09-17T01:41:43.296 INFO:tasks.workunit.client.0.smithi082.stdout:3/593: dread d9/f47 [0,4194304] 0 2024-09-17T01:41:43.297 INFO:tasks.workunit.client.0.smithi082.stdout:8/541: rmdir d3/dd/d18/d2d/d3e/d4a/d66 39 2024-09-17T01:41:43.298 INFO:tasks.workunit.client.0.smithi082.stdout:4/687: creat d9/dbd/fe1 x:0 0 0 2024-09-17T01:41:43.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/542: stat d3/dd/d18/d2d/d58/c5d 0 2024-09-17T01:41:43.300 INFO:tasks.workunit.client.0.smithi082.stdout:2/679: rename d1/d17/d38/d42/d52/d78/d82 to d1/d17/d60/dc6/de8 0 2024-09-17T01:41:43.300 INFO:tasks.workunit.client.0.smithi082.stdout:4/688: dread - d9/d15/d16/d3e/d73/fa2 zero size 2024-09-17T01:41:43.301 INFO:tasks.workunit.client.0.smithi082.stdout:2/680: fsync d1/d17/d38/d5c/f79 0 2024-09-17T01:41:43.306 INFO:tasks.workunit.client.0.smithi082.stdout:9/537: creat d4/d27/d2d/d60/d11/d39/d7d/fb5 x:0 0 0 2024-09-17T01:41:43.311 INFO:tasks.workunit.client.0.smithi082.stdout:5/622: getdents db/d1e/d20/d4d 0 2024-09-17T01:41:43.315 INFO:tasks.workunit.client.0.smithi082.stdout:4/689: dread d9/d15/d16/d18/d4a/d52/f6a [0,4194304] 0 2024-09-17T01:41:43.318 INFO:tasks.workunit.client.0.smithi082.stdout:3/594: truncate d9/db/d26/f96 635138 0 2024-09-17T01:41:43.322 INFO:tasks.workunit.client.0.smithi082.stdout:9/538: chown d4/d27/d2d/d60/d11/d39/d29/l6c 6 1 2024-09-17T01:41:43.324 INFO:tasks.workunit.client.0.smithi082.stdout:8/543: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab 0 2024-09-17T01:41:43.324 INFO:tasks.workunit.client.0.smithi082.stdout:3/595: dwrite d9/d35/f43 [0,4194304] 0 2024-09-17T01:41:43.324 INFO:tasks.workunit.client.0.smithi082.stdout:9/539: dread - d4/d27/d2d/fad zero size 2024-09-17T01:41:43.325 INFO:tasks.workunit.client.0.smithi082.stdout:3/596: stat d9/db/d49/d4e/lcb 0 2024-09-17T01:41:43.327 INFO:tasks.workunit.client.0.smithi082.stdout:5/623: mkdir db/d1e/d20/d30/dc6 0 2024-09-17T01:41:43.327 INFO:tasks.workunit.client.0.smithi082.stdout:3/597: fsync d9/db/d49/d4e/d53/d5b/f6c 0 2024-09-17T01:41:43.333 INFO:tasks.workunit.client.0.smithi082.stdout:0/444: write da/df/d2b/d59/d8f/f74 [1317632,95749] 0 2024-09-17T01:41:43.335 INFO:tasks.workunit.client.0.smithi082.stdout:9/540: creat d4/d27/d2d/d60/d11/d39/d31/fb6 x:0 0 0 2024-09-17T01:41:43.340 INFO:tasks.workunit.client.0.smithi082.stdout:3/598: write d9/db/d8f/fc6 [2560903,5467] 0 2024-09-17T01:41:43.342 INFO:tasks.workunit.client.0.smithi082.stdout:9/541: unlink d4/f9c 0 2024-09-17T01:41:43.344 INFO:tasks.workunit.client.0.smithi082.stdout:0/445: creat da/df/d2b/d9a/f9b x:0 0 0 2024-09-17T01:41:43.345 INFO:tasks.workunit.client.0.smithi082.stdout:2/681: truncate d1/d17/d38/d5c/f64 7678687 0 2024-09-17T01:41:43.350 INFO:tasks.workunit.client.0.smithi082.stdout:0/446: mkdir da/d80/d9c 0 2024-09-17T01:41:43.350 INFO:tasks.workunit.client.0.smithi082.stdout:2/682: truncate d1/fd 3650658 0 2024-09-17T01:41:43.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/542: dwrite d4/f8 [8388608,4194304] 0 2024-09-17T01:41:43.351 INFO:tasks.workunit.client.0.smithi082.stdout:5/624: link db/d1e/d5b/d83/c8d db/cc7 0 2024-09-17T01:41:43.353 INFO:tasks.workunit.client.0.smithi082.stdout:2/683: stat d1/d5a/d6d/fa9 0 2024-09-17T01:41:43.355 INFO:tasks.workunit.client.0.smithi082.stdout:5/625: chown db/d1e/d5b/d83/d94 0 1 2024-09-17T01:41:43.357 INFO:tasks.workunit.client.0.smithi082.stdout:4/690: dwrite d9/d15/d16/d3e/f3f [0,4194304] 0 2024-09-17T01:41:43.359 INFO:tasks.workunit.client.0.smithi082.stdout:0/447: rmdir da/d1b/d23/d42/d43/d6b 39 2024-09-17T01:41:43.360 INFO:tasks.workunit.client.0.smithi082.stdout:9/543: truncate d4/d27/d2d/d60/d11/d39/d31/fb6 632951 0 2024-09-17T01:41:43.367 INFO:tasks.workunit.client.0.smithi082.stdout:5/626: unlink db/d1e/d20/d30/d47/fb5 0 2024-09-17T01:41:43.367 INFO:tasks.workunit.client.0.smithi082.stdout:0/448: dwrite da/df/d2b/d59/d8f/f74 [0,4194304] 0 2024-09-17T01:41:43.369 INFO:tasks.workunit.client.0.smithi082.stdout:2/684: creat d1/d5a/fe9 x:0 0 0 2024-09-17T01:41:43.371 INFO:tasks.workunit.client.0.smithi082.stdout:5/627: symlink db/d1e/d20/d4d/lc8 0 2024-09-17T01:41:43.379 INFO:tasks.workunit.client.0.smithi082.stdout:0/449: fdatasync da/d1b/d23/d42/d43/f57 0 2024-09-17T01:41:43.384 INFO:tasks.workunit.client.0.smithi082.stdout:5/628: creat db/d1e/fc9 x:0 0 0 2024-09-17T01:41:43.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/450: creat da/d1b/d23/d4d/f9d x:0 0 0 2024-09-17T01:41:43.388 INFO:tasks.workunit.client.0.smithi082.stdout:4/691: write d9/d15/d16/d18/f32 [4926412,45500] 0 2024-09-17T01:41:43.394 INFO:tasks.workunit.client.0.smithi082.stdout:0/451: getdents da/d1b 0 2024-09-17T01:41:43.397 INFO:tasks.workunit.client.0.smithi082.stdout:0/452: truncate da/d1b/f4f 61285 0 2024-09-17T01:41:43.397 INFO:tasks.workunit.client.0.smithi082.stdout:2/685: dread d1/d17/d29/d50/fc5 [0,4194304] 0 2024-09-17T01:41:43.399 INFO:tasks.workunit.client.0.smithi082.stdout:2/686: chown d1/d35/c2e 1706608 1 2024-09-17T01:41:43.400 INFO:tasks.workunit.client.0.smithi082.stdout:0/453: creat da/d80/f9e x:0 0 0 2024-09-17T01:41:43.403 INFO:tasks.workunit.client.0.smithi082.stdout:0/454: symlink da/df/l9f 0 2024-09-17T01:41:43.403 INFO:tasks.workunit.client.0.smithi082.stdout:5/629: dread db/d1e/d5b/fb8 [4194304,4194304] 0 2024-09-17T01:41:43.405 INFO:tasks.workunit.client.0.smithi082.stdout:5/630: write db/d56/f50 [211808,99827] 0 2024-09-17T01:41:43.407 INFO:tasks.workunit.client.0.smithi082.stdout:2/687: dwrite d1/d35/f65 [0,4194304] 0 2024-09-17T01:41:43.408 INFO:tasks.workunit.client.0.smithi082.stdout:0/455: symlink da/df/la0 0 2024-09-17T01:41:43.411 INFO:tasks.workunit.client.0.smithi082.stdout:2/688: rmdir d1/d5a 39 2024-09-17T01:41:43.412 INFO:tasks.workunit.client.0.smithi082.stdout:2/689: stat d1/d17/lb2 0 2024-09-17T01:41:43.415 INFO:tasks.workunit.client.0.smithi082.stdout:0/456: rename da/df/d71/l17 to da/d80/d99/la1 0 2024-09-17T01:41:43.416 INFO:tasks.workunit.client.0.smithi082.stdout:5/631: mkdir db/d1e/d20/d30/dc6/dca 0 2024-09-17T01:41:43.417 INFO:tasks.workunit.client.0.smithi082.stdout:2/690: mknod d1/d17/d38/d5c/cea 0 2024-09-17T01:41:43.419 INFO:tasks.workunit.client.0.smithi082.stdout:5/632: dread - db/d2b/f87 zero size 2024-09-17T01:41:43.422 INFO:tasks.workunit.client.0.smithi082.stdout:2/691: symlink d1/d17/d38/d42/d52/d78/da0/dba/leb 0 2024-09-17T01:41:43.424 INFO:tasks.workunit.client.0.smithi082.stdout:0/457: getdents da/df/d2b/d9a 0 2024-09-17T01:41:43.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/633: creat db/d2b/fcb x:0 0 0 2024-09-17T01:41:43.427 INFO:tasks.workunit.client.0.smithi082.stdout:2/692: read d1/d17/faa [796897,10360] 0 2024-09-17T01:41:43.431 INFO:tasks.workunit.client.0.smithi082.stdout:0/458: rename da/df/d2b/d59/d8f/d69/f7b to da/df/d2b/d59/fa2 0 2024-09-17T01:41:43.432 INFO:tasks.workunit.client.0.smithi082.stdout:2/693: symlink d1/d17/d38/d42/d52/d78/da0/lec 0 2024-09-17T01:41:43.432 INFO:tasks.workunit.client.0.smithi082.stdout:2/694: write d1/d17/f53 [1333224,99875] 0 2024-09-17T01:41:43.433 INFO:tasks.workunit.client.0.smithi082.stdout:0/459: symlink da/df/d2b/la3 0 2024-09-17T01:41:43.437 INFO:tasks.workunit.client.0.smithi082.stdout:2/695: chown d1/d17/d60/c75 19 1 2024-09-17T01:41:43.439 INFO:tasks.workunit.client.0.smithi082.stdout:5/634: link db/d56/d18/c5c db/d1e/d20/d30/d47/ccc 0 2024-09-17T01:41:43.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/696: mknod d1/d17/d38/de6/ced 0 2024-09-17T01:41:43.454 INFO:tasks.workunit.client.0.smithi082.stdout:0/460: write da/df/d2b/d59/d8f/f6d [291571,43118] 0 2024-09-17T01:41:43.456 INFO:tasks.workunit.client.0.smithi082.stdout:0/461: write f8 [10675250,43502] 0 2024-09-17T01:41:43.457 INFO:tasks.workunit.client.0.smithi082.stdout:0/462: readlink da/df/l3d 0 2024-09-17T01:41:43.457 INFO:tasks.workunit.client.0.smithi082.stdout:2/697: write d1/d17/faa [4377927,104378] 0 2024-09-17T01:41:43.461 INFO:tasks.workunit.client.0.smithi082.stdout:5/635: dwrite f9 [8388608,4194304] 0 2024-09-17T01:41:43.464 INFO:tasks.workunit.client.0.smithi082.stdout:5/636: chown db/d1e/d20/l3a 471 1 2024-09-17T01:41:43.466 INFO:tasks.workunit.client.0.smithi082.stdout:0/463: write da/d1b/d23/d4d/f5e [659457,84537] 0 2024-09-17T01:41:43.469 INFO:tasks.workunit.client.0.smithi082.stdout:5/637: truncate db/d56/d18/f70 4080961 0 2024-09-17T01:41:43.471 INFO:tasks.workunit.client.0.smithi082.stdout:0/464: creat da/d80/fa4 x:0 0 0 2024-09-17T01:41:43.476 INFO:tasks.workunit.client.0.smithi082.stdout:0/465: dwrite da/df/d71/f51 [8388608,4194304] 0 2024-09-17T01:41:43.479 INFO:tasks.workunit.client.0.smithi082.stdout:0/466: read da/df/d2b/d59/d8f/f6d [86394,93686] 0 2024-09-17T01:41:43.486 INFO:tasks.workunit.client.0.smithi082.stdout:5/638: write db/d56/d18/d23/f65 [162283,96601] 0 2024-09-17T01:41:43.486 INFO:tasks.workunit.client.0.smithi082.stdout:0/467: dwrite da/df/d2b/f89 [0,4194304] 0 2024-09-17T01:41:43.489 INFO:tasks.workunit.client.0.smithi082.stdout:0/468: readlink da/d80/d99/l64 0 2024-09-17T01:41:43.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/469: symlink da/d80/d99/la5 0 2024-09-17T01:41:43.494 INFO:tasks.workunit.client.0.smithi082.stdout:2/698: dread d1/d35/f68 [0,4194304] 0 2024-09-17T01:41:43.494 INFO:tasks.workunit.client.0.smithi082.stdout:0/470: write da/df/d2b/d59/d8f/f74 [837707,130719] 0 2024-09-17T01:41:43.495 INFO:tasks.workunit.client.0.smithi082.stdout:5/639: rename db/d56/d18/f1d to db/d56/fcd 0 2024-09-17T01:41:43.495 INFO:tasks.workunit.client.0.smithi082.stdout:5/640: stat db/d2b/f87 0 2024-09-17T01:41:43.500 INFO:tasks.workunit.client.0.smithi082.stdout:0/471: mkdir da/df/d2b/d59/d6f/da6 0 2024-09-17T01:41:43.505 INFO:tasks.workunit.client.0.smithi082.stdout:0/472: symlink da/df/d27/la7 0 2024-09-17T01:41:43.508 INFO:tasks.workunit.client.0.smithi082.stdout:0/473: creat da/df/d2b/d59/d8f/d69/fa8 x:0 0 0 2024-09-17T01:41:43.508 INFO:tasks.workunit.client.0.smithi082.stdout:5/641: getdents db/da7 0 2024-09-17T01:41:43.509 INFO:tasks.workunit.client.0.smithi082.stdout:0/474: chown da/d1b/d23/d4d/f9d 35170908 1 2024-09-17T01:41:43.512 INFO:tasks.workunit.client.0.smithi082.stdout:5/642: rename db/d56/d29/l58 to db/d56/d78/da0/lce 0 2024-09-17T01:41:43.515 INFO:tasks.workunit.client.0.smithi082.stdout:5/643: creat db/da7/fcf x:0 0 0 2024-09-17T01:41:43.516 INFO:tasks.workunit.client.0.smithi082.stdout:2/699: write d1/d17/d38/d42/d52/f70 [1083388,23904] 0 2024-09-17T01:41:43.518 INFO:tasks.workunit.client.0.smithi082.stdout:5/644: dread db/d56/d18/d23/f6c [0,4194304] 0 2024-09-17T01:41:43.520 INFO:tasks.workunit.client.0.smithi082.stdout:0/475: link da/df/d27/c32 da/df/ca9 0 2024-09-17T01:41:43.521 INFO:tasks.workunit.client.0.smithi082.stdout:5/645: mknod db/d56/d78/da0/cd0 0 2024-09-17T01:41:43.525 INFO:tasks.workunit.client.0.smithi082.stdout:5/646: mkdir db/d1e/d20/d30/dc6/dd1 0 2024-09-17T01:41:43.526 INFO:tasks.workunit.client.0.smithi082.stdout:2/700: creat d1/d17/fee x:0 0 0 2024-09-17T01:41:43.528 INFO:tasks.workunit.client.0.smithi082.stdout:0/476: symlink da/df/d2b/d59/laa 0 2024-09-17T01:41:43.529 INFO:tasks.workunit.client.0.smithi082.stdout:2/701: creat d1/d17/d38/d42/d52/d78/da0/fef x:0 0 0 2024-09-17T01:41:43.530 INFO:tasks.workunit.client.0.smithi082.stdout:5/647: mknod db/d1e/d20/d30/dc6/dd1/cd2 0 2024-09-17T01:41:43.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/477: mknod da/d1b/d23/d42/cab 0 2024-09-17T01:41:43.532 INFO:tasks.workunit.client.0.smithi082.stdout:2/702: rmdir d1/d17/d29/d50 39 2024-09-17T01:41:43.532 INFO:tasks.workunit.client.0.smithi082.stdout:2/703: stat d1/d17/d60/dc6/de8/la2 0 2024-09-17T01:41:43.533 INFO:tasks.workunit.client.0.smithi082.stdout:5/648: creat db/da7/db3/fd3 x:0 0 0 2024-09-17T01:41:43.534 INFO:tasks.workunit.client.0.smithi082.stdout:5/649: write db/d1e/d5b/f92 [962183,98399] 0 2024-09-17T01:41:43.535 INFO:tasks.workunit.client.0.smithi082.stdout:0/478: mknod da/df/d2b/cac 0 2024-09-17T01:41:43.538 INFO:tasks.workunit.client.0.smithi082.stdout:5/650: readlink db/d56/lad 0 2024-09-17T01:41:43.540 INFO:tasks.workunit.client.0.smithi082.stdout:2/704: rename d1/d90/ca6 to d1/d5a/d6d/dc2/cf0 0 2024-09-17T01:41:43.541 INFO:tasks.workunit.client.0.smithi082.stdout:0/479: symlink da/lad 0 2024-09-17T01:41:43.544 INFO:tasks.workunit.client.0.smithi082.stdout:5/651: chown db/cc7 669946 1 2024-09-17T01:41:43.544 INFO:tasks.workunit.client.0.smithi082.stdout:2/705: read d1/d10/fd0 [3762161,47701] 0 2024-09-17T01:41:43.545 INFO:tasks.workunit.client.0.smithi082.stdout:2/706: fdatasync d1/d17/d38/d5c/f79 0 2024-09-17T01:41:43.545 INFO:tasks.workunit.client.0.smithi082.stdout:2/707: readlink d1/d35/db1/lb6 0 2024-09-17T01:41:43.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/708: write d1/d35/f65 [4231747,109240] 0 2024-09-17T01:41:43.551 INFO:tasks.workunit.client.0.smithi082.stdout:0/480: rmdir da/d80/d9c 0 2024-09-17T01:41:43.552 INFO:tasks.workunit.client.0.smithi082.stdout:2/709: dread d1/d17/d38/d42/d52/f70 [0,4194304] 0 2024-09-17T01:41:43.556 INFO:tasks.workunit.client.0.smithi082.stdout:2/710: mkdir d1/d17/d38/d42/d52/d78/df1 0 2024-09-17T01:41:43.559 INFO:tasks.workunit.client.0.smithi082.stdout:5/652: write db/d1e/d20/f73 [4681787,87274] 0 2024-09-17T01:41:43.560 INFO:tasks.workunit.client.0.smithi082.stdout:0/481: symlink da/d1b/d23/d42/d43/lae 0 2024-09-17T01:41:43.563 INFO:tasks.workunit.client.0.smithi082.stdout:0/482: dread - da/d1b/d23/d42/d43/f97 zero size 2024-09-17T01:41:43.563 INFO:tasks.workunit.client.0.smithi082.stdout:2/711: dwrite d1/f1b [4194304,4194304] 0 2024-09-17T01:41:43.564 INFO:tasks.workunit.client.0.smithi082.stdout:0/483: write da/d80/f9e [948475,90072] 0 2024-09-17T01:41:43.565 INFO:tasks.workunit.client.0.smithi082.stdout:5/653: mknod db/d56/cd4 0 2024-09-17T01:41:43.566 INFO:tasks.workunit.client.0.smithi082.stdout:0/484: chown da/df/d2b/d59/d6f/f87 3624 1 2024-09-17T01:41:43.573 INFO:tasks.workunit.client.0.smithi082.stdout:0/485: getdents da/df 0 2024-09-17T01:41:43.577 INFO:tasks.workunit.client.0.smithi082.stdout:0/486: creat da/df/d2b/d59/d8f/faf x:0 0 0 2024-09-17T01:41:43.581 INFO:tasks.workunit.client.0.smithi082.stdout:0/487: mknod da/d1b/d23/d42/d43/cb0 0 2024-09-17T01:41:43.584 INFO:tasks.workunit.client.0.smithi082.stdout:2/712: dread d1/d35/f37 [0,4194304] 0 2024-09-17T01:41:43.585 INFO:tasks.workunit.client.0.smithi082.stdout:0/488: write da/d1b/d23/d4d/f5e [1081914,50821] 0 2024-09-17T01:41:43.586 INFO:tasks.workunit.client.0.smithi082.stdout:5/654: dwrite db/d2b/fa2 [0,4194304] 0 2024-09-17T01:41:43.587 INFO:tasks.workunit.client.0.smithi082.stdout:2/713: fsync d1/d35/f30 0 2024-09-17T01:41:43.593 INFO:tasks.workunit.client.0.smithi082.stdout:2/714: truncate d1/fd 2709000 0 2024-09-17T01:41:43.594 INFO:tasks.workunit.client.0.smithi082.stdout:0/489: link da/d1b/d23/d4d/c34 da/df/d2b/d59/d6f/d70/cb1 0 2024-09-17T01:41:43.595 INFO:tasks.workunit.client.0.smithi082.stdout:0/490: chown da/d1b/d23/d4d/f2a 12760 1 2024-09-17T01:41:43.599 INFO:tasks.workunit.client.0.smithi082.stdout:0/491: rename da/d1b/l6e to da/df/d2b/d59/lb2 0 2024-09-17T01:41:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:43 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:43 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:43 smithi082 ceph-mon[28077]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:41:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:43 smithi082 ceph-mon[28077]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:41:43.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:43 smithi082 ceph-mon[28077]: pgmap v25: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 201 MiB/s wr, 413 op/s 2024-09-17T01:41:43.727 INFO:tasks.workunit.client.0.smithi082.stdout:7/604: sync 2024-09-17T01:41:43.729 INFO:tasks.workunit.client.0.smithi082.stdout:7/605: symlink d0/dd/lcc 0 2024-09-17T01:41:43.730 INFO:tasks.workunit.client.0.smithi082.stdout:7/606: symlink d0/dd/lcd 0 2024-09-17T01:41:43.737 INFO:tasks.workunit.client.0.smithi082.stdout:7/607: mkdir d0/d62/dce 0 2024-09-17T01:41:43.739 INFO:tasks.workunit.client.0.smithi082.stdout:7/608: truncate d0/dd/d2c/d55/f9d 1150752 0 2024-09-17T01:41:43.741 INFO:tasks.workunit.client.0.smithi082.stdout:7/609: mknod d0/d3/db/d10/d3f/ccf 0 2024-09-17T01:41:43.743 INFO:tasks.workunit.client.0.smithi082.stdout:7/610: symlink d0/d3/d36/d37/d71/ld0 0 2024-09-17T01:41:43.745 INFO:tasks.workunit.client.0.smithi082.stdout:7/611: rmdir d0/dd/d34/d58/d6e/d8a 39 2024-09-17T01:41:43.747 INFO:tasks.workunit.client.0.smithi082.stdout:7/612: creat d0/d3/db/fd1 x:0 0 0 2024-09-17T01:41:43.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/613: mkdir d0/d50/dd2 0 2024-09-17T01:41:43.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/614: chown d0/d3/db/d10/l4c 22397671 1 2024-09-17T01:41:43.751 INFO:tasks.workunit.client.0.smithi082.stdout:7/615: symlink d0/d3/d36/d37/d86/ld3 0 2024-09-17T01:41:43.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:43 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:43.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:43 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:41:43.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:43 smithi167 ceph-mon[35643]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:41:43.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:43 smithi167 ceph-mon[35643]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:41:43.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:43 smithi167 ceph-mon[35643]: pgmap v25: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 201 MiB/s wr, 413 op/s 2024-09-17T01:41:43.765 INFO:tasks.workunit.client.0.smithi082.stdout:7/616: dread d0/dd/d2c/f89 [0,4194304] 0 2024-09-17T01:41:43.770 INFO:tasks.workunit.client.0.smithi082.stdout:7/617: write d0/dd/d34/d58/d6e/d8a/f93 [1020971,74746] 0 2024-09-17T01:41:43.772 INFO:tasks.workunit.client.0.smithi082.stdout:7/618: rename d0/d3/d36 to d0/d62/d7e/dd4 0 2024-09-17T01:41:43.784 INFO:tasks.workunit.client.0.smithi082.stdout:7/619: dread d0/d3/db/d10/d47/f6c [4194304,4194304] 0 2024-09-17T01:41:43.789 INFO:tasks.workunit.client.0.smithi082.stdout:7/620: dwrite d0/d3/db/f83 [0,4194304] 0 2024-09-17T01:41:43.796 INFO:tasks.workunit.client.0.smithi082.stdout:7/621: getdents d0/dd/d2c/d42/d77/db2 0 2024-09-17T01:41:43.797 INFO:tasks.workunit.client.0.smithi082.stdout:7/622: chown d0/d3/db/d10/l4c 1 1 2024-09-17T01:41:43.803 INFO:tasks.workunit.client.0.smithi082.stdout:7/623: rename d0/d62/d7e/dd4/d37/l4a to d0/d3/ld5 0 2024-09-17T01:41:43.808 INFO:tasks.workunit.client.0.smithi082.stdout:7/624: link d0/f13 d0/d62/d7e/db5/fd6 0 2024-09-17T01:41:43.810 INFO:tasks.workunit.client.0.smithi082.stdout:7/625: mkdir d0/d62/d7e/dd7 0 2024-09-17T01:41:43.812 INFO:tasks.workunit.client.0.smithi082.stdout:7/626: symlink d0/dd/d2c/d55/ld8 0 2024-09-17T01:41:43.814 INFO:tasks.workunit.client.0.smithi082.stdout:7/627: rename d0/d62/d7e/dd4/d37/f44 to d0/d62/d7e/fd9 0 2024-09-17T01:41:43.816 INFO:tasks.workunit.client.0.smithi082.stdout:7/628: mknod d0/dd/d2c/cda 0 2024-09-17T01:41:43.820 INFO:tasks.workunit.client.0.smithi082.stdout:7/629: truncate d0/dd/d2c/d55/fbd 2415086 0 2024-09-17T01:41:43.827 INFO:tasks.workunit.client.0.smithi082.stdout:7/630: dread d0/d3/db/d10/f22 [0,4194304] 0 2024-09-17T01:41:43.829 INFO:tasks.workunit.client.0.smithi082.stdout:7/631: unlink d0/d3/db/d10/l59 0 2024-09-17T01:41:43.830 INFO:tasks.workunit.client.0.smithi082.stdout:7/632: creat d0/d50/fdb x:0 0 0 2024-09-17T01:41:43.832 INFO:tasks.workunit.client.0.smithi082.stdout:7/633: mknod d0/d62/dce/cdc 0 2024-09-17T01:41:43.834 INFO:tasks.workunit.client.0.smithi082.stdout:7/634: getdents d0/dd/d2c/d42/d77/db2 0 2024-09-17T01:41:43.850 INFO:tasks.workunit.client.0.smithi082.stdout:7/635: dwrite d0/d62/d7e/dd4/f6b [0,4194304] 0 2024-09-17T01:41:43.858 INFO:tasks.workunit.client.0.smithi082.stdout:7/636: dread d0/dd/f17 [0,4194304] 0 2024-09-17T01:41:43.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/637: dread d0/d62/d7e/dd4/d37/d71/fb4 [0,4194304] 0 2024-09-17T01:41:43.862 INFO:tasks.workunit.client.0.smithi082.stdout:7/638: creat d0/dd/d2c/d42/fdd x:0 0 0 2024-09-17T01:41:43.873 INFO:tasks.workunit.client.0.smithi082.stdout:7/639: dwrite d0/d3/db/f18 [0,4194304] 0 2024-09-17T01:41:43.877 INFO:tasks.workunit.client.0.smithi082.stdout:7/640: mkdir d0/dd/d2c/d42/dde 0 2024-09-17T01:41:43.877 INFO:tasks.workunit.client.0.smithi082.stdout:7/641: chown d0/d3/db/d10/d47 306 1 2024-09-17T01:41:43.878 INFO:tasks.workunit.client.0.smithi082.stdout:7/642: write d0/d3/f5e [828779,54918] 0 2024-09-17T01:41:43.880 INFO:tasks.workunit.client.0.smithi082.stdout:7/643: truncate d0/dd/d2c/d42/fdd 1046903 0 2024-09-17T01:41:43.882 INFO:tasks.workunit.client.0.smithi082.stdout:7/644: mkdir d0/d3/db/ddf 0 2024-09-17T01:41:43.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/645: read d0/dd/fa2 [1883316,16578] 0 2024-09-17T01:41:43.894 INFO:tasks.workunit.client.0.smithi082.stdout:7/646: write d0/d62/d7e/dd4/d37/d71/f94 [1086297,82865] 0 2024-09-17T01:41:43.895 INFO:tasks.workunit.client.0.smithi082.stdout:7/647: read d0/d3/f2b [3124136,98886] 0 2024-09-17T01:41:44.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/711: sync 2024-09-17T01:41:44.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/712: chown d2/d3f/d24/l5b 24896 1 2024-09-17T01:41:44.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/713: stat d2/d3f/d24/f69 0 2024-09-17T01:41:44.117 INFO:tasks.workunit.client.0.smithi082.stdout:1/714: rmdir d2/d3f/d34/dc5/deb 0 2024-09-17T01:41:44.117 INFO:tasks.workunit.client.0.smithi082.stdout:1/715: write d2/fbc [508020,122000] 0 2024-09-17T01:41:44.118 INFO:tasks.workunit.client.0.smithi082.stdout:1/716: chown d2/df/ldb 5005873 1 2024-09-17T01:41:44.150 INFO:tasks.workunit.client.0.smithi082.stdout:1/717: truncate d2/d3f/f26 3657334 0 2024-09-17T01:41:44.153 INFO:tasks.workunit.client.0.smithi082.stdout:1/718: mkdir d2/d3f/d24/db5/dec 0 2024-09-17T01:41:44.156 INFO:tasks.workunit.client.0.smithi082.stdout:1/719: getdents d2/d3f/d24/dba 0 2024-09-17T01:41:44.157 INFO:tasks.workunit.client.0.smithi082.stdout:1/720: chown d2/d3f/d24/l25 0 1 2024-09-17T01:41:44.158 INFO:tasks.workunit.client.0.smithi082.stdout:1/721: write d2/d3f/d24/f7e [356331,116067] 0 2024-09-17T01:41:44.160 INFO:tasks.workunit.client.0.smithi082.stdout:1/722: chown d2/d3f/d24/f86 80683 1 2024-09-17T01:41:44.182 INFO:tasks.workunit.client.0.smithi082.stdout:1/723: truncate d2/da/d2f/f31 5586927 0 2024-09-17T01:41:44.183 INFO:tasks.workunit.client.0.smithi082.stdout:1/724: read d2/da/d2d/f45 [2675424,33] 0 2024-09-17T01:41:44.185 INFO:tasks.workunit.client.0.smithi082.stdout:1/725: fsync d2/d3f/d24/f86 0 2024-09-17T01:41:44.203 INFO:tasks.workunit.client.0.smithi082.stdout:1/726: dread d2/da/f33 [0,4194304] 0 2024-09-17T01:41:44.207 INFO:tasks.workunit.client.0.smithi082.stdout:1/727: getdents d2/da/d80 0 2024-09-17T01:41:44.211 INFO:tasks.workunit.client.0.smithi082.stdout:1/728: unlink d2/da/fcc 0 2024-09-17T01:41:44.212 INFO:tasks.workunit.client.0.smithi082.stdout:1/729: write d2/d3f/d24/f69 [4516878,2928] 0 2024-09-17T01:41:44.213 INFO:tasks.workunit.client.0.smithi082.stdout:1/730: fsync d2/da/fb2 0 2024-09-17T01:41:44.224 INFO:tasks.workunit.client.0.smithi082.stdout:1/731: truncate d2/d3f/d24/f69 628221 0 2024-09-17T01:41:44.228 INFO:tasks.workunit.client.0.smithi082.stdout:1/732: truncate d2/d3f/fe1 4563942 0 2024-09-17T01:41:44.241 INFO:tasks.workunit.client.0.smithi082.stdout:1/733: dwrite d2/da/f33 [0,4194304] 0 2024-09-17T01:41:44.242 INFO:tasks.workunit.client.0.smithi082.stdout:1/734: dread - d2/da/d76/d93/fcb zero size 2024-09-17T01:41:44.248 INFO:tasks.workunit.client.0.smithi082.stdout:1/735: dwrite d2/da/d80/dc6/fd8 [0,4194304] 0 2024-09-17T01:41:44.251 INFO:tasks.workunit.client.0.smithi082.stdout:1/736: mkdir d2/da/d80/dc6/ded 0 2024-09-17T01:41:44.254 INFO:tasks.workunit.client.0.smithi082.stdout:1/737: rmdir d2/da/d76/d93 39 2024-09-17T01:41:44.257 INFO:tasks.workunit.client.0.smithi082.stdout:1/738: rename d2/df/d46/f91 to d2/da/d2f/d47/fee 0 2024-09-17T01:41:44.262 INFO:tasks.workunit.client.0.smithi082.stdout:1/739: dwrite d2/da/d80/da3/fe5 [0,4194304] 0 2024-09-17T01:41:44.264 INFO:tasks.workunit.client.0.smithi082.stdout:1/740: mknod d2/d3f/d24/db5/cef 0 2024-09-17T01:41:44.268 INFO:tasks.workunit.client.0.smithi082.stdout:1/741: symlink d2/da/d80/dc6/ded/lf0 0 2024-09-17T01:41:44.280 INFO:tasks.workunit.client.0.smithi082.stdout:1/742: write d2/d3f/f26 [3110537,228] 0 2024-09-17T01:41:44.283 INFO:tasks.workunit.client.0.smithi082.stdout:1/743: truncate d2/d3f/d34/f59 648599 0 2024-09-17T01:41:44.287 INFO:tasks.workunit.client.0.smithi082.stdout:1/744: getdents d2/d3f 0 2024-09-17T01:41:44.288 INFO:tasks.workunit.client.0.smithi082.stdout:1/745: write d2/da/d2f/d47/fd9 [931500,41260] 0 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:7/648: sync 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:0/492: sync 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:5/655: sync 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:2/715: sync 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:6/672: sync 2024-09-17T01:41:44.291 INFO:tasks.workunit.client.0.smithi082.stdout:4/692: sync 2024-09-17T01:41:44.292 INFO:tasks.workunit.client.0.smithi082.stdout:9/544: sync 2024-09-17T01:41:44.292 INFO:tasks.workunit.client.0.smithi082.stdout:8/544: sync 2024-09-17T01:41:44.292 INFO:tasks.workunit.client.0.smithi082.stdout:3/599: sync 2024-09-17T01:41:44.294 INFO:tasks.workunit.client.0.smithi082.stdout:5/656: readlink db/d1e/d5b/l84 0 2024-09-17T01:41:44.294 INFO:tasks.workunit.client.0.smithi082.stdout:2/716: stat d1/d35/f65 0 2024-09-17T01:41:44.297 INFO:tasks.workunit.client.0.smithi082.stdout:1/746: dwrite d2/d3f/d24/f81 [0,4194304] 0 2024-09-17T01:41:44.298 INFO:tasks.workunit.client.0.smithi082.stdout:4/693: chown d9/d15/d16/d18/d4a/d52/d55/l7e 56863482 1 2024-09-17T01:41:44.304 INFO:tasks.workunit.client.0.smithi082.stdout:8/545: creat d3/dd/d18/d2d/d3e/d4a/d66/fac x:0 0 0 2024-09-17T01:41:44.305 INFO:tasks.workunit.client.0.smithi082.stdout:6/673: dwrite d1/d7/d10/d4f/d32/f9b [0,4194304] 0 2024-09-17T01:41:44.308 INFO:tasks.workunit.client.0.smithi082.stdout:6/674: dread - d1/d7/d10/d4f/d32/fdf zero size 2024-09-17T01:41:44.315 INFO:tasks.workunit.client.0.smithi082.stdout:4/694: dread d9/fa [0,4194304] 0 2024-09-17T01:41:44.322 INFO:tasks.workunit.client.0.smithi082.stdout:4/695: dwrite d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:44.326 INFO:tasks.workunit.client.0.smithi082.stdout:5/657: write db/f2d [633168,128224] 0 2024-09-17T01:41:44.329 INFO:tasks.workunit.client.0.smithi082.stdout:7/649: write d0/d3/db/fc8 [1238677,18414] 0 2024-09-17T01:41:44.334 INFO:tasks.workunit.client.0.smithi082.stdout:0/493: creat da/d1b/d23/d4d/fb3 x:0 0 0 2024-09-17T01:41:44.336 INFO:tasks.workunit.client.0.smithi082.stdout:6/675: mkdir d1/d1f/db0/ded 0 2024-09-17T01:41:44.341 INFO:tasks.workunit.client.0.smithi082.stdout:4/696: mknod d9/d47/d9b/ce2 0 2024-09-17T01:41:44.349 INFO:tasks.workunit.client.0.smithi082.stdout:2/717: creat d1/d17/d38/d42/ff2 x:0 0 0 2024-09-17T01:41:44.350 INFO:tasks.workunit.client.0.smithi082.stdout:0/494: unlink da/df/f15 0 2024-09-17T01:41:44.353 INFO:tasks.workunit.client.0.smithi082.stdout:6/676: dread d1/f5d [0,4194304] 0 2024-09-17T01:41:44.354 INFO:tasks.workunit.client.0.smithi082.stdout:9/545: getdents d4/d27/d2d/d60/d11/d39 0 2024-09-17T01:41:44.356 INFO:tasks.workunit.client.0.smithi082.stdout:4/697: creat d9/d15/d16/d18/d4f/fe3 x:0 0 0 2024-09-17T01:41:44.357 INFO:tasks.workunit.client.0.smithi082.stdout:3/600: link d9/db/l7a d9/d35/d63/ld3 0 2024-09-17T01:41:44.361 INFO:tasks.workunit.client.0.smithi082.stdout:7/650: mkdir d0/d62/d7e/dd7/de0 0 2024-09-17T01:41:44.364 INFO:tasks.workunit.client.0.smithi082.stdout:9/546: mkdir d4/d27/d2d/d3d/db7 0 2024-09-17T01:41:44.365 INFO:tasks.workunit.client.0.smithi082.stdout:9/547: dread - d4/f94 zero size 2024-09-17T01:41:44.365 INFO:tasks.workunit.client.0.smithi082.stdout:6/677: rmdir d1/d7/d10/d4f/dc/d99/dbb 39 2024-09-17T01:41:44.366 INFO:tasks.workunit.client.0.smithi082.stdout:1/747: link d2/da/d2f/c8b d2/da/d2f/cf1 0 2024-09-17T01:41:44.368 INFO:tasks.workunit.client.0.smithi082.stdout:6/678: read d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fce [2108365,126498] 0 2024-09-17T01:41:44.370 INFO:tasks.workunit.client.0.smithi082.stdout:8/546: getdents d3/dd 0 2024-09-17T01:41:44.372 INFO:tasks.workunit.client.0.smithi082.stdout:3/601: dread - d9/db/d49/d4e/f72 zero size 2024-09-17T01:41:44.373 INFO:tasks.workunit.client.0.smithi082.stdout:8/547: dread d3/dd/d18/d2d/d3e/d4a/f88 [0,4194304] 0 2024-09-17T01:41:44.376 INFO:tasks.workunit.client.0.smithi082.stdout:4/698: dread d9/d15/d16/f2c [0,4194304] 0 2024-09-17T01:41:44.383 INFO:tasks.workunit.client.0.smithi082.stdout:3/602: rmdir d9/db/daa 39 2024-09-17T01:41:44.384 INFO:tasks.workunit.client.0.smithi082.stdout:4/699: dwrite d9/d15/d16/d18/d4f/fe3 [0,4194304] 0 2024-09-17T01:41:44.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/495: stat da/df/d2b/d59/d8f/d69 0 2024-09-17T01:41:44.389 INFO:tasks.workunit.client.0.smithi082.stdout:1/748: mkdir d2/da/df2 0 2024-09-17T01:41:44.390 INFO:tasks.workunit.client.0.smithi082.stdout:1/749: chown d2/d3f/d24/db5/dec 372 1 2024-09-17T01:41:44.392 INFO:tasks.workunit.client.0.smithi082.stdout:9/548: rename d4/d27/d2d/d60/d11/d39/d44/c64 to d4/d27/d36/d3b/db0/cb8 0 2024-09-17T01:41:44.397 INFO:tasks.workunit.client.0.smithi082.stdout:2/718: dwrite d1/d10/fd0 [0,4194304] 0 2024-09-17T01:41:44.398 INFO:tasks.workunit.client.0.smithi082.stdout:6/679: dread d1/d7/d10/f9f [0,4194304] 0 2024-09-17T01:41:44.400 INFO:tasks.workunit.client.0.smithi082.stdout:7/651: link d0/f7a d0/d3/db/ddf/fe1 0 2024-09-17T01:41:44.402 INFO:tasks.workunit.client.0.smithi082.stdout:7/652: chown d0/d62/d7e/dd4/d37/d86/l8d 0 1 2024-09-17T01:41:44.412 INFO:tasks.workunit.client.0.smithi082.stdout:1/750: symlink d2/d3f/d24/db5/de6/lf3 0 2024-09-17T01:41:44.412 INFO:tasks.workunit.client.0.smithi082.stdout:9/549: fdatasync d4/d27/d2d/d60/d11/d39/d44/f72 0 2024-09-17T01:41:44.415 INFO:tasks.workunit.client.0.smithi082.stdout:9/550: write d4/d27/d2d/d3d/f8c [907913,62101] 0 2024-09-17T01:41:44.416 INFO:tasks.workunit.client.0.smithi082.stdout:9/551: chown d4/d27/d2d/d60/d11/d39/d29/fac 53492307 1 2024-09-17T01:41:44.420 INFO:tasks.workunit.client.0.smithi082.stdout:6/680: dread d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [0,4194304] 0 2024-09-17T01:41:44.425 INFO:tasks.workunit.client.0.smithi082.stdout:7/653: getdents d0/d50/dd2 0 2024-09-17T01:41:44.427 INFO:tasks.workunit.client.0.smithi082.stdout:8/548: dwrite d3/dd/d18/d3a/f57 [0,4194304] 0 2024-09-17T01:41:44.429 INFO:tasks.workunit.client.0.smithi082.stdout:9/552: symlink d4/d27/d2d/d60/d11/d39/d31/lb9 0 2024-09-17T01:41:44.429 INFO:tasks.workunit.client.0.smithi082.stdout:9/553: chown d4/d27/d2d/c5b 885436 1 2024-09-17T01:41:44.433 INFO:tasks.workunit.client.0.smithi082.stdout:3/603: link d9/c1c d9/db/daf/d69/d79/cd4 0 2024-09-17T01:41:44.438 INFO:tasks.workunit.client.0.smithi082.stdout:0/496: link da/fd da/d1b/fb4 0 2024-09-17T01:41:44.443 INFO:tasks.workunit.client.0.smithi082.stdout:1/751: creat d2/da/d76/ff4 x:0 0 0 2024-09-17T01:41:44.445 INFO:tasks.workunit.client.0.smithi082.stdout:2/719: getdents d1/d17/d38/d5c 0 2024-09-17T01:41:44.446 INFO:tasks.workunit.client.0.smithi082.stdout:4/700: dwrite d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:44.448 INFO:tasks.workunit.client.0.smithi082.stdout:7/654: mkdir d0/dd/d2c/d42/dde/de2 0 2024-09-17T01:41:44.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/554: getdents d4/da6 0 2024-09-17T01:41:44.452 INFO:tasks.workunit.client.0.smithi082.stdout:1/752: write d2/d3f/d24/d54/fb4 [90776,47259] 0 2024-09-17T01:41:44.452 INFO:tasks.workunit.client.0.smithi082.stdout:4/701: write d9/dbd/fe1 [477789,46694] 0 2024-09-17T01:41:44.453 INFO:tasks.workunit.client.0.smithi082.stdout:9/555: fsync d4/d27/d36/d3b/faf 0 2024-09-17T01:41:44.458 INFO:tasks.workunit.client.0.smithi082.stdout:3/604: truncate d9/db/d49/d4e/d53/f7f 924808 0 2024-09-17T01:41:44.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/655: rmdir d0/dd/d2c 39 2024-09-17T01:41:44.461 INFO:tasks.workunit.client.0.smithi082.stdout:4/702: chown d9/d2b/c5c 0 1 2024-09-17T01:41:44.464 INFO:tasks.workunit.client.0.smithi082.stdout:9/556: truncate d4/f4c 887191 0 2024-09-17T01:41:44.465 INFO:tasks.workunit.client.0.smithi082.stdout:4/703: chown d9/d47/cc6 2279858 1 2024-09-17T01:41:44.466 INFO:tasks.workunit.client.0.smithi082.stdout:8/549: getdents d3/dd/d18/d2d/d3e/d4a/d66/d6e 0 2024-09-17T01:41:44.467 INFO:tasks.workunit.client.0.smithi082.stdout:3/605: dwrite d9/db/daf/fa8 [0,4194304] 0 2024-09-17T01:41:44.469 INFO:tasks.workunit.client.0.smithi082.stdout:9/557: chown d4/d27/d2d/d60/d11/d39/c48 5308 1 2024-09-17T01:41:44.470 INFO:tasks.workunit.client.0.smithi082.stdout:7/656: creat d0/dd/d34/d58/d6e/d8a/fe3 x:0 0 0 2024-09-17T01:41:44.478 INFO:tasks.workunit.client.0.smithi082.stdout:3/606: dwrite d9/db/daf/d69/dbc/fc9 [0,4194304] 0 2024-09-17T01:41:44.483 INFO:tasks.workunit.client.0.smithi082.stdout:8/550: unlink d3/dd/d18/d34/l37 0 2024-09-17T01:41:44.489 INFO:tasks.workunit.client.0.smithi082.stdout:2/720: getdents d1/d17/d60 0 2024-09-17T01:41:44.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/681: write d1/d7/d10/d4f/dc/d1d/d36/d56/f71 [1165463,97101] 0 2024-09-17T01:41:44.490 INFO:tasks.workunit.client.0.smithi082.stdout:2/721: chown d1/d66/d85/dde 22333 1 2024-09-17T01:41:44.491 INFO:tasks.workunit.client.0.smithi082.stdout:9/558: mkdir d4/d27/d2d/d60/dba 0 2024-09-17T01:41:44.492 INFO:tasks.workunit.client.0.smithi082.stdout:9/559: chown d4/d27/d2d/d60/d11/l9a 0 1 2024-09-17T01:41:44.493 INFO:tasks.workunit.client.0.smithi082.stdout:8/551: creat d3/dd/d18/d2d/d3e/d4a/d6a/fad x:0 0 0 2024-09-17T01:41:44.493 INFO:tasks.workunit.client.0.smithi082.stdout:7/657: mknod d0/dd/d2c/d54/ce4 0 2024-09-17T01:41:44.501 INFO:tasks.workunit.client.0.smithi082.stdout:8/552: dwrite d3/dd/d18/d2d/d3e/d4a/d6a/f42 [0,4194304] 0 2024-09-17T01:41:44.504 INFO:tasks.workunit.client.0.smithi082.stdout:7/658: unlink d0/dd/f1d 0 2024-09-17T01:41:44.504 INFO:tasks.workunit.client.0.smithi082.stdout:8/553: readlink d3/dd/l17 0 2024-09-17T01:41:44.508 INFO:tasks.workunit.client.0.smithi082.stdout:6/682: creat d1/d7/d10/fee x:0 0 0 2024-09-17T01:41:44.511 INFO:tasks.workunit.client.0.smithi082.stdout:7/659: creat d0/dd/d34/d58/fe5 x:0 0 0 2024-09-17T01:41:44.514 INFO:tasks.workunit.client.0.smithi082.stdout:2/722: dread d1/fd [0,4194304] 0 2024-09-17T01:41:44.515 INFO:tasks.workunit.client.0.smithi082.stdout:0/497: dwrite da/d80/d99/f66 [0,4194304] 0 2024-09-17T01:41:44.517 INFO:tasks.workunit.client.0.smithi082.stdout:8/554: mkdir d3/dd/d18/d51/dae 0 2024-09-17T01:41:44.523 INFO:tasks.workunit.client.0.smithi082.stdout:7/660: write d0/d62/d7e/fd9 [1461368,48927] 0 2024-09-17T01:41:44.530 INFO:tasks.workunit.client.0.smithi082.stdout:8/555: mknod d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/caf 0 2024-09-17T01:41:44.531 INFO:tasks.workunit.client.0.smithi082.stdout:1/753: dwrite d2/da/d76/d93/fa4 [0,4194304] 0 2024-09-17T01:41:44.534 INFO:tasks.workunit.client.0.smithi082.stdout:2/723: rename d1/d17/d29/d50/fd9 to d1/d10/ff3 0 2024-09-17T01:41:44.536 INFO:tasks.workunit.client.0.smithi082.stdout:4/704: dwrite d9/d15/d16/d18/d4a/d52/f82 [4194304,4194304] 0 2024-09-17T01:41:44.540 INFO:tasks.workunit.client.0.smithi082.stdout:8/556: write d3/dd/d18/d2d/d3e/d4a/fa2 [926369,94236] 0 2024-09-17T01:41:44.541 INFO:tasks.workunit.client.0.smithi082.stdout:1/754: mknod d2/d3f/d34/dc5/cf5 0 2024-09-17T01:41:44.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/755: readlink d2/d3f/d34/l73 0 2024-09-17T01:41:44.544 INFO:tasks.workunit.client.0.smithi082.stdout:0/498: rename da/df/d2b/d59/d6f/d70 to da/df/d27/db5 0 2024-09-17T01:41:44.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/724: dread d1/d35/f37 [4194304,4194304] 0 2024-09-17T01:41:44.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/725: chown d1/d35/db1/d9c 30359581 1 2024-09-17T01:41:44.546 INFO:tasks.workunit.client.0.smithi082.stdout:2/726: chown d1/d17/faa 197314 1 2024-09-17T01:41:44.547 INFO:tasks.workunit.client.0.smithi082.stdout:2/727: chown d1/d17/d38/d42/f45 0 1 2024-09-17T01:41:44.549 INFO:tasks.workunit.client.0.smithi082.stdout:2/728: dread - d1/d66/fd6 zero size 2024-09-17T01:41:44.549 INFO:tasks.workunit.client.0.smithi082.stdout:7/661: mknod d0/d62/d7e/dd7/de0/ce6 0 2024-09-17T01:41:44.562 INFO:tasks.workunit.client.0.smithi082.stdout:4/705: rename d9/d15/d37/d4c/cc4 to d9/d47/dc2/dda/dd4/ce4 0 2024-09-17T01:41:44.563 INFO:tasks.workunit.client.0.smithi082.stdout:0/499: getdents da/df/d2b/d9a 0 2024-09-17T01:41:44.563 INFO:tasks.workunit.client.0.smithi082.stdout:4/706: chown d9/d15/d16/d3e/d73/c8c 0 1 2024-09-17T01:41:44.564 INFO:tasks.workunit.client.0.smithi082.stdout:4/707: chown d9/d15/c29 80033 1 2024-09-17T01:41:44.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/662: rename d0/dd/d34/d58/f6a to d0/d3/db/d10/d47/fe7 0 2024-09-17T01:41:44.571 INFO:tasks.workunit.client.0.smithi082.stdout:4/708: creat d9/d15/d37/d4c/fe5 x:0 0 0 2024-09-17T01:41:44.572 INFO:tasks.workunit.client.0.smithi082.stdout:1/756: dwrite d2/d3f/d24/f86 [0,4194304] 0 2024-09-17T01:41:44.574 INFO:tasks.workunit.client.0.smithi082.stdout:7/663: creat d0/d62/fe8 x:0 0 0 2024-09-17T01:41:44.575 INFO:tasks.workunit.client.0.smithi082.stdout:0/500: mknod da/df/d71/cb6 0 2024-09-17T01:41:44.579 INFO:tasks.workunit.client.0.smithi082.stdout:8/557: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fb0 x:0 0 0 2024-09-17T01:41:44.592 INFO:tasks.workunit.client.0.smithi082.stdout:7/664: link d0/d62/d7e/dd4/d37/d86/laa d0/dd/d34/d58/le9 0 2024-09-17T01:41:44.596 INFO:tasks.workunit.client.0.smithi082.stdout:0/501: rename da/fd to da/d1b/d23/d42/d43/d6b/fb7 0 2024-09-17T01:41:44.599 INFO:tasks.workunit.client.0.smithi082.stdout:1/757: link d2/d3f/d24/f69 d2/da/d2f/ff6 0 2024-09-17T01:41:44.601 INFO:tasks.workunit.client.0.smithi082.stdout:8/558: getdents d3/dd/d18/d2d/d3e/d4a/d68 0 2024-09-17T01:41:44.602 INFO:tasks.workunit.client.0.smithi082.stdout:0/502: unlink da/df/c30 0 2024-09-17T01:41:44.603 INFO:tasks.workunit.client.0.smithi082.stdout:1/758: dread d2/fbc [0,4194304] 0 2024-09-17T01:41:44.603 INFO:tasks.workunit.client.0.smithi082.stdout:7/665: link d0/l3e d0/dd/d2c/d42/dde/de2/lea 0 2024-09-17T01:41:44.604 INFO:tasks.workunit.client.0.smithi082.stdout:8/559: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/db1 0 2024-09-17T01:41:44.606 INFO:tasks.workunit.client.0.smithi082.stdout:0/503: mknod da/d80/d99/cb8 0 2024-09-17T01:41:44.607 INFO:tasks.workunit.client.0.smithi082.stdout:8/560: dread - d3/dd/d18/d2d/d3e/d4a/d6a/fa4 zero size 2024-09-17T01:41:44.611 INFO:tasks.workunit.client.0.smithi082.stdout:0/504: mknod da/d1b/cb9 0 2024-09-17T01:41:44.612 INFO:tasks.workunit.client.0.smithi082.stdout:1/759: dwrite d2/da/d80/dc6/fe9 [0,4194304] 0 2024-09-17T01:41:44.614 INFO:tasks.workunit.client.0.smithi082.stdout:7/666: dwrite d0/dd/d34/d58/d6e/d8a/fe3 [0,4194304] 0 2024-09-17T01:41:44.615 INFO:tasks.workunit.client.0.smithi082.stdout:7/667: chown d0 340309353 1 2024-09-17T01:41:44.615 INFO:tasks.workunit.client.0.smithi082.stdout:8/561: mknod d3/dd/d18/d2d/d3b/cb2 0 2024-09-17T01:41:44.617 INFO:tasks.workunit.client.0.smithi082.stdout:8/562: fsync d3/dd/d18/d51/f6f 0 2024-09-17T01:41:44.619 INFO:tasks.workunit.client.0.smithi082.stdout:8/563: dread - d3/dd/d18/d2d/d3e/d4a/f90 zero size 2024-09-17T01:41:44.621 INFO:tasks.workunit.client.0.smithi082.stdout:8/564: chown d3/dd/d18/d3a/l91 1279 1 2024-09-17T01:41:44.634 INFO:tasks.workunit.client.0.smithi082.stdout:1/760: truncate d2/da/d2f/d47/f4d 1568861 0 2024-09-17T01:41:44.636 INFO:tasks.workunit.client.0.smithi082.stdout:7/668: write d0/dd/f16 [2426783,46037] 0 2024-09-17T01:41:44.640 INFO:tasks.workunit.client.0.smithi082.stdout:1/761: rename d2/da/d76/d93/fcb to d2/d3f/d24/db5/dea/ff7 0 2024-09-17T01:41:44.640 INFO:tasks.workunit.client.0.smithi082.stdout:0/505: dread da/df/f4a [0,4194304] 0 2024-09-17T01:41:44.640 INFO:tasks.workunit.client.0.smithi082.stdout:7/669: rmdir d0/d62/d7e/dd4 39 2024-09-17T01:41:44.640 INFO:tasks.workunit.client.0.smithi082.stdout:0/506: dread - da/d80/fa4 zero size 2024-09-17T01:41:44.641 INFO:tasks.workunit.client.0.smithi082.stdout:1/762: write d2/fd6 [5063302,51348] 0 2024-09-17T01:41:44.647 INFO:tasks.workunit.client.0.smithi082.stdout:7/670: mkdir d0/d62/dce/deb 0 2024-09-17T01:41:44.648 INFO:tasks.workunit.client.0.smithi082.stdout:0/507: creat da/d1b/d23/d42/d43/d6b/fba x:0 0 0 2024-09-17T01:41:44.649 INFO:tasks.workunit.client.0.smithi082.stdout:1/763: unlink d2/da/d76/d93/fb7 0 2024-09-17T01:41:44.657 INFO:tasks.workunit.client.0.smithi082.stdout:8/565: dwrite d3/dd/f23 [0,4194304] 0 2024-09-17T01:41:44.657 INFO:tasks.workunit.client.0.smithi082.stdout:8/566: chown d3/dd/d18/l6c 86 1 2024-09-17T01:41:44.678 INFO:tasks.workunit.client.0.smithi082.stdout:7/671: chown d0/dd/ca5 4040 1 2024-09-17T01:41:44.679 INFO:tasks.workunit.client.0.smithi082.stdout:0/508: stat da/df/d2b/d9a 0 2024-09-17T01:41:44.679 INFO:tasks.workunit.client.0.smithi082.stdout:7/672: chown d0/d3/db/d10/f27 100 1 2024-09-17T01:41:44.679 INFO:tasks.workunit.client.0.smithi082.stdout:0/509: chown da/df/d2b/l41 60512 1 2024-09-17T01:41:44.685 INFO:tasks.workunit.client.0.smithi082.stdout:7/673: fsync d0/dd/d2c/fb7 0 2024-09-17T01:41:44.689 INFO:tasks.workunit.client.0.smithi082.stdout:8/567: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3 0 2024-09-17T01:41:44.692 INFO:tasks.workunit.client.0.smithi082.stdout:0/510: unlink da/df/d27/la7 0 2024-09-17T01:41:44.693 INFO:tasks.workunit.client.0.smithi082.stdout:0/511: fdatasync da/d1b/d23/d42/d43/f97 0 2024-09-17T01:41:44.696 INFO:tasks.workunit.client.0.smithi082.stdout:1/764: getdents d2/d3f/d24/dc8 0 2024-09-17T01:41:44.698 INFO:tasks.workunit.client.0.smithi082.stdout:0/512: chown da/d1b/f4f 2 1 2024-09-17T01:41:44.701 INFO:tasks.workunit.client.0.smithi082.stdout:0/513: mknod da/df/d2b/d59/d6f/cbb 0 2024-09-17T01:41:44.705 INFO:tasks.workunit.client.0.smithi082.stdout:8/568: getdents d3/dd/d18/d2d/d3e 0 2024-09-17T01:41:44.705 INFO:tasks.workunit.client.0.smithi082.stdout:1/765: link d2/da/d2f/l60 d2/da/df2/lf8 0 2024-09-17T01:41:44.706 INFO:tasks.workunit.client.0.smithi082.stdout:0/514: dread da/d1b/d23/d4d/f5e [0,4194304] 0 2024-09-17T01:41:44.707 INFO:tasks.workunit.client.0.smithi082.stdout:7/674: write d0/dd/f7c [1675950,71256] 0 2024-09-17T01:41:44.713 INFO:tasks.workunit.client.0.smithi082.stdout:7/675: mkdir d0/d3/db/d10/d3f/dec 0 2024-09-17T01:41:44.713 INFO:tasks.workunit.client.0.smithi082.stdout:0/515: dread da/df/d2b/f89 [0,4194304] 0 2024-09-17T01:41:44.713 INFO:tasks.workunit.client.0.smithi082.stdout:8/569: dwrite d3/dd/d18/d2d/d3e/d4a/d68/f78 [0,4194304] 0 2024-09-17T01:41:44.715 INFO:tasks.workunit.client.0.smithi082.stdout:1/766: link d2/da/d2f/ld7 d2/df/d46/lf9 0 2024-09-17T01:41:44.715 INFO:tasks.workunit.client.0.smithi082.stdout:8/570: write d3/dd/d18/d2d/d3e/d43/f45 [3527282,52419] 0 2024-09-17T01:41:44.716 INFO:tasks.workunit.client.0.smithi082.stdout:7/676: mknod d0/d50/ced 0 2024-09-17T01:41:44.718 INFO:tasks.workunit.client.0.smithi082.stdout:7/677: dread - d0/dd/d2c/d42/d77/db2/fc6 zero size 2024-09-17T01:41:44.721 INFO:tasks.workunit.client.0.smithi082.stdout:8/571: chown d3/dd/d18/d2d/d60/l9e 0 1 2024-09-17T01:41:44.722 INFO:tasks.workunit.client.0.smithi082.stdout:7/678: write d0/dd/d2c/f89 [1259915,124077] 0 2024-09-17T01:41:44.724 INFO:tasks.workunit.client.0.smithi082.stdout:0/516: creat da/df/d71/d92/fbc x:0 0 0 2024-09-17T01:41:44.726 INFO:tasks.workunit.client.0.smithi082.stdout:0/517: read da/d1b/f52 [2712935,67855] 0 2024-09-17T01:41:44.729 INFO:tasks.workunit.client.0.smithi082.stdout:8/572: dwrite d3/dd/d18/d2d/d3e/d43/f45 [4194304,4194304] 0 2024-09-17T01:41:44.732 INFO:tasks.workunit.client.0.smithi082.stdout:8/573: getdents d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3 0 2024-09-17T01:41:44.742 INFO:tasks.workunit.client.0.smithi082.stdout:1/767: write d2/da/d2f/fc2 [1357945,93957] 0 2024-09-17T01:41:44.744 INFO:tasks.workunit.client.0.smithi082.stdout:1/768: fsync d2/da/d80/dc6/fd8 0 2024-09-17T01:41:44.745 INFO:tasks.workunit.client.0.smithi082.stdout:1/769: stat d2/da/d2d/d6c/l8e 0 2024-09-17T01:41:44.745 INFO:tasks.workunit.client.0.smithi082.stdout:0/518: dread da/d1b/d23/d4d/f7f [0,4194304] 0 2024-09-17T01:41:44.749 INFO:tasks.workunit.client.0.smithi082.stdout:7/679: write d0/d62/d7e/dd4/d37/d86/fa8 [825308,101350] 0 2024-09-17T01:41:44.750 INFO:tasks.workunit.client.0.smithi082.stdout:0/519: unlink da/d1b/d23/d42/d43/d6b/fba 0 2024-09-17T01:41:44.753 INFO:tasks.workunit.client.0.smithi082.stdout:1/770: truncate d2/f11 965796 0 2024-09-17T01:41:44.753 INFO:tasks.workunit.client.0.smithi082.stdout:1/771: stat d2/d3f/d24/l25 0 2024-09-17T01:41:44.755 INFO:tasks.workunit.client.0.smithi082.stdout:8/574: dwrite d3/f76 [0,4194304] 0 2024-09-17T01:41:44.763 INFO:tasks.workunit.client.0.smithi082.stdout:8/575: rename d3/dd/d18/d2d/d3e/d4a/d66/d7b/db1 to d3/dd/d18/d51/db4 0 2024-09-17T01:41:44.766 INFO:tasks.workunit.client.0.smithi082.stdout:7/680: creat d0/d3/fee x:0 0 0 2024-09-17T01:41:44.768 INFO:tasks.workunit.client.0.smithi082.stdout:0/520: getdents da/d80 0 2024-09-17T01:41:44.772 INFO:tasks.workunit.client.0.smithi082.stdout:8/576: truncate d3/dd/d18/d2d/d3e/faa 2163125 0 2024-09-17T01:41:44.776 INFO:tasks.workunit.client.0.smithi082.stdout:1/772: dread d2/d3f/fe1 [0,4194304] 0 2024-09-17T01:41:44.781 INFO:tasks.workunit.client.0.smithi082.stdout:0/521: rename da/df/d2b/d59/d8f/faf to da/df/d2b/d59/fbd 0 2024-09-17T01:41:44.783 INFO:tasks.workunit.client.0.smithi082.stdout:0/522: write da/d1b/d23/d4d/fb3 [554589,81449] 0 2024-09-17T01:41:44.786 INFO:tasks.workunit.client.0.smithi082.stdout:1/773: link d2/da/d16/l85 d2/da/d80/dc6/ded/lfa 0 2024-09-17T01:41:44.787 INFO:tasks.workunit.client.0.smithi082.stdout:1/774: readlink d2/d3f/d24/l98 0 2024-09-17T01:41:44.788 INFO:tasks.workunit.client.0.smithi082.stdout:0/523: truncate da/df/d71/f25 416266 0 2024-09-17T01:41:44.790 INFO:tasks.workunit.client.0.smithi082.stdout:1/775: creat d2/d3f/d34/dc5/ffb x:0 0 0 2024-09-17T01:41:44.791 INFO:tasks.workunit.client.0.smithi082.stdout:8/577: write d3/dd/d18/f1e [4049786,63220] 0 2024-09-17T01:41:44.791 INFO:tasks.workunit.client.0.smithi082.stdout:0/524: mkdir da/df/d2b/d59/d8f/dbe 0 2024-09-17T01:41:44.792 INFO:tasks.workunit.client.0.smithi082.stdout:7/681: dread d0/d3/db/ddf/fe1 [0,4194304] 0 2024-09-17T01:41:44.792 INFO:tasks.workunit.client.0.smithi082.stdout:0/525: stat da/df/d27/db5 0 2024-09-17T01:41:44.797 INFO:tasks.workunit.client.0.smithi082.stdout:8/578: mknod d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/cb5 0 2024-09-17T01:41:44.798 INFO:tasks.workunit.client.0.smithi082.stdout:7/682: symlink d0/d62/d7e/dd4/d37/d71/lef 0 2024-09-17T01:41:44.802 INFO:tasks.workunit.client.0.smithi082.stdout:0/526: symlink da/df/d2b/d59/lbf 0 2024-09-17T01:41:44.807 INFO:tasks.workunit.client.0.smithi082.stdout:8/579: rename d3/dd/d18/d2d/d60/c8e to d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/cb6 0 2024-09-17T01:41:44.808 INFO:tasks.workunit.client.0.smithi082.stdout:0/527: dwrite da/fe [4194304,4194304] 0 2024-09-17T01:41:44.815 INFO:tasks.workunit.client.0.smithi082.stdout:1/776: truncate f0 2186446 0 2024-09-17T01:41:44.816 INFO:tasks.workunit.client.0.smithi082.stdout:8/580: creat d3/dd/d18/d2d/d3e/d4a/d68/fb7 x:0 0 0 2024-09-17T01:41:44.817 INFO:tasks.workunit.client.0.smithi082.stdout:8/581: chown d3/dd/d18/d2d/d3b/l9d 529567067 1 2024-09-17T01:41:44.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/528: mknod da/d1b/cc0 0 2024-09-17T01:41:44.818 INFO:tasks.workunit.client.0.smithi082.stdout:7/683: link d0/d3/db/c51 d0/d62/cf0 0 2024-09-17T01:41:44.819 INFO:tasks.workunit.client.0.smithi082.stdout:0/529: rmdir da/df/d27 39 2024-09-17T01:41:44.820 INFO:tasks.workunit.client.0.smithi082.stdout:0/530: dread - da/d80/f8c zero size 2024-09-17T01:41:44.822 INFO:tasks.workunit.client.0.smithi082.stdout:7/684: truncate d0/d3/db/d10/f65 771258 0 2024-09-17T01:41:44.822 INFO:tasks.workunit.client.0.smithi082.stdout:7/685: chown d0/d50/fdb 467 1 2024-09-17T01:41:44.824 INFO:tasks.workunit.client.0.smithi082.stdout:0/531: symlink da/df/d2b/d59/d8f/dbe/lc1 0 2024-09-17T01:41:44.825 INFO:tasks.workunit.client.0.smithi082.stdout:7/686: creat d0/d62/dce/deb/ff1 x:0 0 0 2024-09-17T01:41:44.826 INFO:tasks.workunit.client.0.smithi082.stdout:0/532: symlink da/d80/lc2 0 2024-09-17T01:41:44.828 INFO:tasks.workunit.client.0.smithi082.stdout:0/533: symlink da/df/d71/lc3 0 2024-09-17T01:41:44.830 INFO:tasks.workunit.client.0.smithi082.stdout:7/687: rename d0/d62/d7e/dd4/d37/d86/fa8 to d0/d3/db/d10/d3f/daf/ff2 0 2024-09-17T01:41:44.834 INFO:tasks.workunit.client.0.smithi082.stdout:0/534: dwrite da/d1b/f7e [0,4194304] 0 2024-09-17T01:41:44.839 INFO:tasks.workunit.client.0.smithi082.stdout:1/777: write d2/da/f56 [4568539,66202] 0 2024-09-17T01:41:44.844 INFO:tasks.workunit.client.0.smithi082.stdout:1/778: read d2/fd6 [3836168,43511] 0 2024-09-17T01:41:44.847 INFO:tasks.workunit.client.0.smithi082.stdout:8/582: dwrite d3/dd/d18/d2d/d3e/d43/f44 [0,4194304] 0 2024-09-17T01:41:44.851 INFO:tasks.workunit.client.0.smithi082.stdout:1/779: fsync d2/d3f/fe1 0 2024-09-17T01:41:44.852 INFO:tasks.workunit.client.0.smithi082.stdout:1/780: chown d2/da/cc3 48 1 2024-09-17T01:41:44.854 INFO:tasks.workunit.client.0.smithi082.stdout:8/583: symlink d3/dd/d18/d51/dae/lb8 0 2024-09-17T01:41:44.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/688: dwrite d0/dd/d2c/f8e [0,4194304] 0 2024-09-17T01:41:44.859 INFO:tasks.workunit.client.0.smithi082.stdout:8/584: creat d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/fb9 x:0 0 0 2024-09-17T01:41:44.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/689: dread - d0/d3/fee zero size 2024-09-17T01:41:44.862 INFO:tasks.workunit.client.0.smithi082.stdout:8/585: mknod d3/dd/cba 0 2024-09-17T01:41:44.866 INFO:tasks.workunit.client.0.smithi082.stdout:0/535: write da/df/d27/f21 [2126624,4398] 0 2024-09-17T01:41:44.867 INFO:tasks.workunit.client.0.smithi082.stdout:0/536: readlink da/df/d2b/la3 0 2024-09-17T01:41:44.932 INFO:tasks.workunit.client.0.smithi082.stdout:1/781: write d2/d3f/fe1 [1843147,83155] 0 2024-09-17T01:41:44.936 INFO:tasks.workunit.client.0.smithi082.stdout:0/537: symlink da/lc4 0 2024-09-17T01:41:44.937 INFO:tasks.workunit.client.0.smithi082.stdout:0/538: chown da/df/d2b/f85 62465 1 2024-09-17T01:41:44.939 INFO:tasks.workunit.client.0.smithi082.stdout:1/782: rename d2/da/d80 to d2/d3f/d24/db5/dec/dfc 0 2024-09-17T01:41:44.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/783: creat d2/df/ffd x:0 0 0 2024-09-17T01:41:44.946 INFO:tasks.workunit.client.0.smithi082.stdout:0/539: getdents da/df 0 2024-09-17T01:41:44.947 INFO:tasks.workunit.client.0.smithi082.stdout:0/540: read da/d1b/f7e [4905031,69742] 0 2024-09-17T01:41:44.947 INFO:tasks.workunit.client.0.smithi082.stdout:8/586: dwrite d3/dd/f9f [4194304,4194304] 0 2024-09-17T01:41:44.949 INFO:tasks.workunit.client.0.smithi082.stdout:1/784: creat d2/d3f/d24/dba/ffe x:0 0 0 2024-09-17T01:41:44.951 INFO:tasks.workunit.client.0.smithi082.stdout:0/541: truncate da/d1b/d23/d42/d43/f97 105581 0 2024-09-17T01:41:44.952 INFO:tasks.workunit.client.0.smithi082.stdout:0/542: read da/d1b/d23/d4d/f2a [900185,55038] 0 2024-09-17T01:41:44.953 INFO:tasks.workunit.client.0.smithi082.stdout:8/587: chown d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e 147429259 1 2024-09-17T01:41:44.959 INFO:tasks.workunit.client.0.smithi082.stdout:0/543: symlink da/d80/lc5 0 2024-09-17T01:41:44.961 INFO:tasks.workunit.client.0.smithi082.stdout:8/588: unlink d3/dd/d18/d2d/d3e/d4a/d6a/fad 0 2024-09-17T01:41:44.962 INFO:tasks.workunit.client.0.smithi082.stdout:8/589: readlink d3/dd/d18/d2d/d3e/d43/l73 0 2024-09-17T01:41:44.962 INFO:tasks.workunit.client.0.smithi082.stdout:1/785: mkdir d2/d3f/d24/db5/dec/dfc/ddf/dff 0 2024-09-17T01:41:44.965 INFO:tasks.workunit.client.0.smithi082.stdout:0/544: symlink da/d1b/d23/d42/lc6 0 2024-09-17T01:41:44.967 INFO:tasks.workunit.client.0.smithi082.stdout:0/545: creat da/df/d27/fc7 x:0 0 0 2024-09-17T01:41:44.968 INFO:tasks.workunit.client.0.smithi082.stdout:0/546: write da/fc [94402,27699] 0 2024-09-17T01:41:44.970 INFO:tasks.workunit.client.0.smithi082.stdout:0/547: dread - da/d1b/d23/d42/d43/d6b/f6c zero size 2024-09-17T01:41:44.971 INFO:tasks.workunit.client.0.smithi082.stdout:0/548: write da/d80/f9e [661325,124573] 0 2024-09-17T01:41:44.971 INFO:tasks.workunit.client.0.smithi082.stdout:0/549: readlink da/d80/lc2 0 2024-09-17T01:41:44.977 INFO:tasks.workunit.client.0.smithi082.stdout:0/550: dwrite da/d80/d99/f66 [4194304,4194304] 0 2024-09-17T01:41:44.983 INFO:tasks.workunit.client.0.smithi082.stdout:0/551: unlink da/df/d2b/d59/d8f/l28 0 2024-09-17T01:41:44.984 INFO:tasks.workunit.client.0.smithi082.stdout:0/552: truncate da/d1b/d23/d4d/f9d 905961 0 2024-09-17T01:41:44.990 INFO:tasks.workunit.client.0.smithi082.stdout:8/590: dwrite d3/dd/d18/d2d/f53 [0,4194304] 0 2024-09-17T01:41:44.991 INFO:tasks.workunit.client.0.smithi082.stdout:8/591: chown d3/dd/d18/d2d/d60/la8 24305 1 2024-09-17T01:41:44.993 INFO:tasks.workunit.client.0.smithi082.stdout:0/553: link da/df/d2b/d59/f73 da/df/d27/fc8 0 2024-09-17T01:41:44.995 INFO:tasks.workunit.client.0.smithi082.stdout:8/592: symlink d3/dd/d18/d2d/d58/lbb 0 2024-09-17T01:41:44.998 INFO:tasks.workunit.client.0.smithi082.stdout:0/554: read - da/df/d27/fc8 zero size 2024-09-17T01:41:44.999 INFO:tasks.workunit.client.0.smithi082.stdout:8/593: symlink d3/dd/d18/d2d/d58/lbc 0 2024-09-17T01:41:45.000 INFO:tasks.workunit.client.0.smithi082.stdout:0/555: truncate da/d1b/d23/d42/f88 857901 0 2024-09-17T01:41:45.002 INFO:tasks.workunit.client.0.smithi082.stdout:0/556: creat da/df/d27/fc9 x:0 0 0 2024-09-17T01:41:45.008 INFO:tasks.workunit.client.0.smithi082.stdout:0/557: mknod da/df/d2b/d59/d6f/da6/cca 0 2024-09-17T01:41:45.010 INFO:tasks.workunit.client.0.smithi082.stdout:0/558: fdatasync f8 0 2024-09-17T01:41:45.018 INFO:tasks.workunit.client.0.smithi082.stdout:8/594: dwrite d3/dd/d18/d2d/d3e/d4a/d66/d6e/fa1 [4194304,4194304] 0 2024-09-17T01:41:45.023 INFO:tasks.workunit.client.0.smithi082.stdout:0/559: rename da/d1b/c7a to da/df/d2b/d59/d8f/dbe/ccb 0 2024-09-17T01:41:45.028 INFO:tasks.workunit.client.0.smithi082.stdout:0/560: dread da/d80/d99/f66 [0,4194304] 0 2024-09-17T01:41:45.034 INFO:tasks.workunit.client.0.smithi082.stdout:8/595: getdents d3/dd/d18/d34 0 2024-09-17T01:41:45.037 INFO:tasks.workunit.client.0.smithi082.stdout:8/596: rmdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab 39 2024-09-17T01:41:45.041 INFO:tasks.workunit.client.0.smithi082.stdout:8/597: mknod d3/dd/d18/d2d/d3e/d4a/d66/cbd 0 2024-09-17T01:41:45.142 INFO:tasks.workunit.client.0.smithi082.stdout:0/561: fsync da/d1b/d23/d42/d43/f97 0 2024-09-17T01:41:45.221 INFO:tasks.workunit.client.0.smithi082.stdout:8/598: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe 0 2024-09-17T01:41:45.227 INFO:tasks.workunit.client.0.smithi082.stdout:8/599: dwrite d3/dd/d18/d51/fa5 [0,4194304] 0 2024-09-17T01:41:45.229 INFO:tasks.workunit.client.0.smithi082.stdout:8/600: chown d3/dd/d18/d3a/l91 4 1 2024-09-17T01:41:45.234 INFO:tasks.workunit.client.0.smithi082.stdout:8/601: unlink d3/dd/d18/d2d/d3e/d4a/d6a/f42 0 2024-09-17T01:41:45.238 INFO:tasks.workunit.client.0.smithi082.stdout:8/602: mknod d3/dd/d18/d2d/d3e/cbf 0 2024-09-17T01:41:45.239 INFO:tasks.workunit.client.0.smithi082.stdout:8/603: dread - d3/dd/d18/d2d/d3e/d4a/d6a/f99 zero size 2024-09-17T01:41:45.244 INFO:tasks.workunit.client.0.smithi082.stdout:0/562: write da/df/d2b/d59/fa2 [386331,83823] 0 2024-09-17T01:41:45.247 INFO:tasks.workunit.client.0.smithi082.stdout:0/563: fdatasync da/d1b/d23/d42/d43/f57 0 2024-09-17T01:41:45.262 INFO:tasks.workunit.client.0.smithi082.stdout:0/564: dread da/df/d71/f51 [0,4194304] 0 2024-09-17T01:41:45.268 INFO:tasks.workunit.client.0.smithi082.stdout:0/565: dwrite da/d80/f8c [0,4194304] 0 2024-09-17T01:41:45.269 INFO:tasks.workunit.client.0.smithi082.stdout:0/566: readlink da/df/d2b/d59/d8f/l37 0 2024-09-17T01:41:45.273 INFO:tasks.workunit.client.0.smithi082.stdout:0/567: rmdir da/d80/d77 39 2024-09-17T01:41:45.278 INFO:tasks.workunit.client.0.smithi082.stdout:0/568: symlink da/df/d2b/d59/lcc 0 2024-09-17T01:41:45.281 INFO:tasks.workunit.client.0.smithi082.stdout:0/569: symlink da/df/d71/lcd 0 2024-09-17T01:41:45.284 INFO:tasks.workunit.client.0.smithi082.stdout:0/570: dread - da/df/d2b/d59/f73 zero size 2024-09-17T01:41:45.285 INFO:tasks.workunit.client.0.smithi082.stdout:0/571: write da/df/d2b/d9a/f9b [605362,71841] 0 2024-09-17T01:41:45.288 INFO:tasks.workunit.client.0.smithi082.stdout:0/572: symlink da/df/d27/lce 0 2024-09-17T01:41:45.293 INFO:tasks.workunit.client.0.smithi082.stdout:0/573: dwrite da/d80/f8c [0,4194304] 0 2024-09-17T01:41:45.300 INFO:tasks.workunit.client.0.smithi082.stdout:0/574: dwrite da/d1b/d23/d4d/f9d [0,4194304] 0 2024-09-17T01:41:45.312 INFO:tasks.workunit.client.0.smithi082.stdout:0/575: write da/d1b/f4f [831900,83449] 0 2024-09-17T01:41:45.313 INFO:tasks.workunit.client.0.smithi082.stdout:0/576: readlink da/df/d2b/d59/lcc 0 2024-09-17T01:41:45.328 INFO:tasks.workunit.client.0.smithi082.stdout:0/577: truncate da/fc 1743835 0 2024-09-17T01:41:45.355 INFO:tasks.workunit.client.0.smithi082.stdout:0/578: dwrite da/df/d2b/d59/d8f/f6d [0,4194304] 0 2024-09-17T01:41:45.357 INFO:tasks.workunit.client.0.smithi082.stdout:0/579: dread - da/df/d27/fc9 zero size 2024-09-17T01:41:45.359 INFO:tasks.workunit.client.0.smithi082.stdout:0/580: truncate da/d1b/d23/d42/d43/d6b/f6c 510835 0 2024-09-17T01:41:45.363 INFO:tasks.workunit.client.0.smithi082.stdout:0/581: rename da/df/d2b/d59/d8f/d69/fa8 to da/d80/d77/fcf 0 2024-09-17T01:41:45.390 INFO:tasks.workunit.client.0.smithi082.stdout:0/582: truncate da/d1b/f7d 383186 0 2024-09-17T01:41:45.394 INFO:tasks.workunit.client.0.smithi082.stdout:0/583: mknod da/d1b/d23/d42/d43/cd0 0 2024-09-17T01:41:45.398 INFO:tasks.workunit.client.0.smithi082.stdout:0/584: creat da/d1b/d23/d42/fd1 x:0 0 0 2024-09-17T01:41:45.401 INFO:tasks.workunit.client.0.smithi082.stdout:0/585: dread da/d1b/d23/d4d/f9d [0,4194304] 0 2024-09-17T01:41:45.423 INFO:tasks.workunit.client.0.smithi082.stdout:0/586: dwrite da/df/d2b/d59/d6f/f87 [0,4194304] 0 2024-09-17T01:41:45.427 INFO:tasks.workunit.client.0.smithi082.stdout:0/587: read da/df/d2b/d59/d8f/f81 [3192752,18923] 0 2024-09-17T01:41:45.432 INFO:tasks.workunit.client.0.smithi082.stdout:0/588: mkdir da/d1b/d23/d42/d43/d6b/dd2 0 2024-09-17T01:41:45.432 INFO:tasks.workunit.client.0.smithi082.stdout:0/589: stat da/df/l5c 0 2024-09-17T01:41:45.444 INFO:tasks.workunit.client.0.smithi082.stdout:0/590: getdents da/d1b/d23/d42/d43/d6b 0 2024-09-17T01:41:45.448 INFO:tasks.workunit.client.0.smithi082.stdout:0/591: mkdir da/df/d2b/d59/dd3 0 2024-09-17T01:41:45.451 INFO:tasks.workunit.client.0.smithi082.stdout:0/592: rename da/d1b/d23/l2d to da/df/d2b/d59/dd3/ld4 0 2024-09-17T01:41:45.470 INFO:tasks.workunit.client.0.smithi082.stdout:0/593: truncate da/df/d27/f21 1974031 0 2024-09-17T01:41:45.481 INFO:tasks.workunit.client.0.smithi082.stdout:0/594: write da/d1b/f7e [121876,66456] 0 2024-09-17T01:41:45.483 INFO:tasks.workunit.client.0.smithi082.stdout:0/595: symlink da/df/d27/ld5 0 2024-09-17T01:41:45.486 INFO:tasks.workunit.client.0.smithi082.stdout:0/596: fsync da/df/d27/fc8 0 2024-09-17T01:41:45.489 INFO:tasks.workunit.client.0.smithi082.stdout:0/597: truncate da/d1b/fb4 1098278 0 2024-09-17T01:41:45.491 INFO:tasks.workunit.client.0.smithi082.stdout:0/598: rmdir da/df/d71/d92 39 2024-09-17T01:41:45.491 INFO:tasks.workunit.client.0.smithi082.stdout:0/599: dread - da/df/d27/fc8 zero size 2024-09-17T01:41:45.494 INFO:tasks.workunit.client.0.smithi082.stdout:0/600: creat da/d1b/d23/d42/d43/d6b/dd2/fd6 x:0 0 0 2024-09-17T01:41:45.495 INFO:tasks.workunit.client.0.smithi082.stdout:0/601: fsync da/d1b/d23/d42/d43/d6b/f6c 0 2024-09-17T01:41:45.498 INFO:tasks.workunit.client.0.smithi082.stdout:0/602: mkdir da/d1b/d23/d4d/dd7 0 2024-09-17T01:41:45.500 INFO:tasks.workunit.client.0.smithi082.stdout:0/603: mknod da/d80/cd8 0 2024-09-17T01:41:45.503 INFO:tasks.workunit.client.0.smithi082.stdout:0/604: rename da/df/d2b/d59/dd3 to da/df/d2b/d59/d6f/dd9 0 2024-09-17T01:41:45.515 INFO:tasks.workunit.client.0.smithi082.stdout:0/605: dwrite da/df/d2b/d59/f73 [0,4194304] 0 2024-09-17T01:41:45.520 INFO:tasks.workunit.client.0.smithi082.stdout:0/606: creat da/df/d71/d92/fda x:0 0 0 2024-09-17T01:41:45.523 INFO:tasks.workunit.client.0.smithi082.stdout:0/607: creat da/df/d71/fdb x:0 0 0 2024-09-17T01:41:45.529 INFO:tasks.workunit.client.0.smithi082.stdout:0/608: link da/d80/d99/c65 da/df/d2b/d59/d6f/cdc 0 2024-09-17T01:41:45.530 INFO:tasks.workunit.client.0.smithi082.stdout:0/609: chown da/df/d71/d92/fda 17 1 2024-09-17T01:41:45.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/610: stat da/d1b/d23/d42/d43/d6b/f6c 0 2024-09-17T01:41:45.534 INFO:tasks.workunit.client.0.smithi082.stdout:0/611: mknod da/d1b/cdd 0 2024-09-17T01:41:45.536 INFO:tasks.workunit.client.0.smithi082.stdout:0/612: truncate da/df/d27/f21 20223 0 2024-09-17T01:41:45.538 INFO:tasks.workunit.client.0.smithi082.stdout:0/613: chown da/d1b/d23/d42/d43/d6b/fb7 1 1 2024-09-17T01:41:45.553 INFO:tasks.workunit.client.0.smithi082.stdout:0/614: read da/df/d27/f21 [3845,18794] 0 2024-09-17T01:41:45.554 INFO:tasks.workunit.client.0.smithi082.stdout:0/615: stat da/d80/d99/l67 0 2024-09-17T01:41:45.556 INFO:tasks.workunit.client.0.smithi082.stdout:0/616: unlink da/df/d2b/d59/d8f/f74 0 2024-09-17T01:41:45.558 INFO:tasks.workunit.client.0.smithi082.stdout:0/617: creat da/df/d2b/d59/d6f/fde x:0 0 0 2024-09-17T01:41:45.573 INFO:tasks.workunit.client.0.smithi082.stdout:0/618: dwrite da/df/d71/f25 [0,4194304] 0 2024-09-17T01:41:45.579 INFO:tasks.workunit.client.0.smithi082.stdout:0/619: symlink da/d80/ldf 0 2024-09-17T01:41:45.583 INFO:tasks.workunit.client.0.smithi082.stdout:0/620: dread da/df/d2b/d59/d6f/f87 [0,4194304] 0 2024-09-17T01:41:45.585 INFO:tasks.workunit.client.0.smithi082.stdout:0/621: truncate da/d1b/d23/d42/d43/d6b/fb7 1582526 0 2024-09-17T01:41:45.588 INFO:tasks.workunit.client.0.smithi082.stdout:0/622: creat da/fe0 x:0 0 0 2024-09-17T01:41:45.590 INFO:tasks.workunit.client.0.smithi082.stdout:0/623: dread da/df/f4a [4194304,4194304] 0 2024-09-17T01:41:45.611 INFO:tasks.workunit.client.0.smithi082.stdout:3/607: sync 2024-09-17T01:41:45.611 INFO:tasks.workunit.client.0.smithi082.stdout:9/560: sync 2024-09-17T01:41:45.611 INFO:tasks.workunit.client.0.smithi082.stdout:5/658: sync 2024-09-17T01:41:45.612 INFO:tasks.workunit.client.0.smithi082.stdout:9/561: stat d4/d27/d2d/l87 0 2024-09-17T01:41:45.614 INFO:tasks.workunit.client.0.smithi082.stdout:5/659: mknod db/d2b/d59/cd5 0 2024-09-17T01:41:45.615 INFO:tasks.workunit.client.0.smithi082.stdout:5/660: chown db/d1e/fa8 5455350 1 2024-09-17T01:41:45.615 INFO:tasks.workunit.client.0.smithi082.stdout:3/608: mknod d9/db/d49/d4e/d53/d5b/cd5 0 2024-09-17T01:41:45.618 INFO:tasks.workunit.client.0.smithi082.stdout:3/609: dread - d9/db/d49/d4e/f72 zero size 2024-09-17T01:41:45.619 INFO:tasks.workunit.client.0.smithi082.stdout:0/624: dwrite da/d80/d77/fcf [0,4194304] 0 2024-09-17T01:41:45.620 INFO:tasks.workunit.client.0.smithi082.stdout:3/610: chown d9/db/daf/d69/d9c/fa7 9131580 1 2024-09-17T01:41:45.620 INFO:tasks.workunit.client.0.smithi082.stdout:0/625: chown da/d80/l98 52581 1 2024-09-17T01:41:45.620 INFO:tasks.workunit.client.0.smithi082.stdout:5/661: mkdir db/d56/dd6 0 2024-09-17T01:41:45.622 INFO:tasks.workunit.client.0.smithi082.stdout:0/626: stat da/df/d71/lcd 0 2024-09-17T01:41:45.623 INFO:tasks.workunit.client.0.smithi082.stdout:0/627: fdatasync da/d1b/d23/d42/f88 0 2024-09-17T01:41:45.626 INFO:tasks.workunit.client.0.smithi082.stdout:5/662: fsync db/d56/d29/d4f/f57 0 2024-09-17T01:41:45.629 INFO:tasks.workunit.client.0.smithi082.stdout:5/663: read db/d1e/d20/d30/f3b [1157949,128015] 0 2024-09-17T01:41:45.629 INFO:tasks.workunit.client.0.smithi082.stdout:3/611: mknod d9/db/d95/cd6 0 2024-09-17T01:41:45.630 INFO:tasks.workunit.client.0.smithi082.stdout:5/664: fdatasync db/da7/fcf 0 2024-09-17T01:41:45.631 INFO:tasks.workunit.client.0.smithi082.stdout:5/665: fsync db/d56/d18/f4a 0 2024-09-17T01:41:45.631 INFO:tasks.workunit.client.0.smithi082.stdout:0/628: write da/d1b/f52 [685878,63355] 0 2024-09-17T01:41:45.632 INFO:tasks.workunit.client.0.smithi082.stdout:5/666: stat db/d2b/fa2 0 2024-09-17T01:41:45.633 INFO:tasks.workunit.client.0.smithi082.stdout:3/612: write d9/db/d49/d4e/d53/f54 [118676,40839] 0 2024-09-17T01:41:45.634 INFO:tasks.workunit.client.0.smithi082.stdout:0/629: chown da/df/d2b/d59/d8f/l37 3407472 1 2024-09-17T01:41:45.638 INFO:tasks.workunit.client.0.smithi082.stdout:0/630: symlink da/df/d2b/d59/d8f/dbe/le1 0 2024-09-17T01:41:45.641 INFO:tasks.workunit.client.0.smithi082.stdout:5/667: creat db/d56/fd7 x:0 0 0 2024-09-17T01:41:45.643 INFO:tasks.workunit.client.0.smithi082.stdout:0/631: creat da/df/d2b/d9a/fe2 x:0 0 0 2024-09-17T01:41:45.646 INFO:tasks.workunit.client.0.smithi082.stdout:5/668: creat db/d56/dd6/fd8 x:0 0 0 2024-09-17T01:41:45.650 INFO:tasks.workunit.client.0.smithi082.stdout:5/669: creat db/da7/db3/fd9 x:0 0 0 2024-09-17T01:41:45.654 INFO:tasks.workunit.client.0.smithi082.stdout:3/613: dwrite d9/db/d26/f27 [0,4194304] 0 2024-09-17T01:41:45.677 INFO:tasks.workunit.client.0.smithi082.stdout:0/632: rename da/d1b/d23/d4d/f9d to da/df/d71/fe3 0 2024-09-17T01:41:45.679 INFO:tasks.workunit.client.0.smithi082.stdout:5/670: mknod db/d56/d29/d4f/d8e/dbc/cda 0 2024-09-17T01:41:45.680 INFO:tasks.workunit.client.0.smithi082.stdout:3/614: symlink d9/ld7 0 2024-09-17T01:41:45.681 INFO:tasks.workunit.client.0.smithi082.stdout:0/633: write da/df/d2b/d59/d8f/f81 [4492784,74485] 0 2024-09-17T01:41:45.682 INFO:tasks.workunit.client.0.smithi082.stdout:5/671: symlink db/da7/db3/ldb 0 2024-09-17T01:41:45.683 INFO:tasks.workunit.client.0.smithi082.stdout:0/634: chown da/df/d2b/d59/d6f/f87 1989 1 2024-09-17T01:41:45.683 INFO:tasks.workunit.client.0.smithi082.stdout:3/615: rmdir d9/db/daf/d69/d9c 39 2024-09-17T01:41:45.685 INFO:tasks.workunit.client.0.smithi082.stdout:5/672: mkdir db/d56/d29/d4f/d8e/ddc 0 2024-09-17T01:41:45.686 INFO:tasks.workunit.client.0.smithi082.stdout:5/673: write db/d56/f50 [1829918,6874] 0 2024-09-17T01:41:45.686 INFO:tasks.workunit.client.0.smithi082.stdout:0/635: creat da/df/d2b/d9a/fe4 x:0 0 0 2024-09-17T01:41:45.688 INFO:tasks.workunit.client.0.smithi082.stdout:0/636: chown da/df/d2b/d59/d6f/f87 352681 1 2024-09-17T01:41:45.688 INFO:tasks.workunit.client.0.smithi082.stdout:5/674: rename db/d1e/d5b/d83 to db/d1e/d5b/d83/ddd 22 2024-09-17T01:41:45.689 INFO:tasks.workunit.client.0.smithi082.stdout:3/616: getdents d9/db/daf/dbf 0 2024-09-17T01:41:45.691 INFO:tasks.workunit.client.0.smithi082.stdout:5/675: mknod db/d56/d18/cde 0 2024-09-17T01:41:45.692 INFO:tasks.workunit.client.0.smithi082.stdout:5/676: chown db/d2b/f8c 37540 1 2024-09-17T01:41:45.692 INFO:tasks.workunit.client.0.smithi082.stdout:3/617: creat d9/db/daf/fd8 x:0 0 0 2024-09-17T01:41:45.695 INFO:tasks.workunit.client.0.smithi082.stdout:5/677: mknod db/da7/cdf 0 2024-09-17T01:41:45.696 INFO:tasks.workunit.client.0.smithi082.stdout:0/637: dwrite da/df/d27/f21 [0,4194304] 0 2024-09-17T01:41:45.699 INFO:tasks.workunit.client.0.smithi082.stdout:0/638: chown da/df/d71/d92/fbc 50455937 1 2024-09-17T01:41:45.703 INFO:tasks.workunit.client.0.smithi082.stdout:3/618: dwrite d9/d78/f8b [0,4194304] 0 2024-09-17T01:41:45.709 INFO:tasks.workunit.client.0.smithi082.stdout:0/639: dwrite da/d80/d77/fcf [4194304,4194304] 0 2024-09-17T01:41:45.713 INFO:tasks.workunit.client.0.smithi082.stdout:0/640: symlink da/df/d2b/d59/d8f/d69/le5 0 2024-09-17T01:41:45.719 INFO:tasks.workunit.client.0.smithi082.stdout:0/641: unlink da/d1b/f4f 0 2024-09-17T01:41:45.720 INFO:tasks.workunit.client.0.smithi082.stdout:0/642: fsync da/df/d2b/f39 0 2024-09-17T01:41:45.722 INFO:tasks.workunit.client.0.smithi082.stdout:0/643: unlink da/df/l3d 0 2024-09-17T01:41:45.728 INFO:tasks.workunit.client.0.smithi082.stdout:5/678: truncate db/d1e/d20/f73 1377354 0 2024-09-17T01:41:45.735 INFO:tasks.workunit.client.0.smithi082.stdout:3/619: dwrite d9/f40 [0,4194304] 0 2024-09-17T01:41:45.737 INFO:tasks.workunit.client.0.smithi082.stdout:3/620: read d9/db/daf/f6e [2610187,28306] 0 2024-09-17T01:41:45.742 INFO:tasks.workunit.client.0.smithi082.stdout:3/621: mknod d9/db/d49/d4e/d53/cd9 0 2024-09-17T01:41:45.745 INFO:tasks.workunit.client.0.smithi082.stdout:3/622: mkdir d9/d35/dda 0 2024-09-17T01:41:45.745 INFO:tasks.workunit.client.0.smithi082.stdout:3/623: stat d9/db/f17 0 2024-09-17T01:41:45.748 INFO:tasks.workunit.client.0.smithi082.stdout:3/624: unlink d9/db/d49/d4e/d53/cd9 0 2024-09-17T01:41:45.751 INFO:tasks.workunit.client.0.smithi082.stdout:5/679: write db/d2b/f87 [117804,85107] 0 2024-09-17T01:41:45.752 INFO:tasks.workunit.client.0.smithi082.stdout:0/644: dwrite f8 [4194304,4194304] 0 2024-09-17T01:41:45.759 INFO:tasks.workunit.client.0.smithi082.stdout:3/625: dwrite d9/f21 [0,4194304] 0 2024-09-17T01:41:45.761 INFO:tasks.workunit.client.0.smithi082.stdout:3/626: stat d9/db/d26/dbd/fc0 0 2024-09-17T01:41:45.761 INFO:tasks.workunit.client.0.smithi082.stdout:3/627: stat d9/db/d49/da4/fa6 0 2024-09-17T01:41:45.765 INFO:tasks.workunit.client.0.smithi082.stdout:0/645: creat da/df/d2b/d59/d6f/dd9/fe6 x:0 0 0 2024-09-17T01:41:45.767 INFO:tasks.workunit.client.0.smithi082.stdout:3/628: mkdir d9/db/daf/d69/dbc/ddb 0 2024-09-17T01:41:45.773 INFO:tasks.workunit.client.0.smithi082.stdout:5/680: dread db/f5a [0,4194304] 0 2024-09-17T01:41:45.776 INFO:tasks.workunit.client.0.smithi082.stdout:0/646: rename da/df/d2b/d59/lb2 to da/df/d71/le7 0 2024-09-17T01:41:45.777 INFO:tasks.workunit.client.0.smithi082.stdout:0/647: dread - da/df/d2b/d59/d6f/dd9/fe6 zero size 2024-09-17T01:41:45.778 INFO:tasks.workunit.client.0.smithi082.stdout:5/681: creat db/d1e/d20/d30/fe0 x:0 0 0 2024-09-17T01:41:45.785 INFO:tasks.workunit.client.0.smithi082.stdout:0/648: dwrite da/df/d71/fdb [0,4194304] 0 2024-09-17T01:41:45.789 INFO:tasks.workunit.client.0.smithi082.stdout:0/649: creat da/d1b/d23/d42/fe8 x:0 0 0 2024-09-17T01:41:45.793 INFO:tasks.workunit.client.0.smithi082.stdout:3/629: dread d9/db/f17 [0,4194304] 0 2024-09-17T01:41:45.796 INFO:tasks.workunit.client.0.smithi082.stdout:3/630: mkdir d9/db/daf/dbf/ddc 0 2024-09-17T01:41:45.799 INFO:tasks.workunit.client.0.smithi082.stdout:3/631: mknod d9/db/daf/d69/d9c/dc2/cdd 0 2024-09-17T01:41:45.804 INFO:tasks.workunit.client.0.smithi082.stdout:5/682: dread db/d1e/d20/d30/d47/fb6 [0,4194304] 0 2024-09-17T01:41:45.806 INFO:tasks.workunit.client.0.smithi082.stdout:5/683: chown db/d56/l1a 2066869 1 2024-09-17T01:41:45.806 INFO:tasks.workunit.client.0.smithi082.stdout:3/632: dwrite d9/db/d26/dad/fbb [0,4194304] 0 2024-09-17T01:41:45.809 INFO:tasks.workunit.client.0.smithi082.stdout:0/650: dwrite da/fc [0,4194304] 0 2024-09-17T01:41:45.814 INFO:tasks.workunit.client.0.smithi082.stdout:5/684: truncate db/d56/d29/d4f/f57 649326 0 2024-09-17T01:41:45.815 INFO:tasks.workunit.client.0.smithi082.stdout:5/685: chown db/d56/d18/cde 1 1 2024-09-17T01:41:45.819 INFO:tasks.workunit.client.0.smithi082.stdout:0/651: unlink da/d1b/d23/d4d/f7f 0 2024-09-17T01:41:45.823 INFO:tasks.workunit.client.0.smithi082.stdout:0/652: read da/df/d71/f2e [100007,106372] 0 2024-09-17T01:41:45.831 INFO:tasks.workunit.client.0.smithi082.stdout:6/683: sync 2024-09-17T01:41:45.831 INFO:tasks.workunit.client.0.smithi082.stdout:2/729: sync 2024-09-17T01:41:45.837 INFO:tasks.workunit.client.0.smithi082.stdout:2/730: creat d1/d17/d38/d42/d52/ff4 x:0 0 0 2024-09-17T01:41:45.842 INFO:tasks.workunit.client.0.smithi082.stdout:3/633: write d9/d35/d63/f97 [2665402,75391] 0 2024-09-17T01:41:45.842 INFO:tasks.workunit.client.0.smithi082.stdout:5/686: dwrite db/f8f [0,4194304] 0 2024-09-17T01:41:45.843 INFO:tasks.workunit.client.0.smithi082.stdout:7/690: sync 2024-09-17T01:41:45.843 INFO:tasks.workunit.client.0.smithi082.stdout:1/786: sync 2024-09-17T01:41:45.843 INFO:tasks.workunit.client.0.smithi082.stdout:4/709: sync 2024-09-17T01:41:45.845 INFO:tasks.workunit.client.0.smithi082.stdout:7/691: chown d0/d3/f64 11 1 2024-09-17T01:41:45.846 INFO:tasks.workunit.client.0.smithi082.stdout:6/684: creat d1/fef x:0 0 0 2024-09-17T01:41:45.846 INFO:tasks.workunit.client.0.smithi082.stdout:0/653: write da/d1b/d23/d42/f58 [1676388,47220] 0 2024-09-17T01:41:45.847 INFO:tasks.workunit.client.0.smithi082.stdout:1/787: write d2/d3f/d24/dba/ffe [130600,38455] 0 2024-09-17T01:41:45.850 INFO:tasks.workunit.client.0.smithi082.stdout:5/687: creat db/d56/d78/da0/fe1 x:0 0 0 2024-09-17T01:41:45.853 INFO:tasks.workunit.client.0.smithi082.stdout:4/710: creat d9/d15/d16/d18/fe6 x:0 0 0 2024-09-17T01:41:45.855 INFO:tasks.workunit.client.0.smithi082.stdout:3/634: rename d9/db/d6d/l83 to d9/db/d49/da4/lde 0 2024-09-17T01:41:45.859 INFO:tasks.workunit.client.0.smithi082.stdout:7/692: creat d0/dd/d2c/ff3 x:0 0 0 2024-09-17T01:41:45.861 INFO:tasks.workunit.client.0.smithi082.stdout:5/688: fdatasync db/d56/d78/f80 0 2024-09-17T01:41:45.863 INFO:tasks.workunit.client.0.smithi082.stdout:4/711: rmdir d9/d15 39 2024-09-17T01:41:45.866 INFO:tasks.workunit.client.0.smithi082.stdout:2/731: dwrite d1/d17/d60/f6f [0,4194304] 0 2024-09-17T01:41:45.866 INFO:tasks.workunit.client.0.smithi082.stdout:3/635: mknod d9/db/d26/cdf 0 2024-09-17T01:41:45.868 INFO:tasks.workunit.client.0.smithi082.stdout:2/732: dread - d1/d17/d29/dc9/fd3 zero size 2024-09-17T01:41:45.875 INFO:tasks.workunit.client.0.smithi082.stdout:7/693: dread d0/d62/d7e/dd4/f6b [0,4194304] 0 2024-09-17T01:41:45.877 INFO:tasks.workunit.client.0.smithi082.stdout:5/689: truncate db/d56/f1c 3371255 0 2024-09-17T01:41:45.878 INFO:tasks.workunit.client.0.smithi082.stdout:4/712: truncate d9/d15/f6f 543846 0 2024-09-17T01:41:45.879 INFO:tasks.workunit.client.0.smithi082.stdout:3/636: mkdir d9/db/d6d/de0 0 2024-09-17T01:41:45.881 INFO:tasks.workunit.client.0.smithi082.stdout:4/713: write d9/d15/d16/d3e/f3f [4814646,24351] 0 2024-09-17T01:41:45.881 INFO:tasks.workunit.client.0.smithi082.stdout:3/637: stat d9/db/daf/l65 0 2024-09-17T01:41:45.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/694: dwrite d0/dd/f16 [0,4194304] 0 2024-09-17T01:41:45.887 INFO:tasks.workunit.client.0.smithi082.stdout:3/638: creat d9/db/daf/d69/dbc/fe1 x:0 0 0 2024-09-17T01:41:45.887 INFO:tasks.workunit.client.0.smithi082.stdout:3/639: readlink d9/db/d49/l48 0 2024-09-17T01:41:45.890 INFO:tasks.workunit.client.0.smithi082.stdout:4/714: write d9/d15/d16/f36 [2297270,8548] 0 2024-09-17T01:41:45.893 INFO:tasks.workunit.client.0.smithi082.stdout:0/654: truncate da/df/d27/fc8 375346 0 2024-09-17T01:41:45.894 INFO:tasks.workunit.client.0.smithi082.stdout:3/640: unlink d9/db/d26/fa3 0 2024-09-17T01:41:45.895 INFO:tasks.workunit.client.0.smithi082.stdout:5/690: write db/d56/d18/d98/fa9 [1020723,97093] 0 2024-09-17T01:41:45.896 INFO:tasks.workunit.client.0.smithi082.stdout:7/695: truncate d0/d3/db/d10/d47/fe7 420171 0 2024-09-17T01:41:45.900 INFO:tasks.workunit.client.0.smithi082.stdout:0/655: chown da/d1b/cc0 859872 1 2024-09-17T01:41:45.902 INFO:tasks.workunit.client.0.smithi082.stdout:7/696: read - d0/d62/d7e/dd4/d37/d86/fbb zero size 2024-09-17T01:41:45.902 INFO:tasks.workunit.client.0.smithi082.stdout:4/715: symlink d9/d15/d16/d44/le7 0 2024-09-17T01:41:45.908 INFO:tasks.workunit.client.0.smithi082.stdout:3/641: link d9/db/daf/d69/d9c/dc2/fc7 d9/db/d49/fe2 0 2024-09-17T01:41:45.908 INFO:tasks.workunit.client.0.smithi082.stdout:3/642: fdatasync d9/db/f85 0 2024-09-17T01:41:45.912 INFO:tasks.workunit.client.0.smithi082.stdout:4/716: truncate d9/d47/dc2/dda/f66 425103 0 2024-09-17T01:41:45.913 INFO:tasks.workunit.client.0.smithi082.stdout:4/717: write d9/d15/d16/d18/fe6 [326529,90160] 0 2024-09-17T01:41:45.917 INFO:tasks.workunit.client.0.smithi082.stdout:3/643: symlink d9/db/daf/d69/dbc/le3 0 2024-09-17T01:41:45.919 INFO:tasks.workunit.client.0.smithi082.stdout:4/718: dwrite d9/d15/d16/d18/d4a/d8f/d91/f95 [4194304,4194304] 0 2024-09-17T01:41:45.920 INFO:tasks.workunit.client.0.smithi082.stdout:5/691: truncate db/f96 1329555 0 2024-09-17T01:41:45.921 INFO:tasks.workunit.client.0.smithi082.stdout:7/697: mkdir d0/d3/df4 0 2024-09-17T01:41:45.926 INFO:tasks.workunit.client.0.smithi082.stdout:4/719: creat d9/d15/d16/d44/d84/fe8 x:0 0 0 2024-09-17T01:41:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:7/698: creat d0/d62/d7e/dd7/ff5 x:0 0 0 2024-09-17T01:41:45.929 INFO:tasks.workunit.client.0.smithi082.stdout:0/656: link da/df/d2b/d59/d8f/dbe/ccb da/df/d2b/d59/d6f/dd9/ce9 0 2024-09-17T01:41:45.933 INFO:tasks.workunit.client.0.smithi082.stdout:0/657: chown da/d1b/c79 74 1 2024-09-17T01:41:45.936 INFO:tasks.workunit.client.0.smithi082.stdout:4/720: dwrite d9/d15/d16/d3e/fbb [0,4194304] 0 2024-09-17T01:41:45.942 INFO:tasks.workunit.client.0.smithi082.stdout:7/699: dwrite d0/d62/dce/deb/ff1 [0,4194304] 0 2024-09-17T01:41:45.945 INFO:tasks.workunit.client.0.smithi082.stdout:0/658: mkdir da/d1b/d23/dea 0 2024-09-17T01:41:45.946 INFO:tasks.workunit.client.0.smithi082.stdout:0/659: write da/d1b/f52 [1270130,10938] 0 2024-09-17T01:41:45.947 INFO:tasks.workunit.client.0.smithi082.stdout:7/700: creat d0/d62/dce/ff6 x:0 0 0 2024-09-17T01:41:45.947 INFO:tasks.workunit.client.0.smithi082.stdout:5/692: write db/d56/d18/d23/f66 [186151,49005] 0 2024-09-17T01:41:45.948 INFO:tasks.workunit.client.0.smithi082.stdout:3/644: dread d9/db/d49/d4e/d53/f58 [0,4194304] 0 2024-09-17T01:41:45.951 INFO:tasks.workunit.client.0.smithi082.stdout:4/721: truncate d9/d15/d16/d18/d4a/d52/f59 635272 0 2024-09-17T01:41:45.953 INFO:tasks.workunit.client.0.smithi082.stdout:7/701: mknod d0/d3/db/d10/cf7 0 2024-09-17T01:41:45.954 INFO:tasks.workunit.client.0.smithi082.stdout:5/693: creat db/d2b/d59/fe2 x:0 0 0 2024-09-17T01:41:45.955 INFO:tasks.workunit.client.0.smithi082.stdout:3/645: dread d9/db/d49/d4e/d53/f58 [0,4194304] 0 2024-09-17T01:41:45.958 INFO:tasks.workunit.client.0.smithi082.stdout:0/660: symlink da/d1b/d23/d42/d43/leb 0 2024-09-17T01:41:45.962 INFO:tasks.workunit.client.0.smithi082.stdout:3/646: rmdir d9/db/daf/d69/d9c/dc2 39 2024-09-17T01:41:45.962 INFO:tasks.workunit.client.0.smithi082.stdout:0/661: rmdir da/d1b 39 2024-09-17T01:41:45.964 INFO:tasks.workunit.client.0.smithi082.stdout:4/722: truncate d9/d15/f62 544099 0 2024-09-17T01:41:45.965 INFO:tasks.workunit.client.0.smithi082.stdout:7/702: creat d0/d62/d7e/db5/ff8 x:0 0 0 2024-09-17T01:41:45.966 INFO:tasks.workunit.client.0.smithi082.stdout:5/694: symlink db/d56/le3 0 2024-09-17T01:41:45.967 INFO:tasks.workunit.client.0.smithi082.stdout:7/703: write d0/d62/d7e/fd9 [4272371,96012] 0 2024-09-17T01:41:45.968 INFO:tasks.workunit.client.0.smithi082.stdout:5/695: dread - db/d56/d78/da0/fe1 zero size 2024-09-17T01:41:45.968 INFO:tasks.workunit.client.0.smithi082.stdout:3/647: rmdir d9/d78 39 2024-09-17T01:41:45.969 INFO:tasks.workunit.client.0.smithi082.stdout:7/704: chown d0/d62/d7e/dd4/d37/d86 2 1 2024-09-17T01:41:45.970 INFO:tasks.workunit.client.0.smithi082.stdout:4/723: dread d9/d15/d16/f2c [0,4194304] 0 2024-09-17T01:41:45.976 INFO:tasks.workunit.client.0.smithi082.stdout:0/662: mknod da/df/cec 0 2024-09-17T01:41:45.979 INFO:tasks.workunit.client.0.smithi082.stdout:7/705: rename d0/c9e to d0/d62/d7e/dd7/cf9 0 2024-09-17T01:41:45.981 INFO:tasks.workunit.client.0.smithi082.stdout:0/663: dread da/d80/f8c [0,4194304] 0 2024-09-17T01:41:45.983 INFO:tasks.workunit.client.0.smithi082.stdout:3/648: dread d9/db/d26/f9e [0,4194304] 0 2024-09-17T01:41:45.984 INFO:tasks.workunit.client.0.smithi082.stdout:3/649: chown d9/db/d95/cd6 0 1 2024-09-17T01:41:45.986 INFO:tasks.workunit.client.0.smithi082.stdout:7/706: creat d0/d62/d7e/ffa x:0 0 0 2024-09-17T01:41:45.987 INFO:tasks.workunit.client.0.smithi082.stdout:5/696: dread db/d2b/f36 [0,4194304] 0 2024-09-17T01:41:45.988 INFO:tasks.workunit.client.0.smithi082.stdout:0/664: creat da/d1b/d23/d4d/fed x:0 0 0 2024-09-17T01:41:45.989 INFO:tasks.workunit.client.0.smithi082.stdout:7/707: rmdir d0/d62/d7e/dd4 39 2024-09-17T01:41:45.990 INFO:tasks.workunit.client.0.smithi082.stdout:7/708: fdatasync d0/dd/d2c/f8e 0 2024-09-17T01:41:45.990 INFO:tasks.workunit.client.0.smithi082.stdout:7/709: stat d0/d50/dd2 0 2024-09-17T01:41:45.995 INFO:tasks.workunit.client.0.smithi082.stdout:5/697: getdents db/d56/d78/da0 0 2024-09-17T01:41:45.997 INFO:tasks.workunit.client.0.smithi082.stdout:0/665: getdents da/d1b 0 2024-09-17T01:41:46.001 INFO:tasks.workunit.client.0.smithi082.stdout:7/710: getdents d0/d3/db/d10 0 2024-09-17T01:41:46.003 INFO:tasks.workunit.client.0.smithi082.stdout:0/666: creat da/df/d2b/d9a/fee x:0 0 0 2024-09-17T01:41:46.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:45 smithi167 ceph-mon[35643]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 201 MiB/s wr, 413 op/s 2024-09-17T01:41:46.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:45 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:46.007 INFO:tasks.workunit.client.0.smithi082.stdout:7/711: dread d0/d3/db/d10/d3f/fcb [0,4194304] 0 2024-09-17T01:41:46.007 INFO:tasks.workunit.client.0.smithi082.stdout:0/667: chown da/d1b/fb4 629542 1 2024-09-17T01:41:46.010 INFO:tasks.workunit.client.0.smithi082.stdout:0/668: stat da/d80/d99/c65 0 2024-09-17T01:41:46.011 INFO:tasks.workunit.client.0.smithi082.stdout:7/712: mkdir d0/dd/d34/d58/d6e/d8a/dfb 0 2024-09-17T01:41:46.012 INFO:tasks.workunit.client.0.smithi082.stdout:5/698: dwrite db/d1e/d20/fac [0,4194304] 0 2024-09-17T01:41:46.013 INFO:tasks.workunit.client.0.smithi082.stdout:0/669: symlink da/d80/d77/lef 0 2024-09-17T01:41:46.014 INFO:tasks.workunit.client.0.smithi082.stdout:7/713: dread - d0/dd/d34/fc5 zero size 2024-09-17T01:41:46.015 INFO:tasks.workunit.client.0.smithi082.stdout:0/670: fsync da/df/d2b/d59/d6f/dd9/fe6 0 2024-09-17T01:41:46.019 INFO:tasks.workunit.client.0.smithi082.stdout:5/699: dread db/d1e/d20/d30/d47/fb6 [0,4194304] 0 2024-09-17T01:41:46.020 INFO:tasks.workunit.client.0.smithi082.stdout:0/671: rmdir da/df/d27 39 2024-09-17T01:41:46.021 INFO:tasks.workunit.client.0.smithi082.stdout:5/700: chown db/d2b/d59/fe2 14173931 1 2024-09-17T01:41:46.021 INFO:tasks.workunit.client.0.smithi082.stdout:7/714: rmdir d0/dd/d2c/d42/dde/de2 39 2024-09-17T01:41:46.024 INFO:tasks.workunit.client.0.smithi082.stdout:5/701: mkdir db/da7/de4 0 2024-09-17T01:41:46.026 INFO:tasks.workunit.client.0.smithi082.stdout:7/715: truncate d0/dd/d2c/d54/f5a 132386 0 2024-09-17T01:41:46.028 INFO:tasks.workunit.client.0.smithi082.stdout:0/672: symlink da/d1b/d23/d42/d43/lf0 0 2024-09-17T01:41:46.030 INFO:tasks.workunit.client.0.smithi082.stdout:7/716: creat d0/d62/dce/ffc x:0 0 0 2024-09-17T01:41:46.030 INFO:tasks.workunit.client.0.smithi082.stdout:7/717: stat d0/d3/db/d10/d47 0 2024-09-17T01:41:46.035 INFO:tasks.workunit.client.0.smithi082.stdout:7/718: symlink d0/dd/d2c/lfd 0 2024-09-17T01:41:46.035 INFO:tasks.workunit.client.0.smithi082.stdout:5/702: write db/f9d [511578,102857] 0 2024-09-17T01:41:46.096 INFO:tasks.workunit.client.0.smithi082.stdout:0/673: link da/df/d2b/d59/lbf da/d80/d77/lf1 0 2024-09-17T01:41:46.098 INFO:tasks.workunit.client.0.smithi082.stdout:8/604: sync 2024-09-17T01:41:46.098 INFO:tasks.workunit.client.0.smithi082.stdout:9/562: sync 2024-09-17T01:41:46.102 INFO:tasks.workunit.client.0.smithi082.stdout:5/703: dwrite db/d1e/d5b/f92 [0,4194304] 0 2024-09-17T01:41:46.102 INFO:tasks.workunit.client.0.smithi082.stdout:7/719: dwrite d0/d62/d7e/ffa [0,4194304] 0 2024-09-17T01:41:46.103 INFO:tasks.workunit.client.0.smithi082.stdout:8/605: creat d3/dd/d18/d51/fc0 x:0 0 0 2024-09-17T01:41:46.103 INFO:tasks.workunit.client.0.smithi082.stdout:7/720: dread - d0/d62/d7e/dd7/ff5 zero size 2024-09-17T01:41:46.105 INFO:tasks.workunit.client.0.smithi082.stdout:5/704: read db/d56/d18/d23/f6c [79480,119100] 0 2024-09-17T01:41:46.107 INFO:tasks.workunit.client.0.smithi082.stdout:0/674: rename da/d1b/d23/d42/d43/lae to da/df/d71/d92/lf2 0 2024-09-17T01:41:46.108 INFO:tasks.workunit.client.0.smithi082.stdout:0/675: stat da/d1b/c79 0 2024-09-17T01:41:46.109 INFO:tasks.workunit.client.0.smithi082.stdout:0/676: chown da/d80/d77 87 1 2024-09-17T01:41:46.110 INFO:tasks.workunit.client.0.smithi082.stdout:0/677: write da/df/d71/fdb [746974,28806] 0 2024-09-17T01:41:46.113 INFO:tasks.workunit.client.0.smithi082.stdout:7/721: symlink d0/d62/d7e/dd4/lfe 0 2024-09-17T01:41:46.114 INFO:tasks.workunit.client.0.smithi082.stdout:5/705: mknod db/d56/d29/d4f/d8e/ddc/ce5 0 2024-09-17T01:41:46.115 INFO:tasks.workunit.client.0.smithi082.stdout:8/606: mknod d3/dd/d18/d2d/d58/d85/cc1 0 2024-09-17T01:41:46.116 INFO:tasks.workunit.client.0.smithi082.stdout:0/678: symlink da/df/d71/d92/lf3 0 2024-09-17T01:41:46.117 INFO:tasks.workunit.client.0.smithi082.stdout:7/722: symlink d0/d3/db/lff 0 2024-09-17T01:41:46.117 INFO:tasks.workunit.client.0.smithi082.stdout:0/679: dread - da/d80/fa4 zero size 2024-09-17T01:41:46.118 INFO:tasks.workunit.client.0.smithi082.stdout:0/680: write f8 [987368,78609] 0 2024-09-17T01:41:46.119 INFO:tasks.workunit.client.0.smithi082.stdout:7/723: truncate d0/dd/d34/d58/fe5 866654 0 2024-09-17T01:41:46.119 INFO:tasks.workunit.client.0.smithi082.stdout:9/563: rename d4/d27/d2d/d60/d11/d39/f41 to d4/d27/d2d/d60/d11/fbb 0 2024-09-17T01:41:46.120 INFO:tasks.workunit.client.0.smithi082.stdout:8/607: mknod d3/dd/d18/cc2 0 2024-09-17T01:41:46.121 INFO:tasks.workunit.client.0.smithi082.stdout:7/724: stat d0/d3/db/d10/d47 0 2024-09-17T01:41:46.121 INFO:tasks.workunit.client.0.smithi082.stdout:0/681: dread da/d1b/d23/d42/f88 [0,4194304] 0 2024-09-17T01:41:46.122 INFO:tasks.workunit.client.0.smithi082.stdout:8/608: readlink d3/dd/d18/d2d/d58/lbb 0 2024-09-17T01:41:46.122 INFO:tasks.workunit.client.0.smithi082.stdout:7/725: chown d0/d3/db/d10/d3f/fcb 2494688 1 2024-09-17T01:41:46.123 INFO:tasks.workunit.client.0.smithi082.stdout:5/706: rename db/d1e/d5b/db4/fbd to db/d56/d18/d23/fe6 0 2024-09-17T01:41:46.124 INFO:tasks.workunit.client.0.smithi082.stdout:8/609: write d3/dd/d18/d2d/d3e/d4a/d6a/fa4 [997240,69783] 0 2024-09-17T01:41:46.126 INFO:tasks.workunit.client.0.smithi082.stdout:0/682: rmdir da/df/d2b/d59/d8f 39 2024-09-17T01:41:46.127 INFO:tasks.workunit.client.0.smithi082.stdout:7/726: truncate d0/d62/d7e/dd4/d37/d86/fb1 66281 0 2024-09-17T01:41:46.130 INFO:tasks.workunit.client.0.smithi082.stdout:5/707: rename db/d1e/d5b/la5 to db/da7/le7 0 2024-09-17T01:41:46.134 INFO:tasks.workunit.client.0.smithi082.stdout:7/727: dwrite d0/dd/f7c [0,4194304] 0 2024-09-17T01:41:46.141 INFO:tasks.workunit.client.0.smithi082.stdout:8/610: creat d3/dd/d18/d2d/d3e/d4a/d68/fc3 x:0 0 0 2024-09-17T01:41:46.142 INFO:tasks.workunit.client.0.smithi082.stdout:7/728: dwrite d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:46.144 INFO:tasks.workunit.client.0.smithi082.stdout:8/611: write d3/dd/d18/d51/fc0 [874836,16058] 0 2024-09-17T01:41:46.145 INFO:tasks.workunit.client.0.smithi082.stdout:0/683: dread da/d1b/d23/d4d/f2a [0,4194304] 0 2024-09-17T01:41:46.147 INFO:tasks.workunit.client.0.smithi082.stdout:0/684: chown da/df/d71/f51 17 1 2024-09-17T01:41:46.149 INFO:tasks.workunit.client.0.smithi082.stdout:0/685: read da/d1b/f7d [107651,28105] 0 2024-09-17T01:41:46.156 INFO:tasks.workunit.client.0.smithi082.stdout:5/708: link db/d56/d18/lb1 db/d56/d29/d4f/d8e/ddc/le8 0 2024-09-17T01:41:46.156 INFO:tasks.workunit.client.0.smithi082.stdout:5/709: dread - db/d56/dd6/fd8 zero size 2024-09-17T01:41:46.157 INFO:tasks.workunit.client.0.smithi082.stdout:5/710: dread - db/d56/d78/da0/fb2 zero size 2024-09-17T01:41:46.160 INFO:tasks.workunit.client.0.smithi082.stdout:9/564: rename d4/c6 to d4/d27/d2d/d60/d11/d39/d29/d35/cbc 0 2024-09-17T01:41:46.161 INFO:tasks.workunit.client.0.smithi082.stdout:7/729: creat d0/d3/db/ddf/f100 x:0 0 0 2024-09-17T01:41:46.164 INFO:tasks.workunit.client.0.smithi082.stdout:0/686: rmdir da/df/d2b/d59/d8f 39 2024-09-17T01:41:46.166 INFO:tasks.workunit.client.0.smithi082.stdout:9/565: dwrite d4/fae [0,4194304] 0 2024-09-17T01:41:46.166 INFO:tasks.workunit.client.0.smithi082.stdout:5/711: rename db/d1e/d20/d30/f3b to db/d1e/d5b/db4/fe9 0 2024-09-17T01:41:46.167 INFO:tasks.workunit.client.0.smithi082.stdout:9/566: readlink d4/d27/d21/l89 0 2024-09-17T01:41:46.169 INFO:tasks.workunit.client.0.smithi082.stdout:8/612: truncate d3/dd/f26 11494228 0 2024-09-17T01:41:46.179 INFO:tasks.workunit.client.0.smithi082.stdout:5/712: readlink db/da7/le7 0 2024-09-17T01:41:46.180 INFO:tasks.workunit.client.0.smithi082.stdout:5/713: truncate db/d2b/f87 1103827 0 2024-09-17T01:41:46.180 INFO:tasks.workunit.client.0.smithi082.stdout:9/567: dread - d4/d27/d2d/d60/fa3 zero size 2024-09-17T01:41:46.182 INFO:tasks.workunit.client.0.smithi082.stdout:7/730: link d0/d3/db/fd1 d0/d3/db/d10/d3f/f101 0 2024-09-17T01:41:46.183 INFO:tasks.workunit.client.0.smithi082.stdout:7/731: truncate d0/d3/db/ddf/f100 733167 0 2024-09-17T01:41:46.183 INFO:tasks.workunit.client.0.smithi082.stdout:0/687: mkdir da/df/df4 0 2024-09-17T01:41:46.186 INFO:tasks.workunit.client.0.smithi082.stdout:5/714: creat db/d2b/d59/fea x:0 0 0 2024-09-17T01:41:46.186 INFO:tasks.workunit.client.0.smithi082.stdout:9/568: dread - d4/d27/d2d/d3d/f5c zero size 2024-09-17T01:41:46.190 INFO:tasks.workunit.client.0.smithi082.stdout:0/688: creat da/df/d2b/d9a/ff5 x:0 0 0 2024-09-17T01:41:46.191 INFO:tasks.workunit.client.0.smithi082.stdout:5/715: symlink db/d56/d29/d4f/d8e/leb 0 2024-09-17T01:41:46.192 INFO:tasks.workunit.client.0.smithi082.stdout:8/613: truncate d3/dd/d18/d3a/f57 1263750 0 2024-09-17T01:41:46.198 INFO:tasks.workunit.client.0.smithi082.stdout:8/614: stat d3/dd/d18/f24 0 2024-09-17T01:41:46.199 INFO:tasks.workunit.client.0.smithi082.stdout:9/569: creat d4/d27/d2d/d60/dba/fbd x:0 0 0 2024-09-17T01:41:46.203 INFO:tasks.workunit.client.0.smithi082.stdout:7/732: write d0/f13 [800475,65208] 0 2024-09-17T01:41:46.204 INFO:tasks.workunit.client.0.smithi082.stdout:0/689: chown da/df/d27/c32 993 1 2024-09-17T01:41:46.205 INFO:tasks.workunit.client.0.smithi082.stdout:0/690: write da/d1b/d23/d4d/fed [872437,7530] 0 2024-09-17T01:41:46.206 INFO:tasks.workunit.client.0.smithi082.stdout:0/691: write da/df/d2b/d59/fa2 [521277,10115] 0 2024-09-17T01:41:46.206 INFO:tasks.workunit.client.0.smithi082.stdout:5/716: dread db/d56/d29/f6a [0,4194304] 0 2024-09-17T01:41:46.211 INFO:tasks.workunit.client.0.smithi082.stdout:5/717: mknod db/d1e/d5b/d83/cec 0 2024-09-17T01:41:46.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:45 smithi082 ceph-mon[28077]: pgmap v26: 65 pgs: 65 active+clean; 3.1 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 82 MiB/s rd, 201 MiB/s wr, 413 op/s 2024-09-17T01:41:46.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:45 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:41:46.214 INFO:tasks.workunit.client.0.smithi082.stdout:0/692: symlink da/df/df4/lf6 0 2024-09-17T01:41:46.216 INFO:tasks.workunit.client.0.smithi082.stdout:9/570: getdents d4/d59/d63 0 2024-09-17T01:41:46.217 INFO:tasks.workunit.client.0.smithi082.stdout:5/718: mknod db/d56/d76/ced 0 2024-09-17T01:41:46.218 INFO:tasks.workunit.client.0.smithi082.stdout:0/693: rmdir da 39 2024-09-17T01:41:46.219 INFO:tasks.workunit.client.0.smithi082.stdout:7/733: getdents d0/d62/dce 0 2024-09-17T01:41:46.220 INFO:tasks.workunit.client.0.smithi082.stdout:7/734: chown d0/dd/d34/d58/la6 221514 1 2024-09-17T01:41:46.225 INFO:tasks.workunit.client.0.smithi082.stdout:7/735: unlink d0/dd/lf 0 2024-09-17T01:41:46.226 INFO:tasks.workunit.client.0.smithi082.stdout:7/736: chown d0/d3/db/f33 231 1 2024-09-17T01:41:46.227 INFO:tasks.workunit.client.0.smithi082.stdout:7/737: chown d0/dd/d2c/lb3 1354115 1 2024-09-17T01:41:46.228 INFO:tasks.workunit.client.0.smithi082.stdout:0/694: truncate da/df/d2b/d59/f73 554087 0 2024-09-17T01:41:46.231 INFO:tasks.workunit.client.0.smithi082.stdout:7/738: mknod d0/d3/db/ddf/c102 0 2024-09-17T01:41:46.232 INFO:tasks.workunit.client.0.smithi082.stdout:7/739: rename d0 to d0/dd/d2c/d103 22 2024-09-17T01:41:46.233 INFO:tasks.workunit.client.0.smithi082.stdout:0/695: dwrite da/df/d2b/f39 [0,4194304] 0 2024-09-17T01:41:46.238 INFO:tasks.workunit.client.0.smithi082.stdout:9/571: write d4/d27/d2d/d60/d11/d39/d29/d6d/f90 [552680,97583] 0 2024-09-17T01:41:46.251 INFO:tasks.workunit.client.0.smithi082.stdout:7/740: dwrite d0/d3/db/d10/d3f/f5d [0,4194304] 0 2024-09-17T01:41:46.252 INFO:tasks.workunit.client.0.smithi082.stdout:0/696: truncate da/df/d27/db5/f8e 1895235 0 2024-09-17T01:41:46.256 INFO:tasks.workunit.client.0.smithi082.stdout:0/697: unlink da/d80/cd8 0 2024-09-17T01:41:46.261 INFO:tasks.workunit.client.0.smithi082.stdout:0/698: rename da/df/d2b/d59/d8f to da/df/d71/d92/df7 0 2024-09-17T01:41:46.272 INFO:tasks.workunit.client.0.smithi082.stdout:9/572: dread d4/d59/d63/f67 [0,4194304] 0 2024-09-17T01:41:46.272 INFO:tasks.workunit.client.0.smithi082.stdout:9/573: fsync d4/f57 0 2024-09-17T01:41:46.278 INFO:tasks.workunit.client.0.smithi082.stdout:0/699: truncate da/df/d27/db5/f8e 2004428 0 2024-09-17T01:41:46.279 INFO:tasks.workunit.client.0.smithi082.stdout:0/700: stat da/df/d71/c46 0 2024-09-17T01:41:46.280 INFO:tasks.workunit.client.0.smithi082.stdout:9/574: dread d4/d27/d2d/d60/d11/d39/d29/fb2 [0,4194304] 0 2024-09-17T01:41:46.282 INFO:tasks.workunit.client.0.smithi082.stdout:0/701: stat da/df/l5c 0 2024-09-17T01:41:46.283 INFO:tasks.workunit.client.0.smithi082.stdout:9/575: symlink d4/d27/d2d/d60/d11/d39/d29/d6d/lbe 0 2024-09-17T01:41:46.286 INFO:tasks.workunit.client.0.smithi082.stdout:9/576: getdents d4/d27/d36/d3b/da9 0 2024-09-17T01:41:46.288 INFO:tasks.workunit.client.0.smithi082.stdout:0/702: dwrite da/df/d2b/d9a/f9b [0,4194304] 0 2024-09-17T01:41:46.289 INFO:tasks.workunit.client.0.smithi082.stdout:9/577: rmdir d4/d27/d2d/d60/d11/d39/d29/d6d 39 2024-09-17T01:41:46.292 INFO:tasks.workunit.client.0.smithi082.stdout:0/703: unlink da/df/d27/c2c 0 2024-09-17T01:41:46.296 INFO:tasks.workunit.client.0.smithi082.stdout:9/578: mknod d4/d27/d2d/d60/d11/d39/d44/cbf 0 2024-09-17T01:41:46.297 INFO:tasks.workunit.client.0.smithi082.stdout:0/704: symlink da/d1b/d23/lf8 0 2024-09-17T01:41:46.299 INFO:tasks.workunit.client.0.smithi082.stdout:9/579: creat d4/d27/d2d/d60/d11/d39/d44/fc0 x:0 0 0 2024-09-17T01:41:46.315 INFO:tasks.workunit.client.0.smithi082.stdout:0/705: dread da/d1b/f52 [0,4194304] 0 2024-09-17T01:41:46.320 INFO:tasks.workunit.client.0.smithi082.stdout:0/706: rename da/df/d2b/d9a/fe4 to da/d1b/d23/d4d/dd7/ff9 0 2024-09-17T01:41:46.323 INFO:tasks.workunit.client.0.smithi082.stdout:0/707: mknod da/d1b/cfa 0 2024-09-17T01:41:46.371 INFO:tasks.workunit.client.0.smithi082.stdout:0/708: dread da/df/d71/f51 [8388608,4194304] 0 2024-09-17T01:41:46.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/709: fdatasync da/d1b/d23/d4d/dd7/ff9 0 2024-09-17T01:41:46.378 INFO:tasks.workunit.client.0.smithi082.stdout:0/710: mkdir da/df/d71/d92/df7/dbe/dfb 0 2024-09-17T01:41:46.379 INFO:tasks.workunit.client.0.smithi082.stdout:0/711: dread da/d80/d77/f91 [0,4194304] 0 2024-09-17T01:41:46.382 INFO:tasks.workunit.client.0.smithi082.stdout:0/712: creat da/d1b/d23/d42/d43/d6b/ffc x:0 0 0 2024-09-17T01:41:46.388 INFO:tasks.workunit.client.0.smithi082.stdout:0/713: creat da/ffd x:0 0 0 2024-09-17T01:41:46.389 INFO:tasks.workunit.client.0.smithi082.stdout:0/714: dread da/d80/d77/f91 [0,4194304] 0 2024-09-17T01:41:46.391 INFO:tasks.workunit.client.0.smithi082.stdout:0/715: mkdir da/d1b/d23/d42/d43/dfe 0 2024-09-17T01:41:46.449 INFO:tasks.workunit.client.0.smithi082.stdout:0/716: dwrite da/df/d27/db5/f8e [0,4194304] 0 2024-09-17T01:41:47.211 INFO:tasks.workunit.client.0.smithi082.stdout:6/685: sync 2024-09-17T01:41:47.216 INFO:tasks.workunit.client.0.smithi082.stdout:6/686: dread d1/d7/d10/d4f/dc/d2b/d48/f76 [0,4194304] 0 2024-09-17T01:41:47.216 INFO:tasks.workunit.client.0.smithi082.stdout:6/687: stat d1/d1f/da7/ddd/lb4 0 2024-09-17T01:41:47.217 INFO:tasks.workunit.client.0.smithi082.stdout:6/688: readlink d1/d7/d10/d4f/l89 0 2024-09-17T01:41:47.228 INFO:tasks.workunit.client.0.smithi082.stdout:6/689: truncate d1/f98 4022075 0 2024-09-17T01:41:47.229 INFO:tasks.workunit.client.0.smithi082.stdout:6/690: read - d1/fef zero size 2024-09-17T01:41:47.230 INFO:tasks.workunit.client.0.smithi082.stdout:6/691: chown d1/d7/d10/d4f/dc/d1d/d36/cb1 55 1 2024-09-17T01:41:47.232 INFO:tasks.workunit.client.0.smithi082.stdout:6/692: mknod d1/d7/d10/d4f/dc/d1d/d36/d7a/cf0 0 2024-09-17T01:41:47.233 INFO:tasks.workunit.client.0.smithi082.stdout:6/693: stat d1/d7/d10/d4f/dc/c54 0 2024-09-17T01:41:47.254 INFO:tasks.workunit.client.0.smithi082.stdout:6/694: truncate d1/d1f/fe1 1860502 0 2024-09-17T01:41:47.255 INFO:tasks.workunit.client.0.smithi082.stdout:2/733: sync 2024-09-17T01:41:47.255 INFO:tasks.workunit.client.0.smithi082.stdout:1/788: sync 2024-09-17T01:41:47.256 INFO:tasks.workunit.client.0.smithi082.stdout:6/695: stat d1/d7/d10/f16 0 2024-09-17T01:41:47.267 INFO:tasks.workunit.client.0.smithi082.stdout:6/696: write d1/f83 [36089,121708] 0 2024-09-17T01:41:47.267 INFO:tasks.workunit.client.0.smithi082.stdout:2/734: link d1/d17/d38/d42/l4f d1/d35/db1/d9c/lf5 0 2024-09-17T01:41:47.267 INFO:tasks.workunit.client.0.smithi082.stdout:2/735: stat d1/d10/ff3 0 2024-09-17T01:41:47.269 INFO:tasks.workunit.client.0.smithi082.stdout:2/736: write d1/d17/d38/d5c/f79 [457853,63077] 0 2024-09-17T01:41:47.274 INFO:tasks.workunit.client.0.smithi082.stdout:2/737: rename d1/d17/d38/d42/d52/ce3 to d1/d17/d29/dc9/cf6 0 2024-09-17T01:41:47.280 INFO:tasks.workunit.client.0.smithi082.stdout:6/697: dread d1/d7/d10/f5e [0,4194304] 0 2024-09-17T01:41:47.281 INFO:tasks.workunit.client.0.smithi082.stdout:6/698: mkdir d1/d1f/da7/ddd/df1 0 2024-09-17T01:41:47.283 INFO:tasks.workunit.client.0.smithi082.stdout:6/699: rmdir d1/d7/d10/d4f/d8e/da8/dae 39 2024-09-17T01:41:47.287 INFO:tasks.workunit.client.0.smithi082.stdout:6/700: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/lf2 0 2024-09-17T01:41:47.288 INFO:tasks.workunit.client.0.smithi082.stdout:6/701: mkdir d1/d7/d10/d4f/dc/d1d/df3 0 2024-09-17T01:41:47.289 INFO:tasks.workunit.client.0.smithi082.stdout:2/738: dread d1/d17/d29/f4c [0,4194304] 0 2024-09-17T01:41:47.290 INFO:tasks.workunit.client.0.smithi082.stdout:6/702: unlink d1/d3/l37 0 2024-09-17T01:41:47.294 INFO:tasks.workunit.client.0.smithi082.stdout:6/703: rename d1/d7/d10/d4f/dc/d1d/df3 to d1/d1f/da7/ddd/df1/df4 0 2024-09-17T01:41:47.300 INFO:tasks.workunit.client.0.smithi082.stdout:6/704: dread d1/d7/d10/d4f/d32/fc7 [0,4194304] 0 2024-09-17T01:41:47.303 INFO:tasks.workunit.client.0.smithi082.stdout:6/705: rmdir d1/d7/d10/d4f 39 2024-09-17T01:41:47.306 INFO:tasks.workunit.client.0.smithi082.stdout:2/739: dwrite d1/f1f [0,4194304] 0 2024-09-17T01:41:47.306 INFO:tasks.workunit.client.0.smithi082.stdout:6/706: chown d1/d7/d10/d4f/dc/d1d/d36/f91 226641 1 2024-09-17T01:41:47.308 INFO:tasks.workunit.client.0.smithi082.stdout:2/740: creat d1/d17/d60/ff7 x:0 0 0 2024-09-17T01:41:47.308 INFO:tasks.workunit.client.0.smithi082.stdout:6/707: truncate d1/d3/f3b 507347 0 2024-09-17T01:41:47.311 INFO:tasks.workunit.client.0.smithi082.stdout:6/708: unlink d1/d1f/l3c 0 2024-09-17T01:41:47.312 INFO:tasks.workunit.client.0.smithi082.stdout:6/709: dread - d1/d1f/fba zero size 2024-09-17T01:41:47.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/741: dwrite d1/ff [0,4194304] 0 2024-09-17T01:41:47.341 INFO:tasks.workunit.client.0.smithi082.stdout:2/742: getdents d1/d17/d38/d42/d52/d78/df1 0 2024-09-17T01:41:47.345 INFO:tasks.workunit.client.0.smithi082.stdout:6/710: dwrite d1/d7/d10/d4f/dc/f88 [4194304,4194304] 0 2024-09-17T01:41:47.347 INFO:tasks.workunit.client.0.smithi082.stdout:2/743: creat d1/d17/d38/d42/d52/d78/df1/ff8 x:0 0 0 2024-09-17T01:41:47.351 INFO:tasks.workunit.client.0.smithi082.stdout:2/744: rename d1/d35/f68 to d1/d35/db1/ff9 0 2024-09-17T01:41:47.352 INFO:tasks.workunit.client.0.smithi082.stdout:6/711: creat d1/d7/ff5 x:0 0 0 2024-09-17T01:41:47.352 INFO:tasks.workunit.client.0.smithi082.stdout:2/745: fdatasync d1/d10/f12 0 2024-09-17T01:41:47.370 INFO:tasks.workunit.client.0.smithi082.stdout:2/746: dread d1/d17/d60/dc6/de8/f9a [0,4194304] 0 2024-09-17T01:41:47.370 INFO:tasks.workunit.client.0.smithi082.stdout:7/741: sync 2024-09-17T01:41:47.370 INFO:tasks.workunit.client.0.smithi082.stdout:4/724: sync 2024-09-17T01:41:47.372 INFO:tasks.workunit.client.0.smithi082.stdout:7/742: mkdir d0/dd/d2c/d42/d104 0 2024-09-17T01:41:47.373 INFO:tasks.workunit.client.0.smithi082.stdout:4/725: mkdir d9/d15/d16/d18/d4a/d52/d55/de9 0 2024-09-17T01:41:47.374 INFO:tasks.workunit.client.0.smithi082.stdout:4/726: chown d9/d15/ca7 25091 1 2024-09-17T01:41:47.375 INFO:tasks.workunit.client.0.smithi082.stdout:6/712: write d1/d7/d10/f9f [2929762,56444] 0 2024-09-17T01:41:47.378 INFO:tasks.workunit.client.0.smithi082.stdout:4/727: creat d9/d15/d16/d18/d4f/db1/fea x:0 0 0 2024-09-17T01:41:47.392 INFO:tasks.workunit.client.0.smithi082.stdout:4/728: dread d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:47.395 INFO:tasks.workunit.client.0.smithi082.stdout:4/729: truncate d9/d15/f62 260439 0 2024-09-17T01:41:47.401 INFO:tasks.workunit.client.0.smithi082.stdout:4/730: dwrite d9/d47/fca [0,4194304] 0 2024-09-17T01:41:47.408 INFO:tasks.workunit.client.0.smithi082.stdout:4/731: dwrite d9/d15/d37/f71 [0,4194304] 0 2024-09-17T01:41:47.412 INFO:tasks.workunit.client.0.smithi082.stdout:4/732: symlink d9/d15/d37/d4c/leb 0 2024-09-17T01:41:47.413 INFO:tasks.workunit.client.0.smithi082.stdout:4/733: read - d9/d47/d9b/fdb zero size 2024-09-17T01:41:47.420 INFO:tasks.workunit.client.0.smithi082.stdout:4/734: dread d9/d15/d16/d44/d84/fb4 [0,4194304] 0 2024-09-17T01:41:47.432 INFO:tasks.workunit.client.0.smithi082.stdout:4/735: link d9/d15/d16/d18/d4a/l85 d9/d47/d9b/dd5/ddd/lec 0 2024-09-17T01:41:47.441 INFO:tasks.workunit.client.0.smithi082.stdout:4/736: getdents d9/d47/dc2/dda 0 2024-09-17T01:41:47.444 INFO:tasks.workunit.client.0.smithi082.stdout:4/737: truncate d9/d15/d16/d3e/d54/dab/fd1 658003 0 2024-09-17T01:41:47.448 INFO:tasks.workunit.client.0.smithi082.stdout:4/738: mknod d9/d47/dc2/ced 0 2024-09-17T01:41:47.449 INFO:tasks.workunit.client.0.smithi082.stdout:7/743: write d0/d3/db/d10/d3f/fa7 [347876,74392] 0 2024-09-17T01:41:47.454 INFO:tasks.workunit.client.0.smithi082.stdout:4/739: unlink d9/d15/d16/d18/d4a/d8f/fd0 0 2024-09-17T01:41:47.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/744: dwrite d0/d3/db/d10/d3f/fcb [0,4194304] 0 2024-09-17T01:41:47.473 INFO:tasks.workunit.client.0.smithi082.stdout:7/745: mknod d0/d50/dd2/c105 0 2024-09-17T01:41:47.477 INFO:tasks.workunit.client.0.smithi082.stdout:7/746: creat d0/d3/df4/f106 x:0 0 0 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:0/717: sync 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:8/615: sync 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:5/719: sync 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:3/650: sync 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:1/789: sync 2024-09-17T01:41:47.511 INFO:tasks.workunit.client.0.smithi082.stdout:9/580: sync 2024-09-17T01:41:47.515 INFO:tasks.workunit.client.0.smithi082.stdout:7/747: dwrite d0/d3/db/d10/fa0 [0,4194304] 0 2024-09-17T01:41:47.516 INFO:tasks.workunit.client.0.smithi082.stdout:5/720: chown db/d56/d78/f80 1153555491 1 2024-09-17T01:41:47.519 INFO:tasks.workunit.client.0.smithi082.stdout:3/651: unlink d9/db/daf/f75 0 2024-09-17T01:41:47.521 INFO:tasks.workunit.client.0.smithi082.stdout:3/652: write d9/f21 [5083435,120019] 0 2024-09-17T01:41:47.521 INFO:tasks.workunit.client.0.smithi082.stdout:5/721: chown db/d1e/d5b/d83/cec 1478513493 1 2024-09-17T01:41:47.524 INFO:tasks.workunit.client.0.smithi082.stdout:8/616: dread - d3/dd/d18/d2d/d3e/f7c zero size 2024-09-17T01:41:47.524 INFO:tasks.workunit.client.0.smithi082.stdout:7/748: mkdir d0/d3/db/d10/d3f/d107 0 2024-09-17T01:41:47.525 INFO:tasks.workunit.client.0.smithi082.stdout:1/790: truncate d2/d3f/d24/d54/f9f 4931788 0 2024-09-17T01:41:47.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/718: symlink da/df/d2b/d59/lff 0 2024-09-17T01:41:47.533 INFO:tasks.workunit.client.0.smithi082.stdout:5/722: creat db/d2b/d59/fee x:0 0 0 2024-09-17T01:41:47.534 INFO:tasks.workunit.client.0.smithi082.stdout:9/581: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1 0 2024-09-17T01:41:47.536 INFO:tasks.workunit.client.0.smithi082.stdout:7/749: write d0/dd/fc7 [4448018,60603] 0 2024-09-17T01:41:47.538 INFO:tasks.workunit.client.0.smithi082.stdout:8/617: symlink d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/lc4 0 2024-09-17T01:41:47.542 INFO:tasks.workunit.client.0.smithi082.stdout:1/791: mknod d2/da/d2d/d79/c100 0 2024-09-17T01:41:47.542 INFO:tasks.workunit.client.0.smithi082.stdout:0/719: mknod da/d80/d99/c100 0 2024-09-17T01:41:47.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/723: creat db/d1e/d20/d30/dc6/fef x:0 0 0 2024-09-17T01:41:47.544 INFO:tasks.workunit.client.0.smithi082.stdout:1/792: fdatasync d2/d3f/fe1 0 2024-09-17T01:41:47.547 INFO:tasks.workunit.client.0.smithi082.stdout:3/653: creat d9/db/daf/d69/d79/d86/db5/fe4 x:0 0 0 2024-09-17T01:41:47.547 INFO:tasks.workunit.client.0.smithi082.stdout:7/750: dread d0/d3/db/d10/d3f/daf/ff2 [0,4194304] 0 2024-09-17T01:41:47.550 INFO:tasks.workunit.client.0.smithi082.stdout:9/582: mknod d4/d27/d2d/d60/d11/d39/d29/d6d/cc2 0 2024-09-17T01:41:47.550 INFO:tasks.workunit.client.0.smithi082.stdout:3/654: dread - d9/db/daf/d69/d79/fab zero size 2024-09-17T01:41:47.555 INFO:tasks.workunit.client.0.smithi082.stdout:0/720: creat da/d1b/d23/d42/d43/d6b/f101 x:0 0 0 2024-09-17T01:41:47.556 INFO:tasks.workunit.client.0.smithi082.stdout:8/618: fsync d3/dd/d18/d3a/f46 0 2024-09-17T01:41:47.557 INFO:tasks.workunit.client.0.smithi082.stdout:5/724: dwrite db/d2b/f87 [0,4194304] 0 2024-09-17T01:41:47.559 INFO:tasks.workunit.client.0.smithi082.stdout:9/583: chown d4/d27/d2d/fad 26947 1 2024-09-17T01:41:47.563 INFO:tasks.workunit.client.0.smithi082.stdout:3/655: write d9/db/d26/f9e [4730456,29052] 0 2024-09-17T01:41:47.566 INFO:tasks.workunit.client.0.smithi082.stdout:7/751: dwrite d0/d62/d7e/ffa [4194304,4194304] 0 2024-09-17T01:41:47.567 INFO:tasks.workunit.client.0.smithi082.stdout:7/752: read - d0/d62/fe8 zero size 2024-09-17T01:41:47.571 INFO:tasks.workunit.client.0.smithi082.stdout:9/584: dread - d4/d27/d36/fab zero size 2024-09-17T01:41:47.573 INFO:tasks.workunit.client.0.smithi082.stdout:1/793: dread d2/d3f/d24/f86 [0,4194304] 0 2024-09-17T01:41:47.574 INFO:tasks.workunit.client.0.smithi082.stdout:9/585: write d4/f8 [76269,122222] 0 2024-09-17T01:41:47.575 INFO:tasks.workunit.client.0.smithi082.stdout:7/753: mkdir d0/d50/dd2/d108 0 2024-09-17T01:41:47.582 INFO:tasks.workunit.client.0.smithi082.stdout:7/754: dread d0/d62/d7e/dd4/f6b [0,4194304] 0 2024-09-17T01:41:47.583 INFO:tasks.workunit.client.0.smithi082.stdout:3/656: write d9/db/d49/d4e/d53/d5b/f6c [3085224,108343] 0 2024-09-17T01:41:47.592 INFO:tasks.workunit.client.0.smithi082.stdout:5/725: rename db/d56/d29/d4f/d8e/dbc/cda to db/d1e/d5b/db7/cf0 0 2024-09-17T01:41:47.597 INFO:tasks.workunit.client.0.smithi082.stdout:9/586: dread d4/d27/d2d/d60/d11/d39/d31/fb6 [0,4194304] 0 2024-09-17T01:41:47.599 INFO:tasks.workunit.client.0.smithi082.stdout:7/755: creat d0/d62/d7e/db5/f109 x:0 0 0 2024-09-17T01:41:47.602 INFO:tasks.workunit.client.0.smithi082.stdout:3/657: stat d9/d35/d63/c6b 0 2024-09-17T01:41:47.606 INFO:tasks.workunit.client.0.smithi082.stdout:1/794: unlink d2/d3f/d34/fe8 0 2024-09-17T01:41:47.609 INFO:tasks.workunit.client.0.smithi082.stdout:9/587: truncate d4/d27/d2d/d60/fa3 851703 0 2024-09-17T01:41:47.617 INFO:tasks.workunit.client.0.smithi082.stdout:8/619: dwrite d3/dd/f26 [0,4194304] 0 2024-09-17T01:41:47.617 INFO:tasks.workunit.client.0.smithi082.stdout:1/795: dwrite d2/da/f56 [0,4194304] 0 2024-09-17T01:41:47.622 INFO:tasks.workunit.client.0.smithi082.stdout:5/726: rename db/d1e/d20/d4d/c7a to db/d56/cf1 0 2024-09-17T01:41:47.623 INFO:tasks.workunit.client.0.smithi082.stdout:3/658: dread d9/db/daf/d69/dbc/fc9 [0,4194304] 0 2024-09-17T01:41:47.624 INFO:tasks.workunit.client.0.smithi082.stdout:3/659: chown d9/d35/dda 1 1 2024-09-17T01:41:47.629 INFO:tasks.workunit.client.0.smithi082.stdout:8/620: mkdir d3/dd/d18/d51/dc5 0 2024-09-17T01:41:47.630 INFO:tasks.workunit.client.0.smithi082.stdout:7/756: write d0/d62/d7e/dd4/d37/d71/f7b [1627134,52236] 0 2024-09-17T01:41:47.632 INFO:tasks.workunit.client.0.smithi082.stdout:1/796: mknod d2/da/d76/d93/c101 0 2024-09-17T01:41:47.633 INFO:tasks.workunit.client.0.smithi082.stdout:7/757: truncate d0/d62/d7e/db5/f109 730075 0 2024-09-17T01:41:47.633 INFO:tasks.workunit.client.0.smithi082.stdout:5/727: mknod db/d56/dd6/cf2 0 2024-09-17T01:41:47.633 INFO:tasks.workunit.client.0.smithi082.stdout:1/797: dread - d2/d3f/d24/d54/fe7 zero size 2024-09-17T01:41:47.636 INFO:tasks.workunit.client.0.smithi082.stdout:3/660: rmdir d9/db/d26 39 2024-09-17T01:41:47.637 INFO:tasks.workunit.client.0.smithi082.stdout:8/621: rmdir d3/dd/d18/d2d/d3e/d4a/d66/d6e 39 2024-09-17T01:41:47.639 INFO:tasks.workunit.client.0.smithi082.stdout:5/728: creat db/d56/d29/d4f/ff3 x:0 0 0 2024-09-17T01:41:47.640 INFO:tasks.workunit.client.0.smithi082.stdout:8/622: fsync d3/dd/d18/d2d/d3e/d43/f59 0 2024-09-17T01:41:47.642 INFO:tasks.workunit.client.0.smithi082.stdout:7/758: creat d0/dd/f10a x:0 0 0 2024-09-17T01:41:47.643 INFO:tasks.workunit.client.0.smithi082.stdout:5/729: dread - db/d1e/fa8 zero size 2024-09-17T01:41:47.645 INFO:tasks.workunit.client.0.smithi082.stdout:8/623: symlink d3/dd/d18/d2d/d58/lc6 0 2024-09-17T01:41:47.646 INFO:tasks.workunit.client.0.smithi082.stdout:7/759: read d0/d3/db/d10/fb0 [1559100,108583] 0 2024-09-17T01:41:47.647 INFO:tasks.workunit.client.0.smithi082.stdout:3/661: dwrite d9/db/d26/dbd/fc0 [0,4194304] 0 2024-09-17T01:41:47.651 INFO:tasks.workunit.client.0.smithi082.stdout:7/760: chown d0/d3/db/d10/d3f/l72 3443 1 2024-09-17T01:41:47.660 INFO:tasks.workunit.client.0.smithi082.stdout:9/588: dwrite d4/d27/d2d/d60/d11/d39/d29/fac [0,4194304] 0 2024-09-17T01:41:47.660 INFO:tasks.workunit.client.0.smithi082.stdout:8/624: dread d3/dd/f27 [0,4194304] 0 2024-09-17T01:41:47.670 INFO:tasks.workunit.client.0.smithi082.stdout:1/798: dwrite d2/df/fce [0,4194304] 0 2024-09-17T01:41:47.673 INFO:tasks.workunit.client.0.smithi082.stdout:5/730: dwrite db/d56/d18/d23/f65 [0,4194304] 0 2024-09-17T01:41:47.674 INFO:tasks.workunit.client.0.smithi082.stdout:9/589: dwrite d4/f49 [4194304,4194304] 0 2024-09-17T01:41:47.763 INFO:tasks.workunit.client.0.smithi082.stdout:8/625: fdatasync d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fb0 0 2024-09-17T01:41:47.768 INFO:tasks.workunit.client.0.smithi082.stdout:5/731: symlink db/d1e/d5b/d83/d94/lf4 0 2024-09-17T01:41:47.773 INFO:tasks.workunit.client.0.smithi082.stdout:3/662: link d9/l4c d9/d35/dda/le5 0 2024-09-17T01:41:47.776 INFO:tasks.workunit.client.0.smithi082.stdout:7/761: rmdir d0/dd/d2c/d42/d104 0 2024-09-17T01:41:47.779 INFO:tasks.workunit.client.0.smithi082.stdout:8/626: write d3/dd/f23 [2437424,68180] 0 2024-09-17T01:41:47.784 INFO:tasks.workunit.client.0.smithi082.stdout:1/799: fdatasync f0 0 2024-09-17T01:41:47.789 INFO:tasks.workunit.client.0.smithi082.stdout:9/590: symlink d4/d27/d36/d3b/da9/lc3 0 2024-09-17T01:41:47.801 INFO:tasks.workunit.client.0.smithi082.stdout:1/800: creat d2/d3f/d24/db5/dea/f102 x:0 0 0 2024-09-17T01:41:47.803 INFO:tasks.workunit.client.0.smithi082.stdout:3/663: getdents d9/db/daf/d69/dbc/ddb 0 2024-09-17T01:41:47.806 INFO:tasks.workunit.client.0.smithi082.stdout:7/762: creat d0/d3/db/d10/d3f/dec/f10b x:0 0 0 2024-09-17T01:41:47.809 INFO:tasks.workunit.client.0.smithi082.stdout:5/732: creat db/d1e/d20/ff5 x:0 0 0 2024-09-17T01:41:47.811 INFO:tasks.workunit.client.0.smithi082.stdout:9/591: mkdir d4/da6/dc4 0 2024-09-17T01:41:47.814 INFO:tasks.workunit.client.0.smithi082.stdout:9/592: chown d4/d27/d2d/d60/d11/d39/d44/c8e 180043 1 2024-09-17T01:41:47.815 INFO:tasks.workunit.client.0.smithi082.stdout:9/593: chown d4/d27/d2d/d60/d11/d8d/fa7 24086912 1 2024-09-17T01:41:47.818 INFO:tasks.workunit.client.0.smithi082.stdout:1/801: dread d2/da/d2d/f41 [0,4194304] 0 2024-09-17T01:41:47.820 INFO:tasks.workunit.client.0.smithi082.stdout:9/594: write d4/d27/d2d/d60/d11/d39/d29/d77/f84 [126267,27889] 0 2024-09-17T01:41:47.823 INFO:tasks.workunit.client.0.smithi082.stdout:7/763: rmdir d0/d50/dd2/d108 0 2024-09-17T01:41:47.825 INFO:tasks.workunit.client.0.smithi082.stdout:7/764: readlink d0/l1 0 2024-09-17T01:41:47.827 INFO:tasks.workunit.client.0.smithi082.stdout:1/802: dwrite d2/d3f/d24/db5/dec/dfc/dc6/fd8 [0,4194304] 0 2024-09-17T01:41:47.828 INFO:tasks.workunit.client.0.smithi082.stdout:9/595: truncate d4/d27/d36/fab 443833 0 2024-09-17T01:41:47.828 INFO:tasks.workunit.client.0.smithi082.stdout:1/803: readlink d2/d3f/d24/l5b 0 2024-09-17T01:41:47.832 INFO:tasks.workunit.client.0.smithi082.stdout:9/596: read d4/d27/d2d/d60/d11/d39/d31/f7a [24092,49355] 0 2024-09-17T01:41:47.833 INFO:tasks.workunit.client.0.smithi082.stdout:9/597: read - d4/f94 zero size 2024-09-17T01:41:47.835 INFO:tasks.workunit.client.0.smithi082.stdout:1/804: creat d2/d3f/d24/d54/f103 x:0 0 0 2024-09-17T01:41:47.841 INFO:tasks.workunit.client.0.smithi082.stdout:5/733: dread db/d56/fcd [0,4194304] 0 2024-09-17T01:41:47.841 INFO:tasks.workunit.client.0.smithi082.stdout:7/765: creat d0/d3/db/d10/d3f/d107/f10c x:0 0 0 2024-09-17T01:41:47.841 INFO:tasks.workunit.client.0.smithi082.stdout:7/766: stat d0/dd/d2c/lb3 0 2024-09-17T01:41:47.842 INFO:tasks.workunit.client.0.smithi082.stdout:7/767: fsync d0/d3/db/f18 0 2024-09-17T01:41:47.852 INFO:tasks.workunit.client.0.smithi082.stdout:7/768: link d0/d3/db/fc8 d0/d3/db/d10/d3f/d107/f10d 0 2024-09-17T01:41:47.861 INFO:tasks.workunit.client.0.smithi082.stdout:7/769: getdents d0/dd 0 2024-09-17T01:41:47.864 INFO:tasks.workunit.client.0.smithi082.stdout:7/770: creat d0/dd/f10e x:0 0 0 2024-09-17T01:41:47.868 INFO:tasks.workunit.client.0.smithi082.stdout:1/805: dread d2/d3f/d24/d54/f74 [0,4194304] 0 2024-09-17T01:41:47.922 INFO:tasks.workunit.client.0.smithi082.stdout:8/627: write d3/dd/d18/d34/f4f [1099713,107786] 0 2024-09-17T01:41:47.924 INFO:tasks.workunit.client.0.smithi082.stdout:8/628: write d3/dd/d18/d2d/d3b/f69 [1652529,104405] 0 2024-09-17T01:41:47.944 INFO:tasks.workunit.client.0.smithi082.stdout:9/598: dwrite d4/d27/d2d/d60/d11/d39/d29/d77/fa4 [0,4194304] 0 2024-09-17T01:41:47.946 INFO:tasks.workunit.client.0.smithi082.stdout:9/599: write d4/d27/d2d/d60/d11/d39/d29/fac [2523444,96192] 0 2024-09-17T01:41:47.952 INFO:tasks.workunit.client.0.smithi082.stdout:7/771: write d0/d3/db/fe [176518,13091] 0 2024-09-17T01:41:47.956 INFO:tasks.workunit.client.0.smithi082.stdout:1/806: write d2/df/f1d [3243165,76717] 0 2024-09-17T01:41:47.957 INFO:tasks.workunit.client.0.smithi082.stdout:7/772: dread d0/f23 [0,4194304] 0 2024-09-17T01:41:47.964 INFO:tasks.workunit.client.0.smithi082.stdout:1/807: dwrite d2/da/d76/d93/fb6 [0,4194304] 0 2024-09-17T01:41:47.965 INFO:tasks.workunit.client.0.smithi082.stdout:7/773: mkdir d0/dd/d34/d10f 0 2024-09-17T01:41:47.972 INFO:tasks.workunit.client.0.smithi082.stdout:7/774: creat d0/d3/db/d10/f110 x:0 0 0 2024-09-17T01:41:47.980 INFO:tasks.workunit.client.0.smithi082.stdout:8/629: write d3/fb [3011160,108022] 0 2024-09-17T01:41:47.986 INFO:tasks.workunit.client.0.smithi082.stdout:5/734: rename db/f19 to db/d56/d78/ff6 0 2024-09-17T01:41:47.987 INFO:tasks.workunit.client.0.smithi082.stdout:5/735: dread - db/d1e/d20/d30/fe0 zero size 2024-09-17T01:41:47.988 INFO:tasks.workunit.client.0.smithi082.stdout:9/600: rename d4/d27/d2d/d60/d11/f8a to d4/d59/d63/fc5 0 2024-09-17T01:41:47.989 INFO:tasks.workunit.client.0.smithi082.stdout:2/747: sync 2024-09-17T01:41:47.989 INFO:tasks.workunit.client.0.smithi082.stdout:6/713: sync 2024-09-17T01:41:47.989 INFO:tasks.workunit.client.0.smithi082.stdout:4/740: sync 2024-09-17T01:41:47.989 INFO:tasks.workunit.client.0.smithi082.stdout:2/748: stat d1/d17/c8e 0 2024-09-17T01:41:47.991 INFO:tasks.workunit.client.0.smithi082.stdout:7/775: truncate d0/d3/db/d10/d3f/f5d 375175 0 2024-09-17T01:41:47.991 INFO:tasks.workunit.client.0.smithi082.stdout:6/714: write d1/d7/d10/fee [280645,83704] 0 2024-09-17T01:41:48.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:47 smithi167 ceph-mon[35643]: pgmap v27: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 108 MiB/s rd, 265 MiB/s wr, 565 op/s 2024-09-17T01:41:48.011 INFO:tasks.workunit.client.0.smithi082.stdout:4/741: fdatasync d9/d15/d16/d18/d4a/faf 0 2024-09-17T01:41:48.014 INFO:tasks.workunit.client.0.smithi082.stdout:1/808: dwrite d2/d3f/d24/dcf/fd5 [0,4194304] 0 2024-09-17T01:41:48.014 INFO:tasks.workunit.client.0.smithi082.stdout:5/736: write db/d1e/f55 [121644,26103] 0 2024-09-17T01:41:48.015 INFO:tasks.workunit.client.0.smithi082.stdout:4/742: write d9/d15/d16/d18/f32 [5769605,101261] 0 2024-09-17T01:41:48.018 INFO:tasks.workunit.client.0.smithi082.stdout:1/809: write d2/da/d2d/f41 [448783,5649] 0 2024-09-17T01:41:48.020 INFO:tasks.workunit.client.0.smithi082.stdout:6/715: rmdir d1/d7/d10/d4f/dc/d1d/d36/d7a 39 2024-09-17T01:41:48.024 INFO:tasks.workunit.client.0.smithi082.stdout:2/749: creat d1/d17/ffa x:0 0 0 2024-09-17T01:41:48.027 INFO:tasks.workunit.client.0.smithi082.stdout:4/743: truncate d9/f46 109847 0 2024-09-17T01:41:48.035 INFO:tasks.workunit.client.0.smithi082.stdout:9/601: link d4/d27/d2d/d60/d11/d39/d44/cbf d4/d27/d95/cc6 0 2024-09-17T01:41:48.037 INFO:tasks.workunit.client.0.smithi082.stdout:5/737: creat db/d1e/d20/d30/dc6/dca/ff7 x:0 0 0 2024-09-17T01:41:48.038 INFO:tasks.workunit.client.0.smithi082.stdout:4/744: creat d9/d15/d16/d44/d84/fee x:0 0 0 2024-09-17T01:41:48.040 INFO:tasks.workunit.client.0.smithi082.stdout:4/745: dread d9/d15/d16/d44/d84/fb4 [0,4194304] 0 2024-09-17T01:41:48.053 INFO:tasks.workunit.client.0.smithi082.stdout:9/602: dread d4/d27/d21/f5a [0,4194304] 0 2024-09-17T01:41:48.054 INFO:tasks.workunit.client.0.smithi082.stdout:9/603: readlink d4/d27/d21/l89 0 2024-09-17T01:41:48.055 INFO:tasks.workunit.client.0.smithi082.stdout:5/738: symlink db/d1e/d20/lf8 0 2024-09-17T01:41:48.057 INFO:tasks.workunit.client.0.smithi082.stdout:1/810: getdents d2/d3f/d24/db5/dec/dfc/ddf 0 2024-09-17T01:41:48.058 INFO:tasks.workunit.client.0.smithi082.stdout:4/746: dread d9/d15/d16/d18/d4a/d8f/d91/f95 [4194304,4194304] 0 2024-09-17T01:41:48.058 INFO:tasks.workunit.client.0.smithi082.stdout:7/776: truncate d0/d3/db/d10/d3f/fcb 59771 0 2024-09-17T01:41:48.059 INFO:tasks.workunit.client.0.smithi082.stdout:6/716: dwrite d1/d7/f24 [0,4194304] 0 2024-09-17T01:41:48.059 INFO:tasks.workunit.client.0.smithi082.stdout:5/739: chown db/d2b/d59/c74 753 1 2024-09-17T01:41:48.060 INFO:tasks.workunit.client.0.smithi082.stdout:9/604: symlink d4/d27/d36/d3b/da9/lc7 0 2024-09-17T01:41:48.063 INFO:tasks.workunit.client.0.smithi082.stdout:9/605: stat d4/d27/d2d/d60/f34 0 2024-09-17T01:41:48.066 INFO:tasks.workunit.client.0.smithi082.stdout:4/747: mkdir d9/d15/d16/d3e/d54/def 0 2024-09-17T01:41:48.069 INFO:tasks.workunit.client.0.smithi082.stdout:7/777: dwrite d0/d62/d7e/dd7/ff5 [0,4194304] 0 2024-09-17T01:41:48.069 INFO:tasks.workunit.client.0.smithi082.stdout:6/717: rename d1/l28 to d1/d7/d10/d4f/dc/d1d/d2c/lf6 0 2024-09-17T01:41:48.071 INFO:tasks.workunit.client.0.smithi082.stdout:2/750: write d1/d5a/d6d/fe1 [202966,70696] 0 2024-09-17T01:41:48.071 INFO:tasks.workunit.client.0.smithi082.stdout:6/718: readlink d1/d7/d10/d4f/dc/d1d/d2c/l45 0 2024-09-17T01:41:48.073 INFO:tasks.workunit.client.0.smithi082.stdout:6/719: readlink d1/d1f/l25 0 2024-09-17T01:41:48.073 INFO:tasks.workunit.client.0.smithi082.stdout:5/740: getdents db/d56/d78/da0 0 2024-09-17T01:41:48.081 INFO:tasks.workunit.client.0.smithi082.stdout:2/751: fdatasync d1/d10/f14 0 2024-09-17T01:41:48.082 INFO:tasks.workunit.client.0.smithi082.stdout:6/720: dwrite d1/d7/f46 [0,4194304] 0 2024-09-17T01:41:48.088 INFO:tasks.workunit.client.0.smithi082.stdout:5/741: truncate db/d56/d29/d4f/f82 3704820 0 2024-09-17T01:41:48.090 INFO:tasks.workunit.client.0.smithi082.stdout:5/742: readlink db/d56/le3 0 2024-09-17T01:41:48.092 INFO:tasks.workunit.client.0.smithi082.stdout:1/811: dwrite d2/df/d46/f64 [0,4194304] 0 2024-09-17T01:41:48.093 INFO:tasks.workunit.client.0.smithi082.stdout:4/748: dread d9/d47/f79 [0,4194304] 0 2024-09-17T01:41:48.100 INFO:tasks.workunit.client.0.smithi082.stdout:5/743: dwrite db/d2b/fa2 [0,4194304] 0 2024-09-17T01:41:48.104 INFO:tasks.workunit.client.0.smithi082.stdout:9/606: dwrite d4/d27/d2d/d60/d11/d39/d44/f72 [0,4194304] 0 2024-09-17T01:41:48.109 INFO:tasks.workunit.client.0.smithi082.stdout:9/607: truncate d4/d27/d2d/d60/d11/d39/d44/fc0 455841 0 2024-09-17T01:41:48.116 INFO:tasks.workunit.client.0.smithi082.stdout:5/744: rmdir db/d56/d76 39 2024-09-17T01:41:48.118 INFO:tasks.workunit.client.0.smithi082.stdout:9/608: dwrite d4/d27/d2d/d60/d11/d8d/fb4 [0,4194304] 0 2024-09-17T01:41:48.121 INFO:tasks.workunit.client.0.smithi082.stdout:2/752: write d1/d66/d85/f93 [3354354,66476] 0 2024-09-17T01:41:48.122 INFO:tasks.workunit.client.0.smithi082.stdout:2/753: readlink d1/l4e 0 2024-09-17T01:41:48.123 INFO:tasks.workunit.client.0.smithi082.stdout:2/754: readlink d1/d5a/d6d/l8a 0 2024-09-17T01:41:48.128 INFO:tasks.workunit.client.0.smithi082.stdout:4/749: rename d9/f5b to d9/d15/d16/d3e/d54/dab/ff0 0 2024-09-17T01:41:48.129 INFO:tasks.workunit.client.0.smithi082.stdout:7/778: link d0/dd/d2c/d42/l90 d0/d3/db/d10/d3f/d107/l111 0 2024-09-17T01:41:48.135 INFO:tasks.workunit.client.0.smithi082.stdout:5/745: unlink db/c67 0 2024-09-17T01:41:48.137 INFO:tasks.workunit.client.0.smithi082.stdout:4/750: dwrite d9/d47/d9b/dd5/f92 [0,4194304] 0 2024-09-17T01:41:48.141 INFO:tasks.workunit.client.0.smithi082.stdout:9/609: creat d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/fc8 x:0 0 0 2024-09-17T01:41:48.144 INFO:tasks.workunit.client.0.smithi082.stdout:9/610: chown d4/d27/d2d/d60/d11/d39/d29/fac 161460869 1 2024-09-17T01:41:48.146 INFO:tasks.workunit.client.0.smithi082.stdout:6/721: dwrite d1/d3/f3b [0,4194304] 0 2024-09-17T01:41:48.147 INFO:tasks.workunit.client.0.smithi082.stdout:7/779: link d0/dd/d2c/lb3 d0/d3/db/d10/l112 0 2024-09-17T01:41:48.149 INFO:tasks.workunit.client.0.smithi082.stdout:7/780: dread - d0/d3/df4/f106 zero size 2024-09-17T01:41:48.151 INFO:tasks.workunit.client.0.smithi082.stdout:1/812: truncate d2/df/fce 525463 0 2024-09-17T01:41:48.153 INFO:tasks.workunit.client.0.smithi082.stdout:6/722: readlink d1/d7/d10/d4f/dc/d1d/d2c/lf6 0 2024-09-17T01:41:48.158 INFO:tasks.workunit.client.0.smithi082.stdout:7/781: creat d0/d3/db/d10/f113 x:0 0 0 2024-09-17T01:41:48.159 INFO:tasks.workunit.client.0.smithi082.stdout:7/782: write d0/d62/d7e/fd9 [3535244,119773] 0 2024-09-17T01:41:48.161 INFO:tasks.workunit.client.0.smithi082.stdout:1/813: truncate d2/da/d2d/d79/fd0 242062 0 2024-09-17T01:41:48.169 INFO:tasks.workunit.client.0.smithi082.stdout:7/783: readlink d0/d62/d7e/dd4/d37/l88 0 2024-09-17T01:41:48.169 INFO:tasks.workunit.client.0.smithi082.stdout:2/755: dwrite d1/d90/fb9 [0,4194304] 0 2024-09-17T01:41:48.173 INFO:tasks.workunit.client.0.smithi082.stdout:2/756: truncate d1/d17/fee 671511 0 2024-09-17T01:41:48.177 INFO:tasks.workunit.client.0.smithi082.stdout:5/746: fsync db/d56/d29/d4f/f82 0 2024-09-17T01:41:48.178 INFO:tasks.workunit.client.0.smithi082.stdout:7/784: dread d0/d62/d7e/dd7/ff5 [0,4194304] 0 2024-09-17T01:41:48.183 INFO:tasks.workunit.client.0.smithi082.stdout:4/751: dwrite d9/d15/d16/d3e/d73/f9d [0,4194304] 0 2024-09-17T01:41:48.184 INFO:tasks.workunit.client.0.smithi082.stdout:7/785: write d0/d3/db/d10/fa0 [418474,57981] 0 2024-09-17T01:41:48.186 INFO:tasks.workunit.client.0.smithi082.stdout:4/752: dread - d9/d15/d16/d18/d4a/d8f/d91/fde zero size 2024-09-17T01:41:48.189 INFO:tasks.workunit.client.0.smithi082.stdout:5/747: creat db/d56/d29/d4f/d8e/dbc/ff9 x:0 0 0 2024-09-17T01:41:48.189 INFO:tasks.workunit.client.0.smithi082.stdout:7/786: fsync d0/d3/f64 0 2024-09-17T01:41:48.192 INFO:tasks.workunit.client.0.smithi082.stdout:1/814: write d2/d3f/d24/f23 [4213171,94976] 0 2024-09-17T01:41:48.192 INFO:tasks.workunit.client.0.smithi082.stdout:5/748: write db/d56/d18/d23/f65 [4857860,8629] 0 2024-09-17T01:41:48.194 INFO:tasks.workunit.client.0.smithi082.stdout:4/753: mknod d9/d15/d16/d18/d4a/d8f/d91/de0/cf1 0 2024-09-17T01:41:48.195 INFO:tasks.workunit.client.0.smithi082.stdout:5/749: truncate db/d2b/d59/fea 529802 0 2024-09-17T01:41:48.196 INFO:tasks.workunit.client.0.smithi082.stdout:5/750: readlink db/d56/l13 0 2024-09-17T01:41:48.197 INFO:tasks.workunit.client.0.smithi082.stdout:6/723: dread d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fce [0,4194304] 0 2024-09-17T01:41:48.198 INFO:tasks.workunit.client.0.smithi082.stdout:7/787: creat d0/d62/d7e/dd4/d37/f114 x:0 0 0 2024-09-17T01:41:48.198 INFO:tasks.workunit.client.0.smithi082.stdout:2/757: write d1/d17/d60/dc6/de8/f9a [1636062,53138] 0 2024-09-17T01:41:48.199 INFO:tasks.workunit.client.0.smithi082.stdout:7/788: chown d0/dd/d34/d58 42357418 1 2024-09-17T01:41:48.202 INFO:tasks.workunit.client.0.smithi082.stdout:5/751: readlink db/d56/d18/lb1 0 2024-09-17T01:41:48.202 INFO:tasks.workunit.client.0.smithi082.stdout:5/752: chown db/d56/d78/f80 23 1 2024-09-17T01:41:48.204 INFO:tasks.workunit.client.0.smithi082.stdout:5/753: chown db/d56/d29/d4f/d8e/dbc/ff9 248 1 2024-09-17T01:41:48.204 INFO:tasks.workunit.client.0.smithi082.stdout:5/754: readlink db/d56/le3 0 2024-09-17T01:41:48.205 INFO:tasks.workunit.client.0.smithi082.stdout:5/755: fdatasync db/d56/dd6/fd8 0 2024-09-17T01:41:48.205 INFO:tasks.workunit.client.0.smithi082.stdout:2/758: mkdir d1/d35/dfb 0 2024-09-17T01:41:48.208 INFO:tasks.workunit.client.0.smithi082.stdout:1/815: getdents d2/da 0 2024-09-17T01:41:48.208 INFO:tasks.workunit.client.0.smithi082.stdout:7/789: creat d0/f115 x:0 0 0 2024-09-17T01:41:48.211 INFO:tasks.workunit.client.0.smithi082.stdout:2/759: truncate d1/d10/f86 4402154 0 2024-09-17T01:41:48.212 INFO:tasks.workunit.client.0.smithi082.stdout:2/760: chown d1/d35/db1/d9c/fb3 14268 1 2024-09-17T01:41:48.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:47 smithi082 ceph-mon[28077]: pgmap v27: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 108 MiB/s rd, 265 MiB/s wr, 565 op/s 2024-09-17T01:41:48.214 INFO:tasks.workunit.client.0.smithi082.stdout:2/761: write d1/d90/fb9 [4816511,4128] 0 2024-09-17T01:41:48.218 INFO:tasks.workunit.client.0.smithi082.stdout:0/721: sync 2024-09-17T01:41:48.218 INFO:tasks.workunit.client.0.smithi082.stdout:7/790: fdatasync d0/dd/f17 0 2024-09-17T01:41:48.219 INFO:tasks.workunit.client.0.smithi082.stdout:6/724: write d1/d1f/f64 [531752,1396] 0 2024-09-17T01:41:48.222 INFO:tasks.workunit.client.0.smithi082.stdout:5/756: dread db/d1e/d20/fac [0,4194304] 0 2024-09-17T01:41:48.223 INFO:tasks.workunit.client.0.smithi082.stdout:6/725: mknod d1/d1f/db0/cf7 0 2024-09-17T01:41:48.224 INFO:tasks.workunit.client.0.smithi082.stdout:6/726: chown d1/d7/d10/l22 1763 1 2024-09-17T01:41:48.225 INFO:tasks.workunit.client.0.smithi082.stdout:4/754: dread d9/d15/d16/d18/f38 [0,4194304] 0 2024-09-17T01:41:48.275 INFO:tasks.workunit.client.0.smithi082.stdout:2/762: symlink d1/d17/d29/lfc 0 2024-09-17T01:41:48.276 INFO:tasks.workunit.client.0.smithi082.stdout:2/763: readlink d1/d17/lb2 0 2024-09-17T01:41:48.278 INFO:tasks.workunit.client.0.smithi082.stdout:5/757: chown db/d1e/f52 10 1 2024-09-17T01:41:48.279 INFO:tasks.workunit.client.0.smithi082.stdout:6/727: mknod d1/d3/cf8 0 2024-09-17T01:41:48.282 INFO:tasks.workunit.client.0.smithi082.stdout:0/722: write da/d1b/f7d [1150359,80142] 0 2024-09-17T01:41:48.282 INFO:tasks.workunit.client.0.smithi082.stdout:4/755: stat d9/f46 0 2024-09-17T01:41:48.282 INFO:tasks.workunit.client.0.smithi082.stdout:1/816: dread d2/d3f/f5a [0,4194304] 0 2024-09-17T01:41:48.283 INFO:tasks.workunit.client.0.smithi082.stdout:0/723: fsync da/df/d27/fc9 0 2024-09-17T01:41:48.286 INFO:tasks.workunit.client.0.smithi082.stdout:5/758: dread - db/d1e/d5b/d83/f89 zero size 2024-09-17T01:41:48.290 INFO:tasks.workunit.client.0.smithi082.stdout:6/728: creat d1/d7/d10/d4f/dc/d2b/db2/ff9 x:0 0 0 2024-09-17T01:41:48.290 INFO:tasks.workunit.client.0.smithi082.stdout:2/764: dread d1/d35/f65 [0,4194304] 0 2024-09-17T01:41:48.291 INFO:tasks.workunit.client.0.smithi082.stdout:7/791: truncate d0/dd/d34/d58/d6e/d8a/fe3 1699435 0 2024-09-17T01:41:48.293 INFO:tasks.workunit.client.0.smithi082.stdout:1/817: fsync d2/df/fab 0 2024-09-17T01:41:48.294 INFO:tasks.workunit.client.0.smithi082.stdout:0/724: unlink da/df/d71/d92/df7/l37 0 2024-09-17T01:41:48.295 INFO:tasks.workunit.client.0.smithi082.stdout:5/759: truncate db/d56/d29/f7e 1707815 0 2024-09-17T01:41:48.297 INFO:tasks.workunit.client.0.smithi082.stdout:7/792: rmdir d0/dd/d34 39 2024-09-17T01:41:48.306 INFO:tasks.workunit.client.0.smithi082.stdout:6/729: write d1/d3/f75 [1127948,15906] 0 2024-09-17T01:41:48.308 INFO:tasks.workunit.client.0.smithi082.stdout:0/725: unlink da/df/d2b/d59/d6f/dd9/fe6 0 2024-09-17T01:41:48.310 INFO:tasks.workunit.client.0.smithi082.stdout:5/760: creat db/d56/d29/d4f/ffa x:0 0 0 2024-09-17T01:41:48.315 INFO:tasks.workunit.client.0.smithi082.stdout:6/730: dwrite d1/d7/d10/fee [0,4194304] 0 2024-09-17T01:41:48.316 INFO:tasks.workunit.client.0.smithi082.stdout:2/765: dwrite d1/d17/d38/d5c/f64 [4194304,4194304] 0 2024-09-17T01:41:48.320 INFO:tasks.workunit.client.0.smithi082.stdout:1/818: creat d2/d3f/d24/db5/dec/dfc/ddf/dff/f104 x:0 0 0 2024-09-17T01:41:48.328 INFO:tasks.workunit.client.0.smithi082.stdout:7/793: truncate d0/dd/d34/fc5 11385 0 2024-09-17T01:41:48.328 INFO:tasks.workunit.client.0.smithi082.stdout:4/756: link d9/d15/d16/c7f d9/d15/cf2 0 2024-09-17T01:41:48.329 INFO:tasks.workunit.client.0.smithi082.stdout:4/757: chown d9/d15/d16/d3e/d54/def 47311 1 2024-09-17T01:41:48.330 INFO:tasks.workunit.client.0.smithi082.stdout:0/726: read da/df/d2b/d59/f73 [69040,45574] 0 2024-09-17T01:41:48.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/766: rename d1/d17/d38/d42/d52/d78/df1 to d1/d17/d38/d42/d52/d78/da0/dba/dfd 0 2024-09-17T01:41:48.333 INFO:tasks.workunit.client.0.smithi082.stdout:5/761: fsync db/d56/d29/d4f/f53 0 2024-09-17T01:41:48.335 INFO:tasks.workunit.client.0.smithi082.stdout:7/794: mkdir d0/dd/d34/d58/d116 0 2024-09-17T01:41:48.336 INFO:tasks.workunit.client.0.smithi082.stdout:4/758: mknod d9/d15/d16/d18/d4a/d8f/cf3 0 2024-09-17T01:41:48.345 INFO:tasks.workunit.client.0.smithi082.stdout:7/795: mkdir d0/d50/dd2/d117 0 2024-09-17T01:41:48.346 INFO:tasks.workunit.client.0.smithi082.stdout:2/767: mkdir d1/d35/db1/ddf/dfe 0 2024-09-17T01:41:48.348 INFO:tasks.workunit.client.0.smithi082.stdout:1/819: dread d2/d3f/d24/db5/dec/dfc/da3/fe5 [0,4194304] 0 2024-09-17T01:41:48.348 INFO:tasks.workunit.client.0.smithi082.stdout:2/768: write d1/d17/d60/dc6/de8/f9a [2626371,33753] 0 2024-09-17T01:41:48.348 INFO:tasks.workunit.client.0.smithi082.stdout:5/762: unlink db/d1e/c75 0 2024-09-17T01:41:48.350 INFO:tasks.workunit.client.0.smithi082.stdout:6/731: getdents d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf 0 2024-09-17T01:41:48.354 INFO:tasks.workunit.client.0.smithi082.stdout:4/759: mknod d9/cf4 0 2024-09-17T01:41:48.358 INFO:tasks.workunit.client.0.smithi082.stdout:1/820: creat d2/d3f/d24/db5/f105 x:0 0 0 2024-09-17T01:41:48.366 INFO:tasks.workunit.client.0.smithi082.stdout:2/769: symlink d1/d17/d29/ddc/lff 0 2024-09-17T01:41:48.366 INFO:tasks.workunit.client.0.smithi082.stdout:7/796: dwrite d0/dd/fa2 [0,4194304] 0 2024-09-17T01:41:48.368 INFO:tasks.workunit.client.0.smithi082.stdout:7/797: stat d0/d3/db/d10/fb0 0 2024-09-17T01:41:48.369 INFO:tasks.workunit.client.0.smithi082.stdout:7/798: readlink d0/d3/db/l4e 0 2024-09-17T01:41:48.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/727: dwrite da/df/d2b/d9a/f9b [4194304,4194304] 0 2024-09-17T01:41:48.379 INFO:tasks.workunit.client.0.smithi082.stdout:7/799: creat d0/d3/db/d10/d3f/f118 x:0 0 0 2024-09-17T01:41:48.382 INFO:tasks.workunit.client.0.smithi082.stdout:5/763: write db/d56/f35 [4281632,114123] 0 2024-09-17T01:41:48.383 INFO:tasks.workunit.client.0.smithi082.stdout:6/732: getdents d1/d3 0 2024-09-17T01:41:48.387 INFO:tasks.workunit.client.0.smithi082.stdout:7/800: mknod d0/d3/db/d10/d3f/d107/c119 0 2024-09-17T01:41:48.389 INFO:tasks.workunit.client.0.smithi082.stdout:4/760: dwrite d9/d15/d16/d3e/f94 [0,4194304] 0 2024-09-17T01:41:48.394 INFO:tasks.workunit.client.0.smithi082.stdout:0/728: creat da/d1b/d23/d4d/f102 x:0 0 0 2024-09-17T01:41:48.394 INFO:tasks.workunit.client.0.smithi082.stdout:2/770: write d1/d17/d38/f99 [2328204,118384] 0 2024-09-17T01:41:48.397 INFO:tasks.workunit.client.0.smithi082.stdout:1/821: dwrite d2/d3f/d34/fdd [0,4194304] 0 2024-09-17T01:41:48.402 INFO:tasks.workunit.client.0.smithi082.stdout:6/733: fsync d1/d1f/fe1 0 2024-09-17T01:41:48.404 INFO:tasks.workunit.client.0.smithi082.stdout:4/761: symlink d9/d47/dc2/dda/lf5 0 2024-09-17T01:41:48.406 INFO:tasks.workunit.client.0.smithi082.stdout:1/822: rmdir d2/da/d76 39 2024-09-17T01:41:48.409 INFO:tasks.workunit.client.0.smithi082.stdout:5/764: creat db/d2b/ffb x:0 0 0 2024-09-17T01:41:48.410 INFO:tasks.workunit.client.0.smithi082.stdout:5/765: read db/d2b/fa2 [3896558,47686] 0 2024-09-17T01:41:48.410 INFO:tasks.workunit.client.0.smithi082.stdout:6/734: fsync d1/d7/d10/d4f/d32/f3f 0 2024-09-17T01:41:48.413 INFO:tasks.workunit.client.0.smithi082.stdout:1/823: creat d2/d3f/d24/db5/dec/dfc/ddf/dff/f106 x:0 0 0 2024-09-17T01:41:48.419 INFO:tasks.workunit.client.0.smithi082.stdout:0/729: creat da/d1b/d23/d4d/f103 x:0 0 0 2024-09-17T01:41:48.419 INFO:tasks.workunit.client.0.smithi082.stdout:0/730: chown da/d1b/f7e 12788 1 2024-09-17T01:41:48.422 INFO:tasks.workunit.client.0.smithi082.stdout:5/766: fdatasync db/d1e/d5b/d83/f89 0 2024-09-17T01:41:48.424 INFO:tasks.workunit.client.0.smithi082.stdout:5/767: chown db/f5a 618 1 2024-09-17T01:41:48.427 INFO:tasks.workunit.client.0.smithi082.stdout:7/801: link d0/dd/d2c/d54/f5a d0/d62/dce/f11a 0 2024-09-17T01:41:48.427 INFO:tasks.workunit.client.0.smithi082.stdout:4/762: dwrite d9/d47/dc2/dda/f66 [0,4194304] 0 2024-09-17T01:41:48.428 INFO:tasks.workunit.client.0.smithi082.stdout:7/802: chown d0/d50/ced 2 1 2024-09-17T01:41:48.431 INFO:tasks.workunit.client.0.smithi082.stdout:0/731: stat da/d1b/d23/d4d/c34 0 2024-09-17T01:41:48.436 INFO:tasks.workunit.client.0.smithi082.stdout:5/768: creat db/d56/dd6/ffc x:0 0 0 2024-09-17T01:41:48.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/735: dwrite d1/f63 [0,4194304] 0 2024-09-17T01:41:48.438 INFO:tasks.workunit.client.0.smithi082.stdout:4/763: creat d9/d15/d16/d18/ff6 x:0 0 0 2024-09-17T01:41:48.440 INFO:tasks.workunit.client.0.smithi082.stdout:0/732: symlink da/df/d2b/l104 0 2024-09-17T01:41:48.442 INFO:tasks.workunit.client.0.smithi082.stdout:1/824: unlink d2/da/cb1 0 2024-09-17T01:41:48.442 INFO:tasks.workunit.client.0.smithi082.stdout:0/733: chown da/d1b/d23/d4d/f102 7 1 2024-09-17T01:41:48.446 INFO:tasks.workunit.client.0.smithi082.stdout:0/734: unlink da/df/d2b/la3 0 2024-09-17T01:41:48.447 INFO:tasks.workunit.client.0.smithi082.stdout:0/735: fdatasync da/d1b/f7d 0 2024-09-17T01:41:48.451 INFO:tasks.workunit.client.0.smithi082.stdout:5/769: link db/d56/d18/f4a db/d56/d29/d4f/d8e/ddc/ffd 0 2024-09-17T01:41:48.453 INFO:tasks.workunit.client.0.smithi082.stdout:1/825: unlink d2/da/d16/f8f 0 2024-09-17T01:41:48.455 INFO:tasks.workunit.client.0.smithi082.stdout:0/736: mknod da/df/d2b/d59/d6f/dd9/c105 0 2024-09-17T01:41:48.456 INFO:tasks.workunit.client.0.smithi082.stdout:4/764: dread d9/d15/d16/f36 [0,4194304] 0 2024-09-17T01:41:48.457 INFO:tasks.workunit.client.0.smithi082.stdout:0/737: write da/df/d71/d92/df7/f81 [1239247,126260] 0 2024-09-17T01:41:48.457 INFO:tasks.workunit.client.0.smithi082.stdout:4/765: stat d9/d47/dc2/dda/f66 0 2024-09-17T01:41:48.458 INFO:tasks.workunit.client.0.smithi082.stdout:5/770: mknod db/d1e/d5b/cfe 0 2024-09-17T01:41:48.463 INFO:tasks.workunit.client.0.smithi082.stdout:0/738: dread da/df/d27/fc8 [0,4194304] 0 2024-09-17T01:41:48.465 INFO:tasks.workunit.client.0.smithi082.stdout:1/826: dread d2/da/f35 [0,4194304] 0 2024-09-17T01:41:48.465 INFO:tasks.workunit.client.0.smithi082.stdout:6/736: write d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e [1264091,24622] 0 2024-09-17T01:41:48.466 INFO:tasks.workunit.client.0.smithi082.stdout:4/766: dread d9/fd [4194304,4194304] 0 2024-09-17T01:41:48.468 INFO:tasks.workunit.client.0.smithi082.stdout:0/739: dread - da/df/d2b/d9a/fee zero size 2024-09-17T01:41:48.469 INFO:tasks.workunit.client.0.smithi082.stdout:5/771: dwrite db/d56/fd7 [0,4194304] 0 2024-09-17T01:41:48.471 INFO:tasks.workunit.client.0.smithi082.stdout:5/772: chown db/d56/d29/f6a 15038725 1 2024-09-17T01:41:48.475 INFO:tasks.workunit.client.0.smithi082.stdout:6/737: mknod d1/d1f/da7/ddd/df1/df4/cfa 0 2024-09-17T01:41:48.479 INFO:tasks.workunit.client.0.smithi082.stdout:4/767: write d9/f14 [844127,94776] 0 2024-09-17T01:41:48.481 INFO:tasks.workunit.client.0.smithi082.stdout:0/740: creat da/d1b/d23/dea/f106 x:0 0 0 2024-09-17T01:41:48.483 INFO:tasks.workunit.client.0.smithi082.stdout:6/738: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/f73 [0,4194304] 0 2024-09-17T01:41:48.485 INFO:tasks.workunit.client.0.smithi082.stdout:4/768: mknod d9/d47/dc2/dda/cf7 0 2024-09-17T01:41:48.488 INFO:tasks.workunit.client.0.smithi082.stdout:0/741: symlink da/d1b/d23/d4d/l107 0 2024-09-17T01:41:48.491 INFO:tasks.workunit.client.0.smithi082.stdout:5/773: dwrite db/d1e/d20/f9b [0,4194304] 0 2024-09-17T01:41:48.493 INFO:tasks.workunit.client.0.smithi082.stdout:6/739: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/lfb 0 2024-09-17T01:41:48.495 INFO:tasks.workunit.client.0.smithi082.stdout:6/740: chown d1/d1f/fc3 8149976 1 2024-09-17T01:41:48.496 INFO:tasks.workunit.client.0.smithi082.stdout:0/742: mknod da/df/d2b/d59/d6f/da6/c108 0 2024-09-17T01:41:48.497 INFO:tasks.workunit.client.0.smithi082.stdout:6/741: stat d1/d7/l17 0 2024-09-17T01:41:48.497 INFO:tasks.workunit.client.0.smithi082.stdout:4/769: dwrite d9/d47/dc2/dda/f66 [0,4194304] 0 2024-09-17T01:41:48.499 INFO:tasks.workunit.client.0.smithi082.stdout:0/743: truncate da/df/d2b/d9a/ff5 73569 0 2024-09-17T01:41:48.504 INFO:tasks.workunit.client.0.smithi082.stdout:5/774: rename db/d1e/d5b/l84 to db/d1e/d20/d4d/lff 0 2024-09-17T01:41:48.508 INFO:tasks.workunit.client.0.smithi082.stdout:0/744: mkdir da/d1b/d109 0 2024-09-17T01:41:48.509 INFO:tasks.workunit.client.0.smithi082.stdout:4/770: symlink d9/lf8 0 2024-09-17T01:41:48.510 INFO:tasks.workunit.client.0.smithi082.stdout:0/745: write da/d1b/d23/d42/d43/d6b/ffc [688115,35130] 0 2024-09-17T01:41:48.512 INFO:tasks.workunit.client.0.smithi082.stdout:4/771: fdatasync d9/d15/d16/d44/d84/fb4 0 2024-09-17T01:41:48.513 INFO:tasks.workunit.client.0.smithi082.stdout:4/772: dread - d9/d47/d9b/fdb zero size 2024-09-17T01:41:48.516 INFO:tasks.workunit.client.0.smithi082.stdout:4/773: creat d9/d15/d16/d3e/d73/ff9 x:0 0 0 2024-09-17T01:41:48.519 INFO:tasks.workunit.client.0.smithi082.stdout:0/746: rmdir da/d1b/d23/d42/d43/dfe 0 2024-09-17T01:41:48.520 INFO:tasks.workunit.client.0.smithi082.stdout:0/747: dread da/df/d27/fc8 [0,4194304] 0 2024-09-17T01:41:48.522 INFO:tasks.workunit.client.0.smithi082.stdout:0/748: chown da/d1b/d23/d42/cab 84916 1 2024-09-17T01:41:48.525 INFO:tasks.workunit.client.0.smithi082.stdout:0/749: symlink da/d1b/d23/d4d/dd7/l10a 0 2024-09-17T01:41:48.526 INFO:tasks.workunit.client.0.smithi082.stdout:0/750: readlink da/d80/d99/la5 0 2024-09-17T01:41:48.527 INFO:tasks.workunit.client.0.smithi082.stdout:6/742: write d1/d7/d10/f4a [1519153,48435] 0 2024-09-17T01:41:48.528 INFO:tasks.workunit.client.0.smithi082.stdout:6/743: readlink d1/d1f/l25 0 2024-09-17T01:41:48.528 INFO:tasks.workunit.client.0.smithi082.stdout:5/775: write fa [4969391,55595] 0 2024-09-17T01:41:48.529 INFO:tasks.workunit.client.0.smithi082.stdout:6/744: readlink d1/d7/d10/d4f/dc/l8a 0 2024-09-17T01:41:48.529 INFO:tasks.workunit.client.0.smithi082.stdout:0/751: mknod da/c10b 0 2024-09-17T01:41:48.530 INFO:tasks.workunit.client.0.smithi082.stdout:0/752: dread - da/df/d27/fc9 zero size 2024-09-17T01:41:48.531 INFO:tasks.workunit.client.0.smithi082.stdout:0/753: stat da/df/d27/c32 0 2024-09-17T01:41:48.532 INFO:tasks.workunit.client.0.smithi082.stdout:6/745: readlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/lf2 0 2024-09-17T01:41:48.532 INFO:tasks.workunit.client.0.smithi082.stdout:0/754: fdatasync da/df/d27/db5/f8e 0 2024-09-17T01:41:48.533 INFO:tasks.workunit.client.0.smithi082.stdout:6/746: chown d1/d7/d10/d4f/dc/f77 24758 1 2024-09-17T01:41:48.534 INFO:tasks.workunit.client.0.smithi082.stdout:6/747: dread - d1/d7/d10/d4f/dc/d1d/d36/d7a/fc8 zero size 2024-09-17T01:41:48.535 INFO:tasks.workunit.client.0.smithi082.stdout:4/774: write d9/d15/d16/d18/d4a/d8f/fa8 [1177103,23549] 0 2024-09-17T01:41:48.544 INFO:tasks.workunit.client.0.smithi082.stdout:4/775: truncate d9/d15/f1e 359401 0 2024-09-17T01:41:48.545 INFO:tasks.workunit.client.0.smithi082.stdout:0/755: creat da/d1b/d23/d42/d43/f10c x:0 0 0 2024-09-17T01:41:48.547 INFO:tasks.workunit.client.0.smithi082.stdout:6/748: creat d1/d7/d10/d4f/d8e/da8/ffc x:0 0 0 2024-09-17T01:41:48.549 INFO:tasks.workunit.client.0.smithi082.stdout:0/756: mknod da/df/d71/d92/df7/dbe/c10d 0 2024-09-17T01:41:48.555 INFO:tasks.workunit.client.0.smithi082.stdout:6/749: fdatasync d1/f98 0 2024-09-17T01:41:48.557 INFO:tasks.workunit.client.0.smithi082.stdout:0/757: dwrite da/d1b/d23/d4d/dd7/ff9 [0,4194304] 0 2024-09-17T01:41:48.559 INFO:tasks.workunit.client.0.smithi082.stdout:0/758: chown da/df/d2b/d59/d6f/f87 77153 1 2024-09-17T01:41:48.566 INFO:tasks.workunit.client.0.smithi082.stdout:6/750: fdatasync d1/d7/d10/f8c 0 2024-09-17T01:41:48.568 INFO:tasks.workunit.client.0.smithi082.stdout:4/776: dwrite d9/d15/d16/d18/d4a/d8f/d91/fa6 [0,4194304] 0 2024-09-17T01:41:48.573 INFO:tasks.workunit.client.0.smithi082.stdout:4/777: read d9/d15/d16/d18/d4a/f83 [1424470,607] 0 2024-09-17T01:41:48.580 INFO:tasks.workunit.client.0.smithi082.stdout:0/759: dwrite da/d1b/d23/d4d/f75 [0,4194304] 0 2024-09-17T01:41:48.580 INFO:tasks.workunit.client.0.smithi082.stdout:4/778: mkdir d9/d15/d16/dfa 0 2024-09-17T01:41:48.584 INFO:tasks.workunit.client.0.smithi082.stdout:6/751: dwrite d1/d1f/fba [0,4194304] 0 2024-09-17T01:41:48.584 INFO:tasks.workunit.client.0.smithi082.stdout:4/779: dread - d9/d15/d16/d3e/d73/fa2 zero size 2024-09-17T01:41:48.585 INFO:tasks.workunit.client.0.smithi082.stdout:0/760: fsync da/df/d2b/f85 0 2024-09-17T01:41:48.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/780: chown d9/d15/d37/fcf 52223966 1 2024-09-17T01:41:48.587 INFO:tasks.workunit.client.0.smithi082.stdout:0/761: read da/df/d2b/f85 [190890,120128] 0 2024-09-17T01:41:48.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/762: chown da/d1b/f52 202594229 1 2024-09-17T01:41:48.590 INFO:tasks.workunit.client.0.smithi082.stdout:0/763: write da/d1b/d23/f63 [1402003,114894] 0 2024-09-17T01:41:48.591 INFO:tasks.workunit.client.0.smithi082.stdout:4/781: truncate d9/d15/d16/d18/d4a/f83 1465856 0 2024-09-17T01:41:48.591 INFO:tasks.workunit.client.0.smithi082.stdout:0/764: chown da/d80 788480 1 2024-09-17T01:41:48.593 INFO:tasks.workunit.client.0.smithi082.stdout:6/752: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/ffd x:0 0 0 2024-09-17T01:41:48.595 INFO:tasks.workunit.client.0.smithi082.stdout:0/765: creat da/df/df4/f10e x:0 0 0 2024-09-17T01:41:48.596 INFO:tasks.workunit.client.0.smithi082.stdout:4/782: symlink d9/d15/d16/d18/d4f/db1/lfb 0 2024-09-17T01:41:48.596 INFO:tasks.workunit.client.0.smithi082.stdout:0/766: write da/d1b/d23/d42/d43/d6b/ffc [1615586,90195] 0 2024-09-17T01:41:48.600 INFO:tasks.workunit.client.0.smithi082.stdout:0/767: creat da/df/d2b/d59/d6f/f10f x:0 0 0 2024-09-17T01:41:48.603 INFO:tasks.workunit.client.0.smithi082.stdout:6/753: rename d1/d7/d10/fc9 to d1/d7/ffe 0 2024-09-17T01:41:48.604 INFO:tasks.workunit.client.0.smithi082.stdout:0/768: dread da/d1b/d23/d4d/fed [0,4194304] 0 2024-09-17T01:41:48.605 INFO:tasks.workunit.client.0.smithi082.stdout:4/783: getdents d9/d47/dc2 0 2024-09-17T01:41:48.610 INFO:tasks.workunit.client.0.smithi082.stdout:4/784: link d9/d15/f6b d9/d15/d16/d18/d4f/ffc 0 2024-09-17T01:41:48.613 INFO:tasks.workunit.client.0.smithi082.stdout:4/785: truncate d9/d15/d16/d3e/d54/fd9 971199 0 2024-09-17T01:41:48.618 INFO:tasks.workunit.client.0.smithi082.stdout:6/754: write d1/fdb [547242,110561] 0 2024-09-17T01:41:48.622 INFO:tasks.workunit.client.0.smithi082.stdout:4/786: rmdir d9/d15/d16/d18/d4a/d52/d55/de9 0 2024-09-17T01:41:48.623 INFO:tasks.workunit.client.0.smithi082.stdout:6/755: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/dff 0 2024-09-17T01:41:48.624 INFO:tasks.workunit.client.0.smithi082.stdout:6/756: write d1/d7/ff5 [381496,105390] 0 2024-09-17T01:41:48.625 INFO:tasks.workunit.client.0.smithi082.stdout:6/757: dread - d1/d7/d10/d4f/d32/f97 zero size 2024-09-17T01:41:48.626 INFO:tasks.workunit.client.0.smithi082.stdout:4/787: creat d9/dbd/ffd x:0 0 0 2024-09-17T01:41:48.627 INFO:tasks.workunit.client.0.smithi082.stdout:6/758: chown d1/d7/d10/d4f/dc/d1d/d36/f91 25135455 1 2024-09-17T01:41:48.633 INFO:tasks.workunit.client.0.smithi082.stdout:4/788: dwrite d9/d15/d16/d18/d4a/d52/f82 [4194304,4194304] 0 2024-09-17T01:41:48.635 INFO:tasks.workunit.client.0.smithi082.stdout:6/759: creat d1/d7/d10/d4f/dc/d1d/d36/f100 x:0 0 0 2024-09-17T01:41:48.641 INFO:tasks.workunit.client.0.smithi082.stdout:4/789: dwrite d9/d15/d16/d3e/d54/dab/fd1 [0,4194304] 0 2024-09-17T01:41:48.645 INFO:tasks.workunit.client.0.smithi082.stdout:4/790: truncate d9/f46 59028 0 2024-09-17T01:41:48.646 INFO:tasks.workunit.client.0.smithi082.stdout:4/791: write d9/d15/d16/d18/ff6 [251739,1819] 0 2024-09-17T01:41:48.654 INFO:tasks.workunit.client.0.smithi082.stdout:6/760: dwrite d1/fd5 [0,4194304] 0 2024-09-17T01:41:48.656 INFO:tasks.workunit.client.0.smithi082.stdout:6/761: dread - d1/d1f/db0/fd0 zero size 2024-09-17T01:41:48.658 INFO:tasks.workunit.client.0.smithi082.stdout:6/762: dread - d1/d7/d10/d4f/dc/d1d/d36/f100 zero size 2024-09-17T01:41:48.659 INFO:tasks.workunit.client.0.smithi082.stdout:6/763: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/ffd zero size 2024-09-17T01:41:48.670 INFO:tasks.workunit.client.0.smithi082.stdout:4/792: truncate d9/d15/d16/d18/ff6 206214 0 2024-09-17T01:41:48.676 INFO:tasks.workunit.client.0.smithi082.stdout:4/793: dwrite d9/d15/d16/d18/f3a [0,4194304] 0 2024-09-17T01:41:48.697 INFO:tasks.workunit.client.0.smithi082.stdout:6/764: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101 0 2024-09-17T01:41:48.705 INFO:tasks.workunit.client.0.smithi082.stdout:6/765: mknod d1/d3/c102 0 2024-09-17T01:41:48.709 INFO:tasks.workunit.client.0.smithi082.stdout:6/766: dwrite d1/d7/d10/d4f/dc/d1d/d36/d56/f7d [0,4194304] 0 2024-09-17T01:41:48.711 INFO:tasks.workunit.client.0.smithi082.stdout:6/767: chown d1/d7/d10/d4f/dc/d1d/cd1 0 1 2024-09-17T01:41:48.717 INFO:tasks.workunit.client.0.smithi082.stdout:6/768: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/fca 876369 0 2024-09-17T01:41:48.718 INFO:tasks.workunit.client.0.smithi082.stdout:6/769: stat d1/d7/d10/d4f/dc/d1d/d36/d56 0 2024-09-17T01:41:48.724 INFO:tasks.workunit.client.0.smithi082.stdout:6/770: link d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/c90 d1/d1f/da7/c103 0 2024-09-17T01:41:48.730 INFO:tasks.workunit.client.0.smithi082.stdout:6/771: dwrite d1/d7/d10/f9f [4194304,4194304] 0 2024-09-17T01:41:48.733 INFO:tasks.workunit.client.0.smithi082.stdout:4/794: dwrite d9/d15/d37/f90 [0,4194304] 0 2024-09-17T01:41:48.739 INFO:tasks.workunit.client.0.smithi082.stdout:6/772: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/d104 0 2024-09-17T01:41:48.742 INFO:tasks.workunit.client.0.smithi082.stdout:4/795: creat d9/ddf/ffe x:0 0 0 2024-09-17T01:41:48.744 INFO:tasks.workunit.client.0.smithi082.stdout:6/773: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/f105 x:0 0 0 2024-09-17T01:41:48.744 INFO:tasks.workunit.client.0.smithi082.stdout:6/774: fsync d1/d1f/f64 0 2024-09-17T01:41:48.745 INFO:tasks.workunit.client.0.smithi082.stdout:4/796: creat d9/d15/d16/d18/d4a/d52/d55/d48/fff x:0 0 0 2024-09-17T01:41:48.746 INFO:tasks.workunit.client.0.smithi082.stdout:6/775: fsync d1/d7/d10/d4f/dc/d1d/d36/f91 0 2024-09-17T01:41:48.848 INFO:tasks.workunit.client.0.smithi082.stdout:4/797: creat d9/d15/d16/d3e/d54/dab/f100 x:0 0 0 2024-09-17T01:41:48.851 INFO:tasks.workunit.client.0.smithi082.stdout:6/776: dread d1/d7/d10/d4f/dc/d2b/d48/f76 [0,4194304] 0 2024-09-17T01:41:48.853 INFO:tasks.workunit.client.0.smithi082.stdout:6/777: stat d1/d7/d10/d4f/dc/f88 0 2024-09-17T01:41:48.853 INFO:tasks.workunit.client.0.smithi082.stdout:4/798: dread d9/d47/d9b/dd5/f92 [0,4194304] 0 2024-09-17T01:41:48.854 INFO:tasks.workunit.client.0.smithi082.stdout:6/778: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/fc0 zero size 2024-09-17T01:41:48.890 INFO:tasks.workunit.client.0.smithi082.stdout:4/799: unlink d9/d15/d16/d3e/d73/ff9 0 2024-09-17T01:41:48.892 INFO:tasks.workunit.client.0.smithi082.stdout:4/800: mknod d9/c101 0 2024-09-17T01:41:48.894 INFO:tasks.workunit.client.0.smithi082.stdout:6/779: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/l106 0 2024-09-17T01:41:48.895 INFO:tasks.workunit.client.0.smithi082.stdout:4/801: rename d9/d15/lc3 to d9/d47/l102 0 2024-09-17T01:41:48.896 INFO:tasks.workunit.client.0.smithi082.stdout:6/780: read - d1/d7/d10/d4f/dc/f77 zero size 2024-09-17T01:41:48.898 INFO:tasks.workunit.client.0.smithi082.stdout:4/802: creat d9/d47/d9b/dd5/ddd/f103 x:0 0 0 2024-09-17T01:41:48.899 INFO:tasks.workunit.client.0.smithi082.stdout:4/803: mkdir d9/d47/d9b/d104 0 2024-09-17T01:41:48.903 INFO:tasks.workunit.client.0.smithi082.stdout:6/781: dwrite d1/d7/d10/d4f/d32/f9b [4194304,4194304] 0 2024-09-17T01:41:48.905 INFO:tasks.workunit.client.0.smithi082.stdout:4/804: unlink d9/d15/d16/d18/d4a/d52/f82 0 2024-09-17T01:41:48.907 INFO:tasks.workunit.client.0.smithi082.stdout:4/805: chown d9/d15/d16/d18/d4a/d52/f6a 1728 1 2024-09-17T01:41:48.909 INFO:tasks.workunit.client.0.smithi082.stdout:6/782: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/f107 x:0 0 0 2024-09-17T01:41:48.910 INFO:tasks.workunit.client.0.smithi082.stdout:4/806: creat d9/d15/d16/d18/d4a/d8f/f105 x:0 0 0 2024-09-17T01:41:48.912 INFO:tasks.workunit.client.0.smithi082.stdout:6/783: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/l108 0 2024-09-17T01:41:48.914 INFO:tasks.workunit.client.0.smithi082.stdout:4/807: link d9/d15/d16/d18/fe6 d9/dbd/f106 0 2024-09-17T01:41:48.916 INFO:tasks.workunit.client.0.smithi082.stdout:6/784: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/fac to d1/d1f/db0/f109 0 2024-09-17T01:41:48.921 INFO:tasks.workunit.client.0.smithi082.stdout:4/808: dwrite d9/d15/f6f [0,4194304] 0 2024-09-17T01:41:48.926 INFO:tasks.workunit.client.0.smithi082.stdout:4/809: dread d9/d15/d16/d3e/d54/fd9 [0,4194304] 0 2024-09-17T01:41:48.930 INFO:tasks.workunit.client.0.smithi082.stdout:4/810: dread d9/d15/d16/d3e/f50 [4194304,4194304] 0 2024-09-17T01:41:48.937 INFO:tasks.workunit.client.0.smithi082.stdout:4/811: dwrite d9/d15/d37/d4c/fba [0,4194304] 0 2024-09-17T01:41:48.939 INFO:tasks.workunit.client.0.smithi082.stdout:4/812: creat d9/d47/dc2/dda/dd4/f107 x:0 0 0 2024-09-17T01:41:48.942 INFO:tasks.workunit.client.0.smithi082.stdout:4/813: symlink d9/d15/d16/d18/d4a/d8f/d91/de0/l108 0 2024-09-17T01:41:48.947 INFO:tasks.workunit.client.0.smithi082.stdout:4/814: link d9/d15/d16/d3e/d54/fd9 d9/d15/d16/d18/d4a/f109 0 2024-09-17T01:41:48.960 INFO:tasks.workunit.client.0.smithi082.stdout:4/815: rename d9/d15/d16/d18/d4a/d8f/d91/de0 to d9/d2b/d10a 0 2024-09-17T01:41:48.961 INFO:tasks.workunit.client.0.smithi082.stdout:4/816: chown d9/d15/d16/d18/d4a/d52/cbc 6884 1 2024-09-17T01:41:48.966 INFO:tasks.workunit.client.0.smithi082.stdout:4/817: rmdir d9/d47/d9b/dd5/ddd 39 2024-09-17T01:41:48.967 INFO:tasks.workunit.client.0.smithi082.stdout:4/818: read d9/d47/f79 [248620,50891] 0 2024-09-17T01:41:48.971 INFO:tasks.workunit.client.0.smithi082.stdout:4/819: creat d9/d15/d16/d18/d4a/d8f/d91/f10b x:0 0 0 2024-09-17T01:41:48.975 INFO:tasks.workunit.client.0.smithi082.stdout:4/820: dread d9/fa [0,4194304] 0 2024-09-17T01:41:48.976 INFO:tasks.workunit.client.0.smithi082.stdout:4/821: dread - d9/d15/d16/d18/fd2 zero size 2024-09-17T01:41:48.981 INFO:tasks.workunit.client.0.smithi082.stdout:4/822: dwrite d9/d15/d16/d3e/d73/fa2 [0,4194304] 0 2024-09-17T01:41:48.987 INFO:tasks.workunit.client.0.smithi082.stdout:4/823: getdents d9/dbd 0 2024-09-17T01:41:48.991 INFO:tasks.workunit.client.0.smithi082.stdout:4/824: creat d9/d47/dc2/dda/f10c x:0 0 0 2024-09-17T01:41:48.993 INFO:tasks.workunit.client.0.smithi082.stdout:4/825: creat d9/d15/f10d x:0 0 0 2024-09-17T01:41:48.995 INFO:tasks.workunit.client.0.smithi082.stdout:4/826: truncate d9/d2b/faa 1254339 0 2024-09-17T01:41:48.997 INFO:tasks.workunit.client.0.smithi082.stdout:4/827: symlink d9/d15/d37/d4c/l10e 0 2024-09-17T01:41:49.000 INFO:tasks.workunit.client.0.smithi082.stdout:4/828: creat d9/d15/d16/f10f x:0 0 0 2024-09-17T01:41:49.009 INFO:tasks.workunit.client.0.smithi082.stdout:4/829: write d9/d15/d16/d18/fd2 [128810,211] 0 2024-09-17T01:41:49.013 INFO:tasks.workunit.client.0.smithi082.stdout:4/830: dread d9/d15/d37/f90 [0,4194304] 0 2024-09-17T01:41:49.015 INFO:tasks.workunit.client.0.smithi082.stdout:4/831: readlink d9/d47/d9b/dd5/ddd/lec 0 2024-09-17T01:41:49.016 INFO:tasks.workunit.client.0.smithi082.stdout:4/832: fsync d9/d15/d16/d44/d84/fe8 0 2024-09-17T01:41:49.017 INFO:tasks.workunit.client.0.smithi082.stdout:4/833: write d9/ddf/ffe [507968,49282] 0 2024-09-17T01:41:49.021 INFO:tasks.workunit.client.0.smithi082.stdout:4/834: mknod d9/d2b/c110 0 2024-09-17T01:41:49.024 INFO:tasks.workunit.client.0.smithi082.stdout:4/835: dread d9/d15/d16/d18/fe6 [0,4194304] 0 2024-09-17T01:41:49.025 INFO:tasks.workunit.client.0.smithi082.stdout:4/836: chown d9/d15/cb2 12 1 2024-09-17T01:41:49.027 INFO:tasks.workunit.client.0.smithi082.stdout:4/837: rename d9/fc to d9/d15/d16/d3e/d54/dab/f111 0 2024-09-17T01:41:49.033 INFO:tasks.workunit.client.0.smithi082.stdout:4/838: write d9/d47/f79 [4824688,22691] 0 2024-09-17T01:41:49.036 INFO:tasks.workunit.client.0.smithi082.stdout:4/839: mknod d9/d15/d16/d18/d4a/c112 0 2024-09-17T01:41:49.039 INFO:tasks.workunit.client.0.smithi082.stdout:4/840: truncate d9/d15/d16/d18/d4a/d52/d55/d48/f74 138791 0 2024-09-17T01:41:49.042 INFO:tasks.workunit.client.0.smithi082.stdout:4/841: dread d9/d15/f6f [0,4194304] 0 2024-09-17T01:41:49.043 INFO:tasks.workunit.client.0.smithi082.stdout:4/842: dread - d9/d47/f60 zero size 2024-09-17T01:41:49.048 INFO:tasks.workunit.client.0.smithi082.stdout:4/843: truncate d9/d15/d16/f2f 1268175 0 2024-09-17T01:41:49.049 INFO:tasks.workunit.client.0.smithi082.stdout:4/844: creat d9/d2b/d10a/f113 x:0 0 0 2024-09-17T01:41:49.052 INFO:tasks.workunit.client.0.smithi082.stdout:4/845: getdents d9/d15/d16/d18/d4f/db1 0 2024-09-17T01:41:49.059 INFO:tasks.workunit.client.0.smithi082.stdout:4/846: write d9/d15/d16/d18/d4f/fbf [929047,65934] 0 2024-09-17T01:41:49.067 INFO:tasks.workunit.client.0.smithi082.stdout:4/847: rename d9/d2b/f70 to d9/d47/d9b/dd5/f114 0 2024-09-17T01:41:49.076 INFO:tasks.workunit.client.0.smithi082.stdout:4/848: dwrite d9/fa [0,4194304] 0 2024-09-17T01:41:49.082 INFO:tasks.workunit.client.0.smithi082.stdout:4/849: link d9/c12 d9/d15/d16/d18/d4a/d52/d55/d48/c115 0 2024-09-17T01:41:49.083 INFO:tasks.workunit.client.0.smithi082.stdout:4/850: fdatasync d9/d15/d16/d3e/f4e 0 2024-09-17T01:41:49.085 INFO:tasks.workunit.client.0.smithi082.stdout:4/851: rmdir d9/d15/d16/d18/d4a/d52 39 2024-09-17T01:41:49.086 INFO:tasks.workunit.client.0.smithi082.stdout:4/852: fsync d9/d15/d37/d4c/fe5 0 2024-09-17T01:41:49.092 INFO:tasks.workunit.client.0.smithi082.stdout:4/853: symlink d9/d47/d9b/l116 0 2024-09-17T01:41:49.094 INFO:tasks.workunit.client.0.smithi082.stdout:4/854: mknod d9/d15/d37/c117 0 2024-09-17T01:41:49.094 INFO:tasks.workunit.client.0.smithi082.stdout:4/855: chown d9/d2b/c5c 4779579 1 2024-09-17T01:41:49.095 INFO:tasks.workunit.client.0.smithi082.stdout:4/856: dread - d9/d15/d16/d18/d4a/d8f/f105 zero size 2024-09-17T01:41:49.096 INFO:tasks.workunit.client.0.smithi082.stdout:4/857: chown d9/d47/dc2/dda/dd4/ld7 645 1 2024-09-17T01:41:49.099 INFO:tasks.workunit.client.0.smithi082.stdout:4/858: dread d9/d15/d16/d3e/f50 [0,4194304] 0 2024-09-17T01:41:49.102 INFO:tasks.workunit.client.0.smithi082.stdout:4/859: dread - d9/d15/d16/d18/d4a/d52/f9a zero size 2024-09-17T01:41:49.104 INFO:tasks.workunit.client.0.smithi082.stdout:4/860: rmdir d9/ddf 39 2024-09-17T01:41:49.121 INFO:tasks.workunit.client.0.smithi082.stdout:4/861: truncate d9/d15/d16/d18/d4f/fbf 589306 0 2024-09-17T01:41:49.123 INFO:tasks.workunit.client.0.smithi082.stdout:4/862: unlink d9/d15/d16/d18/d4a/d52/cbc 0 2024-09-17T01:41:49.135 INFO:tasks.workunit.client.0.smithi082.stdout:4/863: write d9/d15/f7a [426752,117872] 0 2024-09-17T01:41:49.135 INFO:tasks.workunit.client.0.smithi082.stdout:4/864: chown d9/d15/d37/d4c/fe5 154169637 1 2024-09-17T01:41:49.137 INFO:tasks.workunit.client.0.smithi082.stdout:4/865: dread - d9/d15/d16/d3e/d54/dab/f100 zero size 2024-09-17T01:41:49.140 INFO:tasks.workunit.client.0.smithi082.stdout:4/866: creat d9/d15/d16/d18/d4a/d8f/f118 x:0 0 0 2024-09-17T01:41:49.141 INFO:tasks.workunit.client.0.smithi082.stdout:4/867: getdents d9/d15/d16/d3e/d54/def 0 2024-09-17T01:41:49.154 INFO:tasks.workunit.client.0.smithi082.stdout:4/868: dwrite d9/d15/d16/d18/d4a/d52/fd8 [0,4194304] 0 2024-09-17T01:41:49.156 INFO:tasks.workunit.client.0.smithi082.stdout:4/869: stat d9/d15/d16/d18/d4a/d52/d55/d48 0 2024-09-17T01:41:49.159 INFO:tasks.workunit.client.0.smithi082.stdout:4/870: rename d9/d15/d16/d18/d4f/db1/lfb to d9/d47/d9b/d104/l119 0 2024-09-17T01:41:49.162 INFO:tasks.workunit.client.0.smithi082.stdout:4/871: mkdir d9/d15/d16/d11a 0 2024-09-17T01:41:49.170 INFO:tasks.workunit.client.0.smithi082.stdout:4/872: write d9/d15/d16/d18/d4f/fc8 [549493,90213] 0 2024-09-17T01:41:49.172 INFO:tasks.workunit.client.0.smithi082.stdout:4/873: symlink d9/d15/l11b 0 2024-09-17T01:41:49.175 INFO:tasks.workunit.client.0.smithi082.stdout:4/874: rename d9/d47/cc6 to d9/d15/d16/d3e/c11c 0 2024-09-17T01:41:49.177 INFO:tasks.workunit.client.0.smithi082.stdout:4/875: creat d9/ddf/f11d x:0 0 0 2024-09-17T01:41:49.180 INFO:tasks.workunit.client.0.smithi082.stdout:4/876: mkdir d9/d15/d16/d44/d11e 0 2024-09-17T01:41:49.181 INFO:tasks.workunit.client.0.smithi082.stdout:4/877: symlink d9/d47/dc2/l11f 0 2024-09-17T01:41:49.183 INFO:tasks.workunit.client.0.smithi082.stdout:4/878: read d9/d15/d16/d18/fd2 [115751,44666] 0 2024-09-17T01:41:49.184 INFO:tasks.workunit.client.0.smithi082.stdout:4/879: creat d9/d47/d9b/d104/f120 x:0 0 0 2024-09-17T01:41:49.186 INFO:tasks.workunit.client.0.smithi082.stdout:4/880: fdatasync d9/d15/d16/d18/d4a/d52/f9a 0 2024-09-17T01:41:49.192 INFO:tasks.workunit.client.0.smithi082.stdout:4/881: rename d9/d15/d16/d3e/c96 to d9/d47/dc2/c121 0 2024-09-17T01:41:49.194 INFO:tasks.workunit.client.0.smithi082.stdout:4/882: write d9/d15/d37/d4c/fba [2584655,63182] 0 2024-09-17T01:41:49.197 INFO:tasks.workunit.client.0.smithi082.stdout:4/883: fdatasync d9/d15/d16/d18/d4a/d52/fc9 0 2024-09-17T01:41:49.201 INFO:tasks.workunit.client.0.smithi082.stdout:4/884: truncate d9/d15/f2e 778562 0 2024-09-17T01:41:49.203 INFO:tasks.workunit.client.0.smithi082.stdout:4/885: symlink d9/d47/l122 0 2024-09-17T01:41:49.204 INFO:tasks.workunit.client.0.smithi082.stdout:4/886: write d9/d15/d16/d18/d4f/fe3 [1458088,5911] 0 2024-09-17T01:41:49.209 INFO:tasks.workunit.client.0.smithi082.stdout:4/887: link d9/d15/d37/d4c/fe5 d9/d47/d9b/dd5/ddd/f123 0 2024-09-17T01:41:49.210 INFO:tasks.workunit.client.0.smithi082.stdout:4/888: chown d9/d15/d16/d18/d4a/d52/d55/d48 0 1 2024-09-17T01:41:49.222 INFO:tasks.workunit.client.0.smithi082.stdout:4/889: dwrite d9/d47/f60 [0,4194304] 0 2024-09-17T01:41:49.224 INFO:tasks.workunit.client.0.smithi082.stdout:4/890: creat d9/ddf/f124 x:0 0 0 2024-09-17T01:41:49.228 INFO:tasks.workunit.client.0.smithi082.stdout:4/891: fdatasync d9/d15/d16/d3e/d54/fd9 0 2024-09-17T01:41:49.229 INFO:tasks.workunit.client.0.smithi082.stdout:4/892: fsync d9/d15/d16/d3e/f3f 0 2024-09-17T01:41:49.232 INFO:tasks.workunit.client.0.smithi082.stdout:4/893: rename l4 to d9/d15/d16/d3e/d54/dab/l125 0 2024-09-17T01:41:49.233 INFO:tasks.workunit.client.0.smithi082.stdout:4/894: truncate d9/d2b/d10a/f113 222607 0 2024-09-17T01:41:49.236 INFO:tasks.workunit.client.0.smithi082.stdout:4/895: truncate d9/d15/d16/d3e/d54/fac 2722181 0 2024-09-17T01:41:49.239 INFO:tasks.workunit.client.0.smithi082.stdout:4/896: mkdir d9/d15/d16/d18/d4a/d8f/d91/d126 0 2024-09-17T01:41:49.252 INFO:tasks.workunit.client.0.smithi082.stdout:4/897: dread d9/d15/d16/d3e/fbb [0,4194304] 0 2024-09-17T01:41:49.254 INFO:tasks.workunit.client.0.smithi082.stdout:4/898: creat d9/d15/d16/d3e/d73/f127 x:0 0 0 2024-09-17T01:41:49.255 INFO:tasks.workunit.client.0.smithi082.stdout:4/899: dread d9/d2b/d10a/f113 [0,4194304] 0 2024-09-17T01:41:49.259 INFO:tasks.workunit.client.0.smithi082.stdout:4/900: mkdir d9/d15/d16/d18/d4a/d8f/d91/d126/d128 0 2024-09-17T01:41:49.260 INFO:tasks.workunit.client.0.smithi082.stdout:4/901: mknod d9/ddf/c129 0 2024-09-17T01:41:49.262 INFO:tasks.workunit.client.0.smithi082.stdout:4/902: truncate d9/d15/d16/d44/d84/fee 431965 0 2024-09-17T01:41:49.263 INFO:tasks.workunit.client.0.smithi082.stdout:4/903: symlink d9/d47/l12a 0 2024-09-17T01:41:49.271 INFO:tasks.workunit.client.0.smithi082.stdout:4/904: truncate d9/d15/d37/f90 1430401 0 2024-09-17T01:41:49.272 INFO:tasks.workunit.client.0.smithi082.stdout:4/905: symlink d9/d15/d16/d3e/d73/l12b 0 2024-09-17T01:41:49.277 INFO:tasks.workunit.client.0.smithi082.stdout:4/906: creat d9/f12c x:0 0 0 2024-09-17T01:41:49.277 INFO:tasks.workunit.client.0.smithi082.stdout:4/907: chown d9/d15/d16/d44/d84/fe8 17007 1 2024-09-17T01:41:49.284 INFO:tasks.workunit.client.0.smithi082.stdout:4/908: dwrite d9/d15/d16/d18/d4a/d8f/d91/f10b [0,4194304] 0 2024-09-17T01:41:49.287 INFO:tasks.workunit.client.0.smithi082.stdout:4/909: truncate d9/d2b/d10a/f113 619604 0 2024-09-17T01:41:49.290 INFO:tasks.workunit.client.0.smithi082.stdout:4/910: symlink d9/d15/d16/d3e/d54/def/l12d 0 2024-09-17T01:41:49.291 INFO:tasks.workunit.client.0.smithi082.stdout:4/911: mknod d9/d15/c12e 0 2024-09-17T01:41:49.296 INFO:tasks.workunit.client.0.smithi082.stdout:4/912: rename d9/d15/c33 to d9/d47/dc2/dda/c12f 0 2024-09-17T01:41:49.297 INFO:tasks.workunit.client.0.smithi082.stdout:4/913: creat d9/ddf/f130 x:0 0 0 2024-09-17T01:41:49.299 INFO:tasks.workunit.client.0.smithi082.stdout:4/914: symlink d9/d15/d16/d3e/l131 0 2024-09-17T01:41:49.305 INFO:tasks.workunit.client.0.smithi082.stdout:4/915: dwrite d9/d15/d16/d3e/d73/f9d [4194304,4194304] 0 2024-09-17T01:41:49.308 INFO:tasks.workunit.client.0.smithi082.stdout:4/916: mkdir d9/d15/d16/d18/d4a/d8f/d91/d126/d132 0 2024-09-17T01:41:49.322 INFO:tasks.workunit.client.0.smithi082.stdout:4/917: dwrite d9/fd [0,4194304] 0 2024-09-17T01:41:49.324 INFO:tasks.workunit.client.0.smithi082.stdout:4/918: truncate d9/dbd/ffd 1044646 0 2024-09-17T01:41:49.328 INFO:tasks.workunit.client.0.smithi082.stdout:4/919: rename d9/d47/dc2/dda/fc7 to d9/d15/d16/d18/d4a/d8f/f133 0 2024-09-17T01:41:49.331 INFO:tasks.workunit.client.0.smithi082.stdout:4/920: unlink d9/d15/d16/d3e/d54/l78 0 2024-09-17T01:41:49.332 INFO:tasks.workunit.client.0.smithi082.stdout:4/921: creat d9/d47/d9b/f134 x:0 0 0 2024-09-17T01:41:49.338 INFO:tasks.workunit.client.0.smithi082.stdout:4/922: dwrite d9/d15/d37/d4c/fba [4194304,4194304] 0 2024-09-17T01:41:49.339 INFO:tasks.workunit.client.0.smithi082.stdout:4/923: chown d9/d15/d37/l8a 1272 1 2024-09-17T01:41:49.339 INFO:tasks.workunit.client.0.smithi082.stdout:4/924: stat d9/d47/dc2/dda/cf7 0 2024-09-17T01:41:49.343 INFO:tasks.workunit.client.0.smithi082.stdout:4/925: fsync d9/d15/d16/f2f 0 2024-09-17T01:41:49.345 INFO:tasks.workunit.client.0.smithi082.stdout:4/926: mkdir d9/d47/d9b/dd5/ddd/d135 0 2024-09-17T01:41:49.346 INFO:tasks.workunit.client.0.smithi082.stdout:4/927: write d9/d15/d16/d3e/f50 [5555175,21181] 0 2024-09-17T01:41:49.348 INFO:tasks.workunit.client.0.smithi082.stdout:4/928: creat d9/d15/d16/d18/d4a/d8f/f136 x:0 0 0 2024-09-17T01:41:49.348 INFO:tasks.workunit.client.0.smithi082.stdout:4/929: readlink d9/d15/d16/la4 0 2024-09-17T01:41:49.352 INFO:tasks.workunit.client.0.smithi082.stdout:4/930: rename d9/d47/c98 to d9/d15/d16/d18/d4f/db1/c137 0 2024-09-17T01:41:49.374 INFO:tasks.workunit.client.0.smithi082.stdout:4/931: dread d9/d15/d16/d3e/d54/fac [0,4194304] 0 2024-09-17T01:41:49.376 INFO:tasks.workunit.client.0.smithi082.stdout:4/932: read d9/d2b/d10a/f113 [132612,15209] 0 2024-09-17T01:41:49.384 INFO:tasks.workunit.client.0.smithi082.stdout:4/933: dwrite d9/d47/dc2/dda/f10c [0,4194304] 0 2024-09-17T01:41:49.387 INFO:tasks.workunit.client.0.smithi082.stdout:3/664: sync 2024-09-17T01:41:49.393 INFO:tasks.workunit.client.0.smithi082.stdout:3/665: rename d9/ld7 to d9/db/d49/le6 0 2024-09-17T01:41:49.412 INFO:tasks.workunit.client.0.smithi082.stdout:3/666: write d9/db/d26/fa1 [580421,33695] 0 2024-09-17T01:41:49.416 INFO:tasks.workunit.client.0.smithi082.stdout:4/934: dwrite d9/d2b/d10a/f113 [0,4194304] 0 2024-09-17T01:41:49.417 INFO:tasks.workunit.client.0.smithi082.stdout:3/667: stat d9/db/d49/da4/lde 0 2024-09-17T01:41:49.418 INFO:tasks.workunit.client.0.smithi082.stdout:4/935: stat d9/d15/d16/f36 0 2024-09-17T01:41:49.422 INFO:tasks.workunit.client.0.smithi082.stdout:4/936: creat d9/d47/dc2/dda/dd4/f138 x:0 0 0 2024-09-17T01:41:49.424 INFO:tasks.workunit.client.0.smithi082.stdout:3/668: fsync d9/db/d49/d4e/d53/f62 0 2024-09-17T01:41:49.428 INFO:tasks.workunit.client.0.smithi082.stdout:4/937: link d9/d15/cb7 d9/d15/d16/d3e/d73/c139 0 2024-09-17T01:41:49.446 INFO:tasks.workunit.client.0.smithi082.stdout:4/938: dwrite d9/d15/d37/fcf [0,4194304] 0 2024-09-17T01:41:49.448 INFO:tasks.workunit.client.0.smithi082.stdout:4/939: write d9/d47/d9b/f134 [269849,90916] 0 2024-09-17T01:41:49.452 INFO:tasks.workunit.client.0.smithi082.stdout:4/940: unlink d9/d15/d16/d18/d4a/d8f/d91/f95 0 2024-09-17T01:41:49.457 INFO:tasks.workunit.client.0.smithi082.stdout:4/941: rename d9/d47/dc2/dda to d9/d15/d16/d44/d84/d13a 0 2024-09-17T01:41:49.473 INFO:tasks.workunit.client.0.smithi082.stdout:4/942: write d9/d15/f1e [636838,28102] 0 2024-09-17T01:41:49.473 INFO:tasks.workunit.client.0.smithi082.stdout:4/943: write d9/d47/d9b/d104/f120 [396916,42856] 0 2024-09-17T01:41:49.474 INFO:tasks.workunit.client.0.smithi082.stdout:4/944: readlink d9/d47/l102 0 2024-09-17T01:41:49.475 INFO:tasks.workunit.client.0.smithi082.stdout:4/945: truncate d9/d15/d16/d18/d4a/faf 315672 0 2024-09-17T01:41:49.481 INFO:tasks.workunit.client.0.smithi082.stdout:4/946: write d9/d15/d16/d44/d84/d13a/fa5 [4569003,44101] 0 2024-09-17T01:41:49.487 INFO:tasks.workunit.client.0.smithi082.stdout:4/947: dread d9/d15/f2e [0,4194304] 0 2024-09-17T01:41:49.490 INFO:tasks.workunit.client.0.smithi082.stdout:4/948: dread d9/fa [0,4194304] 0 2024-09-17T01:41:49.498 INFO:tasks.workunit.client.0.smithi082.stdout:4/949: dwrite d9/d15/d16/d18/d4a/d8f/f133 [0,4194304] 0 2024-09-17T01:41:49.507 INFO:tasks.workunit.client.0.smithi082.stdout:4/950: write d9/d15/d16/d18/d4f/ffc [2615220,119078] 0 2024-09-17T01:41:49.528 INFO:tasks.workunit.client.0.smithi082.stdout:4/951: dread d9/f14 [4194304,4194304] 0 2024-09-17T01:41:49.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/952: readlink d9/d15/d16/d18/d4a/l85 0 2024-09-17T01:41:49.529 INFO:tasks.workunit.client.0.smithi082.stdout:4/953: stat d9/d2b/d10a/l108 0 2024-09-17T01:41:49.530 INFO:tasks.workunit.client.0.smithi082.stdout:4/954: chown d9/d15/c35 0 1 2024-09-17T01:41:49.532 INFO:tasks.workunit.client.0.smithi082.stdout:4/955: fsync d9/d15/d16/d3e/f50 0 2024-09-17T01:41:49.534 INFO:tasks.workunit.client.0.smithi082.stdout:4/956: mkdir d9/d15/d16/d44/d84/d13b 0 2024-09-17T01:41:49.535 INFO:tasks.workunit.client.0.smithi082.stdout:4/957: stat d9/d15/d16/d18/d4a 0 2024-09-17T01:41:49.537 INFO:tasks.workunit.client.0.smithi082.stdout:4/958: symlink d9/d15/l13c 0 2024-09-17T01:41:49.540 INFO:tasks.workunit.client.0.smithi082.stdout:4/959: symlink d9/d2b/l13d 0 2024-09-17T01:41:49.541 INFO:tasks.workunit.client.0.smithi082.stdout:4/960: chown d9/d15/d16/d3e/fbb 30774 1 2024-09-17T01:41:49.542 INFO:tasks.workunit.client.0.smithi082.stdout:4/961: write d9/d15/d16/d18/d4a/d8f/fa8 [1178639,102368] 0 2024-09-17T01:41:49.557 INFO:tasks.workunit.client.0.smithi082.stdout:4/962: dwrite d9/d15/d16/d3e/d54/fac [0,4194304] 0 2024-09-17T01:41:49.559 INFO:tasks.workunit.client.0.smithi082.stdout:4/963: truncate d9/d15/d16/f4b 381598 0 2024-09-17T01:41:49.576 INFO:tasks.workunit.client.0.smithi082.stdout:4/964: dread d9/d15/d16/d3e/f4e [0,4194304] 0 2024-09-17T01:41:49.577 INFO:tasks.workunit.client.0.smithi082.stdout:4/965: chown d9/d15/d16/d18/d4f/l7c 533066 1 2024-09-17T01:41:49.581 INFO:tasks.workunit.client.0.smithi082.stdout:4/966: truncate d9/d15/d16/d18/f21 1783564 0 2024-09-17T01:41:49.586 INFO:tasks.workunit.client.0.smithi082.stdout:4/967: dwrite d9/f14 [4194304,4194304] 0 2024-09-17T01:41:49.588 INFO:tasks.workunit.client.0.smithi082.stdout:4/968: write d9/d15/f6b [3866900,56194] 0 2024-09-17T01:41:49.592 INFO:tasks.workunit.client.0.smithi082.stdout:8/630: sync 2024-09-17T01:41:49.596 INFO:tasks.workunit.client.0.smithi082.stdout:8/631: fsync d3/dd/d18/d3a/f46 0 2024-09-17T01:41:49.601 INFO:tasks.workunit.client.0.smithi082.stdout:8/632: rmdir d3/dd/d18/d51/dae 39 2024-09-17T01:41:49.603 INFO:tasks.workunit.client.0.smithi082.stdout:4/969: write d9/d15/d16/d18/d4a/faf [1317187,106414] 0 2024-09-17T01:41:49.610 INFO:tasks.workunit.client.0.smithi082.stdout:4/970: creat d9/d47/d9b/dd5/f13e x:0 0 0 2024-09-17T01:41:49.611 INFO:tasks.workunit.client.0.smithi082.stdout:4/971: write d9/d47/f60 [3656288,88452] 0 2024-09-17T01:41:49.612 INFO:tasks.workunit.client.0.smithi082.stdout:8/633: write d3/dd/d18/d2d/d3e/d43/f59 [1731422,74762] 0 2024-09-17T01:41:49.614 INFO:tasks.workunit.client.0.smithi082.stdout:8/634: chown d3/dd/d18/d34/l2c 1 1 2024-09-17T01:41:49.617 INFO:tasks.workunit.client.0.smithi082.stdout:8/635: unlink d3/dd/d18/d2d/d3e/d4a/c7d 0 2024-09-17T01:41:49.621 INFO:tasks.workunit.client.0.smithi082.stdout:8/636: getdents d3/dd/d18/d2d/d3e 0 2024-09-17T01:41:49.622 INFO:tasks.workunit.client.0.smithi082.stdout:8/637: getdents d3/dd/d18/d34 0 2024-09-17T01:41:49.624 INFO:tasks.workunit.client.0.smithi082.stdout:8/638: unlink d3/dd/d18/d2d/d58/c5d 0 2024-09-17T01:41:49.626 INFO:tasks.workunit.client.0.smithi082.stdout:8/639: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/dc7 0 2024-09-17T01:41:49.636 INFO:tasks.workunit.client.0.smithi082.stdout:8/640: dwrite d3/dd/d18/d2d/d3b/f48 [0,4194304] 0 2024-09-17T01:41:49.637 INFO:tasks.workunit.client.0.smithi082.stdout:8/641: chown d3/dd/d18/d2d/d58/d85/cc1 45 1 2024-09-17T01:41:49.644 INFO:tasks.workunit.client.0.smithi082.stdout:8/642: rename d3/l3c to d3/dd/d18/lc8 0 2024-09-17T01:41:49.658 INFO:tasks.workunit.client.0.smithi082.stdout:8/643: mknod d3/dd/d18/d51/db4/cc9 0 2024-09-17T01:41:49.661 INFO:tasks.workunit.client.0.smithi082.stdout:8/644: creat d3/dd/fca x:0 0 0 2024-09-17T01:41:49.693 INFO:tasks.workunit.client.0.smithi082.stdout:8/645: creat d3/dd/d18/d3a/fcb x:0 0 0 2024-09-17T01:41:49.697 INFO:tasks.workunit.client.0.smithi082.stdout:8/646: unlink d3/c8 0 2024-09-17T01:41:49.785 INFO:tasks.workunit.client.0.smithi082.stdout:9/611: sync 2024-09-17T01:41:49.799 INFO:tasks.workunit.client.0.smithi082.stdout:9/612: write d4/f17 [1741078,102965] 0 2024-09-17T01:41:49.805 INFO:tasks.workunit.client.0.smithi082.stdout:9/613: dwrite d4/f8 [0,4194304] 0 2024-09-17T01:41:49.808 INFO:tasks.workunit.client.0.smithi082.stdout:9/614: creat d4/d27/d2d/d60/d11/d39/d31/fc9 x:0 0 0 2024-09-17T01:41:49.810 INFO:tasks.workunit.client.0.smithi082.stdout:9/615: rmdir d4/d27/d2d/d60/dba 39 2024-09-17T01:41:49.815 INFO:tasks.workunit.client.0.smithi082.stdout:9/616: mknod d4/d27/d2d/d60/dba/cca 0 2024-09-17T01:41:49.821 INFO:tasks.workunit.client.0.smithi082.stdout:9/617: dwrite d4/d27/d2d/d60/d11/d39/d44/f72 [0,4194304] 0 2024-09-17T01:41:49.828 INFO:tasks.workunit.client.0.smithi082.stdout:9/618: dwrite d4/fae [0,4194304] 0 2024-09-17T01:41:49.833 INFO:tasks.workunit.client.0.smithi082.stdout:9/619: rename d4/d27/d21/c3a to d4/d27/d21/ccb 0 2024-09-17T01:41:49.835 INFO:tasks.workunit.client.0.smithi082.stdout:9/620: creat d4/d27/d36/d3b/fcc x:0 0 0 2024-09-17T01:41:49.837 INFO:tasks.workunit.client.0.smithi082.stdout:9/621: truncate d4/d27/d36/f7b 192025 0 2024-09-17T01:41:49.847 INFO:tasks.workunit.client.0.smithi082.stdout:9/622: write d4/d27/d2d/d3d/f8c [1054402,115261] 0 2024-09-17T01:41:49.849 INFO:tasks.workunit.client.0.smithi082.stdout:9/623: creat d4/da6/dc4/fcd x:0 0 0 2024-09-17T01:41:49.852 INFO:tasks.workunit.client.0.smithi082.stdout:9/624: creat d4/d27/d2d/d60/d11/fce x:0 0 0 2024-09-17T01:41:49.853 INFO:tasks.workunit.client.0.smithi082.stdout:9/625: fsync d4/d27/d36/d3b/fcc 0 2024-09-17T01:41:49.856 INFO:tasks.workunit.client.0.smithi082.stdout:9/626: dread d4/d27/d2d/d60/d11/d39/d29/d77/f84 [0,4194304] 0 2024-09-17T01:41:49.858 INFO:tasks.workunit.client.0.smithi082.stdout:9/627: dread - d4/d27/d36/f4e zero size 2024-09-17T01:41:49.864 INFO:tasks.workunit.client.0.smithi082.stdout:9/628: creat d4/d27/d2d/d60/d11/fcf x:0 0 0 2024-09-17T01:41:49.865 INFO:tasks.workunit.client.0.smithi082.stdout:9/629: dread - d4/d27/d36/d3b/fcc zero size 2024-09-17T01:41:49.865 INFO:tasks.workunit.client.0.smithi082.stdout:9/630: stat d4/d27/d2d/d60/d11/d39/d29/d35/f61 0 2024-09-17T01:41:49.866 INFO:tasks.workunit.client.0.smithi082.stdout:9/631: dread d4/d27/d2d/d60/d11/d39/d29/d77/f84 [0,4194304] 0 2024-09-17T01:41:49.867 INFO:tasks.workunit.client.0.smithi082.stdout:9/632: dread - d4/d27/d2d/d3d/f5c zero size 2024-09-17T01:41:49.872 INFO:tasks.workunit.client.0.smithi082.stdout:9/633: creat d4/d27/d2d/fd0 x:0 0 0 2024-09-17T01:41:49.874 INFO:tasks.workunit.client.0.smithi082.stdout:9/634: symlink d4/d27/d21/ld1 0 2024-09-17T01:41:49.876 INFO:tasks.workunit.client.0.smithi082.stdout:9/635: read d4/d27/d2d/d3d/fa5 [314063,92566] 0 2024-09-17T01:41:49.879 INFO:tasks.workunit.client.0.smithi082.stdout:9/636: mkdir d4/dd2 0 2024-09-17T01:41:49.886 INFO:tasks.workunit.client.0.smithi082.stdout:9/637: creat d4/d27/d2d/d60/d11/d39/d44/fd3 x:0 0 0 2024-09-17T01:41:49.886 INFO:tasks.workunit.client.0.smithi082.stdout:9/638: creat d4/d27/d2d/d3d/fd4 x:0 0 0 2024-09-17T01:41:49.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/639: rename d4/d27/d2d/d60/d11/d39/d29/d35 to d4/d27/d2d/d60/d11/d39/d29/d35/dd5 22 2024-09-17T01:41:49.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/640: stat d4/d27/d2d/d60/d11/d39/d31/f7a 0 2024-09-17T01:41:49.887 INFO:tasks.workunit.client.0.smithi082.stdout:9/641: stat d4/d27/d2d/d60/d11/d37 0 2024-09-17T01:41:49.965 INFO:tasks.workunit.client.0.smithi082.stdout:2/771: sync 2024-09-17T01:41:49.969 INFO:tasks.workunit.client.0.smithi082.stdout:2/772: dread d1/d17/d38/d42/d52/f70 [0,4194304] 0 2024-09-17T01:41:49.978 INFO:tasks.workunit.client.0.smithi082.stdout:2/773: write d1/d17/d29/d50/f77 [7971213,89732] 0 2024-09-17T01:41:49.985 INFO:tasks.workunit.client.0.smithi082.stdout:2/774: write d1/d10/f7f [570628,84525] 0 2024-09-17T01:41:49.992 INFO:tasks.workunit.client.0.smithi082.stdout:2/775: dwrite d1/d10/f28 [0,4194304] 0 2024-09-17T01:41:49.993 INFO:tasks.workunit.client.0.smithi082.stdout:2/776: readlink d1/d10/l44 0 2024-09-17T01:41:49.995 INFO:tasks.workunit.client.0.smithi082.stdout:2/777: creat d1/d17/d60/dc6/de8/f100 x:0 0 0 2024-09-17T01:41:49.999 INFO:tasks.workunit.client.0.smithi082.stdout:2/778: creat d1/d17/d38/d42/f101 x:0 0 0 2024-09-17T01:41:50.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:49 smithi167 ceph-mon[35643]: pgmap v28: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 65 MiB/s rd, 163 MiB/s wr, 360 op/s 2024-09-17T01:41:50.019 INFO:tasks.workunit.client.0.smithi082.stdout:2/779: dwrite d1/f4d [0,4194304] 0 2024-09-17T01:41:50.022 INFO:tasks.workunit.client.0.smithi082.stdout:2/780: truncate d1/d5a/d6d/dc2/fe2 585498 0 2024-09-17T01:41:50.031 INFO:tasks.workunit.client.0.smithi082.stdout:2/781: dread d1/d5a/d6d/fca [0,4194304] 0 2024-09-17T01:41:50.033 INFO:tasks.workunit.client.0.smithi082.stdout:2/782: mkdir d1/d35/db1/ddf/d102 0 2024-09-17T01:41:50.035 INFO:tasks.workunit.client.0.smithi082.stdout:2/783: dread d1/d5a/d6d/fca [0,4194304] 0 2024-09-17T01:41:50.040 INFO:tasks.workunit.client.0.smithi082.stdout:2/784: symlink d1/d66/l103 0 2024-09-17T01:41:50.041 INFO:tasks.workunit.client.0.smithi082.stdout:2/785: rmdir d1/d35/db1/ddf 39 2024-09-17T01:41:50.041 INFO:tasks.workunit.client.0.smithi082.stdout:2/786: chown d1/d17/d38/f9e 91167111 1 2024-09-17T01:41:50.043 INFO:tasks.workunit.client.0.smithi082.stdout:2/787: mknod d1/d17/d38/d42/d52/c104 0 2024-09-17T01:41:50.053 INFO:tasks.workunit.client.0.smithi082.stdout:2/788: dwrite d1/fd [0,4194304] 0 2024-09-17T01:41:50.057 INFO:tasks.workunit.client.0.smithi082.stdout:2/789: link d1/d90/cae d1/d17/d29/dc9/c105 0 2024-09-17T01:41:50.060 INFO:tasks.workunit.client.0.smithi082.stdout:2/790: rmdir d1/d35/dfb 0 2024-09-17T01:41:50.069 INFO:tasks.workunit.client.0.smithi082.stdout:2/791: write d1/d17/d29/f2d [4236475,109264] 0 2024-09-17T01:41:50.072 INFO:tasks.workunit.client.0.smithi082.stdout:2/792: mknod d1/d17/d38/d42/c106 0 2024-09-17T01:41:50.074 INFO:tasks.workunit.client.0.smithi082.stdout:2/793: rename d1/d17/d38/d5c/d7d/cc8 to d1/d17/d29/ddc/c107 0 2024-09-17T01:41:50.090 INFO:tasks.workunit.client.0.smithi082.stdout:2/794: dread d1/d10/f12 [4194304,4194304] 0 2024-09-17T01:41:50.091 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:49 smithi082 ceph-mon[28077]: pgmap v28: 65 pgs: 65 active+clean; 3.4 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 65 MiB/s rd, 163 MiB/s wr, 360 op/s 2024-09-17T01:41:50.096 INFO:tasks.workunit.client.0.smithi082.stdout:2/795: dwrite d1/d17/fee [0,4194304] 0 2024-09-17T01:41:50.110 INFO:tasks.workunit.client.0.smithi082.stdout:2/796: dread d1/ff [0,4194304] 0 2024-09-17T01:41:50.114 INFO:tasks.workunit.client.0.smithi082.stdout:2/797: link d1/d17/d60/dc6/de8/fc7 d1/d17/d38/d5c/d7d/f108 0 2024-09-17T01:41:50.115 INFO:tasks.workunit.client.0.smithi082.stdout:2/798: dread - d1/fbc zero size 2024-09-17T01:41:50.129 INFO:tasks.workunit.client.0.smithi082.stdout:2/799: dread d1/d10/f88 [0,4194304] 0 2024-09-17T01:41:50.132 INFO:tasks.workunit.client.0.smithi082.stdout:2/800: truncate d1/d10/f86 724983 0 2024-09-17T01:41:50.135 INFO:tasks.workunit.client.0.smithi082.stdout:2/801: creat d1/d17/d38/d42/d52/de5/f109 x:0 0 0 2024-09-17T01:41:50.136 INFO:tasks.workunit.client.0.smithi082.stdout:2/802: rmdir d1/d17/d60 39 2024-09-17T01:41:50.150 INFO:tasks.workunit.client.0.smithi082.stdout:2/803: dread d1/d17/d29/d50/f77 [4194304,4194304] 0 2024-09-17T01:41:50.158 INFO:tasks.workunit.client.0.smithi082.stdout:2/804: write d1/d17/d60/dc6/de8/fc7 [4939448,129310] 0 2024-09-17T01:41:50.161 INFO:tasks.workunit.client.0.smithi082.stdout:2/805: creat d1/d17/d38/d5c/f10a x:0 0 0 2024-09-17T01:41:50.162 INFO:tasks.workunit.client.0.smithi082.stdout:2/806: symlink d1/d66/d85/dde/l10b 0 2024-09-17T01:41:50.165 INFO:tasks.workunit.client.0.smithi082.stdout:2/807: stat d1/d35/db1/ff9 0 2024-09-17T01:41:50.166 INFO:tasks.workunit.client.0.smithi082.stdout:2/808: dread - d1/f9d zero size 2024-09-17T01:41:50.168 INFO:tasks.workunit.client.0.smithi082.stdout:2/809: truncate d1/d35/db1/ff9 278605 0 2024-09-17T01:41:50.449 INFO:tasks.workunit.client.0.smithi082.stdout:7/803: sync 2024-09-17T01:41:50.451 INFO:tasks.workunit.client.0.smithi082.stdout:7/804: symlink d0/dd/d2c/d42/d77/l11b 0 2024-09-17T01:41:50.452 INFO:tasks.workunit.client.0.smithi082.stdout:7/805: chown d0/dd/d2c/d42/d77/c9b 5 1 2024-09-17T01:41:50.455 INFO:tasks.workunit.client.0.smithi082.stdout:7/806: rename d0/dd/d2c/cda to d0/d62/dce/deb/c11c 0 2024-09-17T01:41:50.457 INFO:tasks.workunit.client.0.smithi082.stdout:7/807: creat d0/dd/d2c/d42/d77/db2/f11d x:0 0 0 2024-09-17T01:41:50.462 INFO:tasks.workunit.client.0.smithi082.stdout:7/808: dwrite d0/d62/d7e/db5/ff8 [0,4194304] 0 2024-09-17T01:41:50.466 INFO:tasks.workunit.client.0.smithi082.stdout:7/809: dread d0/d3/db/d10/d3f/fa7 [0,4194304] 0 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:6/785: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:1/827: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:9/642: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:3/669: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:0/769: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:5/776: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:8/647: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:4/972: sync 2024-09-17T01:41:50.471 INFO:tasks.workunit.client.0.smithi082.stdout:2/810: sync 2024-09-17T01:41:50.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/810: dread - d0/dd/d2c/d55/f80 zero size 2024-09-17T01:41:50.474 INFO:tasks.workunit.client.0.smithi082.stdout:0/770: stat da/d1b/d23/d42/d43/d6b 0 2024-09-17T01:41:50.477 INFO:tasks.workunit.client.0.smithi082.stdout:3/670: mkdir d9/db/d26/dad/de7 0 2024-09-17T01:41:50.478 INFO:tasks.workunit.client.0.smithi082.stdout:1/828: mkdir d2/d3f/d24/dc8/d107 0 2024-09-17T01:41:50.481 INFO:tasks.workunit.client.0.smithi082.stdout:6/786: unlink d1/d7/d10/d4f/d32/fc7 0 2024-09-17T01:41:50.482 INFO:tasks.workunit.client.0.smithi082.stdout:6/787: chown d1/d1f/db0/cf7 40958 1 2024-09-17T01:41:50.482 INFO:tasks.workunit.client.0.smithi082.stdout:9/643: symlink d4/d27/d2d/d60/d11/d39/d29/d35/ld6 0 2024-09-17T01:41:50.485 INFO:tasks.workunit.client.0.smithi082.stdout:7/811: mknod d0/d3/db/ddf/c11e 0 2024-09-17T01:41:50.485 INFO:tasks.workunit.client.0.smithi082.stdout:2/811: dwrite d1/d5a/f63 [0,4194304] 0 2024-09-17T01:41:50.487 INFO:tasks.workunit.client.0.smithi082.stdout:8/648: truncate d3/dd/d18/d2d/d3e/d4a/d68/fc3 243129 0 2024-09-17T01:41:50.489 INFO:tasks.workunit.client.0.smithi082.stdout:0/771: symlink da/df/d2b/d59/d6f/da6/l110 0 2024-09-17T01:41:50.490 INFO:tasks.workunit.client.0.smithi082.stdout:3/671: symlink d9/db/d95/le8 0 2024-09-17T01:41:50.491 INFO:tasks.workunit.client.0.smithi082.stdout:1/829: fsync d2/d3f/d24/db5/dec/dfc/dc6/fe9 0 2024-09-17T01:41:50.493 INFO:tasks.workunit.client.0.smithi082.stdout:4/973: mkdir d9/d47/d9b/dd5/ddd/d135/d13f 0 2024-09-17T01:41:50.496 INFO:tasks.workunit.client.0.smithi082.stdout:9/644: unlink d4/f57 0 2024-09-17T01:41:50.496 INFO:tasks.workunit.client.0.smithi082.stdout:4/974: dread d9/d15/d16/d3e/d54/fd9 [0,4194304] 0 2024-09-17T01:41:50.497 INFO:tasks.workunit.client.0.smithi082.stdout:9/645: fdatasync d4/f8 0 2024-09-17T01:41:50.498 INFO:tasks.workunit.client.0.smithi082.stdout:7/812: mkdir d0/dd/d34/d11f 0 2024-09-17T01:41:50.500 INFO:tasks.workunit.client.0.smithi082.stdout:8/649: creat d3/dd/d18/d2d/d58/fcc x:0 0 0 2024-09-17T01:41:50.501 INFO:tasks.workunit.client.0.smithi082.stdout:9/646: dread d4/d27/d2d/d60/d11/d39/d44/f72 [0,4194304] 0 2024-09-17T01:41:50.504 INFO:tasks.workunit.client.0.smithi082.stdout:2/812: dwrite d1/d10/ff3 [0,4194304] 0 2024-09-17T01:41:50.510 INFO:tasks.workunit.client.0.smithi082.stdout:5/777: link db/d56/d78/f8a db/d1e/d5b/d83/d94/f100 0 2024-09-17T01:41:50.513 INFO:tasks.workunit.client.0.smithi082.stdout:6/788: mknod d1/d7/d10/d4f/dc/d99/dbb/c10a 0 2024-09-17T01:41:50.516 INFO:tasks.workunit.client.0.smithi082.stdout:3/672: symlink d9/db/d6d/de0/le9 0 2024-09-17T01:41:50.517 INFO:tasks.workunit.client.0.smithi082.stdout:3/673: fdatasync d9/db/d26/dbd/fc0 0 2024-09-17T01:41:50.518 INFO:tasks.workunit.client.0.smithi082.stdout:3/674: readlink d9/db/d49/l48 0 2024-09-17T01:41:50.520 INFO:tasks.workunit.client.0.smithi082.stdout:6/789: dread d1/d3/f75 [0,4194304] 0 2024-09-17T01:41:50.522 INFO:tasks.workunit.client.0.smithi082.stdout:5/778: creat db/da7/db3/f101 x:0 0 0 2024-09-17T01:41:50.524 INFO:tasks.workunit.client.0.smithi082.stdout:4/975: mknod d9/d15/d16/d18/d4a/d8f/d91/d126/d132/c140 0 2024-09-17T01:41:50.528 INFO:tasks.workunit.client.0.smithi082.stdout:4/976: dread d9/d15/d16/d3e/f50 [4194304,4194304] 0 2024-09-17T01:41:50.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/813: write d0/d3/db/ddf/fe1 [5040740,52255] 0 2024-09-17T01:41:50.532 INFO:tasks.workunit.client.0.smithi082.stdout:1/830: truncate d2/da/d2d/d79/fd0 626927 0 2024-09-17T01:41:50.536 INFO:tasks.workunit.client.0.smithi082.stdout:5/779: unlink db/c69 0 2024-09-17T01:41:50.540 INFO:tasks.workunit.client.0.smithi082.stdout:0/772: rename da/df/d71/fdb to da/df/d2b/d59/f111 0 2024-09-17T01:41:50.543 INFO:tasks.workunit.client.0.smithi082.stdout:4/977: fdatasync d9/d15/d16/d3e/d54/fa1 0 2024-09-17T01:41:50.545 INFO:tasks.workunit.client.0.smithi082.stdout:7/814: mknod d0/d62/dce/c120 0 2024-09-17T01:41:50.545 INFO:tasks.workunit.client.0.smithi082.stdout:4/978: fsync d9/d47/d9b/f134 0 2024-09-17T01:41:50.546 INFO:tasks.workunit.client.0.smithi082.stdout:6/790: dwrite d1/d7/d10/d4f/fd8 [0,4194304] 0 2024-09-17T01:41:50.549 INFO:tasks.workunit.client.0.smithi082.stdout:6/791: write d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e [719074,61926] 0 2024-09-17T01:41:50.553 INFO:tasks.workunit.client.0.smithi082.stdout:5/780: dread db/d56/fd7 [0,4194304] 0 2024-09-17T01:41:50.554 INFO:tasks.workunit.client.0.smithi082.stdout:0/773: creat da/df/d2b/d59/d6f/da6/f112 x:0 0 0 2024-09-17T01:41:50.555 INFO:tasks.workunit.client.0.smithi082.stdout:3/675: link d9/db/d6d/de0/le9 d9/db/d95/lea 0 2024-09-17T01:41:50.558 INFO:tasks.workunit.client.0.smithi082.stdout:5/781: read db/d1e/d5b/f92 [1355019,119498] 0 2024-09-17T01:41:50.558 INFO:tasks.workunit.client.0.smithi082.stdout:7/815: unlink d0/dd/d2c/fb7 0 2024-09-17T01:41:50.561 INFO:tasks.workunit.client.0.smithi082.stdout:2/813: getdents d1/d17/d38/d42/d52/de5 0 2024-09-17T01:41:50.561 INFO:tasks.workunit.client.0.smithi082.stdout:7/816: truncate d0/dd/d2c/d42/d77/db2/fc6 729598 0 2024-09-17T01:41:50.564 INFO:tasks.workunit.client.0.smithi082.stdout:4/979: dwrite d9/d15/d16/d18/f32 [0,4194304] 0 2024-09-17T01:41:50.567 INFO:tasks.workunit.client.0.smithi082.stdout:6/792: rename d1/d7/d10/d4f/dc/d99/ce4 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/c10b 0 2024-09-17T01:41:50.568 INFO:tasks.workunit.client.0.smithi082.stdout:6/793: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/c40 254930795 1 2024-09-17T01:41:50.570 INFO:tasks.workunit.client.0.smithi082.stdout:6/794: chown d1/d7/d10/d4f/dc/d1d/d2c/l45 454677 1 2024-09-17T01:41:50.575 INFO:tasks.workunit.client.0.smithi082.stdout:5/782: fsync db/d1e/d20/f88 0 2024-09-17T01:41:50.575 INFO:tasks.workunit.client.0.smithi082.stdout:3/676: dread d9/f2b [0,4194304] 0 2024-09-17T01:41:50.578 INFO:tasks.workunit.client.0.smithi082.stdout:2/814: creat d1/d17/d38/d5c/f10c x:0 0 0 2024-09-17T01:41:50.579 INFO:tasks.workunit.client.0.smithi082.stdout:2/815: fsync d1/d10/f28 0 2024-09-17T01:41:50.583 INFO:tasks.workunit.client.0.smithi082.stdout:4/980: rename d9/d15/d16/d18/d4a/d8f/d91/fa6 to d9/d15/d16/d18/f141 0 2024-09-17T01:41:50.585 INFO:tasks.workunit.client.0.smithi082.stdout:6/795: unlink d1/f96 0 2024-09-17T01:41:50.586 INFO:tasks.workunit.client.0.smithi082.stdout:6/796: chown d1/d7/d10/d4f/dc/f77 450961801 1 2024-09-17T01:41:50.592 INFO:tasks.workunit.client.0.smithi082.stdout:1/831: link d2/da/d2f/l60 d2/d3f/d24/l108 0 2024-09-17T01:41:50.594 INFO:tasks.workunit.client.0.smithi082.stdout:6/797: rmdir d1/d7/d10/d4f/d8e 39 2024-09-17T01:41:50.595 INFO:tasks.workunit.client.0.smithi082.stdout:2/816: dwrite d1/f1f [0,4194304] 0 2024-09-17T01:41:50.597 INFO:tasks.workunit.client.0.smithi082.stdout:5/783: rmdir db/d2b/d59 39 2024-09-17T01:41:50.599 INFO:tasks.workunit.client.0.smithi082.stdout:3/677: symlink d9/db/daf/d69/leb 0 2024-09-17T01:41:50.603 INFO:tasks.workunit.client.0.smithi082.stdout:2/817: symlink d1/d5a/d6d/l10d 0 2024-09-17T01:41:50.605 INFO:tasks.workunit.client.0.smithi082.stdout:5/784: rename db/d56/d29/d4f/d8e to db/d1e/d20/d30/dc6/dd1/d102 0 2024-09-17T01:41:50.606 INFO:tasks.workunit.client.0.smithi082.stdout:3/678: dread - d9/db/d49/d4e/d53/fcf zero size 2024-09-17T01:41:50.608 INFO:tasks.workunit.client.0.smithi082.stdout:7/817: getdents d0/dd/d2c/d42 0 2024-09-17T01:41:50.610 INFO:tasks.workunit.client.0.smithi082.stdout:4/981: creat d9/d15/d16/f142 x:0 0 0 2024-09-17T01:41:50.613 INFO:tasks.workunit.client.0.smithi082.stdout:6/798: dwrite d1/f5d [0,4194304] 0 2024-09-17T01:41:50.616 INFO:tasks.workunit.client.0.smithi082.stdout:3/679: mkdir d9/db/daa/dec 0 2024-09-17T01:41:50.619 INFO:tasks.workunit.client.0.smithi082.stdout:6/799: symlink d1/d7/d10/d4f/d32/l10c 0 2024-09-17T01:41:50.624 INFO:tasks.workunit.client.0.smithi082.stdout:4/982: rename d9/d15/d16/d18/d4a/d52/d55/d48/c4d to d9/d15/d16/d18/d4a/d52/d55/d48/c143 0 2024-09-17T01:41:50.629 INFO:tasks.workunit.client.0.smithi082.stdout:7/818: dwrite d0/d3/db/d10/d47/f5c [0,4194304] 0 2024-09-17T01:41:50.630 INFO:tasks.workunit.client.0.smithi082.stdout:5/785: dread db/d2b/fa2 [0,4194304] 0 2024-09-17T01:41:50.631 INFO:tasks.workunit.client.0.smithi082.stdout:6/800: mknod d1/d1f/da7/ddd/dbf/c10d 0 2024-09-17T01:41:50.632 INFO:tasks.workunit.client.0.smithi082.stdout:2/818: getdents d1/d35 0 2024-09-17T01:41:50.635 INFO:tasks.workunit.client.0.smithi082.stdout:6/801: fsync d1/d7/d10/f6f 0 2024-09-17T01:41:50.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/786: mkdir db/d56/d103 0 2024-09-17T01:41:50.638 INFO:tasks.workunit.client.0.smithi082.stdout:4/983: creat d9/d47/d9b/dd5/f144 x:0 0 0 2024-09-17T01:41:50.639 INFO:tasks.workunit.client.0.smithi082.stdout:3/680: dwrite d9/db/f11 [0,4194304] 0 2024-09-17T01:41:50.642 INFO:tasks.workunit.client.0.smithi082.stdout:3/681: read d9/db/daf/d69/d79/d86/fb0 [4073988,50693] 0 2024-09-17T01:41:50.649 INFO:tasks.workunit.client.0.smithi082.stdout:3/682: readlink d9/d35/l82 0 2024-09-17T01:41:50.650 INFO:tasks.workunit.client.0.smithi082.stdout:4/984: dwrite d9/d15/d16/d44/d84/d13a/f10c [0,4194304] 0 2024-09-17T01:41:50.650 INFO:tasks.workunit.client.0.smithi082.stdout:7/819: dwrite d0/dd/d2c/d55/f80 [0,4194304] 0 2024-09-17T01:41:50.653 INFO:tasks.workunit.client.0.smithi082.stdout:5/787: link db/d1e/fc9 db/da7/db3/f104 0 2024-09-17T01:41:50.662 INFO:tasks.workunit.client.0.smithi082.stdout:3/683: creat d9/db/daa/fed x:0 0 0 2024-09-17T01:41:50.662 INFO:tasks.workunit.client.0.smithi082.stdout:6/802: write d1/d7/ffe [1354794,65119] 0 2024-09-17T01:41:50.662 INFO:tasks.workunit.client.0.smithi082.stdout:4/985: dwrite d9/d2b/d10a/f113 [4194304,4194304] 0 2024-09-17T01:41:50.665 INFO:tasks.workunit.client.0.smithi082.stdout:3/684: chown d9/d35/l60 12156852 1 2024-09-17T01:41:50.666 INFO:tasks.workunit.client.0.smithi082.stdout:3/685: read - d9/db/daf/d69/dbc/fe1 zero size 2024-09-17T01:41:50.666 INFO:tasks.workunit.client.0.smithi082.stdout:3/686: chown d9/db/d49/cd2 38201 1 2024-09-17T01:41:50.667 INFO:tasks.workunit.client.0.smithi082.stdout:7/820: creat d0/f121 x:0 0 0 2024-09-17T01:41:50.668 INFO:tasks.workunit.client.0.smithi082.stdout:4/986: symlink d9/d15/d16/d3e/d54/dab/l145 0 2024-09-17T01:41:50.669 INFO:tasks.workunit.client.0.smithi082.stdout:6/803: creat d1/d1f/db0/ded/f10e x:0 0 0 2024-09-17T01:41:50.675 INFO:tasks.workunit.client.0.smithi082.stdout:4/987: fsync d9/d15/f2e 0 2024-09-17T01:41:50.690 INFO:tasks.workunit.client.0.smithi082.stdout:5/788: dwrite db/d56/f15 [0,4194304] 0 2024-09-17T01:41:50.735 INFO:tasks.workunit.client.0.smithi082.stdout:7/821: getdents d0/dd/d34/d11f 0 2024-09-17T01:41:50.737 INFO:tasks.workunit.client.0.smithi082.stdout:4/988: creat d9/d15/d16/d3e/d54/f146 x:0 0 0 2024-09-17T01:41:50.738 INFO:tasks.workunit.client.0.smithi082.stdout:4/989: dread - d9/d47/d9b/dd5/ddd/f123 zero size 2024-09-17T01:41:50.738 INFO:tasks.workunit.client.0.smithi082.stdout:5/789: rmdir db/da7/db3 39 2024-09-17T01:41:50.741 INFO:tasks.workunit.client.0.smithi082.stdout:6/804: rename d1/d7/d10/d4f/dc/d99/ca1 to d1/d7/d10/d4f/d8e/da8/de5/c10f 0 2024-09-17T01:41:50.744 INFO:tasks.workunit.client.0.smithi082.stdout:4/990: dread d9/d15/d16/d18/f32 [4194304,4194304] 0 2024-09-17T01:41:50.747 INFO:tasks.workunit.client.0.smithi082.stdout:6/805: mkdir d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/d110 0 2024-09-17T01:41:50.748 INFO:tasks.workunit.client.0.smithi082.stdout:5/790: creat db/da7/db3/f105 x:0 0 0 2024-09-17T01:41:50.751 INFO:tasks.workunit.client.0.smithi082.stdout:6/806: dread d1/d7/ffe [0,4194304] 0 2024-09-17T01:41:50.754 INFO:tasks.workunit.client.0.smithi082.stdout:5/791: creat db/d1e/d20/d30/d47/f106 x:0 0 0 2024-09-17T01:41:50.757 INFO:tasks.workunit.client.0.smithi082.stdout:7/822: rename d0/d3/db/d10/f65 to d0/dd/d2c/d55/f122 0 2024-09-17T01:41:50.761 INFO:tasks.workunit.client.0.smithi082.stdout:5/792: fdatasync db/f8f 0 2024-09-17T01:41:50.763 INFO:tasks.workunit.client.0.smithi082.stdout:4/991: rmdir d9/d47/d9b/dd5/ddd/d135/d13f 0 2024-09-17T01:41:50.764 INFO:tasks.workunit.client.0.smithi082.stdout:7/823: rmdir d0/dd/d34 39 2024-09-17T01:41:50.764 INFO:tasks.workunit.client.0.smithi082.stdout:4/992: dread - d9/d15/d16/d18/d4a/d52/fc9 zero size 2024-09-17T01:41:50.766 INFO:tasks.workunit.client.0.smithi082.stdout:4/993: read d9/d15/d16/f2c [742935,105163] 0 2024-09-17T01:41:50.769 INFO:tasks.workunit.client.0.smithi082.stdout:4/994: rmdir d9/d15/d16/d3e/d54 39 2024-09-17T01:41:50.772 INFO:tasks.workunit.client.0.smithi082.stdout:7/824: dwrite d0/d3/db/f14 [0,4194304] 0 2024-09-17T01:41:50.772 INFO:tasks.workunit.client.0.smithi082.stdout:4/995: rmdir d9/d47/dc2 39 2024-09-17T01:41:50.774 INFO:tasks.workunit.client.0.smithi082.stdout:5/793: dread db/d56/d18/d23/f65 [0,4194304] 0 2024-09-17T01:41:50.775 INFO:tasks.workunit.client.0.smithi082.stdout:4/996: chown d9/d15/d16/d44/d84/d13a/dd4/f138 2798210 1 2024-09-17T01:41:50.775 INFO:tasks.workunit.client.0.smithi082.stdout:7/825: readlink d0/dd/d34/d58/l75 0 2024-09-17T01:41:50.777 INFO:tasks.workunit.client.0.smithi082.stdout:5/794: chown db/d1e/d20/d30/dc6/fef 12 1 2024-09-17T01:41:50.778 INFO:tasks.workunit.client.0.smithi082.stdout:5/795: chown db/d1e/d20/d30/d47 17 1 2024-09-17T01:41:50.779 INFO:tasks.workunit.client.0.smithi082.stdout:4/997: creat d9/d15/d37/d4c/f147 x:0 0 0 2024-09-17T01:41:50.780 INFO:tasks.workunit.client.0.smithi082.stdout:7/826: mknod d0/dd/d2c/d42/d77/c123 0 2024-09-17T01:41:50.782 INFO:tasks.workunit.client.0.smithi082.stdout:3/687: write d9/db/daf/d69/d9c/dc2/fc7 [553491,45528] 0 2024-09-17T01:41:50.785 INFO:tasks.workunit.client.0.smithi082.stdout:7/827: creat d0/d62/d7e/dd4/d37/d71/f124 x:0 0 0 2024-09-17T01:41:50.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/998: symlink d9/d47/d9b/dd5/l148 0 2024-09-17T01:41:50.787 INFO:tasks.workunit.client.0.smithi082.stdout:4/999: readlink d9/d15/d16/d18/d4f/l7c 0 2024-09-17T01:41:50.797 INFO:tasks.workunit.client.0.smithi082.stdout:3/688: rename d9/db/daf/d69/dbc/fc8 to d9/db/daf/fee 0 2024-09-17T01:41:50.798 INFO:tasks.workunit.client.0.smithi082.stdout:6/807: write d1/d7/d10/d4f/dc/f77 [967031,8216] 0 2024-09-17T01:41:50.800 INFO:tasks.workunit.client.0.smithi082.stdout:6/808: write d1/d1f/db0/ded/f10e [86697,39050] 0 2024-09-17T01:41:50.803 INFO:tasks.workunit.client.0.smithi082.stdout:3/689: unlink d9/db/d49/d4e/d53/f58 0 2024-09-17T01:41:50.804 INFO:tasks.workunit.client.0.smithi082.stdout:5/796: dread db/d2b/f7f [0,4194304] 0 2024-09-17T01:41:50.805 INFO:tasks.workunit.client.0.smithi082.stdout:6/809: symlink d1/d7/d10/d4f/d8e/l111 0 2024-09-17T01:41:50.811 INFO:tasks.workunit.client.0.smithi082.stdout:6/810: fsync d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/fda 0 2024-09-17T01:41:50.814 INFO:tasks.workunit.client.0.smithi082.stdout:3/690: rename d9/db/d49/l73 to d9/db/d8f/lef 0 2024-09-17T01:41:50.817 INFO:tasks.workunit.client.0.smithi082.stdout:5/797: mknod db/d56/d78/dba/c107 0 2024-09-17T01:41:50.822 INFO:tasks.workunit.client.0.smithi082.stdout:7/828: dwrite d0/dd/f17 [0,4194304] 0 2024-09-17T01:41:50.828 INFO:tasks.workunit.client.0.smithi082.stdout:3/691: mknod d9/db/daf/d69/cf0 0 2024-09-17T01:41:50.829 INFO:tasks.workunit.client.0.smithi082.stdout:7/829: rmdir d0/dd/d2c/d42 39 2024-09-17T01:41:50.832 INFO:tasks.workunit.client.0.smithi082.stdout:6/811: link d1/d7/d10/d4f/dc/d2b/d48/l8f d1/d7/d10/d4f/dc/d1d/d36/d56/l112 0 2024-09-17T01:41:50.835 INFO:tasks.workunit.client.0.smithi082.stdout:7/830: dwrite d0/dd/fa2 [0,4194304] 0 2024-09-17T01:41:50.836 INFO:tasks.workunit.client.0.smithi082.stdout:3/692: unlink d9/db/d26/dad/fbb 0 2024-09-17T01:41:50.841 INFO:tasks.workunit.client.0.smithi082.stdout:7/831: truncate d0/d50/fb6 3650166 0 2024-09-17T01:41:50.844 INFO:tasks.workunit.client.0.smithi082.stdout:3/693: unlink d9/d35/d63/c6b 0 2024-09-17T01:41:50.844 INFO:tasks.workunit.client.0.smithi082.stdout:5/798: link db/f5a db/d2b/f108 0 2024-09-17T01:41:50.845 INFO:tasks.workunit.client.0.smithi082.stdout:7/832: symlink d0/d62/d7e/dd4/d37/d86/l125 0 2024-09-17T01:41:50.847 INFO:tasks.workunit.client.0.smithi082.stdout:7/833: write d0/d3/db/d10/d3f/fcb [2965829,118658] 0 2024-09-17T01:41:50.848 INFO:tasks.workunit.client.0.smithi082.stdout:5/799: unlink db/da7/db3/fd3 0 2024-09-17T01:41:50.853 INFO:tasks.workunit.client.0.smithi082.stdout:7/834: dread d0/d62/d7e/db5/ff8 [0,4194304] 0 2024-09-17T01:41:50.854 INFO:tasks.workunit.client.0.smithi082.stdout:5/800: rename db/d56/d18/d23/f65 to db/d56/d18/d98/f109 0 2024-09-17T01:41:50.859 INFO:tasks.workunit.client.0.smithi082.stdout:5/801: mkdir db/da7/db3/d10a 0 2024-09-17T01:41:50.860 INFO:tasks.workunit.client.0.smithi082.stdout:7/835: dwrite d0/d62/d7e/db5/fd6 [0,4194304] 0 2024-09-17T01:41:50.865 INFO:tasks.workunit.client.0.smithi082.stdout:7/836: unlink d0/dd/fa2 0 2024-09-17T01:41:50.872 INFO:tasks.workunit.client.0.smithi082.stdout:3/694: dwrite d9/db/d26/f3f [0,4194304] 0 2024-09-17T01:41:50.877 INFO:tasks.workunit.client.0.smithi082.stdout:5/802: link db/d56/d18/f70 db/d56/dd6/f10b 0 2024-09-17T01:41:50.882 INFO:tasks.workunit.client.0.smithi082.stdout:5/803: creat db/d56/d78/da0/f10c x:0 0 0 2024-09-17T01:41:50.887 INFO:tasks.workunit.client.0.smithi082.stdout:5/804: fdatasync db/d1e/fa8 0 2024-09-17T01:41:50.887 INFO:tasks.workunit.client.0.smithi082.stdout:5/805: stat db/d56/le3 0 2024-09-17T01:41:50.892 INFO:tasks.workunit.client.0.smithi082.stdout:5/806: creat db/da7/de4/f10d x:0 0 0 2024-09-17T01:41:50.892 INFO:tasks.workunit.client.0.smithi082.stdout:3/695: dwrite d9/db/d26/fac [0,4194304] 0 2024-09-17T01:41:50.893 INFO:tasks.workunit.client.0.smithi082.stdout:5/807: chown db/d56/d78/da0/fa4 326377403 1 2024-09-17T01:41:50.896 INFO:tasks.workunit.client.0.smithi082.stdout:3/696: fsync d9/db/daf/d69/d79/d86/fb0 0 2024-09-17T01:41:50.897 INFO:tasks.workunit.client.0.smithi082.stdout:5/808: dread - db/d1e/d5b/d83/f89 zero size 2024-09-17T01:41:50.908 INFO:tasks.workunit.client.0.smithi082.stdout:5/809: write db/d2b/f108 [713145,72082] 0 2024-09-17T01:41:50.910 INFO:tasks.workunit.client.0.smithi082.stdout:5/810: mknod db/d1e/d5b/d83/d94/dc1/c10e 0 2024-09-17T01:41:50.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/811: chown db/d2b/f7f 1 1 2024-09-17T01:41:50.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/812: chown db 0 1 2024-09-17T01:41:50.913 INFO:tasks.workunit.client.0.smithi082.stdout:5/813: stat db/d2b/d59/c74 0 2024-09-17T01:41:50.919 INFO:tasks.workunit.client.0.smithi082.stdout:3/697: dread d9/f6f [0,4194304] 0 2024-09-17T01:41:50.926 INFO:tasks.workunit.client.0.smithi082.stdout:3/698: dwrite d9/f40 [4194304,4194304] 0 2024-09-17T01:41:50.926 INFO:tasks.workunit.client.0.smithi082.stdout:5/814: dwrite db/f2d [0,4194304] 0 2024-09-17T01:41:50.927 INFO:tasks.workunit.client.0.smithi082.stdout:3/699: readlink d9/db/d95/lea 0 2024-09-17T01:41:50.930 INFO:tasks.workunit.client.0.smithi082.stdout:5/815: read db/d56/d18/f62 [366604,109406] 0 2024-09-17T01:41:50.933 INFO:tasks.workunit.client.0.smithi082.stdout:3/700: unlink d9/db/daf/d69/cf0 0 2024-09-17T01:41:50.935 INFO:tasks.workunit.client.0.smithi082.stdout:5/816: creat db/d1e/d5b/d83/f10f x:0 0 0 2024-09-17T01:41:50.936 INFO:tasks.workunit.client.0.smithi082.stdout:3/701: mkdir d9/db/daf/d69/d79/d86/db5/df1 0 2024-09-17T01:41:50.937 INFO:tasks.workunit.client.0.smithi082.stdout:5/817: creat db/d56/d18/f110 x:0 0 0 2024-09-17T01:41:50.940 INFO:tasks.workunit.client.0.smithi082.stdout:5/818: truncate db/d1e/d20/d30/f7c 243040 0 2024-09-17T01:41:50.942 INFO:tasks.workunit.client.0.smithi082.stdout:5/819: chown db/d1e/d20/d30/dc6/dd1/d102/ddc/ce5 1005 1 2024-09-17T01:41:50.942 INFO:tasks.workunit.client.0.smithi082.stdout:3/702: link d9/d35/d63/ld3 d9/db/d49/lf2 0 2024-09-17T01:41:50.944 INFO:tasks.workunit.client.0.smithi082.stdout:5/820: symlink db/d56/d29/l111 0 2024-09-17T01:41:50.945 INFO:tasks.workunit.client.0.smithi082.stdout:5/821: truncate db/d56/d18/f110 909653 0 2024-09-17T01:41:50.947 INFO:tasks.workunit.client.0.smithi082.stdout:3/703: truncate d9/db/d49/d4e/d53/f98 92320 0 2024-09-17T01:41:50.949 INFO:tasks.workunit.client.0.smithi082.stdout:3/704: unlink d9/db/d49/d4e/fa5 0 2024-09-17T01:41:50.953 INFO:tasks.workunit.client.0.smithi082.stdout:3/705: truncate d9/db/d49/d4e/d53/d5b/f70 45348 0 2024-09-17T01:41:50.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/706: rename d9/db/d26/dad to d9/db/daa/df3 0 2024-09-17T01:41:50.959 INFO:tasks.workunit.client.0.smithi082.stdout:5/822: write db/d2b/fcb [291146,50971] 0 2024-09-17T01:41:50.959 INFO:tasks.workunit.client.0.smithi082.stdout:3/707: mknod d9/db/daa/dec/cf4 0 2024-09-17T01:41:50.961 INFO:tasks.workunit.client.0.smithi082.stdout:5/823: read db/d1e/fb9 [472952,113632] 0 2024-09-17T01:41:50.964 INFO:tasks.workunit.client.0.smithi082.stdout:5/824: mknod db/d2b/c112 0 2024-09-17T01:41:50.965 INFO:tasks.workunit.client.0.smithi082.stdout:3/708: dwrite d9/db/d26/f3f [0,4194304] 0 2024-09-17T01:41:50.988 INFO:tasks.workunit.client.0.smithi082.stdout:3/709: dwrite d9/db/d6d/fcc [0,4194304] 0 2024-09-17T01:41:50.989 INFO:tasks.workunit.client.0.smithi082.stdout:5/825: dread db/d1e/d20/d30/f33 [0,4194304] 0 2024-09-17T01:41:50.991 INFO:tasks.workunit.client.0.smithi082.stdout:3/710: truncate d9/db/d8f/fbe 714843 0 2024-09-17T01:41:50.993 INFO:tasks.workunit.client.0.smithi082.stdout:5/826: dread - db/da7/db3/f104 zero size 2024-09-17T01:41:50.995 INFO:tasks.workunit.client.0.smithi082.stdout:3/711: creat d9/db/d49/da4/ff5 x:0 0 0 2024-09-17T01:41:50.995 INFO:tasks.workunit.client.0.smithi082.stdout:5/827: fsync db/da7/db3/f105 0 2024-09-17T01:41:50.996 INFO:tasks.workunit.client.0.smithi082.stdout:5/828: chown db/d1e/d20/d30/dc6/dd1/d102 4621 1 2024-09-17T01:41:50.997 INFO:tasks.workunit.client.0.smithi082.stdout:3/712: mknod d9/db/daf/d69/d79/d86/db5/cf6 0 2024-09-17T01:41:50.998 INFO:tasks.workunit.client.0.smithi082.stdout:5/829: mknod db/d56/d18/d23/c113 0 2024-09-17T01:41:50.999 INFO:tasks.workunit.client.0.smithi082.stdout:3/713: unlink d9/db/d49/l41 0 2024-09-17T01:41:51.000 INFO:tasks.workunit.client.0.smithi082.stdout:9/647: sync 2024-09-17T01:41:51.001 INFO:tasks.workunit.client.0.smithi082.stdout:8/650: sync 2024-09-17T01:41:51.003 INFO:tasks.workunit.client.0.smithi082.stdout:3/714: dread d9/f6f [0,4194304] 0 2024-09-17T01:41:51.004 INFO:tasks.workunit.client.0.smithi082.stdout:3/715: write d9/db/d26/f3f [2710677,8611] 0 2024-09-17T01:41:51.005 INFO:tasks.workunit.client.0.smithi082.stdout:8/651: creat d3/dd/d18/d2d/d3e/d43/fcd x:0 0 0 2024-09-17T01:41:51.016 INFO:tasks.workunit.client.0.smithi082.stdout:5/830: dwrite db/d2b/f36 [0,4194304] 0 2024-09-17T01:41:51.018 INFO:tasks.workunit.client.0.smithi082.stdout:8/652: getdents d3/dd/d18/d2d/d60 0 2024-09-17T01:41:51.018 INFO:tasks.workunit.client.0.smithi082.stdout:9/648: dwrite d4/d27/d2d/d60/f16 [0,4194304] 0 2024-09-17T01:41:51.020 INFO:tasks.workunit.client.0.smithi082.stdout:8/653: fsync d3/dd/d18/d2d/d3e/d4a/d68/fc3 0 2024-09-17T01:41:51.022 INFO:tasks.workunit.client.0.smithi082.stdout:9/649: chown d4/d27/d2d/d60/d11/d39/d29/d77/fa4 36451447 1 2024-09-17T01:41:51.023 INFO:tasks.workunit.client.0.smithi082.stdout:5/831: rename db/d56/dd6/fd8 to db/d1e/d5b/d83/d94/f114 0 2024-09-17T01:41:51.024 INFO:tasks.workunit.client.0.smithi082.stdout:3/716: link d9/db/daf/d69/d79/d86/fb0 d9/d78/d88/ff7 0 2024-09-17T01:41:51.028 INFO:tasks.workunit.client.0.smithi082.stdout:3/717: truncate d9/db/fa9 91927 0 2024-09-17T01:41:51.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/718: chown d9/d35/l60 40010 1 2024-09-17T01:41:51.029 INFO:tasks.workunit.client.0.smithi082.stdout:8/654: symlink d3/dd/d18/d2d/d3e/d4a/d68/lce 0 2024-09-17T01:41:51.030 INFO:tasks.workunit.client.0.smithi082.stdout:9/650: creat d4/fd7 x:0 0 0 2024-09-17T01:41:51.031 INFO:tasks.workunit.client.0.smithi082.stdout:8/655: write d3/dd/d18/d2d/d58/fcc [163459,72179] 0 2024-09-17T01:41:51.033 INFO:tasks.workunit.client.0.smithi082.stdout:9/651: creat d4/d59/d63/fd8 x:0 0 0 2024-09-17T01:41:51.036 INFO:tasks.workunit.client.0.smithi082.stdout:3/719: truncate d9/db/d49/d4e/d53/d5b/fa0 310947 0 2024-09-17T01:41:51.039 INFO:tasks.workunit.client.0.smithi082.stdout:9/652: creat d4/d27/d2d/d60/d11/d39/d31/fd9 x:0 0 0 2024-09-17T01:41:51.040 INFO:tasks.workunit.client.0.smithi082.stdout:3/720: creat d9/db/daf/d69/d9c/dc2/ff8 x:0 0 0 2024-09-17T01:41:51.046 INFO:tasks.workunit.client.0.smithi082.stdout:9/653: rmdir d4/d27/d21 39 2024-09-17T01:41:51.048 INFO:tasks.workunit.client.0.smithi082.stdout:9/654: fsync d4/d27/d2d/d60/d11/d8d/fb4 0 2024-09-17T01:41:51.050 INFO:tasks.workunit.client.0.smithi082.stdout:5/832: dwrite db/d56/d29/d4f/f82 [4194304,4194304] 0 2024-09-17T01:41:51.051 INFO:tasks.workunit.client.0.smithi082.stdout:9/655: dread - d4/d27/d2d/d60/d11/fcf zero size 2024-09-17T01:41:51.052 INFO:tasks.workunit.client.0.smithi082.stdout:9/656: chown d4/d27/d2d/d60/d11/d39/d31/l6b 19377299 1 2024-09-17T01:41:51.053 INFO:tasks.workunit.client.0.smithi082.stdout:8/656: write d3/dd/f84 [32763,52488] 0 2024-09-17T01:41:51.060 INFO:tasks.workunit.client.0.smithi082.stdout:3/721: fsync d9/db/daf/d69/d79/d86/fb0 0 2024-09-17T01:41:51.068 INFO:tasks.workunit.client.0.smithi082.stdout:3/722: dread d9/db/d8f/fbe [0,4194304] 0 2024-09-17T01:41:51.070 INFO:tasks.workunit.client.0.smithi082.stdout:5/833: fdatasync db/d56/dd6/f10b 0 2024-09-17T01:41:51.074 INFO:tasks.workunit.client.0.smithi082.stdout:8/657: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/dcf 0 2024-09-17T01:41:51.081 INFO:tasks.workunit.client.0.smithi082.stdout:9/657: getdents d4/da6 0 2024-09-17T01:41:51.082 INFO:tasks.workunit.client.0.smithi082.stdout:5/834: symlink db/d2b/d59/l115 0 2024-09-17T01:41:51.083 INFO:tasks.workunit.client.0.smithi082.stdout:3/723: creat d9/ff9 x:0 0 0 2024-09-17T01:41:51.087 INFO:tasks.workunit.client.0.smithi082.stdout:3/724: mknod d9/db/daa/df3/cfa 0 2024-09-17T01:41:51.091 INFO:tasks.workunit.client.0.smithi082.stdout:3/725: fdatasync d9/db/d49/da4/fa6 0 2024-09-17T01:41:51.093 INFO:tasks.workunit.client.0.smithi082.stdout:8/658: dread d3/dd/d18/d2d/d3e/f71 [0,4194304] 0 2024-09-17T01:41:51.095 INFO:tasks.workunit.client.0.smithi082.stdout:5/835: link db/da7/db3/f105 db/d1e/d20/f116 0 2024-09-17T01:41:51.095 INFO:tasks.workunit.client.0.smithi082.stdout:9/658: write d4/d27/d2d/d60/d11/f70 [1103593,73835] 0 2024-09-17T01:41:51.108 INFO:tasks.workunit.client.0.smithi082.stdout:0/774: sync 2024-09-17T01:41:51.189 INFO:tasks.workunit.client.0.smithi082.stdout:3/726: rmdir d9/d78 39 2024-09-17T01:41:51.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/659: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fd0 x:0 0 0 2024-09-17T01:41:51.190 INFO:tasks.workunit.client.0.smithi082.stdout:5/836: fsync db/d1e/d20/ff5 0 2024-09-17T01:41:51.191 INFO:tasks.workunit.client.0.smithi082.stdout:8/660: readlink d3/dd/d18/d2d/la3 0 2024-09-17T01:41:51.192 INFO:tasks.workunit.client.0.smithi082.stdout:0/775: fdatasync da/fe0 0 2024-09-17T01:41:51.193 INFO:tasks.workunit.client.0.smithi082.stdout:5/837: dread - db/d1e/d20/f88 zero size 2024-09-17T01:41:51.193 INFO:tasks.workunit.client.0.smithi082.stdout:0/776: chown da/lad 13 1 2024-09-17T01:41:51.214 INFO:tasks.workunit.client.0.smithi082.stdout:3/727: symlink d9/db/daf/d69/d79/d86/db5/df1/lfb 0 2024-09-17T01:41:51.216 INFO:tasks.workunit.client.0.smithi082.stdout:0/777: unlink da/d1b/d23/d42/d43/f57 0 2024-09-17T01:41:51.217 INFO:tasks.workunit.client.0.smithi082.stdout:8/661: dwrite d3/dd/d18/d2d/d3b/f69 [0,4194304] 0 2024-09-17T01:41:51.218 INFO:tasks.workunit.client.0.smithi082.stdout:8/662: readlink d3/dd/d18/d2d/d3b/l9d 0 2024-09-17T01:41:51.220 INFO:tasks.workunit.client.0.smithi082.stdout:9/659: rename d4/d27/d36/fab to d4/d27/d2d/d60/d11/d39/fda 0 2024-09-17T01:41:51.221 INFO:tasks.workunit.client.0.smithi082.stdout:0/778: fdatasync da/d80/f8c 0 2024-09-17T01:41:51.222 INFO:tasks.workunit.client.0.smithi082.stdout:3/728: creat d9/d35/dda/ffc x:0 0 0 2024-09-17T01:41:51.226 INFO:tasks.workunit.client.0.smithi082.stdout:5/838: rename db/d56/d18/d23/fe6 to db/d1e/d20/d30/d47/f117 0 2024-09-17T01:41:51.228 INFO:tasks.workunit.client.0.smithi082.stdout:9/660: stat d4/d27/d2d/d60/d11/d39/d44/fc0 0 2024-09-17T01:41:51.230 INFO:tasks.workunit.client.0.smithi082.stdout:0/779: dwrite da/d1b/d23/d42/d43/d6b/ffc [0,4194304] 0 2024-09-17T01:41:51.233 INFO:tasks.workunit.client.0.smithi082.stdout:0/780: truncate da/d1b/d23/d4d/f103 936258 0 2024-09-17T01:41:51.239 INFO:tasks.workunit.client.0.smithi082.stdout:8/663: rename d3/dd/d18/d2d/d3e/d4a/d66/d7b/l9a to d3/dd/d18/d2d/ld1 0 2024-09-17T01:41:51.246 INFO:tasks.workunit.client.0.smithi082.stdout:5/839: dread db/d56/f35 [0,4194304] 0 2024-09-17T01:41:51.247 INFO:tasks.workunit.client.0.smithi082.stdout:8/664: mknod d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/cd2 0 2024-09-17T01:41:51.249 INFO:tasks.workunit.client.0.smithi082.stdout:9/661: rmdir d4/d27/d2d/d3d/db7 0 2024-09-17T01:41:51.251 INFO:tasks.workunit.client.0.smithi082.stdout:0/781: creat da/f113 x:0 0 0 2024-09-17T01:41:51.254 INFO:tasks.workunit.client.0.smithi082.stdout:3/729: dwrite d9/db/d49/d4e/d53/d5b/fa0 [0,4194304] 0 2024-09-17T01:41:51.254 INFO:tasks.workunit.client.0.smithi082.stdout:9/662: chown d4/d27/d2d/d60/dba/cca 735963 1 2024-09-17T01:41:51.259 INFO:tasks.workunit.client.0.smithi082.stdout:5/840: dwrite db/d1e/d20/d30/d47/f106 [0,4194304] 0 2024-09-17T01:41:51.262 INFO:tasks.workunit.client.0.smithi082.stdout:5/841: write db/d56/f15 [5654874,46294] 0 2024-09-17T01:41:51.265 INFO:tasks.workunit.client.0.smithi082.stdout:3/730: mknod d9/db/daf/d69/d79/d86/db5/df1/cfd 0 2024-09-17T01:41:51.265 INFO:tasks.workunit.client.0.smithi082.stdout:0/782: dwrite da/df/d2b/d9a/ff5 [0,4194304] 0 2024-09-17T01:41:51.266 INFO:tasks.workunit.client.0.smithi082.stdout:0/783: readlink da/df/l5c 0 2024-09-17T01:41:51.267 INFO:tasks.workunit.client.0.smithi082.stdout:5/842: creat db/d56/d18/f118 x:0 0 0 2024-09-17T01:41:51.268 INFO:tasks.workunit.client.0.smithi082.stdout:3/731: readlink d9/db/d8f/lef 0 2024-09-17T01:41:51.269 INFO:tasks.workunit.client.0.smithi082.stdout:9/663: rename d4/d27/d2d/d60/d11/d39/d31/l6b to d4/d27/d2d/d60/d11/d8d/ldb 0 2024-09-17T01:41:51.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/732: read d9/f4d [748825,55211] 0 2024-09-17T01:41:51.272 INFO:tasks.workunit.client.0.smithi082.stdout:3/733: read d9/db/d26/fac [2819361,68327] 0 2024-09-17T01:41:51.272 INFO:tasks.workunit.client.0.smithi082.stdout:8/665: truncate d3/dd/d18/d51/f6f 162531 0 2024-09-17T01:41:51.274 INFO:tasks.workunit.client.0.smithi082.stdout:8/666: write d3/dd/d18/d2d/d3e/d43/f59 [2118062,72087] 0 2024-09-17T01:41:51.276 INFO:tasks.workunit.client.0.smithi082.stdout:9/664: fdatasync d4/d27/d2d/d60/d11/d39/d29/d77/fa4 0 2024-09-17T01:41:51.277 INFO:tasks.workunit.client.0.smithi082.stdout:9/665: write d4/d27/d2d/d60/d11/d8d/fb4 [2823357,58405] 0 2024-09-17T01:41:51.283 INFO:tasks.workunit.client.0.smithi082.stdout:9/666: symlink d4/d27/d2d/d3d/d81/ldc 0 2024-09-17T01:41:51.284 INFO:tasks.workunit.client.0.smithi082.stdout:3/734: symlink d9/db/daa/df3/de7/lfe 0 2024-09-17T01:41:51.285 INFO:tasks.workunit.client.0.smithi082.stdout:3/735: write d9/db/d6d/fcc [4887699,87173] 0 2024-09-17T01:41:51.289 INFO:tasks.workunit.client.0.smithi082.stdout:3/736: creat d9/db/d49/fff x:0 0 0 2024-09-17T01:41:51.290 INFO:tasks.workunit.client.0.smithi082.stdout:8/667: link d3/f64 d3/dd/d18/d3a/fd3 0 2024-09-17T01:41:51.297 INFO:tasks.workunit.client.0.smithi082.stdout:5/843: write db/d1e/d5b/f92 [4412564,11151] 0 2024-09-17T01:41:51.301 INFO:tasks.workunit.client.0.smithi082.stdout:5/844: symlink db/d1e/d20/d30/dc6/dd1/d102/ddc/l119 0 2024-09-17T01:41:51.301 INFO:tasks.workunit.client.0.smithi082.stdout:0/784: dread da/df/d2b/f89 [0,4194304] 0 2024-09-17T01:41:51.303 INFO:tasks.workunit.client.0.smithi082.stdout:1/832: sync 2024-09-17T01:41:51.304 INFO:tasks.workunit.client.0.smithi082.stdout:0/785: symlink da/d1b/d23/d42/l114 0 2024-09-17T01:41:51.306 INFO:tasks.workunit.client.0.smithi082.stdout:5/845: creat db/d1e/d20/d30/dc6/dd1/d102/ddc/f11a x:0 0 0 2024-09-17T01:41:51.308 INFO:tasks.workunit.client.0.smithi082.stdout:3/737: write d9/db/d26/f3a [2075646,119737] 0 2024-09-17T01:41:51.309 INFO:tasks.workunit.client.0.smithi082.stdout:3/738: chown d9/db/daf/d69/d79/fd0 8639682 1 2024-09-17T01:41:51.313 INFO:tasks.workunit.client.0.smithi082.stdout:9/667: dread d4/d27/d21/f5a [0,4194304] 0 2024-09-17T01:41:51.315 INFO:tasks.workunit.client.0.smithi082.stdout:9/668: dread - d4/d27/d2d/d60/d11/fcf zero size 2024-09-17T01:41:51.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/833: dread d2/d3f/d24/f69 [0,4194304] 0 2024-09-17T01:41:51.316 INFO:tasks.workunit.client.0.smithi082.stdout:3/739: symlink d9/db/d26/dbd/l100 0 2024-09-17T01:41:51.317 INFO:tasks.workunit.client.0.smithi082.stdout:3/740: stat d9/db/lc 0 2024-09-17T01:41:51.320 INFO:tasks.workunit.client.0.smithi082.stdout:9/669: symlink d4/d27/d2d/d60/dba/ldd 0 2024-09-17T01:41:51.321 INFO:tasks.workunit.client.0.smithi082.stdout:5/846: write db/d1e/d20/d30/f33 [320145,106573] 0 2024-09-17T01:41:51.321 INFO:tasks.workunit.client.0.smithi082.stdout:0/786: getdents da/d1b/d23/d4d/dd7 0 2024-09-17T01:41:51.321 INFO:tasks.workunit.client.0.smithi082.stdout:3/741: mknod d9/db/daa/df3/de7/c101 0 2024-09-17T01:41:51.323 INFO:tasks.workunit.client.0.smithi082.stdout:1/834: rename d2/d3f/d24/db5/dec/dfc/l83 to d2/df/d46/l109 0 2024-09-17T01:41:51.325 INFO:tasks.workunit.client.0.smithi082.stdout:8/668: dread d3/dd/d18/d3a/fd3 [0,4194304] 0 2024-09-17T01:41:51.326 INFO:tasks.workunit.client.0.smithi082.stdout:9/670: dread d4/d27/d2d/d60/d11/d39/fda [0,4194304] 0 2024-09-17T01:41:51.327 INFO:tasks.workunit.client.0.smithi082.stdout:3/742: mknod d9/db/daf/d69/dbc/c102 0 2024-09-17T01:41:51.328 INFO:tasks.workunit.client.0.smithi082.stdout:0/787: dread - da/d1b/d23/d42/d43/d6b/dd2/fd6 zero size 2024-09-17T01:41:51.328 INFO:tasks.workunit.client.0.smithi082.stdout:3/743: write d9/db/d49/fe2 [568060,20158] 0 2024-09-17T01:41:51.332 INFO:tasks.workunit.client.0.smithi082.stdout:5/847: write db/da7/fcf [373524,130489] 0 2024-09-17T01:41:51.333 INFO:tasks.workunit.client.0.smithi082.stdout:5/848: read - db/da7/db3/f104 zero size 2024-09-17T01:41:51.334 INFO:tasks.workunit.client.0.smithi082.stdout:9/671: truncate d4/d27/d36/f4e 555071 0 2024-09-17T01:41:51.340 INFO:tasks.workunit.client.0.smithi082.stdout:1/835: link d2/d3f/d24/db5/f105 d2/d3f/f10a 0 2024-09-17T01:41:51.340 INFO:tasks.workunit.client.0.smithi082.stdout:8/669: mknod d3/dd/d18/d51/dc5/cd4 0 2024-09-17T01:41:51.343 INFO:tasks.workunit.client.0.smithi082.stdout:9/672: symlink d4/d27/d2d/d3d/d81/lde 0 2024-09-17T01:41:51.344 INFO:tasks.workunit.client.0.smithi082.stdout:9/673: stat d4/d27/d2d/fd0 0 2024-09-17T01:41:51.347 INFO:tasks.workunit.client.0.smithi082.stdout:0/788: link da/df/d2b/d9a/fee da/d1b/d23/dea/f115 0 2024-09-17T01:41:51.351 INFO:tasks.workunit.client.0.smithi082.stdout:3/744: dwrite d9/db/f22 [0,4194304] 0 2024-09-17T01:41:51.357 INFO:tasks.workunit.client.0.smithi082.stdout:5/849: dread f6 [0,4194304] 0 2024-09-17T01:41:51.361 INFO:tasks.workunit.client.0.smithi082.stdout:7/837: sync 2024-09-17T01:41:51.362 INFO:tasks.workunit.client.0.smithi082.stdout:6/812: sync 2024-09-17T01:41:51.362 INFO:tasks.workunit.client.0.smithi082.stdout:2/819: sync 2024-09-17T01:41:51.362 INFO:tasks.workunit.client.0.smithi082.stdout:9/674: mkdir d4/d59/d63/ddf 0 2024-09-17T01:41:51.364 INFO:tasks.workunit.client.0.smithi082.stdout:7/838: write d0/d62/d7e/fd9 [593720,120465] 0 2024-09-17T01:41:51.364 INFO:tasks.workunit.client.0.smithi082.stdout:2/820: chown d1/d17/d38/d42/d52/de5 6 1 2024-09-17T01:41:51.365 INFO:tasks.workunit.client.0.smithi082.stdout:6/813: write d1/fef [1018150,6560] 0 2024-09-17T01:41:51.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/850: creat db/da7/db3/f11b x:0 0 0 2024-09-17T01:41:51.367 INFO:tasks.workunit.client.0.smithi082.stdout:8/670: creat d3/dd/d18/d51/dae/fd5 x:0 0 0 2024-09-17T01:41:51.369 INFO:tasks.workunit.client.0.smithi082.stdout:2/821: readlink d1/d17/d38/d42/d52/d78/da0/dba/leb 0 2024-09-17T01:41:51.369 INFO:tasks.workunit.client.0.smithi082.stdout:3/745: creat d9/db/daf/d69/dbc/ddb/f103 x:0 0 0 2024-09-17T01:41:51.370 INFO:tasks.workunit.client.0.smithi082.stdout:2/822: chown d1/d17/d29/f2d 977 1 2024-09-17T01:41:51.373 INFO:tasks.workunit.client.0.smithi082.stdout:6/814: creat d1/d7/d10/d4f/dc/d1d/f113 x:0 0 0 2024-09-17T01:41:51.375 INFO:tasks.workunit.client.0.smithi082.stdout:7/839: dread d0/dd/d2c/d42/f99 [0,4194304] 0 2024-09-17T01:41:51.376 INFO:tasks.workunit.client.0.smithi082.stdout:9/675: truncate d4/d27/d36/f4e 853845 0 2024-09-17T01:41:51.379 INFO:tasks.workunit.client.0.smithi082.stdout:5/851: dread db/d1e/d20/f73 [0,4194304] 0 2024-09-17T01:41:51.380 INFO:tasks.workunit.client.0.smithi082.stdout:1/836: getdents d2/d3f/d34/dc5 0 2024-09-17T01:41:51.381 INFO:tasks.workunit.client.0.smithi082.stdout:2/823: mknod d1/d5a/d6d/dc2/c10e 0 2024-09-17T01:41:51.382 INFO:tasks.workunit.client.0.smithi082.stdout:7/840: dwrite d0/d3/db/fe [0,4194304] 0 2024-09-17T01:41:51.389 INFO:tasks.workunit.client.0.smithi082.stdout:2/824: dread d1/d17/d38/d42/d52/f70 [0,4194304] 0 2024-09-17T01:41:51.391 INFO:tasks.workunit.client.0.smithi082.stdout:7/841: dwrite d0/dd/f17 [4194304,4194304] 0 2024-09-17T01:41:51.394 INFO:tasks.workunit.client.0.smithi082.stdout:9/676: truncate d4/f5f 4393336 0 2024-09-17T01:41:51.396 INFO:tasks.workunit.client.0.smithi082.stdout:1/837: creat d2/d3f/d24/dcf/f10b x:0 0 0 2024-09-17T01:41:51.399 INFO:tasks.workunit.client.0.smithi082.stdout:0/789: dwrite da/d1b/d23/d4d/f2a [0,4194304] 0 2024-09-17T01:41:51.400 INFO:tasks.workunit.client.0.smithi082.stdout:2/825: mkdir d1/d17/d38/d42/d52/d78/d10f 0 2024-09-17T01:41:51.402 INFO:tasks.workunit.client.0.smithi082.stdout:8/671: rename d3/dd/d18/l19 to d3/dd/d18/d2d/d3e/d4a/ld6 0 2024-09-17T01:41:51.405 INFO:tasks.workunit.client.0.smithi082.stdout:0/790: dread da/d1b/d23/d42/d43/d6b/ffc [0,4194304] 0 2024-09-17T01:41:51.411 INFO:tasks.workunit.client.0.smithi082.stdout:2/826: mkdir d1/d17/d38/d5c/d7d/d110 0 2024-09-17T01:41:51.415 INFO:tasks.workunit.client.0.smithi082.stdout:1/838: unlink d2/da/d2f/f31 0 2024-09-17T01:41:51.416 INFO:tasks.workunit.client.0.smithi082.stdout:3/746: write f0 [4599478,52402] 0 2024-09-17T01:41:51.417 INFO:tasks.workunit.client.0.smithi082.stdout:3/747: chown d9/db/f85 3 1 2024-09-17T01:41:51.422 INFO:tasks.workunit.client.0.smithi082.stdout:9/677: getdents d4/d27/d36/d3b/db0 0 2024-09-17T01:41:51.425 INFO:tasks.workunit.client.0.smithi082.stdout:6/815: write d1/d7/d10/d4f/d8e/feb [356717,42200] 0 2024-09-17T01:41:51.425 INFO:tasks.workunit.client.0.smithi082.stdout:1/839: mknod d2/da/d16/c10c 0 2024-09-17T01:41:51.427 INFO:tasks.workunit.client.0.smithi082.stdout:1/840: dread - d2/da/d2f/f72 zero size 2024-09-17T01:41:51.431 INFO:tasks.workunit.client.0.smithi082.stdout:6/816: creat d1/d1f/da7/ddd/f114 x:0 0 0 2024-09-17T01:41:51.432 INFO:tasks.workunit.client.0.smithi082.stdout:3/748: link d9/db/daf/d69/d79/d86/db5/cf6 d9/db/d95/c104 0 2024-09-17T01:41:51.434 INFO:tasks.workunit.client.0.smithi082.stdout:1/841: creat d2/d3f/d34/dc5/f10d x:0 0 0 2024-09-17T01:41:51.436 INFO:tasks.workunit.client.0.smithi082.stdout:2/827: getdents d1/d66/d85 0 2024-09-17T01:41:51.437 INFO:tasks.workunit.client.0.smithi082.stdout:6/817: symlink d1/d7/d10/d4f/dc/d2b/d48/l115 0 2024-09-17T01:41:51.440 INFO:tasks.workunit.client.0.smithi082.stdout:1/842: write d2/d3f/d24/db5/dea/ff7 [174333,11738] 0 2024-09-17T01:41:51.441 INFO:tasks.workunit.client.0.smithi082.stdout:2/828: truncate d1/d17/d38/d42/d52/f70 254913 0 2024-09-17T01:41:51.443 INFO:tasks.workunit.client.0.smithi082.stdout:6/818: truncate d1/d7/d10/d4f/f78 106830 0 2024-09-17T01:41:51.445 INFO:tasks.workunit.client.0.smithi082.stdout:1/843: symlink d2/d3f/d24/l10e 0 2024-09-17T01:41:51.446 INFO:tasks.workunit.client.0.smithi082.stdout:2/829: fdatasync d1/d17/d38/d42/d52/f76 0 2024-09-17T01:41:51.448 INFO:tasks.workunit.client.0.smithi082.stdout:6/819: symlink d1/d1f/l116 0 2024-09-17T01:41:51.450 INFO:tasks.workunit.client.0.smithi082.stdout:6/820: write d1/d7/d10/f4a [998345,98610] 0 2024-09-17T01:41:51.452 INFO:tasks.workunit.client.0.smithi082.stdout:5/852: dwrite db/d56/d78/f8a [4194304,4194304] 0 2024-09-17T01:41:51.452 INFO:tasks.workunit.client.0.smithi082.stdout:2/830: dread d1/d5a/d6d/dc2/fe2 [0,4194304] 0 2024-09-17T01:41:51.453 INFO:tasks.workunit.client.0.smithi082.stdout:1/844: rmdir d2/da/d76/db8 39 2024-09-17T01:41:51.455 INFO:tasks.workunit.client.0.smithi082.stdout:7/842: write d0/dd/d34/d58/d6e/d8a/fe3 [2550148,95202] 0 2024-09-17T01:41:51.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/845: write d2/d3f/d24/dcf/f10b [421852,72629] 0 2024-09-17T01:41:51.459 INFO:tasks.workunit.client.0.smithi082.stdout:7/843: write d0/dd/d34/d58/d6e/d8a/fe3 [1133785,15812] 0 2024-09-17T01:41:51.468 INFO:tasks.workunit.client.0.smithi082.stdout:7/844: readlink d0/dd/l26 0 2024-09-17T01:41:51.469 INFO:tasks.workunit.client.0.smithi082.stdout:7/845: readlink d0/l24 0 2024-09-17T01:41:51.469 INFO:tasks.workunit.client.0.smithi082.stdout:0/791: write da/df/d2b/d59/d6f/f87 [1570679,56544] 0 2024-09-17T01:41:51.472 INFO:tasks.workunit.client.0.smithi082.stdout:7/846: symlink d0/d62/d7e/dd4/d37/d86/l126 0 2024-09-17T01:41:51.474 INFO:tasks.workunit.client.0.smithi082.stdout:7/847: rmdir d0/d62 39 2024-09-17T01:41:51.475 INFO:tasks.workunit.client.0.smithi082.stdout:0/792: symlink da/d80/l116 0 2024-09-17T01:41:51.478 INFO:tasks.workunit.client.0.smithi082.stdout:0/793: symlink da/d80/l117 0 2024-09-17T01:41:51.479 INFO:tasks.workunit.client.0.smithi082.stdout:7/848: dread d0/dd/d2c/d55/fbd [0,4194304] 0 2024-09-17T01:41:51.479 INFO:tasks.workunit.client.0.smithi082.stdout:8/672: write d3/dd/d18/d2d/d3e/d4a/d68/fb7 [305472,57388] 0 2024-09-17T01:41:51.484 INFO:tasks.workunit.client.0.smithi082.stdout:7/849: symlink d0/dd/d34/l127 0 2024-09-17T01:41:51.486 INFO:tasks.workunit.client.0.smithi082.stdout:8/673: creat d3/fd7 x:0 0 0 2024-09-17T01:41:51.487 INFO:tasks.workunit.client.0.smithi082.stdout:7/850: rename d0/d3/db/f83 to d0/d3/db/d10/f128 0 2024-09-17T01:41:51.491 INFO:tasks.workunit.client.0.smithi082.stdout:7/851: stat d0/dd/d2c/d42/d77 0 2024-09-17T01:41:51.491 INFO:tasks.workunit.client.0.smithi082.stdout:9/678: dwrite d4/d27/d2d/d60/d11/d39/d31/f40 [4194304,4194304] 0 2024-09-17T01:41:51.493 INFO:tasks.workunit.client.0.smithi082.stdout:7/852: fdatasync d0/f13 0 2024-09-17T01:41:51.501 INFO:tasks.workunit.client.0.smithi082.stdout:0/794: dread da/df/d71/f51 [0,4194304] 0 2024-09-17T01:41:51.503 INFO:tasks.workunit.client.0.smithi082.stdout:3/749: dwrite d9/db/d8f/fc6 [0,4194304] 0 2024-09-17T01:41:51.513 INFO:tasks.workunit.client.0.smithi082.stdout:0/795: mknod da/df/d27/db5/c118 0 2024-09-17T01:41:51.514 INFO:tasks.workunit.client.0.smithi082.stdout:0/796: fdatasync da/df/df4/f10e 0 2024-09-17T01:41:51.517 INFO:tasks.workunit.client.0.smithi082.stdout:3/750: creat d9/db/daf/d69/f105 x:0 0 0 2024-09-17T01:41:51.521 INFO:tasks.workunit.client.0.smithi082.stdout:3/751: dread - d9/d35/dda/ffc zero size 2024-09-17T01:41:51.521 INFO:tasks.workunit.client.0.smithi082.stdout:0/797: mkdir da/d1b/d23/d42/d43/d119 0 2024-09-17T01:41:51.521 INFO:tasks.workunit.client.0.smithi082.stdout:3/752: mknod d9/db/d6d/de0/c106 0 2024-09-17T01:41:51.522 INFO:tasks.workunit.client.0.smithi082.stdout:0/798: write da/df/d2b/d59/fbd [1028377,81334] 0 2024-09-17T01:41:51.523 INFO:tasks.workunit.client.0.smithi082.stdout:0/799: fsync da/d80/fa4 0 2024-09-17T01:41:51.524 INFO:tasks.workunit.client.0.smithi082.stdout:0/800: fsync da/d80/fa4 0 2024-09-17T01:41:51.530 INFO:tasks.workunit.client.0.smithi082.stdout:0/801: rmdir da/df/d2b/d9a 39 2024-09-17T01:41:51.532 INFO:tasks.workunit.client.0.smithi082.stdout:7/853: dread d0/dd/fc7 [0,4194304] 0 2024-09-17T01:41:51.539 INFO:tasks.workunit.client.0.smithi082.stdout:7/854: mknod d0/d62/d7e/dd4/d37/d71/c129 0 2024-09-17T01:41:51.540 INFO:tasks.workunit.client.0.smithi082.stdout:6/821: dwrite d1/d1f/f9d [0,4194304] 0 2024-09-17T01:41:51.543 INFO:tasks.workunit.client.0.smithi082.stdout:5/853: write db/d56/dd6/f10b [3068125,12049] 0 2024-09-17T01:41:51.545 INFO:tasks.workunit.client.0.smithi082.stdout:7/855: mkdir d0/d62/d7e/dd4/d37/d71/d12a 0 2024-09-17T01:41:51.549 INFO:tasks.workunit.client.0.smithi082.stdout:0/802: link da/d1b/d23/d4d/fb3 da/d80/d99/f11a 0 2024-09-17T01:41:51.551 INFO:tasks.workunit.client.0.smithi082.stdout:0/803: write da/d80/d77/fcf [2733008,53662] 0 2024-09-17T01:41:51.553 INFO:tasks.workunit.client.0.smithi082.stdout:7/856: creat d0/dd/d2c/d42/f12b x:0 0 0 2024-09-17T01:41:51.554 INFO:tasks.workunit.client.0.smithi082.stdout:2/831: dwrite d1/d17/d29/d50/f6c [0,4194304] 0 2024-09-17T01:41:51.557 INFO:tasks.workunit.client.0.smithi082.stdout:1/846: write d2/da/d2d/d79/fd0 [1441897,127202] 0 2024-09-17T01:41:51.561 INFO:tasks.workunit.client.0.smithi082.stdout:1/847: chown d2/d3f/d24/d54/f66 11 1 2024-09-17T01:41:51.563 INFO:tasks.workunit.client.0.smithi082.stdout:0/804: rmdir da/df/d71/d92/df7 39 2024-09-17T01:41:51.568 INFO:tasks.workunit.client.0.smithi082.stdout:1/848: creat d2/d3f/d24/dcf/f10f x:0 0 0 2024-09-17T01:41:51.575 INFO:tasks.workunit.client.0.smithi082.stdout:1/849: rmdir d2/d3f/d24/dba 39 2024-09-17T01:41:51.580 INFO:tasks.workunit.client.0.smithi082.stdout:2/832: link d1/d17/d38/d5c/c95 d1/d17/d29/c111 0 2024-09-17T01:41:51.581 INFO:tasks.workunit.client.0.smithi082.stdout:1/850: rmdir d2/d3f/d34 39 2024-09-17T01:41:51.585 INFO:tasks.workunit.client.0.smithi082.stdout:8/674: dwrite d3/dd/f26 [0,4194304] 0 2024-09-17T01:41:51.587 INFO:tasks.workunit.client.0.smithi082.stdout:5/854: dread db/d56/d78/ff6 [0,4194304] 0 2024-09-17T01:41:51.601 INFO:tasks.workunit.client.0.smithi082.stdout:3/753: write d9/db/d49/d4e/d53/f98 [649644,6418] 0 2024-09-17T01:41:51.605 INFO:tasks.workunit.client.0.smithi082.stdout:1/851: link d2/d3f/d24/f81 d2/d3f/d24/db5/dec/dfc/ddf/dff/f110 0 2024-09-17T01:41:51.612 INFO:tasks.workunit.client.0.smithi082.stdout:7/857: truncate d0/d62/d7e/fd9 2321599 0 2024-09-17T01:41:51.614 INFO:tasks.workunit.client.0.smithi082.stdout:6/822: dwrite d1/d7/d10/f16 [0,4194304] 0 2024-09-17T01:41:51.617 INFO:tasks.workunit.client.0.smithi082.stdout:1/852: symlink d2/d3f/d24/dc8/d107/l111 0 2024-09-17T01:41:51.620 INFO:tasks.workunit.client.0.smithi082.stdout:2/833: dread d1/d17/d60/dc6/de8/f9a [0,4194304] 0 2024-09-17T01:41:51.622 INFO:tasks.workunit.client.0.smithi082.stdout:3/754: rename d9/db/daa/df3/de7/lfe to d9/db/d49/d4e/d53/l107 0 2024-09-17T01:41:51.625 INFO:tasks.workunit.client.0.smithi082.stdout:0/805: dwrite da/d80/d77/f91 [0,4194304] 0 2024-09-17T01:41:51.628 INFO:tasks.workunit.client.0.smithi082.stdout:1/853: mknod d2/da/d2d/d79/c112 0 2024-09-17T01:41:51.633 INFO:tasks.workunit.client.0.smithi082.stdout:2/834: creat d1/d10/f112 x:0 0 0 2024-09-17T01:41:51.636 INFO:tasks.workunit.client.0.smithi082.stdout:2/835: write d1/d17/d29/dc9/fd3 [467948,41416] 0 2024-09-17T01:41:51.637 INFO:tasks.workunit.client.0.smithi082.stdout:5/855: dwrite db/d56/d18/f62 [0,4194304] 0 2024-09-17T01:41:51.638 INFO:tasks.workunit.client.0.smithi082.stdout:5/856: fsync db/d56/dd6/ffc 0 2024-09-17T01:41:51.639 INFO:tasks.workunit.client.0.smithi082.stdout:7/858: creat d0/dd/d34/d11f/f12c x:0 0 0 2024-09-17T01:41:51.639 INFO:tasks.workunit.client.0.smithi082.stdout:8/675: dread d3/dd/d18/d2d/d3b/f69 [4194304,4194304] 0 2024-09-17T01:41:51.641 INFO:tasks.workunit.client.0.smithi082.stdout:3/755: readlink d9/db/d49/d4e/d53/l107 0 2024-09-17T01:41:51.646 INFO:tasks.workunit.client.0.smithi082.stdout:0/806: mknod da/df/d2b/d59/d6f/dd9/c11b 0 2024-09-17T01:41:51.647 INFO:tasks.workunit.client.0.smithi082.stdout:2/836: fdatasync d1/d10/f98 0 2024-09-17T01:41:51.654 INFO:tasks.workunit.client.0.smithi082.stdout:5/857: dwrite db/d2b/fcb [0,4194304] 0 2024-09-17T01:41:51.654 INFO:tasks.workunit.client.0.smithi082.stdout:5/858: chown db/f2d 7110198 1 2024-09-17T01:41:51.655 INFO:tasks.workunit.client.0.smithi082.stdout:5/859: dread - db/d1e/d20/ff5 zero size 2024-09-17T01:41:51.656 INFO:tasks.workunit.client.0.smithi082.stdout:8/676: creat d3/dd/d18/d3a/fd8 x:0 0 0 2024-09-17T01:41:51.659 INFO:tasks.workunit.client.0.smithi082.stdout:0/807: truncate da/d1b/fb4 656969 0 2024-09-17T01:41:51.660 INFO:tasks.workunit.client.0.smithi082.stdout:6/823: truncate d1/d7/d10/d4f/dc/d1d/d36/d3e/f73 1511769 0 2024-09-17T01:41:51.660 INFO:tasks.workunit.client.0.smithi082.stdout:0/808: truncate da/d80/fa4 211411 0 2024-09-17T01:41:51.668 INFO:tasks.workunit.client.0.smithi082.stdout:1/854: truncate d2/df/f1d 2785944 0 2024-09-17T01:41:51.668 INFO:tasks.workunit.client.0.smithi082.stdout:8/677: fsync d3/dd/d18/d2d/d3e/d43/f45 0 2024-09-17T01:41:51.671 INFO:tasks.workunit.client.0.smithi082.stdout:6/824: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/l117 0 2024-09-17T01:41:51.673 INFO:tasks.workunit.client.0.smithi082.stdout:0/809: creat da/df/d27/db5/f11c x:0 0 0 2024-09-17T01:41:51.682 INFO:tasks.workunit.client.0.smithi082.stdout:2/837: creat d1/d17/f113 x:0 0 0 2024-09-17T01:41:51.683 INFO:tasks.workunit.client.0.smithi082.stdout:3/756: truncate d9/db/d26/fa1 223488 0 2024-09-17T01:41:51.689 INFO:tasks.workunit.client.0.smithi082.stdout:6/825: dwrite d1/d7/d10/d4f/d32/f9b [8388608,4194304] 0 2024-09-17T01:41:51.724 INFO:tasks.workunit.client.0.smithi082.stdout:1/855: mknod d2/da/d76/db8/c113 0 2024-09-17T01:41:51.726 INFO:tasks.workunit.client.0.smithi082.stdout:3/757: mkdir d9/db/d26/dbd/d108 0 2024-09-17T01:41:51.727 INFO:tasks.workunit.client.0.smithi082.stdout:2/838: fsync d1/d35/fd2 0 2024-09-17T01:41:51.729 INFO:tasks.workunit.client.0.smithi082.stdout:2/839: stat d1/d17/d38/de6 0 2024-09-17T01:41:51.742 INFO:tasks.workunit.client.0.smithi082.stdout:1/856: chown d2/da/d76/d93/fe2 10541859 1 2024-09-17T01:41:51.743 INFO:tasks.workunit.client.0.smithi082.stdout:3/758: creat d9/d35/f109 x:0 0 0 2024-09-17T01:41:51.745 INFO:tasks.workunit.client.0.smithi082.stdout:3/759: dread - d9/db/daf/d69/f105 zero size 2024-09-17T01:41:51.747 INFO:tasks.workunit.client.0.smithi082.stdout:8/678: creat d3/dd/d18/d2d/d3e/d4a/d66/fd9 x:0 0 0 2024-09-17T01:41:51.761 INFO:tasks.workunit.client.0.smithi082.stdout:0/810: write da/d1b/d23/d4d/fb3 [1210914,104309] 0 2024-09-17T01:41:51.761 INFO:tasks.workunit.client.0.smithi082.stdout:1/857: truncate d2/f11 1872828 0 2024-09-17T01:41:51.767 INFO:tasks.workunit.client.0.smithi082.stdout:0/811: symlink da/df/l11d 0 2024-09-17T01:41:51.768 INFO:tasks.workunit.client.0.smithi082.stdout:1/858: unlink d2/d3f/d34/l73 0 2024-09-17T01:41:51.769 INFO:tasks.workunit.client.0.smithi082.stdout:3/760: write d9/db/daf/d69/d79/d86/f87 [815529,80818] 0 2024-09-17T01:41:51.771 INFO:tasks.workunit.client.0.smithi082.stdout:2/840: dwrite d1/d66/d85/fac [0,4194304] 0 2024-09-17T01:41:51.771 INFO:tasks.workunit.client.0.smithi082.stdout:8/679: write d3/dd/d18/d3a/f46 [960895,42462] 0 2024-09-17T01:41:51.774 INFO:tasks.workunit.client.0.smithi082.stdout:6/826: dwrite d1/d7/d10/d4f/dc/d2b/f53 [4194304,4194304] 0 2024-09-17T01:41:51.775 INFO:tasks.workunit.client.0.smithi082.stdout:8/680: chown d3/dd/d18/d2d/d3e/d43 125336911 1 2024-09-17T01:41:51.777 INFO:tasks.workunit.client.0.smithi082.stdout:8/681: read - d3/dd/fca zero size 2024-09-17T01:41:51.777 INFO:tasks.workunit.client.0.smithi082.stdout:3/761: dread d9/db/f8a [0,4194304] 0 2024-09-17T01:41:51.777 INFO:tasks.workunit.client.0.smithi082.stdout:6/827: write d1/d7/d10/d4f/fd8 [3265027,4161] 0 2024-09-17T01:41:51.777 INFO:tasks.workunit.client.0.smithi082.stdout:1/859: dread - d2/da/d2f/d47/fa6 zero size 2024-09-17T01:41:51.779 INFO:tasks.workunit.client.0.smithi082.stdout:0/812: getdents da/d80/d99 0 2024-09-17T01:41:51.781 INFO:tasks.workunit.client.0.smithi082.stdout:1/860: write d2/d3f/d34/dc5/f10d [934327,75044] 0 2024-09-17T01:41:51.782 INFO:tasks.workunit.client.0.smithi082.stdout:2/841: rmdir d1/d17/d38/d5c 39 2024-09-17T01:41:51.783 INFO:tasks.workunit.client.0.smithi082.stdout:0/813: write da/df/d2b/d59/d6f/da6/f112 [590503,115980] 0 2024-09-17T01:41:51.787 INFO:tasks.workunit.client.0.smithi082.stdout:8/682: creat d3/dd/d18/d2d/d58/fda x:0 0 0 2024-09-17T01:41:51.788 INFO:tasks.workunit.client.0.smithi082.stdout:3/762: unlink d9/db/daf/d69/d9c/lb6 0 2024-09-17T01:41:51.789 INFO:tasks.workunit.client.0.smithi082.stdout:6/828: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/f118 x:0 0 0 2024-09-17T01:41:51.791 INFO:tasks.workunit.client.0.smithi082.stdout:0/814: dwrite da/d1b/d23/d4d/f75 [0,4194304] 0 2024-09-17T01:41:51.793 INFO:tasks.workunit.client.0.smithi082.stdout:2/842: dread - d1/d17/d38/d5c/f10c zero size 2024-09-17T01:41:51.796 INFO:tasks.workunit.client.0.smithi082.stdout:0/815: unlink l5 0 2024-09-17T01:41:51.797 INFO:tasks.workunit.client.0.smithi082.stdout:6/829: creat d1/d7/d10/d4f/dc/d2b/db2/f119 x:0 0 0 2024-09-17T01:41:51.798 INFO:tasks.workunit.client.0.smithi082.stdout:0/816: chown da/d80/d77/lef 15630744 1 2024-09-17T01:41:51.799 INFO:tasks.workunit.client.0.smithi082.stdout:1/861: mkdir d2/da/d16/d114 0 2024-09-17T01:41:51.799 INFO:tasks.workunit.client.0.smithi082.stdout:6/830: stat d1/d1f/da7/ddd/lb4 0 2024-09-17T01:41:51.801 INFO:tasks.workunit.client.0.smithi082.stdout:0/817: fsync da/df/d2b/d59/fbd 0 2024-09-17T01:41:51.803 INFO:tasks.workunit.client.0.smithi082.stdout:8/683: dwrite d3/dd/f23 [0,4194304] 0 2024-09-17T01:41:51.803 INFO:tasks.workunit.client.0.smithi082.stdout:3/763: read d9/db/d26/f3b [1327652,118181] 0 2024-09-17T01:41:51.809 INFO:tasks.workunit.client.0.smithi082.stdout:3/764: creat d9/db/daa/df3/de7/f10a x:0 0 0 2024-09-17T01:41:51.809 INFO:tasks.workunit.client.0.smithi082.stdout:6/831: read d1/d7/d10/d4f/dc/d1d/d36/f91 [751901,37921] 0 2024-09-17T01:41:51.810 INFO:tasks.workunit.client.0.smithi082.stdout:8/684: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/ddb 0 2024-09-17T01:41:51.814 INFO:tasks.workunit.client.0.smithi082.stdout:0/818: creat da/df/d71/d92/df7/dbe/dfb/f11e x:0 0 0 2024-09-17T01:41:51.815 INFO:tasks.workunit.client.0.smithi082.stdout:3/765: symlink d9/db/daa/dec/l10b 0 2024-09-17T01:41:51.817 INFO:tasks.workunit.client.0.smithi082.stdout:2/843: dread d1/d66/f8d [0,4194304] 0 2024-09-17T01:41:51.821 INFO:tasks.workunit.client.0.smithi082.stdout:6/832: dwrite d1/d7/d10/f9f [0,4194304] 0 2024-09-17T01:41:51.825 INFO:tasks.workunit.client.0.smithi082.stdout:8/685: dwrite d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fd0 [0,4194304] 0 2024-09-17T01:41:51.825 INFO:tasks.workunit.client.0.smithi082.stdout:2/844: dread d1/d5a/d6d/fe1 [0,4194304] 0 2024-09-17T01:41:51.831 INFO:tasks.workunit.client.0.smithi082.stdout:6/833: symlink d1/d1f/db0/l11a 0 2024-09-17T01:41:51.834 INFO:tasks.workunit.client.0.smithi082.stdout:8/686: truncate d3/dd/d18/d34/f5c 340860 0 2024-09-17T01:41:51.835 INFO:tasks.workunit.client.0.smithi082.stdout:8/687: fsync d3/dd/d18/d3a/fd8 0 2024-09-17T01:41:51.837 INFO:tasks.workunit.client.0.smithi082.stdout:6/834: symlink d1/d1f/da7/ddd/dbf/l11b 0 2024-09-17T01:41:51.841 INFO:tasks.workunit.client.0.smithi082.stdout:8/688: mknod d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/cdc 0 2024-09-17T01:41:51.846 INFO:tasks.workunit.client.0.smithi082.stdout:0/819: dwrite da/df/d2b/f89 [0,4194304] 0 2024-09-17T01:41:51.847 INFO:tasks.workunit.client.0.smithi082.stdout:0/820: chown da/d1b/d23/d42 20281 1 2024-09-17T01:41:51.847 INFO:tasks.workunit.client.0.smithi082.stdout:0/821: fdatasync da/df/d27/fc9 0 2024-09-17T01:41:51.848 INFO:tasks.workunit.client.0.smithi082.stdout:2/845: rename d1/d17/d29/l2b to d1/d17/d38/l114 0 2024-09-17T01:41:51.849 INFO:tasks.workunit.client.0.smithi082.stdout:2/846: readlink d1/d17/d38/l92 0 2024-09-17T01:41:51.849 INFO:tasks.workunit.client.0.smithi082.stdout:0/822: dread - da/df/d71/d92/df7/dbe/dfb/f11e zero size 2024-09-17T01:41:51.850 INFO:tasks.workunit.client.0.smithi082.stdout:8/689: creat d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/fdd x:0 0 0 2024-09-17T01:41:51.851 INFO:tasks.workunit.client.0.smithi082.stdout:8/690: stat d3/dd/d18 0 2024-09-17T01:41:51.854 INFO:tasks.workunit.client.0.smithi082.stdout:8/691: truncate d3/dd/fca 803238 0 2024-09-17T01:41:51.854 INFO:tasks.workunit.client.0.smithi082.stdout:3/766: dwrite d9/d78/d88/ff7 [0,4194304] 0 2024-09-17T01:41:51.855 INFO:tasks.workunit.client.0.smithi082.stdout:0/823: chown da/df/c20 199 1 2024-09-17T01:41:51.856 INFO:tasks.workunit.client.0.smithi082.stdout:3/767: readlink d9/db/d26/dbd/l100 0 2024-09-17T01:41:51.857 INFO:tasks.workunit.client.0.smithi082.stdout:3/768: stat d9/db/daa/df3/de7/c101 0 2024-09-17T01:41:51.860 INFO:tasks.workunit.client.0.smithi082.stdout:0/824: creat da/d1b/d23/d4d/f11f x:0 0 0 2024-09-17T01:41:51.865 INFO:tasks.workunit.client.0.smithi082.stdout:8/692: creat d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/dcf/fde x:0 0 0 2024-09-17T01:41:51.866 INFO:tasks.workunit.client.0.smithi082.stdout:6/835: dwrite d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:51.866 INFO:tasks.workunit.client.0.smithi082.stdout:0/825: symlink da/df/d71/d92/df7/d69/l120 0 2024-09-17T01:41:51.867 INFO:tasks.workunit.client.0.smithi082.stdout:2/847: write d1/d35/f37 [4814343,22327] 0 2024-09-17T01:41:51.870 INFO:tasks.workunit.client.0.smithi082.stdout:0/826: rmdir da/df/df4 39 2024-09-17T01:41:51.872 INFO:tasks.workunit.client.0.smithi082.stdout:2/848: creat d1/d17/d60/dc6/f115 x:0 0 0 2024-09-17T01:41:51.874 INFO:tasks.workunit.client.0.smithi082.stdout:2/849: write d1/d17/d60/dc6/f115 [486469,108035] 0 2024-09-17T01:41:51.874 INFO:tasks.workunit.client.0.smithi082.stdout:0/827: dread - da/df/d71/d92/fda zero size 2024-09-17T01:41:51.880 INFO:tasks.workunit.client.0.smithi082.stdout:3/769: dread d9/db/d26/f96 [0,4194304] 0 2024-09-17T01:41:51.882 INFO:tasks.workunit.client.0.smithi082.stdout:3/770: write d9/db/daf/d69/d79/d86/db5/fe4 [836506,95367] 0 2024-09-17T01:41:51.883 INFO:tasks.workunit.client.0.smithi082.stdout:2/850: rename d1/l22 to d1/d17/d60/l116 0 2024-09-17T01:41:51.885 INFO:tasks.workunit.client.0.smithi082.stdout:8/693: dread d3/dd/d18/d3a/f4b [0,4194304] 0 2024-09-17T01:41:51.886 INFO:tasks.workunit.client.0.smithi082.stdout:3/771: mkdir d9/db/daf/d69/d10c 0 2024-09-17T01:41:51.887 INFO:tasks.workunit.client.0.smithi082.stdout:2/851: mknod d1/d17/d38/d42/d52/d78/da0/dba/c117 0 2024-09-17T01:41:51.891 INFO:tasks.workunit.client.0.smithi082.stdout:6/836: dread d1/d7/d10/d4f/d32/f3f [0,4194304] 0 2024-09-17T01:41:51.892 INFO:tasks.workunit.client.0.smithi082.stdout:3/772: creat d9/db/d6d/de0/f10d x:0 0 0 2024-09-17T01:41:51.893 INFO:tasks.workunit.client.0.smithi082.stdout:2/852: dread - d1/d5a/d6d/fa9 zero size 2024-09-17T01:41:51.894 INFO:tasks.workunit.client.0.smithi082.stdout:6/837: rmdir d1/d1f/da7/ddd/df1/df4 39 2024-09-17T01:41:51.895 INFO:tasks.workunit.client.0.smithi082.stdout:2/853: truncate d1/f4d 4316264 0 2024-09-17T01:41:51.896 INFO:tasks.workunit.client.0.smithi082.stdout:8/694: symlink d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/dc7/ldf 0 2024-09-17T01:41:51.897 INFO:tasks.workunit.client.0.smithi082.stdout:3/773: unlink d9/db/daf/d69/d79/fc3 0 2024-09-17T01:41:51.899 INFO:tasks.workunit.client.0.smithi082.stdout:0/828: dwrite da/df/d2b/f39 [0,4194304] 0 2024-09-17T01:41:51.900 INFO:tasks.workunit.client.0.smithi082.stdout:2/854: mknod d1/d5a/d6d/dc2/c118 0 2024-09-17T01:41:51.901 INFO:tasks.workunit.client.0.smithi082.stdout:6/838: mkdir d1/d7/d10/d4f/dc/d1d/d36/d7a/d11c 0 2024-09-17T01:41:51.904 INFO:tasks.workunit.client.0.smithi082.stdout:8/695: truncate d3/dd/d18/d2d/d3e/d4a/f88 370861 0 2024-09-17T01:41:51.911 INFO:tasks.workunit.client.0.smithi082.stdout:6/839: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/f11d x:0 0 0 2024-09-17T01:41:51.912 INFO:tasks.workunit.client.0.smithi082.stdout:2/855: dread d1/d10/f86 [0,4194304] 0 2024-09-17T01:41:51.914 INFO:tasks.workunit.client.0.smithi082.stdout:2/856: truncate d1/d17/f113 252397 0 2024-09-17T01:41:51.916 INFO:tasks.workunit.client.0.smithi082.stdout:3/774: getdents d9/d78/d88 0 2024-09-17T01:41:51.917 INFO:tasks.workunit.client.0.smithi082.stdout:3/775: chown d9/db/f37 3531 1 2024-09-17T01:41:51.918 INFO:tasks.workunit.client.0.smithi082.stdout:3/776: dread - d9/ff9 zero size 2024-09-17T01:41:51.918 INFO:tasks.workunit.client.0.smithi082.stdout:2/857: creat d1/d5a/d6d/f119 x:0 0 0 2024-09-17T01:41:52.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:51 smithi167 ceph-mon[35643]: pgmap v29: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 80 MiB/s rd, 203 MiB/s wr, 485 op/s 2024-09-17T01:41:52.043 INFO:tasks.workunit.client.0.smithi082.stdout:3/777: chown d9/db/daf/d69/d79/fd0 52 1 2024-09-17T01:41:52.043 INFO:tasks.workunit.client.0.smithi082.stdout:0/829: write da/d1b/d23/d42/d43/d6b/fb7 [1696742,3071] 0 2024-09-17T01:41:52.044 INFO:tasks.workunit.client.0.smithi082.stdout:8/696: write d3/f7 [3972631,87635] 0 2024-09-17T01:41:52.046 INFO:tasks.workunit.client.0.smithi082.stdout:6/840: getdents d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c 0 2024-09-17T01:41:52.048 INFO:tasks.workunit.client.0.smithi082.stdout:8/697: write d3/dd/d18/d2d/d3b/f48 [2333629,105590] 0 2024-09-17T01:41:52.050 INFO:tasks.workunit.client.0.smithi082.stdout:6/841: dread d1/d7/d10/d4f/dc/d2b/d48/f76 [0,4194304] 0 2024-09-17T01:41:52.051 INFO:tasks.workunit.client.0.smithi082.stdout:6/842: truncate d1/d7/ff5 1528720 0 2024-09-17T01:41:52.055 INFO:tasks.workunit.client.0.smithi082.stdout:3/778: rename d9/db/d49/d4e/d53/d5b/c61 to d9/db/d6d/de0/c10e 0 2024-09-17T01:41:52.057 INFO:tasks.workunit.client.0.smithi082.stdout:0/830: truncate da/d1b/d23/d42/f58 1617604 0 2024-09-17T01:41:52.057 INFO:tasks.workunit.client.0.smithi082.stdout:2/858: dwrite d1/d17/d29/f4c [0,4194304] 0 2024-09-17T01:41:52.057 INFO:tasks.workunit.client.0.smithi082.stdout:6/843: dread d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:52.059 INFO:tasks.workunit.client.0.smithi082.stdout:3/779: truncate d9/db/daa/df3/fcd 463932 0 2024-09-17T01:41:52.059 INFO:tasks.workunit.client.0.smithi082.stdout:0/831: chown da/df/d71/d92/df7/dbe/dfb/f11e 33 1 2024-09-17T01:41:52.062 INFO:tasks.workunit.client.0.smithi082.stdout:2/859: mkdir d1/d17/d38/d42/d52/de5/d11a 0 2024-09-17T01:41:52.070 INFO:tasks.workunit.client.0.smithi082.stdout:2/860: symlink d1/d17/d29/d50/l11b 0 2024-09-17T01:41:52.071 INFO:tasks.workunit.client.0.smithi082.stdout:0/832: symlink da/d1b/d23/l121 0 2024-09-17T01:41:52.073 INFO:tasks.workunit.client.0.smithi082.stdout:2/861: chown d1/d17/d29/c111 3 1 2024-09-17T01:41:52.084 INFO:tasks.workunit.client.0.smithi082.stdout:3/780: dread d9/db/d26/f27 [0,4194304] 0 2024-09-17T01:41:52.184 INFO:tasks.workunit.client.0.smithi082.stdout:0/833: truncate da/df/d71/d92/df7/f81 2193428 0 2024-09-17T01:41:52.186 INFO:tasks.workunit.client.0.smithi082.stdout:0/834: creat da/df/d71/d92/df7/f122 x:0 0 0 2024-09-17T01:41:52.188 INFO:tasks.workunit.client.0.smithi082.stdout:0/835: chown da/df/d2b/f39 202 1 2024-09-17T01:41:52.189 INFO:tasks.workunit.client.0.smithi082.stdout:2/862: dwrite d1/d17/d38/d42/fd8 [0,4194304] 0 2024-09-17T01:41:52.190 INFO:tasks.workunit.client.0.smithi082.stdout:9/679: sync 2024-09-17T01:41:52.195 INFO:tasks.workunit.client.0.smithi082.stdout:9/680: stat d4/d27/d2d/d60/d11/d39/d44/f72 0 2024-09-17T01:41:52.200 INFO:tasks.workunit.client.0.smithi082.stdout:3/781: dread d9/d35/f43 [0,4194304] 0 2024-09-17T01:41:52.201 INFO:tasks.workunit.client.0.smithi082.stdout:3/782: stat d9/f47 0 2024-09-17T01:41:52.204 INFO:tasks.workunit.client.0.smithi082.stdout:9/681: creat d4/d59/fe0 x:0 0 0 2024-09-17T01:41:52.205 INFO:tasks.workunit.client.0.smithi082.stdout:9/682: chown d4/d59/fe0 3215622 1 2024-09-17T01:41:52.205 INFO:tasks.workunit.client.0.smithi082.stdout:3/783: dread d9/db/daf/d69/d79/d86/f87 [0,4194304] 0 2024-09-17T01:41:52.206 INFO:tasks.workunit.client.0.smithi082.stdout:3/784: chown d9/db/d49/l48 5166413 1 2024-09-17T01:41:52.208 INFO:tasks.workunit.client.0.smithi082.stdout:3/785: truncate d9/db/d49/fe2 1042510 0 2024-09-17T01:41:52.210 INFO:tasks.workunit.client.0.smithi082.stdout:0/836: write da/ffd [581425,123154] 0 2024-09-17T01:41:52.211 INFO:tasks.workunit.client.0.smithi082.stdout:9/683: rename d4/d27/d2d/d60/dba to d4/dd2/de1 0 2024-09-17T01:41:52.211 INFO:tasks.workunit.client.0.smithi082.stdout:0/837: write da/d1b/d23/d4d/f75 [4049950,37009] 0 2024-09-17T01:41:52.212 INFO:tasks.workunit.client.0.smithi082.stdout:2/863: link d1/d66/d85/l89 d1/d5a/d6d/l11c 0 2024-09-17T01:41:52.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:51 smithi082 ceph-mon[28077]: pgmap v29: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 80 MiB/s rd, 203 MiB/s wr, 485 op/s 2024-09-17T01:41:52.214 INFO:tasks.workunit.client.0.smithi082.stdout:3/786: stat d9/l77 0 2024-09-17T01:41:52.215 INFO:tasks.workunit.client.0.smithi082.stdout:3/787: stat d9/db/f17 0 2024-09-17T01:41:52.216 INFO:tasks.workunit.client.0.smithi082.stdout:0/838: dread da/d1b/d23/d4d/f2a [0,4194304] 0 2024-09-17T01:41:52.216 INFO:tasks.workunit.client.0.smithi082.stdout:3/788: write d9/ff9 [900877,121611] 0 2024-09-17T01:41:52.219 INFO:tasks.workunit.client.0.smithi082.stdout:2/864: creat d1/d17/d38/de6/f11d x:0 0 0 2024-09-17T01:41:52.222 INFO:tasks.workunit.client.0.smithi082.stdout:3/789: truncate d9/db/d26/f81 379452 0 2024-09-17T01:41:52.225 INFO:tasks.workunit.client.0.smithi082.stdout:2/865: rmdir d1/d5a 39 2024-09-17T01:41:52.228 INFO:tasks.workunit.client.0.smithi082.stdout:3/790: creat d9/db/d95/f10f x:0 0 0 2024-09-17T01:41:52.229 INFO:tasks.workunit.client.0.smithi082.stdout:3/791: chown d9/db/daf/d69/f105 251524447 1 2024-09-17T01:41:52.231 INFO:tasks.workunit.client.0.smithi082.stdout:3/792: rmdir d9/d35 39 2024-09-17T01:41:52.235 INFO:tasks.workunit.client.0.smithi082.stdout:3/793: mkdir d9/db/d26/d110 0 2024-09-17T01:41:52.236 INFO:tasks.workunit.client.0.smithi082.stdout:2/866: link d1/d17/d38/d42/d52/fbd d1/d66/d85/dde/f11e 0 2024-09-17T01:41:52.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/684: write d4/d27/d2d/d60/d11/d39/d29/d6d/f90 [450004,86717] 0 2024-09-17T01:41:52.238 INFO:tasks.workunit.client.0.smithi082.stdout:3/794: rename d9/db/daf/fa8 to d9/db/daf/dbf/f111 0 2024-09-17T01:41:52.240 INFO:tasks.workunit.client.0.smithi082.stdout:2/867: readlink d1/d5a/d6d/l91 0 2024-09-17T01:41:52.242 INFO:tasks.workunit.client.0.smithi082.stdout:9/685: symlink d4/le2 0 2024-09-17T01:41:52.254 INFO:tasks.workunit.client.0.smithi082.stdout:3/795: getdents d9/d35 0 2024-09-17T01:41:52.257 INFO:tasks.workunit.client.0.smithi082.stdout:3/796: chown d9/db/daf/d69/d79/d86/f87 624 1 2024-09-17T01:41:52.259 INFO:tasks.workunit.client.0.smithi082.stdout:2/868: dwrite d1/d10/f6b [0,4194304] 0 2024-09-17T01:41:52.262 INFO:tasks.workunit.client.0.smithi082.stdout:2/869: dread - d1/d90/fbe zero size 2024-09-17T01:41:52.264 INFO:tasks.workunit.client.0.smithi082.stdout:9/686: dwrite d4/d27/d2d/d3d/f5c [0,4194304] 0 2024-09-17T01:41:52.269 INFO:tasks.workunit.client.0.smithi082.stdout:3/797: dwrite d9/db/d49/d4e/d53/f98 [0,4194304] 0 2024-09-17T01:41:52.270 INFO:tasks.workunit.client.0.smithi082.stdout:3/798: stat d9/db/c38 0 2024-09-17T01:41:52.271 INFO:tasks.workunit.client.0.smithi082.stdout:2/870: rename d1/d17/d38/d42/d52/d78/da0/dba/leb to d1/d17/d29/ddc/l11f 0 2024-09-17T01:41:52.276 INFO:tasks.workunit.client.0.smithi082.stdout:3/799: creat d9/db/daf/d69/dbc/f112 x:0 0 0 2024-09-17T01:41:52.277 INFO:tasks.workunit.client.0.smithi082.stdout:2/871: fdatasync d1/d10/f86 0 2024-09-17T01:41:52.281 INFO:tasks.workunit.client.0.smithi082.stdout:2/872: rename d1/d17/d60/dc6/de8/la2 to d1/d17/d60/l120 0 2024-09-17T01:41:52.281 INFO:tasks.workunit.client.0.smithi082.stdout:9/687: read d4/d27/d2d/d60/d11/d39/d44/f72 [348684,31449] 0 2024-09-17T01:41:52.282 INFO:tasks.workunit.client.0.smithi082.stdout:9/688: dread - d4/d59/fe0 zero size 2024-09-17T01:41:52.285 INFO:tasks.workunit.client.0.smithi082.stdout:2/873: truncate d1/d17/d38/d42/d52/fcd 826154 0 2024-09-17T01:41:52.303 INFO:tasks.workunit.client.0.smithi082.stdout:2/874: write d1/d17/f7a [2398894,32701] 0 2024-09-17T01:41:52.305 INFO:tasks.workunit.client.0.smithi082.stdout:9/689: dwrite d4/d27/d2d/d60/d11/d37/f38 [0,4194304] 0 2024-09-17T01:41:52.310 INFO:tasks.workunit.client.0.smithi082.stdout:2/875: getdents d1/d66/d85/dde 0 2024-09-17T01:41:52.311 INFO:tasks.workunit.client.0.smithi082.stdout:2/876: read - d1/d17/d38/f9e zero size 2024-09-17T01:41:52.312 INFO:tasks.workunit.client.0.smithi082.stdout:9/690: dread d4/d27/d2d/d60/d11/d39/d31/f7a [0,4194304] 0 2024-09-17T01:41:52.314 INFO:tasks.workunit.client.0.smithi082.stdout:9/691: creat d4/da6/fe3 x:0 0 0 2024-09-17T01:41:52.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/692: symlink d4/dd2/le4 0 2024-09-17T01:41:52.319 INFO:tasks.workunit.client.0.smithi082.stdout:9/693: symlink d4/dd2/le5 0 2024-09-17T01:41:52.320 INFO:tasks.workunit.client.0.smithi082.stdout:9/694: unlink d4/d59/d63/l74 0 2024-09-17T01:41:52.328 INFO:tasks.workunit.client.0.smithi082.stdout:9/695: write d4/d27/d36/f4e [627553,60889] 0 2024-09-17T01:41:52.714 INFO:tasks.workunit.client.0.smithi082.stdout:7/859: sync 2024-09-17T01:41:52.812 INFO:tasks.workunit.client.0.smithi082.stdout:5/860: sync 2024-09-17T01:41:52.812 INFO:tasks.workunit.client.0.smithi082.stdout:8/698: sync 2024-09-17T01:41:52.812 INFO:tasks.workunit.client.0.smithi082.stdout:1/862: sync 2024-09-17T01:41:52.815 INFO:tasks.workunit.client.0.smithi082.stdout:1/863: chown d2/d3f/d24/dba/cbd 501883 1 2024-09-17T01:41:52.816 INFO:tasks.workunit.client.0.smithi082.stdout:5/861: mknod db/d56/d78/da0/c11c 0 2024-09-17T01:41:52.817 INFO:tasks.workunit.client.0.smithi082.stdout:5/862: chown db/d1e/d20/d30/dc6/dd1/d102/cbf 7870 1 2024-09-17T01:41:52.818 INFO:tasks.workunit.client.0.smithi082.stdout:8/699: truncate d3/f20 7680371 0 2024-09-17T01:41:52.823 INFO:tasks.workunit.client.0.smithi082.stdout:1/864: symlink d2/d3f/d24/l115 0 2024-09-17T01:41:52.824 INFO:tasks.workunit.client.0.smithi082.stdout:8/700: mknod d3/ce0 0 2024-09-17T01:41:52.829 INFO:tasks.workunit.client.0.smithi082.stdout:1/865: mkdir d2/da/d16/d114/d116 0 2024-09-17T01:41:52.832 INFO:tasks.workunit.client.0.smithi082.stdout:1/866: creat d2/da/d16/d114/d116/f117 x:0 0 0 2024-09-17T01:41:52.835 INFO:tasks.workunit.client.0.smithi082.stdout:8/701: mknod d3/dd/d18/d2d/d3e/d4a/d66/d6e/ce1 0 2024-09-17T01:41:52.837 INFO:tasks.workunit.client.0.smithi082.stdout:1/867: rename d2/da/d2f/c8b to d2/d3f/d24/db5/dec/c118 0 2024-09-17T01:41:52.838 INFO:tasks.workunit.client.0.smithi082.stdout:8/702: mknod d3/dd/d18/d3a/ce2 0 2024-09-17T01:41:52.839 INFO:tasks.workunit.client.0.smithi082.stdout:8/703: stat d3/dd/d18/d34/c32 0 2024-09-17T01:41:52.840 INFO:tasks.workunit.client.0.smithi082.stdout:8/704: chown d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86 47161 1 2024-09-17T01:41:52.841 INFO:tasks.workunit.client.0.smithi082.stdout:8/705: dread - d3/dd/d18/d51/dae/fd5 zero size 2024-09-17T01:41:52.844 INFO:tasks.workunit.client.0.smithi082.stdout:8/706: creat d3/dd/d18/d2d/d3e/fe3 x:0 0 0 2024-09-17T01:41:52.845 INFO:tasks.workunit.client.0.smithi082.stdout:8/707: chown d3/dd/d18/d34/l8d 7263052 1 2024-09-17T01:41:52.847 INFO:tasks.workunit.client.0.smithi082.stdout:1/868: link d2/d3f/d24/f81 d2/da/d16/f119 0 2024-09-17T01:41:52.848 INFO:tasks.workunit.client.0.smithi082.stdout:1/869: chown d2/d3f/d24/f23 42478 1 2024-09-17T01:41:52.853 INFO:tasks.workunit.client.0.smithi082.stdout:1/870: read d2/df/d46/f49 [2070783,88711] 0 2024-09-17T01:41:52.856 INFO:tasks.workunit.client.0.smithi082.stdout:1/871: symlink d2/d3f/d24/db5/dec/dfc/ddf/dff/l11a 0 2024-09-17T01:41:52.868 INFO:tasks.workunit.client.0.smithi082.stdout:1/872: dread d2/d3f/d24/db5/dec/dfc/dc6/fe9 [0,4194304] 0 2024-09-17T01:41:52.878 INFO:tasks.workunit.client.0.smithi082.stdout:7/860: dwrite d0/d62/d7e/fd9 [0,4194304] 0 2024-09-17T01:41:52.879 INFO:tasks.workunit.client.0.smithi082.stdout:7/861: chown d0/dd/d2c/d55/fbd 20090 1 2024-09-17T01:41:52.880 INFO:tasks.workunit.client.0.smithi082.stdout:1/873: dread d2/df/f1d [0,4194304] 0 2024-09-17T01:41:52.881 INFO:tasks.workunit.client.0.smithi082.stdout:7/862: write d0/d62/d7e/db5/fd6 [5139741,87255] 0 2024-09-17T01:41:52.883 INFO:tasks.workunit.client.0.smithi082.stdout:1/874: dread - d2/df/fab zero size 2024-09-17T01:41:52.883 INFO:tasks.workunit.client.0.smithi082.stdout:7/863: chown d0/l3e 128028 1 2024-09-17T01:41:52.885 INFO:tasks.workunit.client.0.smithi082.stdout:1/875: mknod d2/d3f/d24/db5/de6/c11b 0 2024-09-17T01:41:52.886 INFO:tasks.workunit.client.0.smithi082.stdout:1/876: stat d2/d3f/d24/f68 0 2024-09-17T01:41:52.889 INFO:tasks.workunit.client.0.smithi082.stdout:7/864: dwrite d0/dd/d34/d58/d6e/d8a/fe3 [0,4194304] 0 2024-09-17T01:41:52.890 INFO:tasks.workunit.client.0.smithi082.stdout:7/865: readlink d0/d62/d7e/dd4/d37/l81 0 2024-09-17T01:41:52.899 INFO:tasks.workunit.client.0.smithi082.stdout:7/866: link d0/d3/db/d10/f110 d0/d62/d7e/db5/f12d 0 2024-09-17T01:41:52.907 INFO:tasks.workunit.client.0.smithi082.stdout:5/863: truncate db/d56/d18/d98/f109 2315399 0 2024-09-17T01:41:52.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/864: rename db/d1e/d20/d30/dc6/dca/ff7 to db/d56/d29/d4f/f11d 0 2024-09-17T01:41:52.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/865: readlink db/d56/d18/lb1 0 2024-09-17T01:41:52.913 INFO:tasks.workunit.client.0.smithi082.stdout:5/866: read db/d56/d78/da0/fa4 [680880,3941] 0 2024-09-17T01:41:52.921 INFO:tasks.workunit.client.0.smithi082.stdout:7/867: dread d0/d3/db/d10/d47/f5c [4194304,4194304] 0 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:3/800: sync 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:0/839: sync 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:9/696: sync 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:6/844: sync 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:2/877: sync 2024-09-17T01:41:52.922 INFO:tasks.workunit.client.0.smithi082.stdout:8/708: dwrite d3/dd/ff [0,4194304] 0 2024-09-17T01:41:52.926 INFO:tasks.workunit.client.0.smithi082.stdout:7/868: fsync d0/d3/db/d10/f22 0 2024-09-17T01:41:52.928 INFO:tasks.workunit.client.0.smithi082.stdout:2/878: creat d1/d35/f121 x:0 0 0 2024-09-17T01:41:52.929 INFO:tasks.workunit.client.0.smithi082.stdout:2/879: chown d1/d17/d38/d42/d52/ccc 1745723 1 2024-09-17T01:41:52.933 INFO:tasks.workunit.client.0.smithi082.stdout:8/709: mkdir d3/dd/d18/d2d/d3e/d4a/d6a/de4 0 2024-09-17T01:41:52.938 INFO:tasks.workunit.client.0.smithi082.stdout:7/869: rename d0/d62/d7e/dd4/d37/d86/l8d to d0/dd/d34/l12e 0 2024-09-17T01:41:52.939 INFO:tasks.workunit.client.0.smithi082.stdout:7/870: stat d0/l24 0 2024-09-17T01:41:52.941 INFO:tasks.workunit.client.0.smithi082.stdout:1/877: dwrite d2/d3f/d24/d54/fda [0,4194304] 0 2024-09-17T01:41:52.942 INFO:tasks.workunit.client.0.smithi082.stdout:9/697: mknod d4/d27/ce6 0 2024-09-17T01:41:52.948 INFO:tasks.workunit.client.0.smithi082.stdout:8/710: rename d3/dd/d18/d3a/f4b to d3/dd/d18/d2d/d3b/fe5 0 2024-09-17T01:41:52.949 INFO:tasks.workunit.client.0.smithi082.stdout:1/878: stat d2/da/f56 0 2024-09-17T01:41:52.952 INFO:tasks.workunit.client.0.smithi082.stdout:1/879: stat d2/da/d2d/d79/c96 0 2024-09-17T01:41:52.952 INFO:tasks.workunit.client.0.smithi082.stdout:3/801: link d9/db/d49/c59 d9/db/daa/df3/de7/c113 0 2024-09-17T01:41:52.954 INFO:tasks.workunit.client.0.smithi082.stdout:3/802: dread - d9/db/d49/fff zero size 2024-09-17T01:41:52.956 INFO:tasks.workunit.client.0.smithi082.stdout:1/880: rename d2/da/d2f/d47/fd9 to d2/df/f11c 0 2024-09-17T01:41:52.956 INFO:tasks.workunit.client.0.smithi082.stdout:5/867: fsync db/d56/d29/d4f/f11d 0 2024-09-17T01:41:52.958 INFO:tasks.workunit.client.0.smithi082.stdout:3/803: rmdir d9/db/d26 39 2024-09-17T01:41:52.960 INFO:tasks.workunit.client.0.smithi082.stdout:1/881: fdatasync d2/d3f/d24/dba/ffe 0 2024-09-17T01:41:52.961 INFO:tasks.workunit.client.0.smithi082.stdout:1/882: fsync d2/d3f/d34/fdd 0 2024-09-17T01:41:52.963 INFO:tasks.workunit.client.0.smithi082.stdout:1/883: write d2/d3f/d34/dc5/f10d [2048734,86154] 0 2024-09-17T01:41:52.964 INFO:tasks.workunit.client.0.smithi082.stdout:1/884: readlink d2/df/l61 0 2024-09-17T01:41:52.965 INFO:tasks.workunit.client.0.smithi082.stdout:6/845: write d1/d7/d10/f11 [6080997,49754] 0 2024-09-17T01:41:52.966 INFO:tasks.workunit.client.0.smithi082.stdout:7/871: dread d0/d3/db/d10/fb0 [0,4194304] 0 2024-09-17T01:41:52.972 INFO:tasks.workunit.client.0.smithi082.stdout:9/698: dread d4/d27/d2d/d3d/f47 [8388608,4194304] 0 2024-09-17T01:41:52.974 INFO:tasks.workunit.client.0.smithi082.stdout:9/699: write d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/fc8 [353730,48585] 0 2024-09-17T01:41:52.981 INFO:tasks.workunit.client.0.smithi082.stdout:9/700: dwrite d4/d27/d2d/d3d/fd4 [0,4194304] 0 2024-09-17T01:41:52.981 INFO:tasks.workunit.client.0.smithi082.stdout:1/885: rename d2/da/d16/c7a to d2/da/d16/d114/c11d 0 2024-09-17T01:41:52.985 INFO:tasks.workunit.client.0.smithi082.stdout:5/868: link db/d1e/d20/f73 db/d56/dd6/f11e 0 2024-09-17T01:41:52.986 INFO:tasks.workunit.client.0.smithi082.stdout:2/880: symlink d1/d35/db1/d9c/l122 0 2024-09-17T01:41:52.989 INFO:tasks.workunit.client.0.smithi082.stdout:6/846: symlink d1/d7/d10/d4f/dc/d2b/l11e 0 2024-09-17T01:41:52.993 INFO:tasks.workunit.client.0.smithi082.stdout:3/804: truncate d9/db/f13 4150115 0 2024-09-17T01:41:52.995 INFO:tasks.workunit.client.0.smithi082.stdout:9/701: mkdir d4/d27/d95/de7 0 2024-09-17T01:41:52.996 INFO:tasks.workunit.client.0.smithi082.stdout:7/872: mknod d0/c12f 0 2024-09-17T01:41:52.999 INFO:tasks.workunit.client.0.smithi082.stdout:2/881: fdatasync d1/d5a/fcb 0 2024-09-17T01:41:53.000 INFO:tasks.workunit.client.0.smithi082.stdout:2/882: stat d1/d66/d85/fbb 0 2024-09-17T01:41:53.002 INFO:tasks.workunit.client.0.smithi082.stdout:6/847: unlink d1/d7/ffe 0 2024-09-17T01:41:53.007 INFO:tasks.workunit.client.0.smithi082.stdout:2/883: dwrite d1/d10/f112 [0,4194304] 0 2024-09-17T01:41:53.008 INFO:tasks.workunit.client.0.smithi082.stdout:6/848: read - d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/f105 zero size 2024-09-17T01:41:53.010 INFO:tasks.workunit.client.0.smithi082.stdout:5/869: write db/d1e/d5b/d83/f89 [374164,72048] 0 2024-09-17T01:41:53.018 INFO:tasks.workunit.client.0.smithi082.stdout:1/886: creat d2/f11e x:0 0 0 2024-09-17T01:41:53.018 INFO:tasks.workunit.client.0.smithi082.stdout:9/702: write d4/d27/d2d/d60/d11/d39/d44/f83 [885142,42875] 0 2024-09-17T01:41:53.018 INFO:tasks.workunit.client.0.smithi082.stdout:7/873: write d0/d62/d7e/dd4/d37/d71/f94 [713400,42105] 0 2024-09-17T01:41:53.023 INFO:tasks.workunit.client.0.smithi082.stdout:9/703: chown d4/d27/d21/f42 209389 1 2024-09-17T01:41:53.023 INFO:tasks.workunit.client.0.smithi082.stdout:6/849: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/l11f 0 2024-09-17T01:41:53.024 INFO:tasks.workunit.client.0.smithi082.stdout:5/870: dwrite db/da7/db3/f101 [0,4194304] 0 2024-09-17T01:41:53.025 INFO:tasks.workunit.client.0.smithi082.stdout:6/850: stat d1/fd5 0 2024-09-17T01:41:53.027 INFO:tasks.workunit.client.0.smithi082.stdout:2/884: dwrite d1/d17/d60/dc6/de8/fc7 [4194304,4194304] 0 2024-09-17T01:41:53.036 INFO:tasks.workunit.client.0.smithi082.stdout:3/805: rename d9/db/d26/f46 to d9/db/daf/d69/d79/d86/db5/f114 0 2024-09-17T01:41:53.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/887: dread d2/d3f/d24/d54/fda [0,4194304] 0 2024-09-17T01:41:53.040 INFO:tasks.workunit.client.0.smithi082.stdout:7/874: mkdir d0/d62/d130 0 2024-09-17T01:41:53.041 INFO:tasks.workunit.client.0.smithi082.stdout:6/851: mknod d1/d7/d10/d4f/d8e/c120 0 2024-09-17T01:41:53.042 INFO:tasks.workunit.client.0.smithi082.stdout:9/704: truncate d4/d59/d63/f67 2291003 0 2024-09-17T01:41:53.042 INFO:tasks.workunit.client.0.smithi082.stdout:3/806: creat d9/db/daf/dbf/f115 x:0 0 0 2024-09-17T01:41:53.043 INFO:tasks.workunit.client.0.smithi082.stdout:1/888: creat d2/da/d2d/d79/f11f x:0 0 0 2024-09-17T01:41:53.043 INFO:tasks.workunit.client.0.smithi082.stdout:2/885: rmdir d1/d17/d38/d42/d52/d78/da0/dba/dfd 39 2024-09-17T01:41:53.044 INFO:tasks.workunit.client.0.smithi082.stdout:6/852: dread - d1/d7/d10/d4f/dc/d2b/db2/ff9 zero size 2024-09-17T01:41:53.046 INFO:tasks.workunit.client.0.smithi082.stdout:5/871: symlink db/d1e/d20/l11f 0 2024-09-17T01:41:53.047 INFO:tasks.workunit.client.0.smithi082.stdout:9/705: rmdir d4 39 2024-09-17T01:41:53.047 INFO:tasks.workunit.client.0.smithi082.stdout:5/872: chown db/d56/fd7 3192 1 2024-09-17T01:41:53.048 INFO:tasks.workunit.client.0.smithi082.stdout:5/873: stat db/d1e/d5b/l61 0 2024-09-17T01:41:53.048 INFO:tasks.workunit.client.0.smithi082.stdout:1/889: creat d2/d3f/d34/dc5/f120 x:0 0 0 2024-09-17T01:41:53.049 INFO:tasks.workunit.client.0.smithi082.stdout:5/874: chown db/d56/d78/da0/lce 6223150 1 2024-09-17T01:41:53.057 INFO:tasks.workunit.client.0.smithi082.stdout:1/890: rmdir d2/d3f/d24/db5/dec/dfc 39 2024-09-17T01:41:53.061 INFO:tasks.workunit.client.0.smithi082.stdout:6/853: symlink d1/d1f/da7/ddd/df1/df4/l121 0 2024-09-17T01:41:53.062 INFO:tasks.workunit.client.0.smithi082.stdout:2/886: write d1/d17/d38/d42/d52/d78/da0/fef [487425,16762] 0 2024-09-17T01:41:53.063 INFO:tasks.workunit.client.0.smithi082.stdout:9/706: creat d4/d27/d36/d3b/fe8 x:0 0 0 2024-09-17T01:41:53.065 INFO:tasks.workunit.client.0.smithi082.stdout:1/891: fsync d2/d3f/d24/db5/dec/dfc/ddf/dff/f106 0 2024-09-17T01:41:53.066 INFO:tasks.workunit.client.0.smithi082.stdout:7/875: dwrite d0/dd/d34/fc5 [0,4194304] 0 2024-09-17T01:41:53.067 INFO:tasks.workunit.client.0.smithi082.stdout:1/892: write d2/d3f/d34/dc5/f120 [928774,115499] 0 2024-09-17T01:41:53.067 INFO:tasks.workunit.client.0.smithi082.stdout:6/854: rmdir d1/d1f/db0 39 2024-09-17T01:41:53.074 INFO:tasks.workunit.client.0.smithi082.stdout:6/855: mkdir d1/d1f/da7/d122 0 2024-09-17T01:41:53.075 INFO:tasks.workunit.client.0.smithi082.stdout:1/893: creat d2/d3f/d24/db5/dec/dfc/dc6/ded/f121 x:0 0 0 2024-09-17T01:41:53.077 INFO:tasks.workunit.client.0.smithi082.stdout:9/707: truncate d4/d59/d63/fc5 64923 0 2024-09-17T01:41:53.079 INFO:tasks.workunit.client.0.smithi082.stdout:2/887: creat d1/d66/f123 x:0 0 0 2024-09-17T01:41:53.080 INFO:tasks.workunit.client.0.smithi082.stdout:2/888: write d1/d17/d38/f99 [3682104,123684] 0 2024-09-17T01:41:53.082 INFO:tasks.workunit.client.0.smithi082.stdout:6/856: mkdir d1/d1f/da7/d123 0 2024-09-17T01:41:53.085 INFO:tasks.workunit.client.0.smithi082.stdout:9/708: stat d4/d27/d2d/d60/d11/d39/d44/c58 0 2024-09-17T01:41:53.086 INFO:tasks.workunit.client.0.smithi082.stdout:9/709: write d4/d27/d2d/d60/d11/fce [864035,121505] 0 2024-09-17T01:41:53.092 INFO:tasks.workunit.client.0.smithi082.stdout:7/876: write d0/d50/fb6 [3802987,70789] 0 2024-09-17T01:41:53.093 INFO:tasks.workunit.client.0.smithi082.stdout:7/877: chown d0/d3/f2b 178 1 2024-09-17T01:41:53.096 INFO:tasks.workunit.client.0.smithi082.stdout:6/857: creat d1/d7/d10/d4f/dc/d1d/d36/d7a/f124 x:0 0 0 2024-09-17T01:41:53.097 INFO:tasks.workunit.client.0.smithi082.stdout:9/710: mknod d4/d27/d2d/d60/d11/d39/d29/d77/ce9 0 2024-09-17T01:41:53.100 INFO:tasks.workunit.client.0.smithi082.stdout:2/889: rename d1/d35/db1/ff9 to d1/d35/db1/d9c/f124 0 2024-09-17T01:41:53.101 INFO:tasks.workunit.client.0.smithi082.stdout:1/894: truncate d2/d3f/d24/f23 3784030 0 2024-09-17T01:41:53.148 INFO:tasks.workunit.client.0.smithi082.stdout:7/878: creat d0/d62/dce/f131 x:0 0 0 2024-09-17T01:41:53.148 INFO:tasks.workunit.client.0.smithi082.stdout:9/711: symlink d4/d27/d36/d3b/lea 0 2024-09-17T01:41:53.168 INFO:tasks.workunit.client.0.smithi082.stdout:6/858: dwrite d1/d3/f1b [0,4194304] 0 2024-09-17T01:41:53.284 INFO:tasks.workunit.client.0.smithi082.stdout:2/890: creat d1/d17/d38/d42/f125 x:0 0 0 2024-09-17T01:41:53.284 INFO:tasks.workunit.client.0.smithi082.stdout:2/891: readlink d1/d5a/d6d/l91 0 2024-09-17T01:41:53.284 INFO:tasks.workunit.client.0.smithi082.stdout:2/892: chown d1/d10/c20 16 1 2024-09-17T01:41:53.287 INFO:tasks.workunit.client.0.smithi082.stdout:9/712: truncate d4/d27/d2d/d60/d11/d39/d44/f72 3900961 0 2024-09-17T01:41:53.287 INFO:tasks.workunit.client.0.smithi082.stdout:6/859: fsync d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fde 0 2024-09-17T01:41:53.289 INFO:tasks.workunit.client.0.smithi082.stdout:7/879: link d0/dd/d2c/d42/f12b d0/dd/d34/d11f/f132 0 2024-09-17T01:41:53.291 INFO:tasks.workunit.client.0.smithi082.stdout:1/895: dwrite d2/f1b [0,4194304] 0 2024-09-17T01:41:53.292 INFO:tasks.workunit.client.0.smithi082.stdout:2/893: rename d1/d17/d29/ddc/lff to d1/d17/d60/dc6/l126 0 2024-09-17T01:41:53.295 INFO:tasks.workunit.client.0.smithi082.stdout:9/713: dread d4/d27/d2d/d60/d11/d39/d29/d77/f84 [0,4194304] 0 2024-09-17T01:41:53.305 INFO:tasks.workunit.client.0.smithi082.stdout:6/860: dread d1/d3/f72 [0,4194304] 0 2024-09-17T01:41:53.308 INFO:tasks.workunit.client.0.smithi082.stdout:6/861: stat d1/d7/d10/d4f/dc/d1d/d36/d7a 0 2024-09-17T01:41:53.308 INFO:tasks.workunit.client.0.smithi082.stdout:7/880: symlink d0/dd/d2c/l133 0 2024-09-17T01:41:53.310 INFO:tasks.workunit.client.0.smithi082.stdout:1/896: symlink d2/da/d16/l122 0 2024-09-17T01:41:53.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/897: dread d2/da/d2d/d79/fd0 [0,4194304] 0 2024-09-17T01:41:53.316 INFO:tasks.workunit.client.0.smithi082.stdout:1/898: chown d2/da/d2f/d47 242312176 1 2024-09-17T01:41:53.324 INFO:tasks.workunit.client.0.smithi082.stdout:1/899: fdatasync d2/d3f/f13 0 2024-09-17T01:41:53.332 INFO:tasks.workunit.client.0.smithi082.stdout:9/714: dwrite d4/f5f [0,4194304] 0 2024-09-17T01:41:53.332 INFO:tasks.workunit.client.0.smithi082.stdout:6/862: dread d1/d1f/fba [0,4194304] 0 2024-09-17T01:41:53.333 INFO:tasks.workunit.client.0.smithi082.stdout:2/894: dwrite d1/d35/db1/d9c/f124 [0,4194304] 0 2024-09-17T01:41:53.333 INFO:tasks.workunit.client.0.smithi082.stdout:1/900: mkdir d2/da/d16/d114/d116/d123 0 2024-09-17T01:41:53.336 INFO:tasks.workunit.client.0.smithi082.stdout:1/901: chown d2/d3f/d24/dc8 16258206 1 2024-09-17T01:41:53.337 INFO:tasks.workunit.client.0.smithi082.stdout:0/840: sync 2024-09-17T01:41:53.338 INFO:tasks.workunit.client.0.smithi082.stdout:7/881: dwrite d0/d3/db/f2e [0,4194304] 0 2024-09-17T01:41:53.341 INFO:tasks.workunit.client.0.smithi082.stdout:2/895: fsync d1/d17/d60/dc6/de8/f100 0 2024-09-17T01:41:53.343 INFO:tasks.workunit.client.0.smithi082.stdout:2/896: write d1/d17/ffa [239904,8260] 0 2024-09-17T01:41:53.343 INFO:tasks.workunit.client.0.smithi082.stdout:9/715: mkdir d4/deb 0 2024-09-17T01:41:53.344 INFO:tasks.workunit.client.0.smithi082.stdout:6/863: mknod d1/d1f/da7/ddd/c125 0 2024-09-17T01:41:53.346 INFO:tasks.workunit.client.0.smithi082.stdout:1/902: symlink d2/da/d16/d114/d116/d123/l124 0 2024-09-17T01:41:53.347 INFO:tasks.workunit.client.0.smithi082.stdout:7/882: mknod d0/d62/d7e/c134 0 2024-09-17T01:41:53.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/716: write d4/d27/d2d/d60/d11/fcf [793199,7636] 0 2024-09-17T01:41:53.357 INFO:tasks.workunit.client.0.smithi082.stdout:0/841: dread da/d1b/d23/d4d/f5e [0,4194304] 0 2024-09-17T01:41:53.357 INFO:tasks.workunit.client.0.smithi082.stdout:0/842: fsync da/ffd 0 2024-09-17T01:41:53.357 INFO:tasks.workunit.client.0.smithi082.stdout:7/883: symlink d0/d3/db/d10/d3f/d107/l135 0 2024-09-17T01:41:53.358 INFO:tasks.workunit.client.0.smithi082.stdout:1/903: dread d2/d3f/d24/d54/f66 [0,4194304] 0 2024-09-17T01:41:53.358 INFO:tasks.workunit.client.0.smithi082.stdout:6/864: getdents d1/d1f/da7 0 2024-09-17T01:41:53.360 INFO:tasks.workunit.client.0.smithi082.stdout:1/904: read - d2/da/d2f/f72 zero size 2024-09-17T01:41:53.361 INFO:tasks.workunit.client.0.smithi082.stdout:9/717: truncate d4/d27/d2d/d60/fa3 1579360 0 2024-09-17T01:41:53.364 INFO:tasks.workunit.client.0.smithi082.stdout:7/884: dwrite d0/d62/d7e/dd4/d37/f114 [0,4194304] 0 2024-09-17T01:41:53.372 INFO:tasks.workunit.client.0.smithi082.stdout:0/843: dread - da/df/d2b/f95 zero size 2024-09-17T01:41:53.373 INFO:tasks.workunit.client.0.smithi082.stdout:0/844: readlink da/d1b/d23/d42/d43/leb 0 2024-09-17T01:41:53.375 INFO:tasks.workunit.client.0.smithi082.stdout:6/865: unlink d1/d7/d10/f9f 0 2024-09-17T01:41:53.451 INFO:tasks.workunit.client.0.smithi082.stdout:1/905: fdatasync d2/fd6 0 2024-09-17T01:41:53.451 INFO:tasks.workunit.client.0.smithi082.stdout:0/845: unlink da/df/d2b/d59/f73 0 2024-09-17T01:41:53.453 INFO:tasks.workunit.client.0.smithi082.stdout:2/897: dwrite d1/d17/d38/d42/f45 [0,4194304] 0 2024-09-17T01:41:53.454 INFO:tasks.workunit.client.0.smithi082.stdout:7/885: link d0/dd/d34/d11f/f12c d0/dd/d34/d58/f136 0 2024-09-17T01:41:53.458 INFO:tasks.workunit.client.0.smithi082.stdout:1/906: fdatasync d2/da/d2d/d79/fbf 0 2024-09-17T01:41:53.461 INFO:tasks.workunit.client.0.smithi082.stdout:6/866: dwrite d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f9e [0,4194304] 0 2024-09-17T01:41:53.464 INFO:tasks.workunit.client.0.smithi082.stdout:2/898: creat d1/d17/d60/f127 x:0 0 0 2024-09-17T01:41:53.476 INFO:tasks.workunit.client.0.smithi082.stdout:6/867: fsync d1/d7/d10/d4f/dc/d2b/d48/f76 0 2024-09-17T01:41:53.480 INFO:tasks.workunit.client.0.smithi082.stdout:2/899: unlink d1/d10/l2c 0 2024-09-17T01:41:53.482 INFO:tasks.workunit.client.0.smithi082.stdout:0/846: creat da/d1b/d23/d42/d43/d119/f123 x:0 0 0 2024-09-17T01:41:53.482 INFO:tasks.workunit.client.0.smithi082.stdout:6/868: dwrite d1/d7/d10/f38 [0,4194304] 0 2024-09-17T01:41:53.490 INFO:tasks.workunit.client.0.smithi082.stdout:0/847: readlink da/df/d71/lc3 0 2024-09-17T01:41:53.491 INFO:tasks.workunit.client.0.smithi082.stdout:0/848: readlink da/d80/lc2 0 2024-09-17T01:41:53.495 INFO:tasks.workunit.client.0.smithi082.stdout:7/886: rename d0/d3/db/f14 to d0/f137 0 2024-09-17T01:41:53.497 INFO:tasks.workunit.client.0.smithi082.stdout:7/887: write d0/d3/db/d10/d3f/f118 [630162,73737] 0 2024-09-17T01:41:53.498 INFO:tasks.workunit.client.0.smithi082.stdout:2/900: mkdir d1/d17/d128 0 2024-09-17T01:41:53.499 INFO:tasks.workunit.client.0.smithi082.stdout:0/849: unlink f8 0 2024-09-17T01:41:53.500 INFO:tasks.workunit.client.0.smithi082.stdout:6/869: mkdir d1/d1f/da7/d122/d126 0 2024-09-17T01:41:53.501 INFO:tasks.workunit.client.0.smithi082.stdout:7/888: symlink d0/d62/d7e/db5/l138 0 2024-09-17T01:41:53.502 INFO:tasks.workunit.client.0.smithi082.stdout:2/901: dread d1/d17/d38/d42/d52/f76 [0,4194304] 0 2024-09-17T01:41:53.502 INFO:tasks.workunit.client.0.smithi082.stdout:7/889: write d0/f48 [1785016,85118] 0 2024-09-17T01:41:53.506 INFO:tasks.workunit.client.0.smithi082.stdout:6/870: unlink d1/d7/d10/d4f/f20 0 2024-09-17T01:41:53.510 INFO:tasks.workunit.client.0.smithi082.stdout:1/907: dwrite d2/d3f/d24/f23 [0,4194304] 0 2024-09-17T01:41:53.512 INFO:tasks.workunit.client.0.smithi082.stdout:1/908: chown d2/d3f/d24/db5/dec/dfc/dc6/ded/f121 3248 1 2024-09-17T01:41:53.521 INFO:tasks.workunit.client.0.smithi082.stdout:2/902: mknod d1/c129 0 2024-09-17T01:41:53.524 INFO:tasks.workunit.client.0.smithi082.stdout:1/909: mkdir d2/d3f/d24/db5/dec/dfc/da3/d125 0 2024-09-17T01:41:53.527 INFO:tasks.workunit.client.0.smithi082.stdout:7/890: write d0/d3/db/d10/d3f/f101 [922095,107088] 0 2024-09-17T01:41:53.529 INFO:tasks.workunit.client.0.smithi082.stdout:6/871: mkdir d1/d7/d10/d4f/dc/d1d/d36/d127 0 2024-09-17T01:41:53.531 INFO:tasks.workunit.client.0.smithi082.stdout:2/903: creat d1/d17/d60/dc6/f12a x:0 0 0 2024-09-17T01:41:53.534 INFO:tasks.workunit.client.0.smithi082.stdout:0/850: rename da/df/f53 to da/df/d27/db5/f124 0 2024-09-17T01:41:53.534 INFO:tasks.workunit.client.0.smithi082.stdout:1/910: rename d2/d3f to d2/d3f/d24/dba/d126 22 2024-09-17T01:41:53.535 INFO:tasks.workunit.client.0.smithi082.stdout:0/851: fsync da/d80/f8c 0 2024-09-17T01:41:53.536 INFO:tasks.workunit.client.0.smithi082.stdout:0/852: read da/df/d2b/f89 [285580,47632] 0 2024-09-17T01:41:53.538 INFO:tasks.workunit.client.0.smithi082.stdout:6/872: dread d1/d7/d10/d4f/f78 [0,4194304] 0 2024-09-17T01:41:53.539 INFO:tasks.workunit.client.0.smithi082.stdout:2/904: mkdir d1/d90/d12b 0 2024-09-17T01:41:53.540 INFO:tasks.workunit.client.0.smithi082.stdout:6/873: fdatasync d1/d7/d10/d4f/dc/d1d/f113 0 2024-09-17T01:41:53.543 INFO:tasks.workunit.client.0.smithi082.stdout:7/891: write d0/d62/d7e/ffa [1813231,56210] 0 2024-09-17T01:41:53.544 INFO:tasks.workunit.client.0.smithi082.stdout:2/905: dread d1/d17/d60/dc6/de8/fc7 [4194304,4194304] 0 2024-09-17T01:41:53.545 INFO:tasks.workunit.client.0.smithi082.stdout:7/892: dread d0/dd/d2c/d54/f5a [0,4194304] 0 2024-09-17T01:41:53.607 INFO:tasks.workunit.client.0.smithi082.stdout:8/711: sync 2024-09-17T01:41:53.607 INFO:tasks.workunit.client.0.smithi082.stdout:3/807: sync 2024-09-17T01:41:53.608 INFO:tasks.workunit.client.0.smithi082.stdout:3/808: dread - d9/db/d95/f10f zero size 2024-09-17T01:41:53.610 INFO:tasks.workunit.client.0.smithi082.stdout:3/809: stat d9/db/d6d/de0/c106 0 2024-09-17T01:41:53.611 INFO:tasks.workunit.client.0.smithi082.stdout:3/810: stat d9/db/d26/dbd/fc0 0 2024-09-17T01:41:53.652 INFO:tasks.workunit.client.0.smithi082.stdout:9/718: sync 2024-09-17T01:41:53.653 INFO:tasks.workunit.client.0.smithi082.stdout:5/875: sync 2024-09-17T01:41:53.669 INFO:tasks.workunit.client.0.smithi082.stdout:6/874: write d1/d7/d10/d4f/dc/f29 [632911,73224] 0 2024-09-17T01:41:53.670 INFO:tasks.workunit.client.0.smithi082.stdout:0/853: dwrite da/d1b/d23/d42/f4e [0,4194304] 0 2024-09-17T01:41:53.671 INFO:tasks.workunit.client.0.smithi082.stdout:3/811: chown d9/db/f11 12 1 2024-09-17T01:41:53.672 INFO:tasks.workunit.client.0.smithi082.stdout:5/876: stat db/d56/lad 0 2024-09-17T01:41:53.673 INFO:tasks.workunit.client.0.smithi082.stdout:8/712: rename d3/dd/l5b to d3/dd/d18/d3a/le6 0 2024-09-17T01:41:53.674 INFO:tasks.workunit.client.0.smithi082.stdout:1/911: dwrite d2/df/f11c [0,4194304] 0 2024-09-17T01:41:53.677 INFO:tasks.workunit.client.0.smithi082.stdout:3/812: rmdir d9/d78 39 2024-09-17T01:41:53.679 INFO:tasks.workunit.client.0.smithi082.stdout:3/813: chown d9/db/d95/le8 203795749 1 2024-09-17T01:41:53.680 INFO:tasks.workunit.client.0.smithi082.stdout:2/906: dwrite d1/d66/fdd [0,4194304] 0 2024-09-17T01:41:53.681 INFO:tasks.workunit.client.0.smithi082.stdout:3/814: fdatasync d9/db/daf/d69/f105 0 2024-09-17T01:41:53.682 INFO:tasks.workunit.client.0.smithi082.stdout:6/875: mknod d1/d7/d10/d4f/d32/c128 0 2024-09-17T01:41:53.690 INFO:tasks.workunit.client.0.smithi082.stdout:0/854: stat da/d1b/d23/d42/f96 0 2024-09-17T01:41:53.691 INFO:tasks.workunit.client.0.smithi082.stdout:5/877: rename db/d1e/d20/f9b to db/d56/d103/f120 0 2024-09-17T01:41:53.693 INFO:tasks.workunit.client.0.smithi082.stdout:8/713: dread d3/dd/d18/d3a/f46 [0,4194304] 0 2024-09-17T01:41:53.697 INFO:tasks.workunit.client.0.smithi082.stdout:3/815: dwrite d9/db/daf/dbf/f115 [0,4194304] 0 2024-09-17T01:41:53.737 INFO:tasks.workunit.client.0.smithi082.stdout:9/719: getdents d4/d27/d21 0 2024-09-17T01:41:53.737 INFO:tasks.workunit.client.0.smithi082.stdout:2/907: dread - d1/d17/d38/d5c/f10c zero size 2024-09-17T01:41:53.739 INFO:tasks.workunit.client.0.smithi082.stdout:2/908: write d1/d17/d29/f2d [4368452,14648] 0 2024-09-17T01:41:53.739 INFO:tasks.workunit.client.0.smithi082.stdout:5/878: creat db/d56/d18/f121 x:0 0 0 2024-09-17T01:41:53.741 INFO:tasks.workunit.client.0.smithi082.stdout:8/714: dread - d3/dd/d18/d2d/d3e/d4a/f90 zero size 2024-09-17T01:41:53.743 INFO:tasks.workunit.client.0.smithi082.stdout:3/816: symlink d9/db/d49/d4e/d53/d5b/l116 0 2024-09-17T01:41:53.743 INFO:tasks.workunit.client.0.smithi082.stdout:3/817: truncate f0 5532856 0 2024-09-17T01:41:53.748 INFO:tasks.workunit.client.0.smithi082.stdout:5/879: mkdir db/d56/d18/d122 0 2024-09-17T01:41:53.749 INFO:tasks.workunit.client.0.smithi082.stdout:6/876: rename d1/d7/d10/d4f/d8e/da8/de5/c10f to d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/c129 0 2024-09-17T01:41:53.751 INFO:tasks.workunit.client.0.smithi082.stdout:3/818: dread - d9/db/d6d/fae zero size 2024-09-17T01:41:53.752 INFO:tasks.workunit.client.0.smithi082.stdout:3/819: readlink d9/db/daf/l65 0 2024-09-17T01:41:53.752 INFO:tasks.workunit.client.0.smithi082.stdout:1/912: getdents d2/df/d46 0 2024-09-17T01:41:53.755 INFO:tasks.workunit.client.0.smithi082.stdout:0/855: mknod da/df/d71/d92/c125 0 2024-09-17T01:41:53.758 INFO:tasks.workunit.client.0.smithi082.stdout:3/820: fsync d9/f47 0 2024-09-17T01:41:53.765 INFO:tasks.workunit.client.0.smithi082.stdout:9/720: dwrite d4/d27/d2d/d60/d11/d39/d29/fb2 [0,4194304] 0 2024-09-17T01:41:53.769 INFO:tasks.workunit.client.0.smithi082.stdout:5/880: write db/d1e/fc9 [923730,116483] 0 2024-09-17T01:41:53.769 INFO:tasks.workunit.client.0.smithi082.stdout:3/821: creat d9/db/daf/d69/d79/f117 x:0 0 0 2024-09-17T01:41:53.771 INFO:tasks.workunit.client.0.smithi082.stdout:1/913: unlink d2/f5f 0 2024-09-17T01:41:53.772 INFO:tasks.workunit.client.0.smithi082.stdout:2/909: link d1/d17/d38/l114 d1/d5a/d6d/l12c 0 2024-09-17T01:41:53.775 INFO:tasks.workunit.client.0.smithi082.stdout:8/715: link d3/dd/d18/d2d/d3e/d4a/d68/c92 d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/ce7 0 2024-09-17T01:41:53.782 INFO:tasks.workunit.client.0.smithi082.stdout:3/822: mkdir d9/db/daa/df3/de7/d118 0 2024-09-17T01:41:53.783 INFO:tasks.workunit.client.0.smithi082.stdout:8/716: dwrite d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/dcf/fde [0,4194304] 0 2024-09-17T01:41:53.784 INFO:tasks.workunit.client.0.smithi082.stdout:8/717: fdatasync d3/dd/d18/d51/dae/fd5 0 2024-09-17T01:41:53.787 INFO:tasks.workunit.client.0.smithi082.stdout:5/881: write db/d2b/fa2 [2124282,76167] 0 2024-09-17T01:41:53.788 INFO:tasks.workunit.client.0.smithi082.stdout:2/910: fsync d1/d17/f94 0 2024-09-17T01:41:53.789 INFO:tasks.workunit.client.0.smithi082.stdout:2/911: dread - d1/d17/d60/dc6/f12a zero size 2024-09-17T01:41:53.790 INFO:tasks.workunit.client.0.smithi082.stdout:6/877: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/f12a x:0 0 0 2024-09-17T01:41:53.796 INFO:tasks.workunit.client.0.smithi082.stdout:1/914: fdatasync d2/da/f6a 0 2024-09-17T01:41:53.797 INFO:tasks.workunit.client.0.smithi082.stdout:3/823: chown d9/d35/dda/le5 0 1 2024-09-17T01:41:53.802 INFO:tasks.workunit.client.0.smithi082.stdout:2/912: stat d1/d35/c4b 0 2024-09-17T01:41:53.807 INFO:tasks.workunit.client.0.smithi082.stdout:3/824: creat d9/db/daa/dec/f119 x:0 0 0 2024-09-17T01:41:53.811 INFO:tasks.workunit.client.0.smithi082.stdout:8/718: dwrite d3/dd/d18/f24 [0,4194304] 0 2024-09-17T01:41:53.812 INFO:tasks.workunit.client.0.smithi082.stdout:5/882: dwrite db/d56/fcd [8388608,4194304] 0 2024-09-17T01:41:53.813 INFO:tasks.workunit.client.0.smithi082.stdout:2/913: dwrite d1/fd [0,4194304] 0 2024-09-17T01:41:53.813 INFO:tasks.workunit.client.0.smithi082.stdout:6/878: mkdir d1/d7/d10/d12b 0 2024-09-17T01:41:53.817 INFO:tasks.workunit.client.0.smithi082.stdout:9/721: link d4/d27/d21/l89 d4/d27/d2d/d60/d11/d39/d29/lec 0 2024-09-17T01:41:53.822 INFO:tasks.workunit.client.0.smithi082.stdout:1/915: rename d2/da/cc3 to d2/df/d46/c127 0 2024-09-17T01:41:53.826 INFO:tasks.workunit.client.0.smithi082.stdout:8/719: rmdir d3 39 2024-09-17T01:41:53.827 INFO:tasks.workunit.client.0.smithi082.stdout:9/722: dwrite d4/d27/d2d/d3d/fd4 [0,4194304] 0 2024-09-17T01:41:53.827 INFO:tasks.workunit.client.0.smithi082.stdout:2/914: chown d1/d90/cae 433235 1 2024-09-17T01:41:53.828 INFO:tasks.workunit.client.0.smithi082.stdout:9/723: fsync d4/da6/dc4/fcd 0 2024-09-17T01:41:53.829 INFO:tasks.workunit.client.0.smithi082.stdout:5/883: creat db/d1e/d20/d30/dc6/f123 x:0 0 0 2024-09-17T01:41:53.832 INFO:tasks.workunit.client.0.smithi082.stdout:1/916: stat d2/da/d76/db8/lde 0 2024-09-17T01:41:53.836 INFO:tasks.workunit.client.0.smithi082.stdout:6/879: symlink d1/d7/d10/d4f/d8e/da8/dae/l12c 0 2024-09-17T01:41:53.838 INFO:tasks.workunit.client.0.smithi082.stdout:9/724: chown d4/d27/d2d/d60/d11/d39/d7d/l7e 11595 1 2024-09-17T01:41:53.838 INFO:tasks.workunit.client.0.smithi082.stdout:5/884: readlink db/d1e/l91 0 2024-09-17T01:41:53.839 INFO:tasks.workunit.client.0.smithi082.stdout:9/725: write d4/d59/fe0 [643377,69268] 0 2024-09-17T01:41:53.840 INFO:tasks.workunit.client.0.smithi082.stdout:1/917: creat d2/da/d16/d114/d116/f128 x:0 0 0 2024-09-17T01:41:53.845 INFO:tasks.workunit.client.0.smithi082.stdout:9/726: dwrite d4/fae [0,4194304] 0 2024-09-17T01:41:53.850 INFO:tasks.workunit.client.0.smithi082.stdout:5/885: mkdir db/d56/d29/d124 0 2024-09-17T01:41:53.850 INFO:tasks.workunit.client.0.smithi082.stdout:8/720: rmdir d3/dd/d18/d2d/d3e/d4a/d6a/de4 0 2024-09-17T01:41:53.850 INFO:tasks.workunit.client.0.smithi082.stdout:5/886: unlink db/d56/d18/d98/caf 0 2024-09-17T01:41:53.947 INFO:tasks.workunit.client.0.smithi082.stdout:9/727: symlink d4/d27/d95/de7/led 0 2024-09-17T01:41:53.949 INFO:tasks.workunit.client.0.smithi082.stdout:2/915: truncate d1/d17/d29/d50/f77 593870 0 2024-09-17T01:41:53.952 INFO:tasks.workunit.client.0.smithi082.stdout:9/728: mkdir d4/d59/d63/dee 0 2024-09-17T01:41:53.956 INFO:tasks.workunit.client.0.smithi082.stdout:3/825: dwrite d9/db/f17 [0,4194304] 0 2024-09-17T01:41:53.959 INFO:tasks.workunit.client.0.smithi082.stdout:9/729: fdatasync d4/f49 0 2024-09-17T01:41:53.960 INFO:tasks.workunit.client.0.smithi082.stdout:2/916: dread d1/d35/f30 [0,4194304] 0 2024-09-17T01:41:53.961 INFO:tasks.workunit.client.0.smithi082.stdout:5/887: dwrite db/d1e/d5b/f92 [0,4194304] 0 2024-09-17T01:41:53.963 INFO:tasks.workunit.client.0.smithi082.stdout:6/880: dwrite d1/d7/d10/d4f/d8e/da8/fb9 [0,4194304] 0 2024-09-17T01:41:53.965 INFO:tasks.workunit.client.0.smithi082.stdout:3/826: rmdir d9 39 2024-09-17T01:41:53.966 INFO:tasks.workunit.client.0.smithi082.stdout:9/730: fdatasync d4/d27/d2d/fd0 0 2024-09-17T01:41:53.967 INFO:tasks.workunit.client.0.smithi082.stdout:8/721: dwrite d3/dd/f9f [0,4194304] 0 2024-09-17T01:41:53.968 INFO:tasks.workunit.client.0.smithi082.stdout:8/722: readlink d3/dd/d18/d3a/l91 0 2024-09-17T01:41:53.971 INFO:tasks.workunit.client.0.smithi082.stdout:2/917: truncate d1/d17/d38/de6/f11d 531558 0 2024-09-17T01:41:53.983 INFO:tasks.workunit.client.0.smithi082.stdout:6/881: creat d1/d7/d10/d4f/d8e/da8/de5/de9/f12d x:0 0 0 2024-09-17T01:41:53.983 INFO:tasks.workunit.client.0.smithi082.stdout:8/723: creat d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/ddb/fe8 x:0 0 0 2024-09-17T01:41:53.984 INFO:tasks.workunit.client.0.smithi082.stdout:2/918: fsync d1/d17/d38/f9e 0 2024-09-17T01:41:53.985 INFO:tasks.workunit.client.0.smithi082.stdout:6/882: write d1/d1f/fba [3371460,33269] 0 2024-09-17T01:41:53.987 INFO:tasks.workunit.client.0.smithi082.stdout:2/919: chown d1/d17/d38/d42/l4f 801724 1 2024-09-17T01:41:53.989 INFO:tasks.workunit.client.0.smithi082.stdout:2/920: truncate d1/d17/ffa 1018188 0 2024-09-17T01:41:53.989 INFO:tasks.workunit.client.0.smithi082.stdout:6/883: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/d110/f12e x:0 0 0 2024-09-17T01:41:53.990 INFO:tasks.workunit.client.0.smithi082.stdout:8/724: read d3/dd/d18/d51/fc0 [849198,122074] 0 2024-09-17T01:41:53.992 INFO:tasks.workunit.client.0.smithi082.stdout:6/884: read - d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/ffd zero size 2024-09-17T01:41:53.993 INFO:tasks.workunit.client.0.smithi082.stdout:8/725: creat d3/dd/d18/d2d/d3e/d4a/d66/fe9 x:0 0 0 2024-09-17T01:41:53.995 INFO:tasks.workunit.client.0.smithi082.stdout:6/885: rename d1/d7/d10/d4f/dc/d99/fd6 to d1/d7/d10/f12f 0 2024-09-17T01:41:53.997 INFO:tasks.workunit.client.0.smithi082.stdout:5/888: write db/d56/d78/da0/fa4 [3619789,84667] 0 2024-09-17T01:41:53.998 INFO:tasks.workunit.client.0.smithi082.stdout:6/886: write d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/f107 [915354,33803] 0 2024-09-17T01:41:54.000 INFO:tasks.workunit.client.0.smithi082.stdout:3/827: write d9/d35/d63/f97 [711577,84651] 0 2024-09-17T01:41:54.000 INFO:tasks.workunit.client.0.smithi082.stdout:6/887: chown d1/d1f/l116 293 1 2024-09-17T01:41:54.001 INFO:tasks.workunit.client.0.smithi082.stdout:6/888: chown d1/d7/d10/d4f/d8e/c120 3926545 1 2024-09-17T01:41:54.002 INFO:tasks.workunit.client.0.smithi082.stdout:5/889: creat db/d1e/d20/d30/dc6/dd1/d102/dbc/f125 x:0 0 0 2024-09-17T01:41:54.004 INFO:tasks.workunit.client.0.smithi082.stdout:6/889: chown d1/d7/c18 130282 1 2024-09-17T01:41:54.006 INFO:tasks.workunit.client.0.smithi082.stdout:3/828: mknod d9/db/c11a 0 2024-09-17T01:41:54.007 INFO:tasks.workunit.client.0.smithi082.stdout:9/731: dwrite d4/d27/d2d/d60/d11/fbb [0,4194304] 0 2024-09-17T01:41:54.008 INFO:tasks.workunit.client.0.smithi082.stdout:3/829: fsync d9/db/daf/d69/dbc/fe1 0 2024-09-17T01:41:54.013 INFO:tasks.workunit.client.0.smithi082.stdout:5/890: mkdir db/d1e/d5b/d83/d94/dc1/d126 0 2024-09-17T01:41:54.014 INFO:tasks.workunit.client.0.smithi082.stdout:6/890: mkdir d1/d1f/da7/d123/d130 0 2024-09-17T01:41:54.016 INFO:tasks.workunit.client.0.smithi082.stdout:2/921: dwrite d1/d17/f3b [0,4194304] 0 2024-09-17T01:41:54.017 INFO:tasks.workunit.client.0.smithi082.stdout:8/726: dread d3/dd/d18/d51/f6f [0,4194304] 0 2024-09-17T01:41:54.018 INFO:tasks.workunit.client.0.smithi082.stdout:9/732: creat d4/d27/d95/fef x:0 0 0 2024-09-17T01:41:54.019 INFO:tasks.workunit.client.0.smithi082.stdout:3/830: mkdir d9/db/daf/d69/dbc/ddb/d11b 0 2024-09-17T01:41:54.019 INFO:tasks.workunit.client.0.smithi082.stdout:8/727: chown d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/dbe/dcf/fde 4269 1 2024-09-17T01:41:54.020 INFO:tasks.workunit.client.0.smithi082.stdout:9/733: readlink d4/d27/d2d/d60/d11/d39/d29/d77/l93 0 2024-09-17T01:41:54.022 INFO:tasks.workunit.client.0.smithi082.stdout:5/891: dread db/da7/db3/f104 [0,4194304] 0 2024-09-17T01:41:54.022 INFO:tasks.workunit.client.0.smithi082.stdout:3/831: mkdir d9/db/daa/df3/d11c 0 2024-09-17T01:41:54.025 INFO:tasks.workunit.client.0.smithi082.stdout:9/734: fsync d4/d27/d2d/d3d/f85 0 2024-09-17T01:41:54.027 INFO:tasks.workunit.client.0.smithi082.stdout:8/728: fdatasync d3/dd/d18/d2d/d3b/fe5 0 2024-09-17T01:41:54.028 INFO:tasks.workunit.client.0.smithi082.stdout:9/735: rmdir d4/d27/d2d/d3d/d81 39 2024-09-17T01:41:54.029 INFO:tasks.workunit.client.0.smithi082.stdout:3/832: truncate d9/db/f13 2670741 0 2024-09-17T01:41:54.031 INFO:tasks.workunit.client.0.smithi082.stdout:8/729: creat d3/dd/d18/d51/dae/fea x:0 0 0 2024-09-17T01:41:54.032 INFO:tasks.workunit.client.0.smithi082.stdout:9/736: creat d4/d59/d63/ff0 x:0 0 0 2024-09-17T01:41:54.033 INFO:tasks.workunit.client.0.smithi082.stdout:3/833: symlink d9/db/daa/l11d 0 2024-09-17T01:41:54.036 INFO:tasks.workunit.client.0.smithi082.stdout:5/892: dread db/d1e/d5b/db4/fe9 [0,4194304] 0 2024-09-17T01:41:54.036 INFO:tasks.workunit.client.0.smithi082.stdout:3/834: write d9/d78/d88/ff7 [1812316,48684] 0 2024-09-17T01:41:54.038 INFO:tasks.workunit.client.0.smithi082.stdout:5/893: write db/d56/dd6/ffc [144328,70403] 0 2024-09-17T01:41:54.039 INFO:tasks.workunit.client.0.smithi082.stdout:9/737: dread d4/d27/d2d/d60/d11/d39/d44/f83 [0,4194304] 0 2024-09-17T01:41:54.040 INFO:tasks.workunit.client.0.smithi082.stdout:9/738: readlink d4/d27/l79 0 2024-09-17T01:41:54.041 INFO:tasks.workunit.client.0.smithi082.stdout:8/730: dwrite d3/dd/d18/d51/f6f [0,4194304] 0 2024-09-17T01:41:54.045 INFO:tasks.workunit.client.0.smithi082.stdout:9/739: mkdir d4/d27/d2d/d60/d11/d39/d29/d35/df1 0 2024-09-17T01:41:54.046 INFO:tasks.workunit.client.0.smithi082.stdout:9/740: chown d4/dd2/de1/fbd 479 1 2024-09-17T01:41:54.048 INFO:tasks.workunit.client.0.smithi082.stdout:8/731: dread d3/dd/d18/d2d/d58/fcc [0,4194304] 0 2024-09-17T01:41:54.053 INFO:tasks.workunit.client.0.smithi082.stdout:9/741: creat d4/d27/d2d/d60/d11/d39/d29/d6d/ff2 x:0 0 0 2024-09-17T01:41:54.054 INFO:tasks.workunit.client.0.smithi082.stdout:9/742: readlink d4/d27/d2d/d60/d11/d37/l53 0 2024-09-17T01:41:54.055 INFO:tasks.workunit.client.0.smithi082.stdout:8/732: truncate d3/dd/d18/d2d/d3e/d4a/d6a/fa4 2087808 0 2024-09-17T01:41:54.058 INFO:tasks.workunit.client.0.smithi082.stdout:3/835: rename d9/db/daf/d69/dbc to d9/d78/d88/d11e 0 2024-09-17T01:41:54.061 INFO:tasks.workunit.client.0.smithi082.stdout:9/743: creat d4/d27/d2d/d3d/ff3 x:0 0 0 2024-09-17T01:41:54.062 INFO:tasks.workunit.client.0.smithi082.stdout:8/733: dwrite d3/dd/d18/d51/dae/fea [0,4194304] 0 2024-09-17T01:41:54.065 INFO:tasks.workunit.client.0.smithi082.stdout:9/744: truncate d4/d27/d2d/d60/d11/d39/d29/d6d/ff2 757510 0 2024-09-17T01:41:54.067 INFO:tasks.workunit.client.0.smithi082.stdout:8/734: symlink d3/dd/d18/d51/db4/leb 0 2024-09-17T01:41:54.068 INFO:tasks.workunit.client.0.smithi082.stdout:9/745: dread - d4/d27/d2d/d60/d11/d8d/fa7 zero size 2024-09-17T01:41:54.070 INFO:tasks.workunit.client.0.smithi082.stdout:9/746: chown d4/d27/d2d/d60/d11/d39/d29/l6c 1872516 1 2024-09-17T01:41:54.076 INFO:tasks.workunit.client.0.smithi082.stdout:9/747: mknod d4/d27/d36/d3b/db0/cf4 0 2024-09-17T01:41:54.077 INFO:tasks.workunit.client.0.smithi082.stdout:9/748: write d4/d27/d2d/d60/d11/d37/f38 [2588950,110976] 0 2024-09-17T01:41:54.080 INFO:tasks.workunit.client.0.smithi082.stdout:9/749: rmdir d4/da6 39 2024-09-17T01:41:54.081 INFO:tasks.workunit.client.0.smithi082.stdout:5/894: write db/d56/d78/f80 [3982094,84470] 0 2024-09-17T01:41:54.085 INFO:tasks.workunit.client.0.smithi082.stdout:8/735: link d3/dd/c54 d3/dd/d18/d2d/d3e/d4a/d68/cec 0 2024-09-17T01:41:54.087 INFO:tasks.workunit.client.0.smithi082.stdout:5/895: symlink db/d56/d29/d124/l127 0 2024-09-17T01:41:54.088 INFO:tasks.workunit.client.0.smithi082.stdout:5/896: write db/d56/fcd [3049723,47357] 0 2024-09-17T01:41:54.095 INFO:tasks.workunit.client.0.smithi082.stdout:5/897: fsync db/d56/d78/ff6 0 2024-09-17T01:41:54.103 INFO:tasks.workunit.client.0.smithi082.stdout:5/898: chown db/d2b/d59/c60 8 1 2024-09-17T01:41:54.103 INFO:tasks.workunit.client.0.smithi082.stdout:3/836: dread d9/d78/d88/ff7 [0,4194304] 0 2024-09-17T01:41:54.104 INFO:tasks.workunit.client.0.smithi082.stdout:3/837: stat d9/l77 0 2024-09-17T01:41:54.105 INFO:tasks.workunit.client.0.smithi082.stdout:9/750: dread d4/d27/d2d/d60/d11/d39/d29/d77/fa4 [0,4194304] 0 2024-09-17T01:41:54.107 INFO:tasks.workunit.client.0.smithi082.stdout:5/899: mkdir db/d2b/d128 0 2024-09-17T01:41:54.109 INFO:tasks.workunit.client.0.smithi082.stdout:8/736: dread d3/dd/f23 [0,4194304] 0 2024-09-17T01:41:54.111 INFO:tasks.workunit.client.0.smithi082.stdout:5/900: read db/d1e/d20/fc0 [3273504,9592] 0 2024-09-17T01:41:54.111 INFO:tasks.workunit.client.0.smithi082.stdout:3/838: mknod d9/db/d49/d4e/c11f 0 2024-09-17T01:41:54.114 INFO:tasks.workunit.client.0.smithi082.stdout:8/737: rmdir d3/dd 39 2024-09-17T01:41:54.115 INFO:tasks.workunit.client.0.smithi082.stdout:9/751: write d4/d27/d2d/d60/d11/d39/d29/d6d/fa1 [600420,21110] 0 2024-09-17T01:41:54.116 INFO:tasks.workunit.client.0.smithi082.stdout:5/901: truncate db/d1e/f55 3032837 0 2024-09-17T01:41:54.118 INFO:tasks.workunit.client.0.smithi082.stdout:3/839: rename d9/db/daf/d69/d79/d86/db5/fe4 to d9/db/d26/f120 0 2024-09-17T01:41:54.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/840: creat d9/db/daf/d69/d10c/f121 x:0 0 0 2024-09-17T01:41:54.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/841: chown d9/db/d26/dbd 1 1 2024-09-17T01:41:54.125 INFO:tasks.workunit.client.0.smithi082.stdout:3/842: chown d9/db/d6d/c7e 357616931 1 2024-09-17T01:41:54.126 INFO:tasks.workunit.client.0.smithi082.stdout:5/902: creat db/da7/f129 x:0 0 0 2024-09-17T01:41:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:53 smithi082 ceph-mon[28077]: pgmap v30: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 105 MiB/s wr, 276 op/s 2024-09-17T01:41:54.222 INFO:tasks.workunit.client.0.smithi082.stdout:0/856: sync 2024-09-17T01:41:54.222 INFO:tasks.workunit.client.0.smithi082.stdout:7/893: sync 2024-09-17T01:41:54.222 INFO:tasks.workunit.client.0.smithi082.stdout:9/752: truncate d4/d27/d2d/d3d/f8c 3356921 0 2024-09-17T01:41:54.226 INFO:tasks.workunit.client.0.smithi082.stdout:8/738: dwrite d3/dd/d18/d2d/d3e/d4a/d66/f8c [0,4194304] 0 2024-09-17T01:41:54.229 INFO:tasks.workunit.client.0.smithi082.stdout:5/903: truncate db/d56/f15 3707874 0 2024-09-17T01:41:54.231 INFO:tasks.workunit.client.0.smithi082.stdout:9/753: unlink d4/f4c 0 2024-09-17T01:41:54.236 INFO:tasks.workunit.client.0.smithi082.stdout:3/843: rename d9/db/d49/d4e/d53/f7f to d9/db/daa/df3/d11c/f122 0 2024-09-17T01:41:54.243 INFO:tasks.workunit.client.0.smithi082.stdout:7/894: write d0/dd/d2c/d42/f99 [1089670,74214] 0 2024-09-17T01:41:54.247 INFO:tasks.workunit.client.0.smithi082.stdout:5/904: write db/d56/d18/f40 [591946,45721] 0 2024-09-17T01:41:54.248 INFO:tasks.workunit.client.0.smithi082.stdout:9/754: rename d4/d27/d2d/d3d/l43 to d4/d27/d2d/d60/d11/d39/d44/lf5 0 2024-09-17T01:41:54.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:53 smithi167 ceph-mon[35643]: pgmap v30: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 105 MiB/s wr, 276 op/s 2024-09-17T01:41:54.254 INFO:tasks.workunit.client.0.smithi082.stdout:5/905: fdatasync db/d56/d18/d23/f6c 0 2024-09-17T01:41:54.258 INFO:tasks.workunit.client.0.smithi082.stdout:8/739: link d3/dd/d18/d2d/d58/lbb d3/dd/d18/d51/dc5/led 0 2024-09-17T01:41:54.259 INFO:tasks.workunit.client.0.smithi082.stdout:8/740: chown d3/dd/d18/d2d/d3e/cbf 103195 1 2024-09-17T01:41:54.260 INFO:tasks.workunit.client.0.smithi082.stdout:3/844: creat d9/db/daa/df3/de7/d118/f123 x:0 0 0 2024-09-17T01:41:54.264 INFO:tasks.workunit.client.0.smithi082.stdout:0/857: link da/d80/f9e da/d80/f126 0 2024-09-17T01:41:54.265 INFO:tasks.workunit.client.0.smithi082.stdout:8/741: dwrite d3/dd/d18/d2d/d3b/f69 [0,4194304] 0 2024-09-17T01:41:54.265 INFO:tasks.workunit.client.0.smithi082.stdout:5/906: symlink db/d1e/d5b/db7/l12a 0 2024-09-17T01:41:54.267 INFO:tasks.workunit.client.0.smithi082.stdout:9/755: symlink d4/da6/lf6 0 2024-09-17T01:41:54.271 INFO:tasks.workunit.client.0.smithi082.stdout:7/895: creat d0/d3/f139 x:0 0 0 2024-09-17T01:41:54.275 INFO:tasks.workunit.client.0.smithi082.stdout:0/858: creat da/df/d71/d92/df7/f127 x:0 0 0 2024-09-17T01:41:54.275 INFO:tasks.workunit.client.0.smithi082.stdout:9/756: dwrite d4/d27/d36/f4e [0,4194304] 0 2024-09-17T01:41:54.277 INFO:tasks.workunit.client.0.smithi082.stdout:9/757: write d4/fae [2074547,52968] 0 2024-09-17T01:41:54.278 INFO:tasks.workunit.client.0.smithi082.stdout:8/742: unlink d3/dd/d18/l36 0 2024-09-17T01:41:54.279 INFO:tasks.workunit.client.0.smithi082.stdout:5/907: symlink db/d1e/d5b/d83/d94/dc1/l12b 0 2024-09-17T01:41:54.282 INFO:tasks.workunit.client.0.smithi082.stdout:5/908: truncate db/da7/db3/f11b 381866 0 2024-09-17T01:41:54.286 INFO:tasks.workunit.client.0.smithi082.stdout:5/909: write db/da7/db3/f11b [1143146,110017] 0 2024-09-17T01:41:54.287 INFO:tasks.workunit.client.0.smithi082.stdout:3/845: dread d9/f40 [0,4194304] 0 2024-09-17T01:41:54.289 INFO:tasks.workunit.client.0.smithi082.stdout:8/743: dwrite d3/dd/d18/d3a/fcb [0,4194304] 0 2024-09-17T01:41:54.290 INFO:tasks.workunit.client.0.smithi082.stdout:8/744: readlink d3/dd/d18/d51/dae/lb8 0 2024-09-17T01:41:54.295 INFO:tasks.workunit.client.0.smithi082.stdout:7/896: write d0/d62/dce/f11a [1033599,34896] 0 2024-09-17T01:41:54.296 INFO:tasks.workunit.client.0.smithi082.stdout:9/758: stat d4/d27/d2d/d60/d11/d39/d29/d35/ld6 0 2024-09-17T01:41:54.298 INFO:tasks.workunit.client.0.smithi082.stdout:5/910: creat db/d1e/d20/d30/dc6/dd1/d102/dbc/f12c x:0 0 0 2024-09-17T01:41:54.299 INFO:tasks.workunit.client.0.smithi082.stdout:8/745: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d6e/dee 0 2024-09-17T01:41:54.300 INFO:tasks.workunit.client.0.smithi082.stdout:8/746: stat d3/dd/d18/d2d/d3b/c4d 0 2024-09-17T01:41:54.301 INFO:tasks.workunit.client.0.smithi082.stdout:9/759: rename d4/d27/d2d/d60/d11/fce to d4/d27/d95/ff7 0 2024-09-17T01:41:54.302 INFO:tasks.workunit.client.0.smithi082.stdout:7/897: mkdir d0/d62/d7e/dd4/d37/d71/d12a/d13a 0 2024-09-17T01:41:54.303 INFO:tasks.workunit.client.0.smithi082.stdout:3/846: creat d9/db/d49/d4e/f124 x:0 0 0 2024-09-17T01:41:54.305 INFO:tasks.workunit.client.0.smithi082.stdout:5/911: symlink db/d56/d18/d23/l12d 0 2024-09-17T01:41:54.307 INFO:tasks.workunit.client.0.smithi082.stdout:0/859: dread da/df/d2b/f39 [0,4194304] 0 2024-09-17T01:41:54.309 INFO:tasks.workunit.client.0.smithi082.stdout:7/898: dread d0/d3/db/ddf/f100 [0,4194304] 0 2024-09-17T01:41:54.310 INFO:tasks.workunit.client.0.smithi082.stdout:8/747: dwrite d3/dd/d18/d3a/fd8 [0,4194304] 0 2024-09-17T01:41:54.312 INFO:tasks.workunit.client.0.smithi082.stdout:9/760: getdents d4/d27/d2d/d60/d11/d39/d29/d35/df1 0 2024-09-17T01:41:54.312 INFO:tasks.workunit.client.0.smithi082.stdout:5/912: mknod db/d1e/d20/d4d/c12e 0 2024-09-17T01:41:54.317 INFO:tasks.workunit.client.0.smithi082.stdout:3/847: mkdir d9/db/d26/d110/d125 0 2024-09-17T01:41:54.319 INFO:tasks.workunit.client.0.smithi082.stdout:8/748: read d3/f64 [1134431,128491] 0 2024-09-17T01:41:54.321 INFO:tasks.workunit.client.0.smithi082.stdout:7/899: mkdir d0/dd/d2c/d42/d13b 0 2024-09-17T01:41:54.322 INFO:tasks.workunit.client.0.smithi082.stdout:7/900: readlink d0/d62/d7e/dd4/d37/d86/l92 0 2024-09-17T01:41:54.323 INFO:tasks.workunit.client.0.smithi082.stdout:9/761: creat d4/d27/d36/ff8 x:0 0 0 2024-09-17T01:41:54.331 INFO:tasks.workunit.client.0.smithi082.stdout:5/913: mknod db/d1e/d20/c12f 0 2024-09-17T01:41:54.332 INFO:tasks.workunit.client.0.smithi082.stdout:5/914: chown db/d1e/l81 5904 1 2024-09-17T01:41:54.333 INFO:tasks.workunit.client.0.smithi082.stdout:9/762: symlink d4/d27/d2d/d60/d11/d39/d31/lf9 0 2024-09-17T01:41:54.334 INFO:tasks.workunit.client.0.smithi082.stdout:0/860: write da/df/d2b/d9a/f9b [717187,66598] 0 2024-09-17T01:41:54.335 INFO:tasks.workunit.client.0.smithi082.stdout:3/848: write d9/db/daf/f92 [4670954,109324] 0 2024-09-17T01:41:54.336 INFO:tasks.workunit.client.0.smithi082.stdout:0/861: readlink da/d80/l56 0 2024-09-17T01:41:54.337 INFO:tasks.workunit.client.0.smithi082.stdout:3/849: fdatasync d9/db/daf/d69/d79/f117 0 2024-09-17T01:41:54.338 INFO:tasks.workunit.client.0.smithi082.stdout:7/901: truncate d0/dd/d2c/d55/f9d 1913006 0 2024-09-17T01:41:54.338 INFO:tasks.workunit.client.0.smithi082.stdout:5/915: mkdir db/d56/d103/d130 0 2024-09-17T01:41:54.340 INFO:tasks.workunit.client.0.smithi082.stdout:9/763: dread d4/d27/d2d/d60/fa3 [0,4194304] 0 2024-09-17T01:41:54.341 INFO:tasks.workunit.client.0.smithi082.stdout:8/749: rename d3/dd/d18/f24 to d3/dd/d18/d2d/d3e/d4a/fef 0 2024-09-17T01:41:54.342 INFO:tasks.workunit.client.0.smithi082.stdout:0/862: stat da/df/d71/f51 0 2024-09-17T01:41:54.342 INFO:tasks.workunit.client.0.smithi082.stdout:3/850: readlink d9/d78/d88/lce 0 2024-09-17T01:41:54.344 INFO:tasks.workunit.client.0.smithi082.stdout:7/902: creat d0/d3/db/d10/d3f/f13c x:0 0 0 2024-09-17T01:41:54.346 INFO:tasks.workunit.client.0.smithi082.stdout:5/916: mknod db/d1e/d20/d30/dc6/dd1/d102/c131 0 2024-09-17T01:41:54.348 INFO:tasks.workunit.client.0.smithi082.stdout:8/750: rmdir d3/dd/d18/d51/dc5 39 2024-09-17T01:41:54.349 INFO:tasks.workunit.client.0.smithi082.stdout:8/751: chown d3/dd/d18/d2d/d3b/f69 352782964 1 2024-09-17T01:41:54.355 INFO:tasks.workunit.client.0.smithi082.stdout:7/903: creat d0/dd/d34/d58/d6e/d8a/f13d x:0 0 0 2024-09-17T01:41:54.358 INFO:tasks.workunit.client.0.smithi082.stdout:9/764: mkdir d4/d27/d2d/d3d/d81/dfa 0 2024-09-17T01:41:54.359 INFO:tasks.workunit.client.0.smithi082.stdout:0/863: dwrite da/df/d2b/d59/d6f/fde [0,4194304] 0 2024-09-17T01:41:54.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/917: creat db/da7/db3/d10a/f132 x:0 0 0 2024-09-17T01:41:54.365 INFO:tasks.workunit.client.0.smithi082.stdout:5/918: stat db/d2b/c112 0 2024-09-17T01:41:54.367 INFO:tasks.workunit.client.0.smithi082.stdout:9/765: rmdir d4/dd2 39 2024-09-17T01:41:54.368 INFO:tasks.workunit.client.0.smithi082.stdout:5/919: write db/d1e/d20/ff5 [846523,34478] 0 2024-09-17T01:41:54.371 INFO:tasks.workunit.client.0.smithi082.stdout:8/752: dwrite d3/dd/d18/d2d/d58/f83 [0,4194304] 0 2024-09-17T01:41:54.374 INFO:tasks.workunit.client.0.smithi082.stdout:5/920: dread db/d1e/fc9 [0,4194304] 0 2024-09-17T01:41:54.376 INFO:tasks.workunit.client.0.smithi082.stdout:5/921: fdatasync db/d1e/d5b/d83/f89 0 2024-09-17T01:41:54.380 INFO:tasks.workunit.client.0.smithi082.stdout:9/766: dwrite d4/d27/d2d/d60/d11/d39/d44/fd3 [0,4194304] 0 2024-09-17T01:41:54.384 INFO:tasks.workunit.client.0.smithi082.stdout:7/904: link d0/d3/f2b d0/dd/d34/d58/d6e/d8a/dfb/f13e 0 2024-09-17T01:41:54.385 INFO:tasks.workunit.client.0.smithi082.stdout:9/767: rmdir d4/d59 39 2024-09-17T01:41:54.386 INFO:tasks.workunit.client.0.smithi082.stdout:3/851: getdents d9/d78/d88/d11e 0 2024-09-17T01:41:54.392 INFO:tasks.workunit.client.0.smithi082.stdout:9/768: truncate d4/d27/d21/f5a 2607026 0 2024-09-17T01:41:54.395 INFO:tasks.workunit.client.0.smithi082.stdout:8/753: write d3/dd/d18/d2d/d3e/f71 [3700889,118961] 0 2024-09-17T01:41:54.396 INFO:tasks.workunit.client.0.smithi082.stdout:5/922: rmdir db/d56/d103/d130 0 2024-09-17T01:41:54.397 INFO:tasks.workunit.client.0.smithi082.stdout:7/905: symlink d0/d62/d7e/l13f 0 2024-09-17T01:41:54.399 INFO:tasks.workunit.client.0.smithi082.stdout:0/864: getdents da/df/df4 0 2024-09-17T01:41:54.400 INFO:tasks.workunit.client.0.smithi082.stdout:9/769: symlink d4/da6/lfb 0 2024-09-17T01:41:54.404 INFO:tasks.workunit.client.0.smithi082.stdout:7/906: mkdir d0/dd/d2c/d42/d140 0 2024-09-17T01:41:54.404 INFO:tasks.workunit.client.0.smithi082.stdout:0/865: symlink da/df/d2b/d59/d6f/da6/l128 0 2024-09-17T01:41:54.408 INFO:tasks.workunit.client.0.smithi082.stdout:8/754: unlink d3/dd/d18/d2d/d60/l9e 0 2024-09-17T01:41:54.409 INFO:tasks.workunit.client.0.smithi082.stdout:8/755: write d3/dd/d18/d2d/d3e/fe3 [371558,115110] 0 2024-09-17T01:41:54.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/907: dread - d0/d3/df4/f106 zero size 2024-09-17T01:41:54.413 INFO:tasks.workunit.client.0.smithi082.stdout:0/866: mknod da/d1b/d23/dea/c129 0 2024-09-17T01:41:54.417 INFO:tasks.workunit.client.0.smithi082.stdout:7/908: symlink d0/d50/l141 0 2024-09-17T01:41:54.420 INFO:tasks.workunit.client.0.smithi082.stdout:3/852: dwrite d9/db/daf/fd8 [0,4194304] 0 2024-09-17T01:41:54.421 INFO:tasks.workunit.client.0.smithi082.stdout:0/867: creat da/d80/d99/f12a x:0 0 0 2024-09-17T01:41:54.426 INFO:tasks.workunit.client.0.smithi082.stdout:3/853: mkdir d9/db/daa/df3/de7/d118/d126 0 2024-09-17T01:41:54.427 INFO:tasks.workunit.client.0.smithi082.stdout:3/854: chown d9/db/d8f/cb1 33606503 1 2024-09-17T01:41:54.427 INFO:tasks.workunit.client.0.smithi082.stdout:0/868: rmdir da/df/d71/d92/df7/dbe 39 2024-09-17T01:41:54.429 INFO:tasks.workunit.client.0.smithi082.stdout:8/756: getdents d3/dd/d18/d2d/d3b 0 2024-09-17T01:41:54.431 INFO:tasks.workunit.client.0.smithi082.stdout:7/909: creat d0/f142 x:0 0 0 2024-09-17T01:41:54.432 INFO:tasks.workunit.client.0.smithi082.stdout:0/869: read da/df/d2b/d59/d6f/f87 [274585,246] 0 2024-09-17T01:41:54.434 INFO:tasks.workunit.client.0.smithi082.stdout:3/855: dwrite d9/db/f17 [0,4194304] 0 2024-09-17T01:41:54.435 INFO:tasks.workunit.client.0.smithi082.stdout:0/870: dread - da/d1b/d23/d42/d43/d6b/dd2/fd6 zero size 2024-09-17T01:41:54.436 INFO:tasks.workunit.client.0.smithi082.stdout:0/871: chown da/d80/d77/lf1 29 1 2024-09-17T01:41:54.436 INFO:tasks.workunit.client.0.smithi082.stdout:7/910: symlink d0/d3/df4/l143 0 2024-09-17T01:41:54.437 INFO:tasks.workunit.client.0.smithi082.stdout:7/911: dread - d0/d3/db/d10/f110 zero size 2024-09-17T01:41:54.437 INFO:tasks.workunit.client.0.smithi082.stdout:3/856: creat d9/db/daf/d69/d79/d86/db5/f127 x:0 0 0 2024-09-17T01:41:54.439 INFO:tasks.workunit.client.0.smithi082.stdout:3/857: write d9/db/d49/fe2 [1062136,114263] 0 2024-09-17T01:41:54.439 INFO:tasks.workunit.client.0.smithi082.stdout:0/872: mknod da/d1b/c12b 0 2024-09-17T01:41:54.443 INFO:tasks.workunit.client.0.smithi082.stdout:7/912: fsync d0/d3/df4/f106 0 2024-09-17T01:41:54.445 INFO:tasks.workunit.client.0.smithi082.stdout:8/757: link d3/dd/d18/d2d/d3b/l9d d3/dd/d18/d2d/d3e/d4a/d66/lf0 0 2024-09-17T01:41:54.446 INFO:tasks.workunit.client.0.smithi082.stdout:5/923: truncate db/da7/db3/f11b 927930 0 2024-09-17T01:41:54.446 INFO:tasks.workunit.client.0.smithi082.stdout:9/770: dwrite d4/d27/d2d/d60/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:54.449 INFO:tasks.workunit.client.0.smithi082.stdout:3/858: dread d9/db/d26/f120 [0,4194304] 0 2024-09-17T01:41:54.453 INFO:tasks.workunit.client.0.smithi082.stdout:0/873: dwrite da/d1b/d23/d4d/f103 [0,4194304] 0 2024-09-17T01:41:54.457 INFO:tasks.workunit.client.0.smithi082.stdout:9/771: unlink d4/d27/d2d/d60/d11/fcf 0 2024-09-17T01:41:54.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/758: truncate d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/db3/fb9 114040 0 2024-09-17T01:41:54.462 INFO:tasks.workunit.client.0.smithi082.stdout:6/891: sync 2024-09-17T01:41:54.462 INFO:tasks.workunit.client.0.smithi082.stdout:1/918: sync 2024-09-17T01:41:54.462 INFO:tasks.workunit.client.0.smithi082.stdout:2/922: sync 2024-09-17T01:41:54.462 INFO:tasks.workunit.client.0.smithi082.stdout:5/924: dwrite db/d56/f35 [4194304,4194304] 0 2024-09-17T01:41:54.463 INFO:tasks.workunit.client.0.smithi082.stdout:3/859: creat d9/db/daf/dbf/ddc/f128 x:0 0 0 2024-09-17T01:41:54.464 INFO:tasks.workunit.client.0.smithi082.stdout:6/892: write d1/d1f/fba [3040505,53099] 0 2024-09-17T01:41:54.468 INFO:tasks.workunit.client.0.smithi082.stdout:9/772: truncate d4/d27/d2d/d60/fa3 399521 0 2024-09-17T01:41:54.470 INFO:tasks.workunit.client.0.smithi082.stdout:8/759: readlink d3/dd/d18/d51/dc5/led 0 2024-09-17T01:41:54.471 INFO:tasks.workunit.client.0.smithi082.stdout:8/760: stat d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/cd2 0 2024-09-17T01:41:54.474 INFO:tasks.workunit.client.0.smithi082.stdout:1/919: symlink d2/d3f/d34/dc5/l129 0 2024-09-17T01:41:54.476 INFO:tasks.workunit.client.0.smithi082.stdout:5/925: creat db/da7/db3/d10a/f133 x:0 0 0 2024-09-17T01:41:54.477 INFO:tasks.workunit.client.0.smithi082.stdout:3/860: symlink d9/db/daa/df3/l129 0 2024-09-17T01:41:54.481 INFO:tasks.workunit.client.0.smithi082.stdout:9/773: chown d4/d27/d2d/d60/d11/d39/d29/d77/ce9 339901 1 2024-09-17T01:41:54.481 INFO:tasks.workunit.client.0.smithi082.stdout:2/923: mknod d1/d66/c12d 0 2024-09-17T01:41:54.482 INFO:tasks.workunit.client.0.smithi082.stdout:9/774: chown d4/d27/d21/l89 3865170 1 2024-09-17T01:41:54.482 INFO:tasks.workunit.client.0.smithi082.stdout:9/775: readlink d4/d27/d2d/d60/l28 0 2024-09-17T01:41:54.484 INFO:tasks.workunit.client.0.smithi082.stdout:8/761: mknod d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab/cf1 0 2024-09-17T01:41:54.489 INFO:tasks.workunit.client.0.smithi082.stdout:3/861: rmdir d9/db/daf 39 2024-09-17T01:41:54.489 INFO:tasks.workunit.client.0.smithi082.stdout:5/926: read db/d56/d18/d98/fa9 [402894,105500] 0 2024-09-17T01:41:54.490 INFO:tasks.workunit.client.0.smithi082.stdout:6/893: mkdir d1/d1f/da7/ddd/df1/d131 0 2024-09-17T01:41:54.492 INFO:tasks.workunit.client.0.smithi082.stdout:0/874: link da/c10b da/df/d2b/d59/d6f/da6/c12c 0 2024-09-17T01:41:54.493 INFO:tasks.workunit.client.0.smithi082.stdout:8/762: dwrite d3/dd/d18/d3a/fcb [0,4194304] 0 2024-09-17T01:41:54.498 INFO:tasks.workunit.client.0.smithi082.stdout:2/924: write d1/d35/f37 [895515,96211] 0 2024-09-17T01:41:54.498 INFO:tasks.workunit.client.0.smithi082.stdout:9/776: mknod d4/d27/d36/d3b/db0/cfc 0 2024-09-17T01:41:54.504 INFO:tasks.workunit.client.0.smithi082.stdout:1/920: truncate d2/da/f58 281114 0 2024-09-17T01:41:54.508 INFO:tasks.workunit.client.0.smithi082.stdout:2/925: dwrite d1/d17/d38/d42/f101 [0,4194304] 0 2024-09-17T01:41:54.510 INFO:tasks.workunit.client.0.smithi082.stdout:8/763: creat d3/dd/d18/d34/ff2 x:0 0 0 2024-09-17T01:41:54.512 INFO:tasks.workunit.client.0.smithi082.stdout:8/764: dread - d3/fd7 zero size 2024-09-17T01:41:54.513 INFO:tasks.workunit.client.0.smithi082.stdout:5/927: mkdir db/d1e/d20/d30/dc6/dd1/d102/ddc/d134 0 2024-09-17T01:41:54.514 INFO:tasks.workunit.client.0.smithi082.stdout:8/765: readlink d3/dd/d18/d34/l5a 0 2024-09-17T01:41:54.516 INFO:tasks.workunit.client.0.smithi082.stdout:6/894: creat d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f132 x:0 0 0 2024-09-17T01:41:54.520 INFO:tasks.workunit.client.0.smithi082.stdout:1/921: truncate d2/df/f1d 2345262 0 2024-09-17T01:41:54.524 INFO:tasks.workunit.client.0.smithi082.stdout:5/928: symlink db/d56/d29/d124/l135 0 2024-09-17T01:41:54.526 INFO:tasks.workunit.client.0.smithi082.stdout:6/895: creat d1/d1f/da7/d123/f133 x:0 0 0 2024-09-17T01:41:54.530 INFO:tasks.workunit.client.0.smithi082.stdout:9/777: rename d4/d27/d36/d3b/f92 to d4/d59/ffd 0 2024-09-17T01:41:54.533 INFO:tasks.workunit.client.0.smithi082.stdout:7/913: dwrite d0/d3/db/fc8 [0,4194304] 0 2024-09-17T01:41:54.535 INFO:tasks.workunit.client.0.smithi082.stdout:3/862: link d9/d78/d88/d11e/le3 d9/db/daa/dec/l12a 0 2024-09-17T01:41:54.537 INFO:tasks.workunit.client.0.smithi082.stdout:0/875: dread da/df/d2b/d9a/f9b [4194304,4194304] 0 2024-09-17T01:41:54.539 INFO:tasks.workunit.client.0.smithi082.stdout:8/766: mknod d3/dd/d18/d2d/d3e/d4a/d66/cf3 0 2024-09-17T01:41:54.549 INFO:tasks.workunit.client.0.smithi082.stdout:9/778: creat d4/d27/d2d/d60/d11/d39/d29/d77/d88/ffe x:0 0 0 2024-09-17T01:41:54.549 INFO:tasks.workunit.client.0.smithi082.stdout:9/779: readlink d4/d27/d21/ld1 0 2024-09-17T01:41:54.561 INFO:tasks.workunit.client.0.smithi082.stdout:2/926: getdents d1/d5a/d6d/dc2 0 2024-09-17T01:41:54.566 INFO:tasks.workunit.client.0.smithi082.stdout:0/876: symlink da/l12d 0 2024-09-17T01:41:54.568 INFO:tasks.workunit.client.0.smithi082.stdout:8/767: symlink d3/dd/d18/d2d/d3e/d4a/d68/lf4 0 2024-09-17T01:41:54.569 INFO:tasks.workunit.client.0.smithi082.stdout:2/927: unlink d1/d17/d60/ff7 0 2024-09-17T01:41:54.570 INFO:tasks.workunit.client.0.smithi082.stdout:2/928: readlink d1/d5a/d6d/l10d 0 2024-09-17T01:41:54.571 INFO:tasks.workunit.client.0.smithi082.stdout:3/863: dread d9/db/d6d/fcc [0,4194304] 0 2024-09-17T01:41:54.574 INFO:tasks.workunit.client.0.smithi082.stdout:2/929: dread - d1/d66/d85/dde/f11e zero size 2024-09-17T01:41:54.575 INFO:tasks.workunit.client.0.smithi082.stdout:3/864: mkdir d9/db/d26/d110/d12b 0 2024-09-17T01:41:54.576 INFO:tasks.workunit.client.0.smithi082.stdout:0/877: link da/d1b/d23/d42/d43/cb0 da/d1b/c12e 0 2024-09-17T01:41:54.579 INFO:tasks.workunit.client.0.smithi082.stdout:3/865: mkdir d9/db/daa/df3/de7/d12c 0 2024-09-17T01:41:54.580 INFO:tasks.workunit.client.0.smithi082.stdout:2/930: mkdir d1/d17/d38/d42/d52/de5/d11a/d12e 0 2024-09-17T01:41:54.589 INFO:tasks.workunit.client.0.smithi082.stdout:5/929: write db/d2b/f87 [3875652,32287] 0 2024-09-17T01:41:54.590 INFO:tasks.workunit.client.0.smithi082.stdout:6/896: write d1/d7/d10/d4f/dc/d1d/d36/d56/f71 [343262,66726] 0 2024-09-17T01:41:54.645 INFO:tasks.workunit.client.0.smithi082.stdout:7/914: write d0/dd/f10e [291816,68908] 0 2024-09-17T01:41:54.646 INFO:tasks.workunit.client.0.smithi082.stdout:9/780: write d4/f49 [4484778,22655] 0 2024-09-17T01:41:54.648 INFO:tasks.workunit.client.0.smithi082.stdout:8/768: write d3/dd/d18/d2d/f53 [814681,45952] 0 2024-09-17T01:41:54.648 INFO:tasks.workunit.client.0.smithi082.stdout:1/922: dwrite d2/d3f/d24/db5/dec/dfc/dc6/fe9 [0,4194304] 0 2024-09-17T01:41:54.650 INFO:tasks.workunit.client.0.smithi082.stdout:5/930: mknod db/d1e/d20/d30/d47/c136 0 2024-09-17T01:41:54.650 INFO:tasks.workunit.client.0.smithi082.stdout:9/781: chown d4/d59/d63/fd8 157176249 1 2024-09-17T01:41:54.650 INFO:tasks.workunit.client.0.smithi082.stdout:3/866: dread d9/d35/f43 [0,4194304] 0 2024-09-17T01:41:54.850 INFO:tasks.workunit.client.0.smithi082.stdout:3/867: stat d9/db/daa/dec/f119 0 2024-09-17T01:41:54.856 INFO:tasks.workunit.client.0.smithi082.stdout:2/931: dwrite d1/d17/d38/d5c/d7d/f108 [4194304,4194304] 0 2024-09-17T01:41:54.864 INFO:tasks.workunit.client.0.smithi082.stdout:8/769: dwrite d3/dd/d18/d34/ff2 [0,4194304] 0 2024-09-17T01:41:54.864 INFO:tasks.workunit.client.0.smithi082.stdout:1/923: dwrite d2/da/d2f/f72 [0,4194304] 0 2024-09-17T01:41:54.869 INFO:tasks.workunit.client.0.smithi082.stdout:3/868: dwrite d9/db/f3e [0,4194304] 0 2024-09-17T01:41:54.882 INFO:tasks.workunit.client.0.smithi082.stdout:6/897: dread d1/d7/d10/d4f/dc/f88 [4194304,4194304] 0 2024-09-17T01:41:54.893 INFO:tasks.workunit.client.0.smithi082.stdout:7/915: unlink d0/dd/d2c/d55/l8c 0 2024-09-17T01:41:54.894 INFO:tasks.workunit.client.0.smithi082.stdout:5/931: mknod db/d1e/d20/d30/c137 0 2024-09-17T01:41:54.894 INFO:tasks.workunit.client.0.smithi082.stdout:7/916: readlink d0/d62/d7e/dd4/d37/d86/l92 0 2024-09-17T01:41:54.895 INFO:tasks.workunit.client.0.smithi082.stdout:5/932: write db/d1e/d5b/d83/f89 [757818,81670] 0 2024-09-17T01:41:54.896 INFO:tasks.workunit.client.0.smithi082.stdout:5/933: write db/d56/d18/f110 [695514,87367] 0 2024-09-17T01:41:54.902 INFO:tasks.workunit.client.0.smithi082.stdout:8/770: mknod d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/cf5 0 2024-09-17T01:41:54.903 INFO:tasks.workunit.client.0.smithi082.stdout:8/771: chown d3/dd/d18/d2d/d3e/d4a/d66/d7b 35176 1 2024-09-17T01:41:54.911 INFO:tasks.workunit.client.0.smithi082.stdout:5/934: unlink db/da7/de4/f10d 0 2024-09-17T01:41:54.915 INFO:tasks.workunit.client.0.smithi082.stdout:8/772: rename d3/dd/d18/d2d/d3e/d4a/d66/d7b/dab to d3/dd/d18/d2d/d3e/d43/df6 0 2024-09-17T01:41:54.916 INFO:tasks.workunit.client.0.smithi082.stdout:6/898: dread d1/d7/d10/d4f/dc/d2b/d48/f8d [0,4194304] 0 2024-09-17T01:41:54.917 INFO:tasks.workunit.client.0.smithi082.stdout:6/899: dread - d1/d7/d10/d4f/dc/d2b/db2/f119 zero size 2024-09-17T01:41:54.919 INFO:tasks.workunit.client.0.smithi082.stdout:5/935: unlink db/d56/d18/d23/l2a 0 2024-09-17T01:41:54.922 INFO:tasks.workunit.client.0.smithi082.stdout:9/782: link d4/c15 d4/d27/d2d/d60/d11/d39/d29/cff 0 2024-09-17T01:41:54.923 INFO:tasks.workunit.client.0.smithi082.stdout:3/869: getdents d9/d35/d63 0 2024-09-17T01:41:54.926 INFO:tasks.workunit.client.0.smithi082.stdout:8/773: mkdir d3/dd/d18/d2d/d3e/d4a/d68/df7 0 2024-09-17T01:41:54.929 INFO:tasks.workunit.client.0.smithi082.stdout:6/900: dread d1/f98 [0,4194304] 0 2024-09-17T01:41:54.929 INFO:tasks.workunit.client.0.smithi082.stdout:9/783: mkdir d4/d27/d95/de7/d100 0 2024-09-17T01:41:54.930 INFO:tasks.workunit.client.0.smithi082.stdout:6/901: stat d1/d7/d10/d4f/dc/d1d/d2c/c93 0 2024-09-17T01:41:54.935 INFO:tasks.workunit.client.0.smithi082.stdout:2/932: write d1/d17/d38/d42/d52/f76 [154910,125478] 0 2024-09-17T01:41:54.937 INFO:tasks.workunit.client.0.smithi082.stdout:2/933: dread - d1/d5a/d6d/f119 zero size 2024-09-17T01:41:54.937 INFO:tasks.workunit.client.0.smithi082.stdout:9/784: dread d4/d27/d2d/d60/d11/d39/d31/fb6 [0,4194304] 0 2024-09-17T01:41:54.939 INFO:tasks.workunit.client.0.smithi082.stdout:7/917: write d0/dd/d2c/ff3 [406129,53892] 0 2024-09-17T01:41:54.940 INFO:tasks.workunit.client.0.smithi082.stdout:9/785: write d4/fae [5045323,97358] 0 2024-09-17T01:41:54.942 INFO:tasks.workunit.client.0.smithi082.stdout:1/924: dwrite d2/d3f/f13 [0,4194304] 0 2024-09-17T01:41:54.943 INFO:tasks.workunit.client.0.smithi082.stdout:7/918: truncate d0/d3/db/fc8 4382474 0 2024-09-17T01:41:54.944 INFO:tasks.workunit.client.0.smithi082.stdout:9/786: write d4/d27/d2d/d60/d11/d39/d31/f40 [1664460,40175] 0 2024-09-17T01:41:54.945 INFO:tasks.workunit.client.0.smithi082.stdout:9/787: readlink d4/d27/d36/d3b/lea 0 2024-09-17T01:41:54.948 INFO:tasks.workunit.client.0.smithi082.stdout:8/774: link d3/dd/d18/d2d/d3e/d4a/d66/c79 d3/dd/d18/d2d/d3e/d4a/d66/cf8 0 2024-09-17T01:41:54.949 INFO:tasks.workunit.client.0.smithi082.stdout:2/934: truncate d1/d17/d38/d42/d52/ff4 68766 0 2024-09-17T01:41:54.950 INFO:tasks.workunit.client.0.smithi082.stdout:2/935: chown d1/d17/d38/d42/d52/c104 56 1 2024-09-17T01:41:54.951 INFO:tasks.workunit.client.0.smithi082.stdout:2/936: write d1/d17/d38/d5c/f10a [732451,77673] 0 2024-09-17T01:41:54.954 INFO:tasks.workunit.client.0.smithi082.stdout:2/937: read d1/d17/d60/dc6/f115 [28261,50818] 0 2024-09-17T01:41:54.954 INFO:tasks.workunit.client.0.smithi082.stdout:2/938: fsync d1/d10/f7f 0 2024-09-17T01:41:54.956 INFO:tasks.workunit.client.0.smithi082.stdout:7/919: unlink d0/d62/d7e/dd4/d37/d86/c95 0 2024-09-17T01:41:54.958 INFO:tasks.workunit.client.0.smithi082.stdout:5/936: write db/d56/d29/f7e [1394901,55558] 0 2024-09-17T01:41:54.961 INFO:tasks.workunit.client.0.smithi082.stdout:1/925: symlink d2/da/df2/l12a 0 2024-09-17T01:41:54.961 INFO:tasks.workunit.client.0.smithi082.stdout:5/937: truncate db/d2b/fa2 5226372 0 2024-09-17T01:41:54.963 INFO:tasks.workunit.client.0.smithi082.stdout:3/870: dwrite d9/db/d6d/fae [0,4194304] 0 2024-09-17T01:41:54.963 INFO:tasks.workunit.client.0.smithi082.stdout:5/938: chown db/d1e/d20/d30/dc6/dca 8904 1 2024-09-17T01:41:54.968 INFO:tasks.workunit.client.0.smithi082.stdout:9/788: write d4/d27/d21/f42 [379837,109668] 0 2024-09-17T01:41:54.971 INFO:tasks.workunit.client.0.smithi082.stdout:2/939: creat d1/d17/d38/d5c/d7d/d110/f12f x:0 0 0 2024-09-17T01:41:54.973 INFO:tasks.workunit.client.0.smithi082.stdout:5/939: mknod db/d1e/d20/d30/c138 0 2024-09-17T01:41:54.974 INFO:tasks.workunit.client.0.smithi082.stdout:5/940: chown db/d1e/d20/l3a 2691 1 2024-09-17T01:41:54.978 INFO:tasks.workunit.client.0.smithi082.stdout:7/920: dwrite d0/d62/d7e/dd4/d37/d71/f7b [0,4194304] 0 2024-09-17T01:41:54.978 INFO:tasks.workunit.client.0.smithi082.stdout:9/789: chown d4/d27/d2d/d3d/f8c 1565 1 2024-09-17T01:41:54.979 INFO:tasks.workunit.client.0.smithi082.stdout:9/790: readlink d4/d27/d95/de7/led 0 2024-09-17T01:41:54.981 INFO:tasks.workunit.client.0.smithi082.stdout:1/926: mknod d2/da/c12b 0 2024-09-17T01:41:54.983 INFO:tasks.workunit.client.0.smithi082.stdout:2/940: truncate d1/d17/d38/d42/f83 1950707 0 2024-09-17T01:41:54.984 INFO:tasks.workunit.client.0.smithi082.stdout:5/941: dread - db/d2b/d59/fee zero size 2024-09-17T01:41:54.984 INFO:tasks.workunit.client.0.smithi082.stdout:2/941: fdatasync d1/d17/d38/d42/d52/de5/f109 0 2024-09-17T01:41:54.986 INFO:tasks.workunit.client.0.smithi082.stdout:7/921: symlink d0/d3/db/d10/d3f/d107/l144 0 2024-09-17T01:41:54.988 INFO:tasks.workunit.client.0.smithi082.stdout:3/871: rename d9/db/d8f/lef to d9/db/l12d 0 2024-09-17T01:41:54.988 INFO:tasks.workunit.client.0.smithi082.stdout:7/922: read d0/f7a [555980,114797] 0 2024-09-17T01:41:54.990 INFO:tasks.workunit.client.0.smithi082.stdout:3/872: read d9/db/d49/d4e/d53/f62 [2833478,69595] 0 2024-09-17T01:41:54.990 INFO:tasks.workunit.client.0.smithi082.stdout:5/942: chown db/l27 65485568 1 2024-09-17T01:41:54.991 INFO:tasks.workunit.client.0.smithi082.stdout:2/942: creat d1/d10/f130 x:0 0 0 2024-09-17T01:41:54.992 INFO:tasks.workunit.client.0.smithi082.stdout:9/791: creat d4/d27/d95/de7/d100/f101 x:0 0 0 2024-09-17T01:41:54.993 INFO:tasks.workunit.client.0.smithi082.stdout:1/927: symlink d2/da/d76/l12c 0 2024-09-17T01:41:54.994 INFO:tasks.workunit.client.0.smithi082.stdout:7/923: fdatasync d0/d62/d7e/dd4/d37/d71/fb4 0 2024-09-17T01:41:54.995 INFO:tasks.workunit.client.0.smithi082.stdout:7/924: write d0/d3/db/d10/d3f/d107/f10d [124279,70268] 0 2024-09-17T01:41:54.997 INFO:tasks.workunit.client.0.smithi082.stdout:3/873: read - d9/db/daf/d69/d79/d86/db5/f127 zero size 2024-09-17T01:41:54.997 INFO:tasks.workunit.client.0.smithi082.stdout:5/943: truncate db/d2b/f7f 5071109 0 2024-09-17T01:41:54.999 INFO:tasks.workunit.client.0.smithi082.stdout:7/925: dread d0/dd/d2c/d42/d77/db2/fc6 [0,4194304] 0 2024-09-17T01:41:55.001 INFO:tasks.workunit.client.0.smithi082.stdout:7/926: chown d0/d3/db/d10/d3f/dec/f10b 18 1 2024-09-17T01:41:55.002 INFO:tasks.workunit.client.0.smithi082.stdout:9/792: rmdir d4/d27/d2d/d60/d11/d39/d29/d35 39 2024-09-17T01:41:55.002 INFO:tasks.workunit.client.0.smithi082.stdout:2/943: dwrite d1/d90/fe0 [0,4194304] 0 2024-09-17T01:41:55.011 INFO:tasks.workunit.client.0.smithi082.stdout:1/928: dwrite d2/f4 [4194304,4194304] 0 2024-09-17T01:41:55.025 INFO:tasks.workunit.client.0.smithi082.stdout:1/929: chown d2/da/d2f/d47/f4d 2586857 1 2024-09-17T01:41:55.027 INFO:tasks.workunit.client.0.smithi082.stdout:5/944: write db/d1e/fa8 [207314,49377] 0 2024-09-17T01:41:55.030 INFO:tasks.workunit.client.0.smithi082.stdout:7/927: mkdir d0/d62/d130/d145 0 2024-09-17T01:41:55.030 INFO:tasks.workunit.client.0.smithi082.stdout:3/874: dwrite d9/db/daa/fc1 [0,4194304] 0 2024-09-17T01:41:55.035 INFO:tasks.workunit.client.0.smithi082.stdout:2/944: fsync d1/d17/d29/d50/f77 0 2024-09-17T01:41:55.036 INFO:tasks.workunit.client.0.smithi082.stdout:1/930: symlink d2/d3f/d34/l12d 0 2024-09-17T01:41:55.037 INFO:tasks.workunit.client.0.smithi082.stdout:2/945: fsync d1/d17/d29/f4c 0 2024-09-17T01:41:55.039 INFO:tasks.workunit.client.0.smithi082.stdout:7/928: creat d0/d3/db/f146 x:0 0 0 2024-09-17T01:41:55.048 INFO:tasks.workunit.client.0.smithi082.stdout:1/931: symlink d2/df/l12e 0 2024-09-17T01:41:55.054 INFO:tasks.workunit.client.0.smithi082.stdout:7/929: rmdir d0/dd/d2c/d42 39 2024-09-17T01:41:55.056 INFO:tasks.workunit.client.0.smithi082.stdout:9/793: getdents d4/d27/d2d/d3d 0 2024-09-17T01:41:55.057 INFO:tasks.workunit.client.0.smithi082.stdout:1/932: dwrite d2/d3f/d24/db5/dea/ff7 [0,4194304] 0 2024-09-17T01:41:55.057 INFO:tasks.workunit.client.0.smithi082.stdout:5/945: dread db/d56/f1c [0,4194304] 0 2024-09-17T01:41:55.060 INFO:tasks.workunit.client.0.smithi082.stdout:3/875: dwrite d9/db/d26/f9e [0,4194304] 0 2024-09-17T01:41:55.062 INFO:tasks.workunit.client.0.smithi082.stdout:9/794: creat d4/d59/f102 x:0 0 0 2024-09-17T01:41:55.063 INFO:tasks.workunit.client.0.smithi082.stdout:1/933: read d2/da/d2f/d47/f4d [1185110,27193] 0 2024-09-17T01:41:55.064 INFO:tasks.workunit.client.0.smithi082.stdout:2/946: creat d1/d35/db1/f131 x:0 0 0 2024-09-17T01:41:55.068 INFO:tasks.workunit.client.0.smithi082.stdout:3/876: dwrite f0 [0,4194304] 0 2024-09-17T01:41:55.070 INFO:tasks.workunit.client.0.smithi082.stdout:2/947: creat d1/d17/d29/d50/f132 x:0 0 0 2024-09-17T01:41:55.074 INFO:tasks.workunit.client.0.smithi082.stdout:7/930: getdents d0/d50/dd2 0 2024-09-17T01:41:55.076 INFO:tasks.workunit.client.0.smithi082.stdout:5/946: link db/d1e/d20/d30/d47/c136 db/d1e/d20/d30/dc6/dd1/d102/ddc/d134/c139 0 2024-09-17T01:41:55.077 INFO:tasks.workunit.client.0.smithi082.stdout:3/877: symlink d9/d78/d88/d11e/ddb/d11b/l12e 0 2024-09-17T01:41:55.078 INFO:tasks.workunit.client.0.smithi082.stdout:2/948: creat d1/d90/d12b/f133 x:0 0 0 2024-09-17T01:41:55.083 INFO:tasks.workunit.client.0.smithi082.stdout:7/931: mknod d0/dd/c147 0 2024-09-17T01:41:55.086 INFO:tasks.workunit.client.0.smithi082.stdout:1/934: write d2/da/d2f/d47/fac [251067,43527] 0 2024-09-17T01:41:55.087 INFO:tasks.workunit.client.0.smithi082.stdout:7/932: mkdir d0/dd/d2c/d148 0 2024-09-17T01:41:55.090 INFO:tasks.workunit.client.0.smithi082.stdout:1/935: mkdir d2/da/d2d/d12f 0 2024-09-17T01:41:55.092 INFO:tasks.workunit.client.0.smithi082.stdout:1/936: stat d2/d3f/d34/fdd 0 2024-09-17T01:41:55.095 INFO:tasks.workunit.client.0.smithi082.stdout:3/878: write d9/f2b [1473456,69066] 0 2024-09-17T01:41:55.097 INFO:tasks.workunit.client.0.smithi082.stdout:9/795: dwrite d4/d27/d2d/d60/fa3 [0,4194304] 0 2024-09-17T01:41:55.098 INFO:tasks.workunit.client.0.smithi082.stdout:1/937: symlink d2/d3f/d24/db5/de6/l130 0 2024-09-17T01:41:55.099 INFO:tasks.workunit.client.0.smithi082.stdout:9/796: rename d4/da6 to d4/da6/d103 22 2024-09-17T01:41:55.103 INFO:tasks.workunit.client.0.smithi082.stdout:9/797: rmdir d4/d27/d2d/d60/d11 39 2024-09-17T01:41:55.106 INFO:tasks.workunit.client.0.smithi082.stdout:3/879: dwrite d9/db/f17 [0,4194304] 0 2024-09-17T01:41:55.106 INFO:tasks.workunit.client.0.smithi082.stdout:5/947: dread db/d2b/fcb [0,4194304] 0 2024-09-17T01:41:55.108 INFO:tasks.workunit.client.0.smithi082.stdout:7/933: dwrite d0/dd/d34/d11f/f12c [0,4194304] 0 2024-09-17T01:41:55.111 INFO:tasks.workunit.client.0.smithi082.stdout:1/938: write d2/d3f/d24/d54/f103 [754540,74035] 0 2024-09-17T01:41:55.115 INFO:tasks.workunit.client.0.smithi082.stdout:3/880: mknod d9/db/c12f 0 2024-09-17T01:41:55.116 INFO:tasks.workunit.client.0.smithi082.stdout:1/939: write d2/d3f/d24/dcf/f10b [635329,81434] 0 2024-09-17T01:41:55.116 INFO:tasks.workunit.client.0.smithi082.stdout:7/934: read d0/d62/d7e/dd4/d37/d86/fb1 [28675,6941] 0 2024-09-17T01:41:55.118 INFO:tasks.workunit.client.0.smithi082.stdout:5/948: write db/d56/d78/ff6 [3574589,23582] 0 2024-09-17T01:41:55.119 INFO:tasks.workunit.client.0.smithi082.stdout:9/798: dwrite d4/d27/d2d/d60/d11/d37/f3c [8388608,4194304] 0 2024-09-17T01:41:55.121 INFO:tasks.workunit.client.0.smithi082.stdout:7/935: mknod d0/d62/dce/c149 0 2024-09-17T01:41:55.129 INFO:tasks.workunit.client.0.smithi082.stdout:3/881: link d9/db/daf/d69/d9c/la2 d9/db/l130 0 2024-09-17T01:41:55.134 INFO:tasks.workunit.client.0.smithi082.stdout:3/882: link d9/db/d49/da4/lde d9/db/daa/df3/l131 0 2024-09-17T01:41:55.136 INFO:tasks.workunit.client.0.smithi082.stdout:3/883: mknod d9/d35/dda/c132 0 2024-09-17T01:41:55.138 INFO:tasks.workunit.client.0.smithi082.stdout:3/884: truncate d9/f29 1755484 0 2024-09-17T01:41:55.139 INFO:tasks.workunit.client.0.smithi082.stdout:3/885: write d9/db/daa/df3/de7/f10a [640661,79395] 0 2024-09-17T01:41:55.140 INFO:tasks.workunit.client.0.smithi082.stdout:3/886: fsync d9/d78/d88/d11e/fe1 0 2024-09-17T01:41:55.141 INFO:tasks.workunit.client.0.smithi082.stdout:9/799: fsync d4/f1d 0 2024-09-17T01:41:55.141 INFO:tasks.workunit.client.0.smithi082.stdout:9/800: fdatasync d4/f5f 0 2024-09-17T01:41:55.143 INFO:tasks.workunit.client.0.smithi082.stdout:9/801: rmdir d4/d27/d2d/d60/d11/d39/d31 39 2024-09-17T01:41:55.146 INFO:tasks.workunit.client.0.smithi082.stdout:3/887: rename d9/db/l12d to d9/db/d49/d4e/l133 0 2024-09-17T01:41:55.148 INFO:tasks.workunit.client.0.smithi082.stdout:9/802: creat d4/d27/d2d/d60/d11/d39/d29/d6d/f104 x:0 0 0 2024-09-17T01:41:55.150 INFO:tasks.workunit.client.0.smithi082.stdout:9/803: write d4/d27/d2d/d60/d11/d39/d29/d6d/f90 [2579385,115547] 0 2024-09-17T01:41:55.154 INFO:tasks.workunit.client.0.smithi082.stdout:9/804: dread d4/d59/d63/fc5 [0,4194304] 0 2024-09-17T01:41:55.154 INFO:tasks.workunit.client.0.smithi082.stdout:3/888: rmdir d9/db/d26/d110/d12b 0 2024-09-17T01:41:55.161 INFO:tasks.workunit.client.0.smithi082.stdout:1/940: dwrite d2/da/d16/fb9 [0,4194304] 0 2024-09-17T01:41:55.169 INFO:tasks.workunit.client.0.smithi082.stdout:7/936: dwrite d0/d3/db/d10/f128 [0,4194304] 0 2024-09-17T01:41:55.172 INFO:tasks.workunit.client.0.smithi082.stdout:9/805: dwrite d4/d27/d2d/d60/d11/d39/d31/fd9 [0,4194304] 0 2024-09-17T01:41:55.174 INFO:tasks.workunit.client.0.smithi082.stdout:3/889: getdents d9/db/daf/d69/d79/d86/db5/df1 0 2024-09-17T01:41:55.178 INFO:tasks.workunit.client.0.smithi082.stdout:3/890: creat d9/d35/f134 x:0 0 0 2024-09-17T01:41:55.182 INFO:tasks.workunit.client.0.smithi082.stdout:3/891: write d9/db/d26/f9e [5691771,119924] 0 2024-09-17T01:41:55.185 INFO:tasks.workunit.client.0.smithi082.stdout:7/937: getdents d0/d62/d7e/dd7/de0 0 2024-09-17T01:41:55.185 INFO:tasks.workunit.client.0.smithi082.stdout:1/941: dwrite d2/da/d2d/f3e [0,4194304] 0 2024-09-17T01:41:55.190 INFO:tasks.workunit.client.0.smithi082.stdout:1/942: truncate d2/da/d2f/d47/fee 73837 0 2024-09-17T01:41:55.195 INFO:tasks.workunit.client.0.smithi082.stdout:1/943: creat d2/d3f/d24/dc8/f131 x:0 0 0 2024-09-17T01:41:55.200 INFO:tasks.workunit.client.0.smithi082.stdout:1/944: read d2/d3f/d24/f69 [50937,1820] 0 2024-09-17T01:41:55.204 INFO:tasks.workunit.client.0.smithi082.stdout:1/945: dwrite d2/f11e [0,4194304] 0 2024-09-17T01:41:55.208 INFO:tasks.workunit.client.0.smithi082.stdout:1/946: unlink d2/da/d2d/f3e 0 2024-09-17T01:41:55.213 INFO:tasks.workunit.client.0.smithi082.stdout:7/938: truncate d0/dd/d2c/ff3 251654 0 2024-09-17T01:41:55.214 INFO:tasks.workunit.client.0.smithi082.stdout:3/892: dread d9/db/d26/f27 [0,4194304] 0 2024-09-17T01:41:55.222 INFO:tasks.workunit.client.0.smithi082.stdout:3/893: rename d9/db/d95/c104 to d9/db/daa/df3/de7/d118/c135 0 2024-09-17T01:41:55.224 INFO:tasks.workunit.client.0.smithi082.stdout:7/939: creat d0/dd/d2c/d42/dde/f14a x:0 0 0 2024-09-17T01:41:55.224 INFO:tasks.workunit.client.0.smithi082.stdout:3/894: mknod d9/db/daa/df3/de7/c136 0 2024-09-17T01:41:55.225 INFO:tasks.workunit.client.0.smithi082.stdout:7/940: write d0/dd/d2c/d42/d77/db2/f11d [553156,704] 0 2024-09-17T01:41:55.228 INFO:tasks.workunit.client.0.smithi082.stdout:1/947: write d2/d3f/f19 [5149039,121087] 0 2024-09-17T01:41:55.239 INFO:tasks.workunit.client.0.smithi082.stdout:1/948: link d2/d3f/d24/db5/de6/c11b d2/da/d2f/d47/c132 0 2024-09-17T01:41:55.242 INFO:tasks.workunit.client.0.smithi082.stdout:3/895: dwrite d9/db/d26/fa1 [0,4194304] 0 2024-09-17T01:41:55.270 INFO:tasks.workunit.client.0.smithi082.stdout:1/949: symlink d2/da/d16/d114/l133 0 2024-09-17T01:41:55.270 INFO:tasks.workunit.client.0.smithi082.stdout:7/941: dwrite d0/dd/d2c/d42/f57 [0,4194304] 0 2024-09-17T01:41:55.272 INFO:tasks.workunit.client.0.smithi082.stdout:3/896: rename d9/d35/d63/l9d to d9/db/d8f/l137 0 2024-09-17T01:41:55.273 INFO:tasks.workunit.client.0.smithi082.stdout:1/950: fsync d2/d3f/f10a 0 2024-09-17T01:41:55.277 INFO:tasks.workunit.client.0.smithi082.stdout:3/897: mknod d9/db/d95/c138 0 2024-09-17T01:41:55.281 INFO:tasks.workunit.client.0.smithi082.stdout:7/942: creat d0/dd/d2c/d42/d140/f14b x:0 0 0 2024-09-17T01:41:55.286 INFO:tasks.workunit.client.0.smithi082.stdout:7/943: rename d0/d3/db/fd1 to d0/dd/d2c/d55/f14c 0 2024-09-17T01:41:55.291 INFO:tasks.workunit.client.0.smithi082.stdout:1/951: write d2/d3f/d24/dcf/fd5 [4224474,59167] 0 2024-09-17T01:41:55.292 INFO:tasks.workunit.client.0.smithi082.stdout:7/944: mkdir d0/dd/d14d 0 2024-09-17T01:41:55.293 INFO:tasks.workunit.client.0.smithi082.stdout:3/898: write d9/db/d49/f32 [3367610,118562] 0 2024-09-17T01:41:55.302 INFO:tasks.workunit.client.0.smithi082.stdout:3/899: link d9/db/daa/df3/de7/c136 d9/d78/d88/c139 0 2024-09-17T01:41:55.304 INFO:tasks.workunit.client.0.smithi082.stdout:3/900: creat d9/db/d8f/f13a x:0 0 0 2024-09-17T01:41:55.305 INFO:tasks.workunit.client.0.smithi082.stdout:7/945: write d0/dd/d2c/d55/f9d [221831,61267] 0 2024-09-17T01:41:55.309 INFO:tasks.workunit.client.0.smithi082.stdout:3/901: creat d9/db/f13b x:0 0 0 2024-09-17T01:41:55.309 INFO:tasks.workunit.client.0.smithi082.stdout:1/952: dread d2/d3f/d24/db5/dec/dfc/ddf/dff/f110 [0,4194304] 0 2024-09-17T01:41:55.314 INFO:tasks.workunit.client.0.smithi082.stdout:1/953: creat d2/d3f/d24/db5/dec/dfc/dc6/f134 x:0 0 0 2024-09-17T01:41:55.316 INFO:tasks.workunit.client.0.smithi082.stdout:7/946: dwrite d0/d50/fdb [0,4194304] 0 2024-09-17T01:41:55.318 INFO:tasks.workunit.client.0.smithi082.stdout:3/902: rename d9/db/daf/d69/d9c/la2 to d9/db/daf/d69/d79/d86/db5/l13c 0 2024-09-17T01:41:55.325 INFO:tasks.workunit.client.0.smithi082.stdout:1/954: unlink d2/d3f/d24/db5/de6/c11b 0 2024-09-17T01:41:55.326 INFO:tasks.workunit.client.0.smithi082.stdout:1/955: write d2/df/f11c [1773487,9517] 0 2024-09-17T01:41:55.328 INFO:tasks.workunit.client.0.smithi082.stdout:3/903: mknod d9/db/daf/d69/d79/d86/c13d 0 2024-09-17T01:41:55.329 INFO:tasks.workunit.client.0.smithi082.stdout:1/956: rmdir d2/da/df2 39 2024-09-17T01:41:55.331 INFO:tasks.workunit.client.0.smithi082.stdout:1/957: creat d2/da/d16/d114/d116/f135 x:0 0 0 2024-09-17T01:41:55.337 INFO:tasks.workunit.client.0.smithi082.stdout:3/904: rename d9/d78/d88/c139 to d9/db/d49/d4e/d53/c13e 0 2024-09-17T01:41:55.343 INFO:tasks.workunit.client.0.smithi082.stdout:7/947: dwrite d0/d3/db/ddf/f100 [0,4194304] 0 2024-09-17T01:41:55.346 INFO:tasks.workunit.client.0.smithi082.stdout:7/948: rmdir d0 39 2024-09-17T01:41:55.348 INFO:tasks.workunit.client.0.smithi082.stdout:1/958: truncate d2/f4 1175875 0 2024-09-17T01:41:55.349 INFO:tasks.workunit.client.0.smithi082.stdout:1/959: stat d2/d3f/d24/dc8/d107/l111 0 2024-09-17T01:41:55.353 INFO:tasks.workunit.client.0.smithi082.stdout:1/960: symlink d2/da/d2d/l136 0 2024-09-17T01:41:55.356 INFO:tasks.workunit.client.0.smithi082.stdout:1/961: symlink d2/d3f/d24/db5/l137 0 2024-09-17T01:41:55.361 INFO:tasks.workunit.client.0.smithi082.stdout:1/962: rename d2/df/le3 to d2/da/d2d/d12f/l138 0 2024-09-17T01:41:55.365 INFO:tasks.workunit.client.0.smithi082.stdout:1/963: mkdir d2/da/d2d/d12f/d139 0 2024-09-17T01:41:55.366 INFO:tasks.workunit.client.0.smithi082.stdout:7/949: dwrite d0/f32 [4194304,4194304] 0 2024-09-17T01:41:55.370 INFO:tasks.workunit.client.0.smithi082.stdout:1/964: creat d2/da/d2d/d79/f13a x:0 0 0 2024-09-17T01:41:55.374 INFO:tasks.workunit.client.0.smithi082.stdout:7/950: fsync d0/dd/d2c/d55/f122 0 2024-09-17T01:41:55.375 INFO:tasks.workunit.client.0.smithi082.stdout:7/951: chown d0/d3/db/d10/d47 45362419 1 2024-09-17T01:41:55.377 INFO:tasks.workunit.client.0.smithi082.stdout:7/952: write d0/d62/d7e/dd4/d37/d71/f124 [772009,80121] 0 2024-09-17T01:41:55.383 INFO:tasks.workunit.client.0.smithi082.stdout:7/953: unlink d0/dd/d2c/f89 0 2024-09-17T01:41:55.387 INFO:tasks.workunit.client.0.smithi082.stdout:7/954: symlink d0/dd/d2c/d42/dde/de2/l14e 0 2024-09-17T01:41:55.388 INFO:tasks.workunit.client.0.smithi082.stdout:7/955: write d0/dd/d34/d58/f136 [3944651,54050] 0 2024-09-17T01:41:55.395 INFO:tasks.workunit.client.0.smithi082.stdout:1/965: dread d2/d3f/d24/d54/fda [0,4194304] 0 2024-09-17T01:41:55.398 INFO:tasks.workunit.client.0.smithi082.stdout:1/966: creat d2/df/f13b x:0 0 0 2024-09-17T01:41:55.405 INFO:tasks.workunit.client.0.smithi082.stdout:7/956: dread d0/f7a [0,4194304] 0 2024-09-17T01:41:55.406 INFO:tasks.workunit.client.0.smithi082.stdout:7/957: mkdir d0/dd/d2c/d14f 0 2024-09-17T01:41:55.407 INFO:tasks.workunit.client.0.smithi082.stdout:7/958: write d0/dd/d2c/d42/f57 [937470,128659] 0 2024-09-17T01:41:55.411 INFO:tasks.workunit.client.0.smithi082.stdout:7/959: mknod d0/d3/db/c150 0 2024-09-17T01:41:55.413 INFO:tasks.workunit.client.0.smithi082.stdout:7/960: creat d0/d50/dd2/d117/f151 x:0 0 0 2024-09-17T01:41:55.414 INFO:tasks.workunit.client.0.smithi082.stdout:7/961: stat d0/dd/d2c/d42/d77/db2/fc6 0 2024-09-17T01:41:55.415 INFO:tasks.workunit.client.0.smithi082.stdout:7/962: write d0/f48 [67434,83223] 0 2024-09-17T01:41:55.417 INFO:tasks.workunit.client.0.smithi082.stdout:7/963: mkdir d0/dd/d34/d58/d6e/d8a/d152 0 2024-09-17T01:41:55.418 INFO:tasks.workunit.client.0.smithi082.stdout:1/967: write d2/d3f/d24/f9a [354845,115931] 0 2024-09-17T01:41:55.419 INFO:tasks.workunit.client.0.smithi082.stdout:7/964: chown d0/dd/d34/d58/d6e/d8a/d152 78211402 1 2024-09-17T01:41:55.420 INFO:tasks.workunit.client.0.smithi082.stdout:7/965: fdatasync d0/dd/d34/d11f/f12c 0 2024-09-17T01:41:55.421 INFO:tasks.workunit.client.0.smithi082.stdout:1/968: fdatasync d2/da/d2f/ff6 0 2024-09-17T01:41:55.423 INFO:tasks.workunit.client.0.smithi082.stdout:7/966: mknod d0/dd/d2c/d42/c153 0 2024-09-17T01:41:55.429 INFO:tasks.workunit.client.0.smithi082.stdout:7/967: truncate d0/dd/d34/d58/d6e/d8a/dfb/f13e 1426810 0 2024-09-17T01:41:55.430 INFO:tasks.workunit.client.0.smithi082.stdout:7/968: chown d0/dd/d2c/d42/d140 211044 1 2024-09-17T01:41:55.432 INFO:tasks.workunit.client.0.smithi082.stdout:7/969: getdents d0/d62/d130/d145 0 2024-09-17T01:41:55.435 INFO:tasks.workunit.client.0.smithi082.stdout:7/970: creat d0/d62/d7e/dd4/d37/d86/f154 x:0 0 0 2024-09-17T01:41:55.437 INFO:tasks.workunit.client.0.smithi082.stdout:7/971: creat d0/dd/d2c/d42/d77/f155 x:0 0 0 2024-09-17T01:41:55.442 INFO:tasks.workunit.client.0.smithi082.stdout:7/972: rename d0/d62/d7e/dd4/d37/d86/laa to d0/d3/db/ddf/l156 0 2024-09-17T01:41:55.444 INFO:tasks.workunit.client.0.smithi082.stdout:7/973: rmdir d0/d62/dce 39 2024-09-17T01:41:55.464 INFO:tasks.workunit.client.0.smithi082.stdout:1/969: dwrite d2/d3f/d24/d54/f9b [0,4194304] 0 2024-09-17T01:41:55.479 INFO:tasks.workunit.client.0.smithi082.stdout:7/974: write d0/d3/db/f18 [4395896,3844] 0 2024-09-17T01:41:55.480 INFO:tasks.workunit.client.0.smithi082.stdout:7/975: write d0/d62/d7e/fd9 [2149904,47406] 0 2024-09-17T01:41:55.485 INFO:tasks.workunit.client.0.smithi082.stdout:7/976: fdatasync d0/d3/db/f33 0 2024-09-17T01:41:55.495 INFO:tasks.workunit.client.0.smithi082.stdout:7/977: write d0/d62/d7e/dd7/ff5 [1487926,79420] 0 2024-09-17T01:41:55.511 INFO:tasks.workunit.client.0.smithi082.stdout:7/978: dread d0/d3/db/f2e [4194304,4194304] 0 2024-09-17T01:41:55.511 INFO:tasks.workunit.client.0.smithi082.stdout:7/979: chown d0/d3/db/cc4 2649614 1 2024-09-17T01:41:55.523 INFO:tasks.workunit.client.0.smithi082.stdout:7/980: dwrite d0/d3/db/d10/d3f/d107/f10c [0,4194304] 0 2024-09-17T01:41:55.527 INFO:tasks.workunit.client.0.smithi082.stdout:7/981: write d0/d62/dce/f131 [780450,2725] 0 2024-09-17T01:41:55.529 INFO:tasks.workunit.client.0.smithi082.stdout:7/982: symlink d0/l157 0 2024-09-17T01:41:55.532 INFO:tasks.workunit.client.0.smithi082.stdout:7/983: mknod d0/dd/d34/d58/d6e/c158 0 2024-09-17T01:41:55.535 INFO:tasks.workunit.client.0.smithi082.stdout:7/984: symlink d0/dd/d2c/d148/l159 0 2024-09-17T01:41:55.547 INFO:tasks.workunit.client.0.smithi082.stdout:7/985: dwrite d0/d3/db/d10/f27 [4194304,4194304] 0 2024-09-17T01:41:55.548 INFO:tasks.workunit.client.0.smithi082.stdout:7/986: dread - d0/d62/d7e/db5/f12d zero size 2024-09-17T01:41:55.554 INFO:tasks.workunit.client.0.smithi082.stdout:7/987: write d0/d62/d7e/db5/f12d [555489,14272] 0 2024-09-17T01:41:55.559 INFO:tasks.workunit.client.0.smithi082.stdout:7/988: rename d0/dd/d2c/d42/dde/de2/lea to d0/dd/d2c/d42/dde/l15a 0 2024-09-17T01:41:55.559 INFO:tasks.workunit.client.0.smithi082.stdout:7/989: fdatasync d0/d3/db/d10/f128 0 2024-09-17T01:41:55.562 INFO:tasks.workunit.client.0.smithi082.stdout:7/990: rename d0/c12f to d0/dd/d2c/d14f/c15b 0 2024-09-17T01:41:55.563 INFO:tasks.workunit.client.0.smithi082.stdout:7/991: fsync d0/dd/d34/d58/d6e/d8a/fe3 0 2024-09-17T01:41:55.565 INFO:tasks.workunit.client.0.smithi082.stdout:7/992: mkdir d0/d62/d130/d145/d15c 0 2024-09-17T01:41:55.566 INFO:tasks.workunit.client.0.smithi082.stdout:7/993: chown d0/d3/db/d10/d3f/d107 0 1 2024-09-17T01:41:55.566 INFO:tasks.workunit.client.0.smithi082.stdout:7/994: readlink d0/d62/d7e/dd4/l3c 0 2024-09-17T01:41:55.570 INFO:tasks.workunit.client.0.smithi082.stdout:7/995: dread d0/dd/d34/d11f/f12c [0,4194304] 0 2024-09-17T01:41:55.579 INFO:tasks.workunit.client.0.smithi082.stdout:7/996: dwrite d0/d62/d7e/dd4/d37/f96 [0,4194304] 0 2024-09-17T01:41:55.582 INFO:tasks.workunit.client.0.smithi082.stdout:7/997: rename d0/d62/dce/deb to d0/d50/d15d 0 2024-09-17T01:41:55.590 INFO:tasks.workunit.client.0.smithi082.stdout:7/998: dwrite d0/d3/db/d10/d3f/fa7 [0,4194304] 0 2024-09-17T01:41:55.592 INFO:tasks.workunit.client.0.smithi082.stdout:7/999: fdatasync d0/d62/d7e/dd4/d37/d71/f7b 0 2024-09-17T01:41:55.810 INFO:tasks.workunit.client.0.smithi082.stdout:0/878: sync 2024-09-17T01:41:55.811 INFO:tasks.workunit.client.0.smithi082.stdout:0/879: chown da/d1b 105 1 2024-09-17T01:41:55.814 INFO:tasks.workunit.client.0.smithi082.stdout:0/880: creat da/d1b/d23/d4d/f12f x:0 0 0 2024-09-17T01:41:55.816 INFO:tasks.workunit.client.0.smithi082.stdout:0/881: symlink da/d1b/d23/d42/d43/l130 0 2024-09-17T01:41:55.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/882: read - da/d1b/d23/d42/d43/d6b/dd2/fd6 zero size 2024-09-17T01:41:55.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/883: readlink da/df/d2b/l104 0 2024-09-17T01:41:55.823 INFO:tasks.workunit.client.0.smithi082.stdout:0/884: rename da/df/d27/c32 to da/d1b/d23/d4d/c131 0 2024-09-17T01:41:55.828 INFO:tasks.workunit.client.0.smithi082.stdout:0/885: fdatasync da/df/f4a 0 2024-09-17T01:41:55.829 INFO:tasks.workunit.client.0.smithi082.stdout:0/886: write da/d80/f8c [2357328,65685] 0 2024-09-17T01:41:55.830 INFO:tasks.workunit.client.0.smithi082.stdout:0/887: chown da/d1b/d23/d4d 4622707 1 2024-09-17T01:41:55.830 INFO:tasks.workunit.client.0.smithi082.stdout:0/888: chown da/d1b/c94 2616969 1 2024-09-17T01:41:55.831 INFO:tasks.workunit.client.0.smithi082.stdout:0/889: chown da/d80/d99/c68 105972900 1 2024-09-17T01:41:55.832 INFO:tasks.workunit.client.0.smithi082.stdout:0/890: chown da/d1b/d23/d42/d43/d6b/ffc 223 1 2024-09-17T01:41:55.838 INFO:tasks.workunit.client.0.smithi082.stdout:0/891: dwrite da/d80/f8c [4194304,4194304] 0 2024-09-17T01:41:55.844 INFO:tasks.workunit.client.0.smithi082.stdout:0/892: link da/df/d2b/d59/d6f/dd9/c11b da/d1b/d23/dea/c132 0 2024-09-17T01:41:55.856 INFO:tasks.workunit.client.0.smithi082.stdout:0/893: truncate da/d1b/d23/d42/f4e 2091713 0 2024-09-17T01:41:55.878 INFO:tasks.workunit.client.0.smithi082.stdout:0/894: write da/df/d2b/f95 [899730,119346] 0 2024-09-17T01:41:55.883 INFO:tasks.workunit.client.0.smithi082.stdout:0/895: getdents da/d1b/d23/dea 0 2024-09-17T01:41:55.884 INFO:tasks.workunit.client.0.smithi082.stdout:0/896: rmdir da/df 39 2024-09-17T01:41:55.886 INFO:tasks.workunit.client.0.smithi082.stdout:0/897: unlink da/d1b/d23/d4d/f103 0 2024-09-17T01:41:55.892 INFO:tasks.workunit.client.0.smithi082.stdout:0/898: creat da/df/d27/f133 x:0 0 0 2024-09-17T01:41:55.896 INFO:tasks.workunit.client.0.smithi082.stdout:6/902: sync 2024-09-17T01:41:55.898 INFO:tasks.workunit.client.0.smithi082.stdout:6/903: dread - d1/d7/d10/d4f/d8e/da8/ffc zero size 2024-09-17T01:41:55.903 INFO:tasks.workunit.client.0.smithi082.stdout:0/899: dwrite da/df/d2b/d59/fa2 [0,4194304] 0 2024-09-17T01:41:55.908 INFO:tasks.workunit.client.0.smithi082.stdout:6/904: link d1/d7/d10/d4f/d32/ca2 d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/c134 0 2024-09-17T01:41:55.909 INFO:tasks.workunit.client.0.smithi082.stdout:0/900: creat da/d1b/d23/d4d/dd7/f134 x:0 0 0 2024-09-17T01:41:55.911 INFO:tasks.workunit.client.0.smithi082.stdout:6/905: fdatasync d1/fd5 0 2024-09-17T01:41:55.911 INFO:tasks.workunit.client.0.smithi082.stdout:6/906: stat d1/d3/f72 0 2024-09-17T01:41:55.914 INFO:tasks.workunit.client.0.smithi082.stdout:0/901: creat da/d80/f135 x:0 0 0 2024-09-17T01:41:55.914 INFO:tasks.workunit.client.0.smithi082.stdout:0/902: readlink da/df/d2b/d59/d6f/da6/l128 0 2024-09-17T01:41:55.915 INFO:tasks.workunit.client.0.smithi082.stdout:6/907: mknod d1/d1f/da7/ddd/df1/d131/c135 0 2024-09-17T01:41:55.916 INFO:tasks.workunit.client.0.smithi082.stdout:0/903: chown da/df/d27/ld5 9897 1 2024-09-17T01:41:55.917 INFO:tasks.workunit.client.0.smithi082.stdout:0/904: stat da/d1b/d23/d42/d43/cd0 0 2024-09-17T01:41:55.918 INFO:tasks.workunit.client.0.smithi082.stdout:6/908: creat d1/d1f/da7/ddd/df1/df4/f136 x:0 0 0 2024-09-17T01:41:55.918 INFO:tasks.workunit.client.0.smithi082.stdout:6/909: chown d1/d7/d10/d4f 7 1 2024-09-17T01:41:55.919 INFO:tasks.workunit.client.0.smithi082.stdout:6/910: readlink d1/d7/d10/d4f/dc/d1d/d2c/lf6 0 2024-09-17T01:41:55.919 INFO:tasks.workunit.client.0.smithi082.stdout:0/905: mkdir da/df/d2b/d59/d6f/da6/d136 0 2024-09-17T01:41:55.920 INFO:tasks.workunit.client.0.smithi082.stdout:6/911: chown d1/d1f/da7/d123/f133 1969209623 1 2024-09-17T01:41:55.921 INFO:tasks.workunit.client.0.smithi082.stdout:6/912: read - d1/d7/d10/d4f/dc/d2b/db2/ff9 zero size 2024-09-17T01:41:55.922 INFO:tasks.workunit.client.0.smithi082.stdout:0/906: getdents da/d80/d77 0 2024-09-17T01:41:55.924 INFO:tasks.workunit.client.0.smithi082.stdout:6/913: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/f137 x:0 0 0 2024-09-17T01:41:55.925 INFO:tasks.workunit.client.0.smithi082.stdout:0/907: creat da/df/d27/db5/f137 x:0 0 0 2024-09-17T01:41:55.927 INFO:tasks.workunit.client.0.smithi082.stdout:0/908: mknod da/d1b/d23/d42/d43/d6b/dd2/c138 0 2024-09-17T01:41:55.930 INFO:tasks.workunit.client.0.smithi082.stdout:0/909: creat da/d1b/d23/d42/d43/d119/f139 x:0 0 0 2024-09-17T01:41:55.933 INFO:tasks.workunit.client.0.smithi082.stdout:6/914: write d1/d3/f72 [3104792,41670] 0 2024-09-17T01:41:55.935 INFO:tasks.workunit.client.0.smithi082.stdout:0/910: mknod da/df/d2b/c13a 0 2024-09-17T01:41:55.938 INFO:tasks.workunit.client.0.smithi082.stdout:0/911: symlink da/df/d71/d92/l13b 0 2024-09-17T01:41:55.941 INFO:tasks.workunit.client.0.smithi082.stdout:0/912: dread da/df/d2b/d59/fa2 [0,4194304] 0 2024-09-17T01:41:55.949 INFO:tasks.workunit.client.0.smithi082.stdout:0/913: getdents da/df/d27/db5 0 2024-09-17T01:41:55.949 INFO:tasks.workunit.client.0.smithi082.stdout:6/915: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/fde [0,4194304] 0 2024-09-17T01:41:56.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/914: write da/d1b/d23/d4d/f75 [1770670,66583] 0 2024-09-17T01:41:56.031 INFO:tasks.workunit.client.0.smithi082.stdout:6/916: read d1/d7/d10/d4f/d8e/da8/fb9 [104474,127644] 0 2024-09-17T01:41:56.035 INFO:tasks.workunit.client.0.smithi082.stdout:6/917: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/c138 0 2024-09-17T01:41:56.039 INFO:tasks.workunit.client.0.smithi082.stdout:0/915: mknod da/df/d71/d92/df7/dbe/dfb/c13c 0 2024-09-17T01:41:56.053 INFO:tasks.workunit.client.0.smithi082.stdout:6/918: write d1/d7/d10/f8c [714295,38419] 0 2024-09-17T01:41:56.056 INFO:tasks.workunit.client.0.smithi082.stdout:0/916: dread da/d1b/f52 [0,4194304] 0 2024-09-17T01:41:56.057 INFO:tasks.workunit.client.0.smithi082.stdout:0/917: chown da/d1b/d23/d4d/f5e 1769443178 1 2024-09-17T01:41:56.057 INFO:tasks.workunit.client.0.smithi082.stdout:6/919: creat d1/d7/d10/d4f/dc/d1d/d36/f139 x:0 0 0 2024-09-17T01:41:56.059 INFO:tasks.workunit.client.0.smithi082.stdout:0/918: creat da/df/d2b/d59/d6f/dd9/f13d x:0 0 0 2024-09-17T01:41:56.060 INFO:tasks.workunit.client.0.smithi082.stdout:0/919: readlink da/d80/l56 0 2024-09-17T01:41:56.062 INFO:tasks.workunit.client.0.smithi082.stdout:0/920: fdatasync da/d1b/d23/d42/f4e 0 2024-09-17T01:41:56.066 INFO:tasks.workunit.client.0.smithi082.stdout:6/920: write d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/f6c [950015,92922] 0 2024-09-17T01:41:56.069 INFO:tasks.workunit.client.0.smithi082.stdout:0/921: link da/d1b/d23/d4d/fb3 da/f13e 0 2024-09-17T01:41:56.069 INFO:tasks.workunit.client.0.smithi082.stdout:0/922: chown da/df 189791 1 2024-09-17T01:41:56.071 INFO:tasks.workunit.client.0.smithi082.stdout:6/921: dread d1/d1f/db0/ded/f10e [0,4194304] 0 2024-09-17T01:41:56.074 INFO:tasks.workunit.client.0.smithi082.stdout:6/922: creat d1/d1f/da7/f13a x:0 0 0 2024-09-17T01:41:56.078 INFO:tasks.workunit.client.0.smithi082.stdout:6/923: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/la4 to d1/d1f/db0/ded/l13b 0 2024-09-17T01:41:56.080 INFO:tasks.workunit.client.0.smithi082.stdout:0/923: dwrite da/d1b/d23/d42/f88 [0,4194304] 0 2024-09-17T01:41:56.081 INFO:tasks.workunit.client.0.smithi082.stdout:6/924: stat d1/d7/d10/d4f/dc/d1d/d36/d7a 0 2024-09-17T01:41:56.083 INFO:tasks.workunit.client.0.smithi082.stdout:0/924: unlink da/d1b/f52 0 2024-09-17T01:41:56.085 INFO:tasks.workunit.client.0.smithi082.stdout:6/925: rmdir d1/d1f/da7/ddd/df1/df4 39 2024-09-17T01:41:56.087 INFO:tasks.workunit.client.0.smithi082.stdout:0/925: rmdir da/df/d71 39 2024-09-17T01:41:56.092 INFO:tasks.workunit.client.0.smithi082.stdout:6/926: getdents d1/d1f/da7/ddd 0 2024-09-17T01:41:56.094 INFO:tasks.workunit.client.0.smithi082.stdout:0/926: write da/d1b/d23/d42/d43/d6b/dd2/fd6 [976484,31891] 0 2024-09-17T01:41:56.097 INFO:tasks.workunit.client.0.smithi082.stdout:0/927: readlink da/df/d71/d92/l13b 0 2024-09-17T01:41:56.108 INFO:tasks.workunit.client.0.smithi082.stdout:6/927: dread d1/d1f/db0/f109 [0,4194304] 0 2024-09-17T01:41:56.110 INFO:tasks.workunit.client.0.smithi082.stdout:6/928: fsync d1/fdb 0 2024-09-17T01:41:56.114 INFO:tasks.workunit.client.0.smithi082.stdout:6/929: rename d1/d7/d10/d4f/d32/l10c to d1/d7/d10/d4f/dc/d1d/d36/d127/l13c 0 2024-09-17T01:41:56.124 INFO:tasks.workunit.client.0.smithi082.stdout:6/930: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/f58 [0,4194304] 0 2024-09-17T01:41:56.128 INFO:tasks.workunit.client.0.smithi082.stdout:6/931: truncate d1/d7/d10/d4f/dc/d1d/d36/d56/f71 1676097 0 2024-09-17T01:41:56.130 INFO:tasks.workunit.client.0.smithi082.stdout:6/932: symlink d1/d7/d10/d4f/dc/d1d/d2c/l13d 0 2024-09-17T01:41:56.131 INFO:tasks.workunit.client.0.smithi082.stdout:6/933: fsync d1/fef 0 2024-09-17T01:41:56.135 INFO:tasks.workunit.client.0.smithi082.stdout:6/934: dread d1/d7/d10/d4f/d8e/feb [0,4194304] 0 2024-09-17T01:41:56.136 INFO:tasks.workunit.client.0.smithi082.stdout:6/935: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/lcd 43 1 2024-09-17T01:41:56.141 INFO:tasks.workunit.client.0.smithi082.stdout:6/936: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/c74 to d1/c13e 0 2024-09-17T01:41:56.144 INFO:tasks.workunit.client.0.smithi082.stdout:6/937: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/f13f x:0 0 0 2024-09-17T01:41:56.198 INFO:tasks.workunit.client.0.smithi082.stdout:8/775: sync 2024-09-17T01:41:56.198 INFO:tasks.workunit.client.0.smithi082.stdout:2/949: sync 2024-09-17T01:41:56.201 INFO:tasks.workunit.client.0.smithi082.stdout:2/950: read d1/d10/f6b [370894,117208] 0 2024-09-17T01:41:56.202 INFO:tasks.workunit.client.0.smithi082.stdout:2/951: fsync d1/d17/d60/dc6/de8/fc7 0 2024-09-17T01:41:56.202 INFO:tasks.workunit.client.0.smithi082.stdout:6/938: dwrite d1/d7/f2e [0,4194304] 0 2024-09-17T01:41:56.211 INFO:tasks.workunit.client.0.smithi082.stdout:2/952: unlink d1/d17/d38/d42/d52/ccc 0 2024-09-17T01:41:56.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/939: rename d1/d1f/da7/ddd/lb4 to d1/d1f/da7/d123/d130/l140 0 2024-09-17T01:41:56.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:55 smithi082 ceph-mon[28077]: pgmap v31: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 105 MiB/s wr, 276 op/s 2024-09-17T01:41:56.213 INFO:tasks.workunit.client.0.smithi082.stdout:6/940: dread - d1/d7/d10/d4f/dc/d2b/db2/f119 zero size 2024-09-17T01:41:56.220 INFO:tasks.workunit.client.0.smithi082.stdout:6/941: symlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l141 0 2024-09-17T01:41:56.221 INFO:tasks.workunit.client.0.smithi082.stdout:2/953: link d1/d35/f121 d1/d17/d38/d5c/d7d/d110/f134 0 2024-09-17T01:41:56.221 INFO:tasks.workunit.client.0.smithi082.stdout:2/954: dread - d1/d90/d12b/f133 zero size 2024-09-17T01:41:56.221 INFO:tasks.workunit.client.0.smithi082.stdout:8/776: dwrite d3/f33 [0,4194304] 0 2024-09-17T01:41:56.226 INFO:tasks.workunit.client.0.smithi082.stdout:2/955: symlink d1/d66/l135 0 2024-09-17T01:41:56.228 INFO:tasks.workunit.client.0.smithi082.stdout:2/956: chown d1/ff 595037499 1 2024-09-17T01:41:56.231 INFO:tasks.workunit.client.0.smithi082.stdout:6/942: rename d1/d1f/da7/ddd/df1/df4/cfa to d1/d7/d10/d4f/dc/d1d/d36/d56/c142 0 2024-09-17T01:41:56.233 INFO:tasks.workunit.client.0.smithi082.stdout:2/957: creat d1/d17/d38/d42/d52/de5/d11a/f136 x:0 0 0 2024-09-17T01:41:56.236 INFO:tasks.workunit.client.0.smithi082.stdout:6/943: mkdir d1/d7/d10/d4f/d8e/da8/de5/d143 0 2024-09-17T01:41:56.237 INFO:tasks.workunit.client.0.smithi082.stdout:6/944: write d1/d7/ff5 [2403984,102734] 0 2024-09-17T01:41:56.239 INFO:tasks.workunit.client.0.smithi082.stdout:6/945: readlink d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/l5f 0 2024-09-17T01:41:56.242 INFO:tasks.workunit.client.0.smithi082.stdout:8/777: dread d3/dd/d18/d2d/d3b/f48 [0,4194304] 0 2024-09-17T01:41:56.244 INFO:tasks.workunit.client.0.smithi082.stdout:6/946: dread d1/d7/f2e [0,4194304] 0 2024-09-17T01:41:56.245 INFO:tasks.workunit.client.0.smithi082.stdout:8/778: rename d3 to d3/dd/d18/d2d/d3e/d43/df6/dc7/df9 22 2024-09-17T01:41:56.249 INFO:tasks.workunit.client.0.smithi082.stdout:6/947: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/d110/f144 x:0 0 0 2024-09-17T01:41:56.250 INFO:tasks.workunit.client.0.smithi082.stdout:6/948: fdatasync d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/f12a 0 2024-09-17T01:41:56.252 INFO:tasks.workunit.client.0.smithi082.stdout:2/958: dread d1/d10/f7f [0,4194304] 0 2024-09-17T01:41:56.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:55 smithi167 ceph-mon[35643]: pgmap v31: 65 pgs: 65 active+clean; 3.2 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 41 MiB/s rd, 105 MiB/s wr, 276 op/s 2024-09-17T01:41:56.255 INFO:tasks.workunit.client.0.smithi082.stdout:6/949: dread d1/d7/d10/d4f/dc/f88 [4194304,4194304] 0 2024-09-17T01:41:56.256 INFO:tasks.workunit.client.0.smithi082.stdout:2/959: rmdir d1/d17/d38/d42/d52/d78/da0/dba 39 2024-09-17T01:41:56.258 INFO:tasks.workunit.client.0.smithi082.stdout:6/950: mkdir d1/d1f/da7/ddd/d145 0 2024-09-17T01:41:56.262 INFO:tasks.workunit.client.0.smithi082.stdout:8/779: dread d3/f74 [0,4194304] 0 2024-09-17T01:41:56.263 INFO:tasks.workunit.client.0.smithi082.stdout:2/960: dread d1/d17/d60/dc6/f115 [0,4194304] 0 2024-09-17T01:41:56.270 INFO:tasks.workunit.client.0.smithi082.stdout:6/951: link d1/d7/d10/d4f/dc/d2b/db2/ff9 d1/d7/d10/d4f/d8e/f146 0 2024-09-17T01:41:56.275 INFO:tasks.workunit.client.0.smithi082.stdout:8/780: creat d3/dd/d18/ffa x:0 0 0 2024-09-17T01:41:56.276 INFO:tasks.workunit.client.0.smithi082.stdout:8/781: fsync d3/dd/d18/d2d/d3e/d43/f45 0 2024-09-17T01:41:56.283 INFO:tasks.workunit.client.0.smithi082.stdout:8/782: creat d3/dd/ffb x:0 0 0 2024-09-17T01:41:56.286 INFO:tasks.workunit.client.0.smithi082.stdout:8/783: symlink d3/dd/d18/d2d/d3e/d4a/d68/df7/lfc 0 2024-09-17T01:41:56.287 INFO:tasks.workunit.client.0.smithi082.stdout:8/784: dread d3/dd/d18/d2d/d3e/d4a/d68/fc3 [0,4194304] 0 2024-09-17T01:41:56.288 INFO:tasks.workunit.client.0.smithi082.stdout:8/785: readlink d3/dd/d18/d2d/d58/la7 0 2024-09-17T01:41:56.289 INFO:tasks.workunit.client.0.smithi082.stdout:2/961: write d1/d10/f86 [613400,101123] 0 2024-09-17T01:41:56.294 INFO:tasks.workunit.client.0.smithi082.stdout:6/952: truncate d1/d7/d10/f4a 4420095 0 2024-09-17T01:41:56.297 INFO:tasks.workunit.client.0.smithi082.stdout:6/953: dread - d1/d7/d10/d4f/dc/d1d/d36/f100 zero size 2024-09-17T01:41:56.302 INFO:tasks.workunit.client.0.smithi082.stdout:6/954: creat d1/d7/d10/d4f/d8e/da8/dae/f147 x:0 0 0 2024-09-17T01:41:56.304 INFO:tasks.workunit.client.0.smithi082.stdout:2/962: dread d1/d10/f6b [0,4194304] 0 2024-09-17T01:41:56.305 INFO:tasks.workunit.client.0.smithi082.stdout:8/786: truncate d3/dd/d18/d3a/fcb 2278297 0 2024-09-17T01:41:56.307 INFO:tasks.workunit.client.0.smithi082.stdout:5/949: sync 2024-09-17T01:41:56.307 INFO:tasks.workunit.client.0.smithi082.stdout:3/905: sync 2024-09-17T01:41:56.307 INFO:tasks.workunit.client.0.smithi082.stdout:9/806: sync 2024-09-17T01:41:56.311 INFO:tasks.workunit.client.0.smithi082.stdout:6/955: rename d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/l106 to d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/dff/l148 0 2024-09-17T01:41:56.313 INFO:tasks.workunit.client.0.smithi082.stdout:2/963: creat d1/d17/d38/d42/f137 x:0 0 0 2024-09-17T01:41:56.314 INFO:tasks.workunit.client.0.smithi082.stdout:2/964: dread - d1/d17/d38/d5c/d7d/d110/f12f zero size 2024-09-17T01:41:56.316 INFO:tasks.workunit.client.0.smithi082.stdout:9/807: creat d4/d27/d2d/d60/d11/d39/d31/f105 x:0 0 0 2024-09-17T01:41:56.317 INFO:tasks.workunit.client.0.smithi082.stdout:9/808: chown d4/d27/d36/f4e 462 1 2024-09-17T01:41:56.321 INFO:tasks.workunit.client.0.smithi082.stdout:5/950: write db/d56/d29/d4f/f53 [1389051,12780] 0 2024-09-17T01:41:56.322 INFO:tasks.workunit.client.0.smithi082.stdout:6/956: write d1/d7/f2e [581444,122018] 0 2024-09-17T01:41:56.327 INFO:tasks.workunit.client.0.smithi082.stdout:9/809: rename d4/d27/d95/de7/d100/f101 to d4/d27/d2d/d60/d11/d8d/f106 0 2024-09-17T01:41:56.328 INFO:tasks.workunit.client.0.smithi082.stdout:5/951: mkdir db/d1e/d20/d4d/d13a 0 2024-09-17T01:41:56.328 INFO:tasks.workunit.client.0.smithi082.stdout:5/952: readlink db/d56/le3 0 2024-09-17T01:41:56.330 INFO:tasks.workunit.client.0.smithi082.stdout:8/787: getdents d3/dd/d18/d2d/d3e/d43/df6/db3 0 2024-09-17T01:41:56.330 INFO:tasks.workunit.client.0.smithi082.stdout:5/953: dread - db/d1e/d20/f88 zero size 2024-09-17T01:41:56.331 INFO:tasks.workunit.client.0.smithi082.stdout:2/965: creat d1/d17/d29/f138 x:0 0 0 2024-09-17T01:41:56.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/966: chown d1/d35/db1/lb5 107488 1 2024-09-17T01:41:56.333 INFO:tasks.workunit.client.0.smithi082.stdout:5/954: symlink db/d1e/d5b/d83/d94/l13b 0 2024-09-17T01:41:56.336 INFO:tasks.workunit.client.0.smithi082.stdout:2/967: rename d1/d17/d38/f9e to d1/d17/d29/ddc/f139 0 2024-09-17T01:41:56.339 INFO:tasks.workunit.client.0.smithi082.stdout:9/810: dread d4/d27/d2d/d60/f34 [0,4194304] 0 2024-09-17T01:41:56.340 INFO:tasks.workunit.client.0.smithi082.stdout:2/968: dread - d1/d5a/fe9 zero size 2024-09-17T01:41:56.342 INFO:tasks.workunit.client.0.smithi082.stdout:8/788: write d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e [4857271,30681] 0 2024-09-17T01:41:56.343 INFO:tasks.workunit.client.0.smithi082.stdout:8/789: write d3/dd/f84 [1052591,30633] 0 2024-09-17T01:41:56.345 INFO:tasks.workunit.client.0.smithi082.stdout:5/955: rename db/d56/d29/d4f/ff3 to db/d1e/f13c 0 2024-09-17T01:41:56.345 INFO:tasks.workunit.client.0.smithi082.stdout:8/790: read d3/dd/d18/d2d/d3b/f48 [1894417,81092] 0 2024-09-17T01:41:56.346 INFO:tasks.workunit.client.0.smithi082.stdout:8/791: chown d3/dd/d18/d2d/d58/lc6 855937973 1 2024-09-17T01:41:56.346 INFO:tasks.workunit.client.0.smithi082.stdout:2/969: write d1/d66/fd6 [161901,287] 0 2024-09-17T01:41:56.350 INFO:tasks.workunit.client.0.smithi082.stdout:8/792: symlink d3/dd/d18/d3a/lfd 0 2024-09-17T01:41:56.352 INFO:tasks.workunit.client.0.smithi082.stdout:5/956: dwrite db/d56/d18/f40 [4194304,4194304] 0 2024-09-17T01:41:56.353 INFO:tasks.workunit.client.0.smithi082.stdout:9/811: truncate d4/d27/d2d/d3d/f5c 3853580 0 2024-09-17T01:41:56.355 INFO:tasks.workunit.client.0.smithi082.stdout:8/793: write d3/dd/d18/d3a/fd3 [2473960,2984] 0 2024-09-17T01:41:56.357 INFO:tasks.workunit.client.0.smithi082.stdout:5/957: mknod db/d1e/d20/c13d 0 2024-09-17T01:41:56.358 INFO:tasks.workunit.client.0.smithi082.stdout:9/812: mknod d4/d27/d2d/d60/d11/c107 0 2024-09-17T01:41:56.360 INFO:tasks.workunit.client.0.smithi082.stdout:9/813: stat d4/d27/d2d/d60/d11/d39/d44/fc0 0 2024-09-17T01:41:56.361 INFO:tasks.workunit.client.0.smithi082.stdout:8/794: fdatasync d3/dd/d18/d2d/d3e/d4a/fa2 0 2024-09-17T01:41:56.362 INFO:tasks.workunit.client.0.smithi082.stdout:9/814: stat d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1 0 2024-09-17T01:41:56.362 INFO:tasks.workunit.client.0.smithi082.stdout:5/958: creat db/d1e/d20/d30/d47/f13e x:0 0 0 2024-09-17T01:41:56.363 INFO:tasks.workunit.client.0.smithi082.stdout:5/959: readlink db/d56/l13 0 2024-09-17T01:41:56.370 INFO:tasks.workunit.client.0.smithi082.stdout:8/795: dwrite d3/dd/f23 [0,4194304] 0 2024-09-17T01:41:56.370 INFO:tasks.workunit.client.0.smithi082.stdout:9/815: link d4/d27/d2d/d60/d11/d39/d29/d6d/cc2 d4/d27/d2d/d60/d11/d39/d29/d77/c108 0 2024-09-17T01:41:56.372 INFO:tasks.workunit.client.0.smithi082.stdout:5/960: link db/d1e/d5b/db7/fbb db/d2b/f13f 0 2024-09-17T01:41:56.376 INFO:tasks.workunit.client.0.smithi082.stdout:9/816: creat d4/d27/d2d/f109 x:0 0 0 2024-09-17T01:41:56.378 INFO:tasks.workunit.client.0.smithi082.stdout:5/961: creat db/d1e/d20/d4d/d13a/f140 x:0 0 0 2024-09-17T01:41:56.378 INFO:tasks.workunit.client.0.smithi082.stdout:8/796: dwrite d3/dd/d18/d51/dae/fd5 [0,4194304] 0 2024-09-17T01:41:56.381 INFO:tasks.workunit.client.0.smithi082.stdout:8/797: dread d3/dd/d18/d2d/d3e/d4a/d68/fc3 [0,4194304] 0 2024-09-17T01:41:56.382 INFO:tasks.workunit.client.0.smithi082.stdout:9/817: chown d4/d27/d2d/d60/d11/d39/d29/fb2 91410 1 2024-09-17T01:41:56.389 INFO:tasks.workunit.client.0.smithi082.stdout:9/818: dread d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/fc8 [0,4194304] 0 2024-09-17T01:41:56.392 INFO:tasks.workunit.client.0.smithi082.stdout:8/798: dread d3/dd/d18/d2d/d3b/fe5 [0,4194304] 0 2024-09-17T01:41:56.393 INFO:tasks.workunit.client.0.smithi082.stdout:5/962: symlink db/d1e/d5b/d83/l141 0 2024-09-17T01:41:56.397 INFO:tasks.workunit.client.0.smithi082.stdout:9/819: read - d4/f94 zero size 2024-09-17T01:41:56.397 INFO:tasks.workunit.client.0.smithi082.stdout:9/820: chown d4/d59/d63 3908295 1 2024-09-17T01:41:56.404 INFO:tasks.workunit.client.0.smithi082.stdout:9/821: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d10a 0 2024-09-17T01:41:56.407 INFO:tasks.workunit.client.0.smithi082.stdout:8/799: mkdir d3/dd/d18/d2d/d3e/d4a/dfe 0 2024-09-17T01:41:56.410 INFO:tasks.workunit.client.0.smithi082.stdout:8/800: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/fff x:0 0 0 2024-09-17T01:41:56.415 INFO:tasks.workunit.client.0.smithi082.stdout:9/822: link d4/d27/d2d/d60/d11/d39/d29/d6d/cc2 d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/c10b 0 2024-09-17T01:41:56.419 INFO:tasks.workunit.client.0.smithi082.stdout:5/963: dwrite db/d56/d78/da0/fb2 [0,4194304] 0 2024-09-17T01:41:56.420 INFO:tasks.workunit.client.0.smithi082.stdout:9/823: symlink d4/d27/d2d/d60/d11/d39/l10c 0 2024-09-17T01:41:56.425 INFO:tasks.workunit.client.0.smithi082.stdout:9/824: write d4/f1d [12949616,110491] 0 2024-09-17T01:41:56.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/964: getdents db/d1e/d5b/d83/d94/dc1/d126 0 2024-09-17T01:41:56.425 INFO:tasks.workunit.client.0.smithi082.stdout:5/965: chown db/d1e/f52 185 1 2024-09-17T01:41:56.427 INFO:tasks.workunit.client.0.smithi082.stdout:9/825: mknod d4/d27/d2d/d60/d11/d39/d29/d35/c10d 0 2024-09-17T01:41:56.432 INFO:tasks.workunit.client.0.smithi082.stdout:5/966: truncate db/da7/db3/f11b 865047 0 2024-09-17T01:41:56.434 INFO:tasks.workunit.client.0.smithi082.stdout:8/801: write d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fb0 [523958,44385] 0 2024-09-17T01:41:56.437 INFO:tasks.workunit.client.0.smithi082.stdout:9/826: getdents d4/d27/d2d/d3d 0 2024-09-17T01:41:56.438 INFO:tasks.workunit.client.0.smithi082.stdout:8/802: rmdir d3/dd/d18/d2d/d3e/d4a 39 2024-09-17T01:41:56.441 INFO:tasks.workunit.client.0.smithi082.stdout:5/967: getdents db/d1e/d20/d30/dc6/dd1/d102/dbc 0 2024-09-17T01:41:56.442 INFO:tasks.workunit.client.0.smithi082.stdout:9/827: mkdir d4/d27/d2d/d3d/d81/dfa/d10e 0 2024-09-17T01:41:56.442 INFO:tasks.workunit.client.0.smithi082.stdout:8/803: rmdir d3/dd/d18/d2d/d3e/d4a/d6a 39 2024-09-17T01:41:56.443 INFO:tasks.workunit.client.0.smithi082.stdout:9/828: write d4/fae [4895164,1256] 0 2024-09-17T01:41:56.450 INFO:tasks.workunit.client.0.smithi082.stdout:9/829: link d4/d27/d2d/d60/d11/d39/d29/d77/c80 d4/d27/d36/d3b/db0/c10f 0 2024-09-17T01:41:56.458 INFO:tasks.workunit.client.0.smithi082.stdout:5/968: dread db/d56/d29/f6a [0,4194304] 0 2024-09-17T01:41:56.460 INFO:tasks.workunit.client.0.smithi082.stdout:9/830: link d4/d27/d2d/d3d/f5c d4/deb/f110 0 2024-09-17T01:41:56.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/804: dread d3/dd/d18/d2d/d3e/d4a/d68/f78 [0,4194304] 0 2024-09-17T01:41:56.465 INFO:tasks.workunit.client.0.smithi082.stdout:5/969: dwrite db/d56/d29/d4f/f53 [0,4194304] 0 2024-09-17T01:41:56.496 INFO:tasks.workunit.client.0.smithi082.stdout:9/831: truncate d4/f49 969127 0 2024-09-17T01:41:56.497 INFO:tasks.workunit.client.0.smithi082.stdout:9/832: chown d4/d27/d2d/d3d/d81/dfa/d10e 3 1 2024-09-17T01:41:56.577 INFO:tasks.workunit.client.0.smithi082.stdout:1/970: sync 2024-09-17T01:41:56.577 INFO:tasks.workunit.client.0.smithi082.stdout:0/928: sync 2024-09-17T01:41:56.582 INFO:tasks.workunit.client.0.smithi082.stdout:5/970: dwrite db/d56/d18/d98/fa9 [0,4194304] 0 2024-09-17T01:41:56.586 INFO:tasks.workunit.client.0.smithi082.stdout:9/833: dwrite d4/d27/d2d/d60/d11/d39/d31/f105 [0,4194304] 0 2024-09-17T01:41:56.589 INFO:tasks.workunit.client.0.smithi082.stdout:0/929: truncate da/d1b/d23/dea/f115 970597 0 2024-09-17T01:41:56.592 INFO:tasks.workunit.client.0.smithi082.stdout:9/834: mknod d4/deb/c111 0 2024-09-17T01:41:56.593 INFO:tasks.workunit.client.0.smithi082.stdout:5/971: dwrite db/d1e/d20/ff5 [0,4194304] 0 2024-09-17T01:41:56.603 INFO:tasks.workunit.client.0.smithi082.stdout:0/930: rename da/df/d71/d92/l13b to da/df/l13f 0 2024-09-17T01:41:56.604 INFO:tasks.workunit.client.0.smithi082.stdout:9/835: link d4/d27/d2d/d60/d11/d39/d31/f40 d4/d27/d2d/d60/d11/d39/d44/f112 0 2024-09-17T01:41:56.605 INFO:tasks.workunit.client.0.smithi082.stdout:0/931: chown da/d1b/d23/d42/d43/d6b/fb7 198566 1 2024-09-17T01:41:56.605 INFO:tasks.workunit.client.0.smithi082.stdout:5/972: creat db/da7/f142 x:0 0 0 2024-09-17T01:41:56.607 INFO:tasks.workunit.client.0.smithi082.stdout:0/932: symlink da/d1b/d23/d4d/dd7/l140 0 2024-09-17T01:41:56.609 INFO:tasks.workunit.client.0.smithi082.stdout:5/973: creat db/d56/d78/dba/f143 x:0 0 0 2024-09-17T01:41:56.613 INFO:tasks.workunit.client.0.smithi082.stdout:0/933: rename da/d80/f8c to da/d1b/d23/f141 0 2024-09-17T01:41:56.615 INFO:tasks.workunit.client.0.smithi082.stdout:5/974: dwrite db/d56/d29/d4f/f82 [0,4194304] 0 2024-09-17T01:41:56.616 INFO:tasks.workunit.client.0.smithi082.stdout:1/971: dread d2/f1b [0,4194304] 0 2024-09-17T01:41:56.617 INFO:tasks.workunit.client.0.smithi082.stdout:0/934: symlink da/d80/d99/l142 0 2024-09-17T01:41:56.618 INFO:tasks.workunit.client.0.smithi082.stdout:5/975: chown db/d1e/d20/d30/dc6/dd1/d102/c131 41507198 1 2024-09-17T01:41:56.620 INFO:tasks.workunit.client.0.smithi082.stdout:1/972: mkdir d2/da/d2d/d12f/d13c 0 2024-09-17T01:41:56.623 INFO:tasks.workunit.client.0.smithi082.stdout:1/973: fdatasync d2/d3f/d24/d54/fb4 0 2024-09-17T01:41:56.628 INFO:tasks.workunit.client.0.smithi082.stdout:9/836: write d4/f8 [10192340,35572] 0 2024-09-17T01:41:56.631 INFO:tasks.workunit.client.0.smithi082.stdout:9/837: truncate d4/d27/d2d/d60/d11/d39/d29/d6d/fa1 948223 0 2024-09-17T01:41:56.632 INFO:tasks.workunit.client.0.smithi082.stdout:9/838: fdatasync d4/f5f 0 2024-09-17T01:41:56.634 INFO:tasks.workunit.client.0.smithi082.stdout:9/839: write d4/d27/d2d/d60/d11/d39/d29/d6d/f90 [379295,77786] 0 2024-09-17T01:41:56.636 INFO:tasks.workunit.client.0.smithi082.stdout:0/935: link da/d1b/d23/d4d/dd7/l140 da/df/d2b/d59/l143 0 2024-09-17T01:41:56.638 INFO:tasks.workunit.client.0.smithi082.stdout:1/974: link d2/d3f/f88 d2/da/d2d/d6c/f13d 0 2024-09-17T01:41:56.639 INFO:tasks.workunit.client.0.smithi082.stdout:1/975: readlink d2/d3f/l6d 0 2024-09-17T01:41:56.641 INFO:tasks.workunit.client.0.smithi082.stdout:9/840: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d113 0 2024-09-17T01:41:56.651 INFO:tasks.workunit.client.0.smithi082.stdout:1/976: unlink d2/da/d2d/d12f/l138 0 2024-09-17T01:41:56.651 INFO:tasks.workunit.client.0.smithi082.stdout:0/936: write da/d1b/d23/d42/fe8 [422023,35216] 0 2024-09-17T01:41:56.653 INFO:tasks.workunit.client.0.smithi082.stdout:9/841: write d4/d27/d2d/d3d/fa5 [174996,99529] 0 2024-09-17T01:41:56.654 INFO:tasks.workunit.client.0.smithi082.stdout:0/937: creat da/d1b/f144 x:0 0 0 2024-09-17T01:41:56.656 INFO:tasks.workunit.client.0.smithi082.stdout:0/938: dread - da/df/d71/d92/df7/f122 zero size 2024-09-17T01:41:56.660 INFO:tasks.workunit.client.0.smithi082.stdout:0/939: read - da/d1b/d23/d42/fd1 zero size 2024-09-17T01:41:56.661 INFO:tasks.workunit.client.0.smithi082.stdout:9/842: dwrite d4/d27/d95/fef [0,4194304] 0 2024-09-17T01:41:56.661 INFO:tasks.workunit.client.0.smithi082.stdout:1/977: getdents d2/d3f/d24/dcf 0 2024-09-17T01:41:56.662 INFO:tasks.workunit.client.0.smithi082.stdout:0/940: stat da/d1b/c79 0 2024-09-17T01:41:56.668 INFO:tasks.workunit.client.0.smithi082.stdout:9/843: creat d4/d27/d2d/d60/d11/d37/f114 x:0 0 0 2024-09-17T01:41:56.671 INFO:tasks.workunit.client.0.smithi082.stdout:0/941: creat da/df/d2b/d59/d6f/da6/d136/f145 x:0 0 0 2024-09-17T01:41:56.672 INFO:tasks.workunit.client.0.smithi082.stdout:0/942: chown da/d80/d99/c65 198 1 2024-09-17T01:41:56.674 INFO:tasks.workunit.client.0.smithi082.stdout:9/844: creat d4/d27/d2d/d60/d11/d39/d29/d35/df1/f115 x:0 0 0 2024-09-17T01:41:56.678 INFO:tasks.workunit.client.0.smithi082.stdout:9/845: unlink d4/d27/d2d/d60/d11/d39/d29/d35/f61 0 2024-09-17T01:41:56.680 INFO:tasks.workunit.client.0.smithi082.stdout:9/846: dread - d4/d27/d2d/d60/d11/d39/d29/d77/d88/ffe zero size 2024-09-17T01:41:56.683 INFO:tasks.workunit.client.0.smithi082.stdout:9/847: read d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/fc8 [359431,113608] 0 2024-09-17T01:41:56.686 INFO:tasks.workunit.client.0.smithi082.stdout:0/943: write da/df/d71/d92/df7/f6d [3697372,114142] 0 2024-09-17T01:41:56.687 INFO:tasks.workunit.client.0.smithi082.stdout:1/978: dread d2/d3f/d24/db5/dec/dfc/dc6/fd8 [0,4194304] 0 2024-09-17T01:41:56.690 INFO:tasks.workunit.client.0.smithi082.stdout:0/944: write da/df/d2b/d59/d6f/da6/f112 [1116816,130204] 0 2024-09-17T01:41:56.692 INFO:tasks.workunit.client.0.smithi082.stdout:0/945: readlink da/d80/l98 0 2024-09-17T01:41:56.692 INFO:tasks.workunit.client.0.smithi082.stdout:9/848: dwrite d4/d27/d2d/d60/d11/d39/d31/f105 [0,4194304] 0 2024-09-17T01:41:56.694 INFO:tasks.workunit.client.0.smithi082.stdout:9/849: write d4/d27/d2d/d60/d11/fbb [2829434,24657] 0 2024-09-17T01:41:56.702 INFO:tasks.workunit.client.0.smithi082.stdout:9/850: rmdir d4/d27/d2d/d60/d11/d39/d29/d35 39 2024-09-17T01:41:56.703 INFO:tasks.workunit.client.0.smithi082.stdout:0/946: getdents da/df/d27/db5 0 2024-09-17T01:41:56.704 INFO:tasks.workunit.client.0.smithi082.stdout:1/979: link d2/d3f/d24/dc8/d107/l111 d2/d3f/d24/d54/l13e 0 2024-09-17T01:41:56.707 INFO:tasks.workunit.client.0.smithi082.stdout:1/980: creat d2/d3f/d24/dc8/de0/f13f x:0 0 0 2024-09-17T01:41:56.716 INFO:tasks.workunit.client.0.smithi082.stdout:9/851: dread d4/f49 [0,4194304] 0 2024-09-17T01:41:56.720 INFO:tasks.workunit.client.0.smithi082.stdout:9/852: creat d4/d27/d36/d3b/f116 x:0 0 0 2024-09-17T01:41:56.723 INFO:tasks.workunit.client.0.smithi082.stdout:9/853: mkdir d4/d27/d2d/d3d/d81/d117 0 2024-09-17T01:41:56.725 INFO:tasks.workunit.client.0.smithi082.stdout:0/947: dread da/df/d71/f48 [0,4194304] 0 2024-09-17T01:41:56.728 INFO:tasks.workunit.client.0.smithi082.stdout:1/981: dwrite d2/da/f35 [0,4194304] 0 2024-09-17T01:41:56.729 INFO:tasks.workunit.client.0.smithi082.stdout:0/948: read da/d1b/d23/d4d/f75 [2937094,98128] 0 2024-09-17T01:41:56.732 INFO:tasks.workunit.client.0.smithi082.stdout:9/854: truncate d4/d27/d2d/d60/d11/d39/fda 230771 0 2024-09-17T01:41:56.733 INFO:tasks.workunit.client.0.smithi082.stdout:9/855: write d4/d27/d2d/d60/d11/d37/f38 [3731421,30287] 0 2024-09-17T01:41:56.742 INFO:tasks.workunit.client.0.smithi082.stdout:9/856: rename d4/d27/d21 to d4/d27/d2d/d3d/d81/dfa/d10e/d118 0 2024-09-17T01:41:56.748 INFO:tasks.workunit.client.0.smithi082.stdout:9/857: creat d4/d27/d2d/d60/d11/d39/d31/f119 x:0 0 0 2024-09-17T01:41:56.751 INFO:tasks.workunit.client.0.smithi082.stdout:1/982: link d2/d3f/d24/d54/f9f d2/da/d16/d114/d116/d123/f140 0 2024-09-17T01:41:56.751 INFO:tasks.workunit.client.0.smithi082.stdout:1/983: chown d2/d3f/d24/dc8/f131 507211903 1 2024-09-17T01:41:56.752 INFO:tasks.workunit.client.0.smithi082.stdout:9/858: creat d4/d27/d2d/d3d/d81/dfa/d10e/f11a x:0 0 0 2024-09-17T01:41:56.753 INFO:tasks.workunit.client.0.smithi082.stdout:9/859: chown d4/d27/d36/d3b/c5e 73 1 2024-09-17T01:41:56.756 INFO:tasks.workunit.client.0.smithi082.stdout:0/949: link da/d1b/d23/dea/c132 da/df/d71/d92/df7/d69/c146 0 2024-09-17T01:41:56.757 INFO:tasks.workunit.client.0.smithi082.stdout:1/984: mkdir d2/da/d16/d114/d141 0 2024-09-17T01:41:56.759 INFO:tasks.workunit.client.0.smithi082.stdout:9/860: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d11b 0 2024-09-17T01:41:56.762 INFO:tasks.workunit.client.0.smithi082.stdout:0/950: mkdir da/df/d71/d92/d147 0 2024-09-17T01:41:56.763 INFO:tasks.workunit.client.0.smithi082.stdout:9/861: truncate d4/d27/d36/d3b/fcc 883503 0 2024-09-17T01:41:56.768 INFO:tasks.workunit.client.0.smithi082.stdout:0/951: rename da/d1b/d23/d42/d43/d6b to da/df/d71/d92/d147/d148 0 2024-09-17T01:41:56.769 INFO:tasks.workunit.client.0.smithi082.stdout:9/862: dread - d4/d27/d2d/fad zero size 2024-09-17T01:41:56.769 INFO:tasks.workunit.client.0.smithi082.stdout:0/952: read da/df/f4a [3743536,73540] 0 2024-09-17T01:41:56.769 INFO:tasks.workunit.client.0.smithi082.stdout:1/985: dread d2/f11 [0,4194304] 0 2024-09-17T01:41:56.772 INFO:tasks.workunit.client.0.smithi082.stdout:9/863: mkdir d4/d27/d2d/d3d/d81/d117/d11c 0 2024-09-17T01:41:56.775 INFO:tasks.workunit.client.0.smithi082.stdout:9/864: creat d4/d27/d2d/d60/d11/d37/f11d x:0 0 0 2024-09-17T01:41:56.778 INFO:tasks.workunit.client.0.smithi082.stdout:9/865: mkdir d4/d27/d2d/d3d/d81/d117/d11c/d11e 0 2024-09-17T01:41:56.784 INFO:tasks.workunit.client.0.smithi082.stdout:9/866: creat d4/d27/d2d/d3d/d81/dfa/f11f x:0 0 0 2024-09-17T01:41:56.788 INFO:tasks.workunit.client.0.smithi082.stdout:9/867: unlink d4/d27/d2d/d60/d11/d39/d31/l9b 0 2024-09-17T01:41:56.789 INFO:tasks.workunit.client.0.smithi082.stdout:0/953: dwrite da/d1b/d23/d42/d43/f97 [0,4194304] 0 2024-09-17T01:41:56.792 INFO:tasks.workunit.client.0.smithi082.stdout:0/954: chown da/df/d71/lc3 21363721 1 2024-09-17T01:41:56.795 INFO:tasks.workunit.client.0.smithi082.stdout:0/955: dread da/d80/fa4 [0,4194304] 0 2024-09-17T01:41:56.798 INFO:tasks.workunit.client.0.smithi082.stdout:9/868: dwrite d4/d27/d2d/d60/d11/d8d/f106 [0,4194304] 0 2024-09-17T01:41:56.805 INFO:tasks.workunit.client.0.smithi082.stdout:0/956: mknod da/df/c149 0 2024-09-17T01:41:56.805 INFO:tasks.workunit.client.0.smithi082.stdout:9/869: mkdir d4/d59/d63/dee/d120 0 2024-09-17T01:41:56.807 INFO:tasks.workunit.client.0.smithi082.stdout:9/870: write d4/d27/d95/ff7 [645397,58460] 0 2024-09-17T01:41:56.811 INFO:tasks.workunit.client.0.smithi082.stdout:0/957: dwrite da/d1b/d23/d42/d43/d119/f123 [0,4194304] 0 2024-09-17T01:41:56.815 INFO:tasks.workunit.client.0.smithi082.stdout:0/958: mkdir da/d1b/d23/d42/d43/d119/d14a 0 2024-09-17T01:41:57.524 INFO:tasks.workunit.client.0.smithi082.stdout:3/906: sync 2024-09-17T01:41:57.524 INFO:tasks.workunit.client.0.smithi082.stdout:6/957: sync 2024-09-17T01:41:57.525 INFO:tasks.workunit.client.0.smithi082.stdout:6/958: fdatasync d1/fd5 0 2024-09-17T01:41:57.527 INFO:tasks.workunit.client.0.smithi082.stdout:6/959: fdatasync d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d80/f12a 0 2024-09-17T01:41:57.534 INFO:tasks.workunit.client.0.smithi082.stdout:6/960: mknod d1/d1f/da7/d122/d126/c149 0 2024-09-17T01:41:57.535 INFO:tasks.workunit.client.0.smithi082.stdout:6/961: dread - d1/d7/d10/d4f/dc/d1d/d36/f100 zero size 2024-09-17T01:41:57.539 INFO:tasks.workunit.client.0.smithi082.stdout:6/962: creat d1/d1f/da7/ddd/dec/f14a x:0 0 0 2024-09-17T01:41:57.540 INFO:tasks.workunit.client.0.smithi082.stdout:3/907: dread d9/db/f37 [0,4194304] 0 2024-09-17T01:41:57.541 INFO:tasks.workunit.client.0.smithi082.stdout:3/908: dread - d9/d78/d88/d11e/fe1 zero size 2024-09-17T01:41:57.544 INFO:tasks.workunit.client.0.smithi082.stdout:3/909: rename d9/d35/dda/le5 to d9/db/d6d/de0/l13f 0 2024-09-17T01:41:57.545 INFO:tasks.workunit.client.0.smithi082.stdout:3/910: write d9/db/d26/f9e [6453513,98642] 0 2024-09-17T01:41:57.546 INFO:tasks.workunit.client.0.smithi082.stdout:3/911: fsync d9/db/daf/d69/d9c/dc2/fc7 0 2024-09-17T01:41:57.547 INFO:tasks.workunit.client.0.smithi082.stdout:6/963: link d1/d7/d10/d4f/dc/d2b/d48/f76 d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/d110/f14b 0 2024-09-17T01:41:57.548 INFO:tasks.workunit.client.0.smithi082.stdout:6/964: chown d1/d1f/da7/dcc 4738419 1 2024-09-17T01:41:57.549 INFO:tasks.workunit.client.0.smithi082.stdout:3/912: symlink d9/db/d26/l140 0 2024-09-17T01:41:57.552 INFO:tasks.workunit.client.0.smithi082.stdout:6/965: unlink d1/d7/d10/d4f/dc/d2b/c4b 0 2024-09-17T01:41:57.553 INFO:tasks.workunit.client.0.smithi082.stdout:6/966: write d1/d1f/da7/ddd/dec/f14a [808180,55904] 0 2024-09-17T01:41:57.572 INFO:tasks.workunit.client.0.smithi082.stdout:6/967: write d1/f83 [1125213,51149] 0 2024-09-17T01:41:57.817 INFO:tasks.workunit.client.0.smithi082.stdout:0/959: sync 2024-09-17T01:41:57.817 INFO:tasks.workunit.client.0.smithi082.stdout:9/871: sync 2024-09-17T01:41:57.817 INFO:tasks.workunit.client.0.smithi082.stdout:2/970: sync 2024-09-17T01:41:57.817 INFO:tasks.workunit.client.0.smithi082.stdout:8/805: sync 2024-09-17T01:41:57.818 INFO:tasks.workunit.client.0.smithi082.stdout:5/976: sync 2024-09-17T01:41:57.818 INFO:tasks.workunit.client.0.smithi082.stdout:1/986: sync 2024-09-17T01:41:57.820 INFO:tasks.workunit.client.0.smithi082.stdout:2/971: write d1/d10/f86 [1426339,26729] 0 2024-09-17T01:41:57.821 INFO:tasks.workunit.client.0.smithi082.stdout:5/977: fsync db/f2d 0 2024-09-17T01:41:57.824 INFO:tasks.workunit.client.0.smithi082.stdout:2/972: write d1/d5a/d6d/f119 [345036,58156] 0 2024-09-17T01:41:57.827 INFO:tasks.workunit.client.0.smithi082.stdout:9/872: chown d4/d27/d2d/d60/d11/d39/d44/cbf 12758 1 2024-09-17T01:41:57.828 INFO:tasks.workunit.client.0.smithi082.stdout:2/973: write d1/d35/db1/d9c/f124 [4521238,80617] 0 2024-09-17T01:41:57.828 INFO:tasks.workunit.client.0.smithi082.stdout:0/960: dwrite da/d1b/d23/d4d/f12f [0,4194304] 0 2024-09-17T01:41:57.831 INFO:tasks.workunit.client.0.smithi082.stdout:1/987: creat d2/d3f/d24/dc8/f142 x:0 0 0 2024-09-17T01:41:57.833 INFO:tasks.workunit.client.0.smithi082.stdout:1/988: write d2/d3f/d24/db5/dec/dfc/dc6/f134 [910145,65480] 0 2024-09-17T01:41:57.835 INFO:tasks.workunit.client.0.smithi082.stdout:1/989: fsync d2/d3f/d34/dc5/f120 0 2024-09-17T01:41:57.844 INFO:tasks.workunit.client.0.smithi082.stdout:0/961: fdatasync da/df/d71/d92/d147/d148/f101 0 2024-09-17T01:41:57.847 INFO:tasks.workunit.client.0.smithi082.stdout:2/974: mkdir d1/d17/d29/ddc/d13a 0 2024-09-17T01:41:57.857 INFO:tasks.workunit.client.0.smithi082.stdout:9/873: creat d4/d59/d63/ddf/f121 x:0 0 0 2024-09-17T01:41:57.863 INFO:tasks.workunit.client.0.smithi082.stdout:2/975: dread d1/d90/fe0 [0,4194304] 0 2024-09-17T01:41:57.881 INFO:tasks.workunit.client.0.smithi082.stdout:9/874: mknod d4/d27/d2d/d3d/d81/dfa/c122 0 2024-09-17T01:41:57.886 INFO:tasks.workunit.client.0.smithi082.stdout:9/875: symlink d4/d27/d2d/d3d/d81/dfa/l123 0 2024-09-17T01:41:57.887 INFO:tasks.workunit.client.0.smithi082.stdout:1/990: getdents d2/d3f/d34/dc5 0 2024-09-17T01:41:57.890 INFO:tasks.workunit.client.0.smithi082.stdout:2/976: dwrite d1/d17/f7a [0,4194304] 0 2024-09-17T01:41:57.891 INFO:tasks.workunit.client.0.smithi082.stdout:9/876: chown d4/d27/d2d/d60/d11/d39/d29/d77/d88 89943 1 2024-09-17T01:41:57.892 INFO:tasks.workunit.client.0.smithi082.stdout:6/968: sync 2024-09-17T01:41:57.892 INFO:tasks.workunit.client.0.smithi082.stdout:3/913: sync 2024-09-17T01:41:57.894 INFO:tasks.workunit.client.0.smithi082.stdout:1/991: mknod d2/da/d16/d114/d116/d123/c143 0 2024-09-17T01:41:57.895 INFO:tasks.workunit.client.0.smithi082.stdout:6/969: fdatasync d1/d3/f7b 0 2024-09-17T01:41:57.897 INFO:tasks.workunit.client.0.smithi082.stdout:3/914: truncate d9/db/d8f/fc6 1594278 0 2024-09-17T01:41:57.901 INFO:tasks.workunit.client.0.smithi082.stdout:9/877: creat d4/d27/d2d/d60/d11/d39/d29/d77/d11b/f124 x:0 0 0 2024-09-17T01:41:57.902 INFO:tasks.workunit.client.0.smithi082.stdout:6/970: mkdir d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/d14c 0 2024-09-17T01:41:57.903 INFO:tasks.workunit.client.0.smithi082.stdout:6/971: stat d1/d1f/da7/d122/d126 0 2024-09-17T01:41:57.909 INFO:tasks.workunit.client.0.smithi082.stdout:6/972: mknod d1/d7/d10/d4f/d8e/da8/de5/de9/c14d 0 2024-09-17T01:41:57.909 INFO:tasks.workunit.client.0.smithi082.stdout:6/973: chown d1/d7/l17 225932135 1 2024-09-17T01:41:57.914 INFO:tasks.workunit.client.0.smithi082.stdout:6/974: rename d1/d7/d10/d4f/dc/d1d/d36/cb1 to d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/d14c/c14e 0 2024-09-17T01:41:57.914 INFO:tasks.workunit.client.0.smithi082.stdout:6/975: chown d1/d7/d10/d4f/d8e/da8/dae/f147 39 1 2024-09-17T01:41:57.916 INFO:tasks.workunit.client.0.smithi082.stdout:6/976: stat d1/d7/d10/d4f/d8e/da8/dae/cc6 0 2024-09-17T01:41:57.919 INFO:tasks.workunit.client.0.smithi082.stdout:6/977: mknod d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/d49/c14f 0 2024-09-17T01:41:57.922 INFO:tasks.workunit.client.0.smithi082.stdout:9/878: dread d4/d27/d2d/d60/d11/d37/f3c [0,4194304] 0 2024-09-17T01:41:57.922 INFO:tasks.workunit.client.0.smithi082.stdout:6/978: symlink d1/d7/d10/d12b/l150 0 2024-09-17T01:41:57.923 INFO:tasks.workunit.client.0.smithi082.stdout:9/879: write d4/d27/d36/ff8 [139271,77084] 0 2024-09-17T01:41:57.929 INFO:tasks.workunit.client.0.smithi082.stdout:6/979: symlink d1/d7/d10/d4f/dc/d2b/l151 0 2024-09-17T01:41:57.929 INFO:tasks.workunit.client.0.smithi082.stdout:8/806: dwrite d3/dd/d18/d2d/d3e/d4a/fa2 [0,4194304] 0 2024-09-17T01:41:57.932 INFO:tasks.workunit.client.0.smithi082.stdout:5/978: write db/d1e/d20/fc0 [1613551,130885] 0 2024-09-17T01:41:57.934 INFO:tasks.workunit.client.0.smithi082.stdout:9/880: unlink d4/d27/d2d/d60/d11/d39/d29/d77/c108 0 2024-09-17T01:41:57.940 INFO:tasks.workunit.client.0.smithi082.stdout:9/881: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d88/d125 0 2024-09-17T01:41:57.941 INFO:tasks.workunit.client.0.smithi082.stdout:8/807: truncate d3/dd/d18/d2d/d3e/d4a/f88 281065 0 2024-09-17T01:41:57.953 INFO:tasks.workunit.client.0.smithi082.stdout:0/962: dwrite da/d1b/d23/d42/d43/f10c [0,4194304] 0 2024-09-17T01:41:57.962 INFO:tasks.workunit.client.0.smithi082.stdout:0/963: rename da/d1b/d23/d42/cab to da/df/d71/d92/df7/c14b 0 2024-09-17T01:41:57.964 INFO:tasks.workunit.client.0.smithi082.stdout:0/964: write da/df/d71/d92/d147/d148/dd2/fd6 [943422,105231] 0 2024-09-17T01:41:57.965 INFO:tasks.workunit.client.0.smithi082.stdout:0/965: readlink da/d1b/l22 0 2024-09-17T01:41:57.968 INFO:tasks.workunit.client.0.smithi082.stdout:0/966: fsync da/df/d71/d92/d147/d148/fb7 0 2024-09-17T01:41:57.975 INFO:tasks.workunit.client.0.smithi082.stdout:0/967: dwrite da/df/d2b/d59/d6f/fde [4194304,4194304] 0 2024-09-17T01:41:57.976 INFO:tasks.workunit.client.0.smithi082.stdout:3/915: fsync d9/db/d8f/fc6 0 2024-09-17T01:41:57.978 INFO:tasks.workunit.client.0.smithi082.stdout:0/968: fdatasync da/df/f4a 0 2024-09-17T01:41:57.983 INFO:tasks.workunit.client.0.smithi082.stdout:1/992: write d2/da/d2d/f45 [5816857,16765] 0 2024-09-17T01:41:57.987 INFO:tasks.workunit.client.0.smithi082.stdout:1/993: mknod d2/d3f/d24/db5/dec/dfc/ddf/c144 0 2024-09-17T01:41:57.994 INFO:tasks.workunit.client.0.smithi082.stdout:1/994: dwrite d2/d3f/d34/dc5/f10d [0,4194304] 0 2024-09-17T01:41:57.997 INFO:tasks.workunit.client.0.smithi082.stdout:1/995: unlink d2/d3f/d24/db5/dec/dfc/ddf/c144 0 2024-09-17T01:41:58.000 INFO:tasks.workunit.client.0.smithi082.stdout:9/882: write d4/d59/d63/f67 [1186512,91154] 0 2024-09-17T01:41:58.007 INFO:tasks.workunit.client.0.smithi082.stdout:6/980: dwrite d1/d7/d10/d4f/d8e/f146 [0,4194304] 0 2024-09-17T01:41:58.008 INFO:tasks.workunit.client.0.smithi082.stdout:5/979: dwrite db/d2b/d59/fe2 [0,4194304] 0 2024-09-17T01:41:58.009 INFO:tasks.workunit.client.0.smithi082.stdout:1/996: symlink d2/d3f/d24/db5/dec/dfc/l145 0 2024-09-17T01:41:58.012 INFO:tasks.workunit.client.0.smithi082.stdout:8/808: dwrite d3/dd/d18/d2d/d3e/d4a/d6a/fa4 [0,4194304] 0 2024-09-17T01:41:58.013 INFO:tasks.workunit.client.0.smithi082.stdout:9/883: mknod d4/d27/d36/d3b/db0/c126 0 2024-09-17T01:41:58.016 INFO:tasks.workunit.client.0.smithi082.stdout:3/916: dread d9/d35/d63/f97 [0,4194304] 0 2024-09-17T01:41:58.019 INFO:tasks.workunit.client.0.smithi082.stdout:6/981: chown d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/dd7/d101/f105 199257948 1 2024-09-17T01:41:58.021 INFO:tasks.workunit.client.0.smithi082.stdout:1/997: creat d2/da/d2d/f146 x:0 0 0 2024-09-17T01:41:58.022 INFO:tasks.workunit.client.0.smithi082.stdout:8/809: mknod d3/dd/d18/d2d/c100 0 2024-09-17T01:41:58.027 INFO:tasks.workunit.client.0.smithi082.stdout:9/884: dwrite d4/f1d [8388608,4194304] 0 2024-09-17T01:41:58.028 INFO:tasks.workunit.client.0.smithi082.stdout:6/982: unlink d1/d7/d10/f16 0 2024-09-17T01:41:58.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/969: write da/d80/f126 [482383,96389] 0 2024-09-17T01:41:58.033 INFO:tasks.workunit.client.0.smithi082.stdout:0/970: dread - da/d1b/d23/d42/d43/d119/f139 zero size 2024-09-17T01:41:58.034 INFO:tasks.workunit.client.0.smithi082.stdout:8/810: truncate d3/dd/d18/d2d/d3e/d4a/d6a/f99 158509 0 2024-09-17T01:41:58.038 INFO:tasks.workunit.client.0.smithi082.stdout:9/885: write d4/d27/d2d/d60/d11/d39/d44/f83 [890207,114489] 0 2024-09-17T01:41:58.038 INFO:tasks.workunit.client.0.smithi082.stdout:1/998: mknod d2/da/d16/d114/d141/c147 0 2024-09-17T01:41:58.042 INFO:tasks.workunit.client.0.smithi082.stdout:5/980: getdents db/d1e/d5b/d83 0 2024-09-17T01:41:58.043 INFO:tasks.workunit.client.0.smithi082.stdout:5/981: readlink db/d56/d18/d23/l12d 0 2024-09-17T01:41:58.044 INFO:tasks.workunit.client.0.smithi082.stdout:5/982: write db/d1e/d5b/d83/f89 [1166506,93835] 0 2024-09-17T01:41:58.045 INFO:tasks.workunit.client.0.smithi082.stdout:6/983: truncate d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/db5/f11d 749288 0 2024-09-17T01:41:58.045 INFO:tasks.workunit.client.0.smithi082.stdout:0/971: rmdir da/df/d71 39 2024-09-17T01:41:58.048 INFO:tasks.workunit.client.0.smithi082.stdout:8/811: mknod d3/dd/d18/d2d/c101 0 2024-09-17T01:41:58.053 INFO:tasks.workunit.client.0.smithi082.stdout:9/886: rename d4/d27/d2d/d3d/d81/dfa to d4/d59/d63/dee/d127 0 2024-09-17T01:41:58.055 INFO:tasks.workunit.client.0.smithi082.stdout:3/917: getdents d9/db/d49/d4e/d53 0 2024-09-17T01:41:58.056 INFO:tasks.workunit.client.0.smithi082.stdout:3/918: chown d9/db/d49/d4e/f57 9465 1 2024-09-17T01:41:58.060 INFO:tasks.workunit.client.0.smithi082.stdout:5/983: mknod db/da7/de4/c144 0 2024-09-17T01:41:58.060 INFO:tasks.workunit.client.0.smithi082.stdout:1/999: dread d2/da/f33 [0,4194304] 0 2024-09-17T01:41:58.065 INFO:tasks.workunit.client.0.smithi082.stdout:0/972: chown da/d1b/d23/d4d/dd7/l140 45373157 1 2024-09-17T01:41:58.066 INFO:tasks.workunit.client.0.smithi082.stdout:8/812: write d3/dd/d18/d2d/d58/fcc [1229007,61033] 0 2024-09-17T01:41:58.066 INFO:tasks.workunit.client.0.smithi082.stdout:3/919: fdatasync d9/db/daf/d69/d79/d86/f87 0 2024-09-17T01:41:58.068 INFO:tasks.workunit.client.0.smithi082.stdout:0/973: dwrite da/d1b/d23/d42/fe8 [0,4194304] 0 2024-09-17T01:41:58.068 INFO:tasks.workunit.client.0.smithi082.stdout:5/984: dread - db/d2b/f13f zero size 2024-09-17T01:41:58.073 INFO:tasks.workunit.client.0.smithi082.stdout:8/813: creat d3/dd/d18/d51/dc5/f102 x:0 0 0 2024-09-17T01:41:58.083 INFO:tasks.workunit.client.0.smithi082.stdout:3/920: dwrite d9/db/daf/d69/d79/d86/fb0 [0,4194304] 0 2024-09-17T01:41:58.084 INFO:tasks.workunit.client.0.smithi082.stdout:3/921: chown d9/db/daf 0 1 2024-09-17T01:41:58.084 INFO:tasks.workunit.client.0.smithi082.stdout:9/887: creat d4/d27/d2d/d60/d11/d39/f128 x:0 0 0 2024-09-17T01:41:58.088 INFO:tasks.workunit.client.0.smithi082.stdout:5/985: symlink db/d1e/d20/d30/dc6/l145 0 2024-09-17T01:41:58.094 INFO:tasks.workunit.client.0.smithi082.stdout:6/984: getdents d1/d1f/da7/d123/d130 0 2024-09-17T01:41:58.094 INFO:tasks.workunit.client.0.smithi082.stdout:0/974: dread da/df/d71/d92/d147/d148/dd2/fd6 [0,4194304] 0 2024-09-17T01:41:58.094 INFO:tasks.workunit.client.0.smithi082.stdout:6/985: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/f13f zero size 2024-09-17T01:41:58.098 INFO:tasks.workunit.client.0.smithi082.stdout:3/922: mkdir d9/db/d95/d141 0 2024-09-17T01:41:58.100 INFO:tasks.workunit.client.0.smithi082.stdout:9/888: symlink d4/d27/d2d/d60/d11/d39/d7d/l129 0 2024-09-17T01:41:58.102 INFO:tasks.workunit.client.0.smithi082.stdout:0/975: creat da/df/d2b/d9a/f14c x:0 0 0 2024-09-17T01:41:58.103 INFO:tasks.workunit.client.0.smithi082.stdout:6/986: mkdir d1/d7/d10/d4f/d8e/da8/dae/d152 0 2024-09-17T01:41:58.103 INFO:tasks.workunit.client.0.smithi082.stdout:3/923: rmdir d9/db/daf/dbf/ddc 39 2024-09-17T01:41:58.104 INFO:tasks.workunit.client.0.smithi082.stdout:9/889: rmdir d4/deb 39 2024-09-17T01:41:58.104 INFO:tasks.workunit.client.0.smithi082.stdout:6/987: write d1/d7/d10/d4f/f12 [1230371,31535] 0 2024-09-17T01:41:58.106 INFO:tasks.workunit.client.0.smithi082.stdout:5/986: mkdir db/d56/d76/d146 0 2024-09-17T01:41:58.107 INFO:tasks.workunit.client.0.smithi082.stdout:8/814: creat d3/dd/d18/d2d/d3e/d4a/d66/f103 x:0 0 0 2024-09-17T01:41:58.111 INFO:tasks.workunit.client.0.smithi082.stdout:3/924: write d9/db/daf/d69/d79/d86/f87 [1831443,60231] 0 2024-09-17T01:41:58.112 INFO:tasks.workunit.client.0.smithi082.stdout:6/988: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/f58 [0,4194304] 0 2024-09-17T01:41:58.114 INFO:tasks.workunit.client.0.smithi082.stdout:6/989: read d1/d7/d10/d4f/dc/d1d/d36/f91 [883642,10313] 0 2024-09-17T01:41:58.116 INFO:tasks.workunit.client.0.smithi082.stdout:8/815: creat d3/dd/d18/d2d/d3e/d43/f104 x:0 0 0 2024-09-17T01:41:58.117 INFO:tasks.workunit.client.0.smithi082.stdout:6/990: dread - d1/d7/d10/d4f/dc/d1d/d36/d3e/d4c/d95/f137 zero size 2024-09-17T01:41:58.118 INFO:tasks.workunit.client.0.smithi082.stdout:9/890: symlink d4/l12a 0 2024-09-17T01:41:58.120 INFO:tasks.workunit.client.0.smithi082.stdout:3/925: rmdir d9/db 39 2024-09-17T01:41:58.124 INFO:tasks.workunit.client.0.smithi082.stdout:8/816: dwrite d3/dd/d18/d2d/f53 [4194304,4194304] 0 2024-09-17T01:41:58.129 INFO:tasks.workunit.client.0.smithi082.stdout:6/991: symlink d1/d7/d10/d4f/dc/d99/dbb/l153 0 2024-09-17T01:41:58.130 INFO:tasks.workunit.client.0.smithi082.stdout:3/926: stat d9/db/daa/df3 0 2024-09-17T01:41:58.131 INFO:tasks.workunit.client.0.smithi082.stdout:3/927: chown d9/db/daa/fed 137 1 2024-09-17T01:41:58.138 INFO:tasks.workunit.client.0.smithi082.stdout:9/891: unlink d4/d27/d2d/d60/d11/d39/d29/d35/ld6 0 2024-09-17T01:41:58.139 INFO:tasks.workunit.client.0.smithi082.stdout:5/987: link db/d1e/d20/c44 db/d1e/d5b/db7/c147 0 2024-09-17T01:41:58.140 INFO:tasks.workunit.client.0.smithi082.stdout:8/817: symlink d3/dd/d18/d2d/d3e/d4a/d66/d6e/dee/l105 0 2024-09-17T01:41:58.140 INFO:tasks.workunit.client.0.smithi082.stdout:3/928: mknod d9/db/c142 0 2024-09-17T01:41:58.142 INFO:tasks.workunit.client.0.smithi082.stdout:9/892: mkdir d4/d59/d63/dee/d12b 0 2024-09-17T01:41:58.144 INFO:tasks.workunit.client.0.smithi082.stdout:5/988: creat db/d56/d78/da0/f148 x:0 0 0 2024-09-17T01:41:58.144 INFO:tasks.workunit.client.0.smithi082.stdout:8/818: rmdir d3/dd/d18/d2d/d60 39 2024-09-17T01:41:58.145 INFO:tasks.workunit.client.0.smithi082.stdout:9/893: chown d4/d27/d2d/d60/d11/c12 5207 1 2024-09-17T01:41:58.146 INFO:tasks.workunit.client.0.smithi082.stdout:5/989: chown db/d2b/d59/c9a 1090 1 2024-09-17T01:41:58.147 INFO:tasks.workunit.client.0.smithi082.stdout:8/819: mkdir d3/dd/d18/d2d/d3e/d43/df6/db3/ddb/d106 0 2024-09-17T01:41:58.150 INFO:tasks.workunit.client.0.smithi082.stdout:5/990: mkdir db/d56/d18/d149 0 2024-09-17T01:41:58.151 INFO:tasks.workunit.client.0.smithi082.stdout:9/894: mkdir d4/deb/d12c 0 2024-09-17T01:41:58.152 INFO:tasks.workunit.client.0.smithi082.stdout:8/820: truncate d3/dd/d18/d51/fa5 1179822 0 2024-09-17T01:41:58.153 INFO:tasks.workunit.client.0.smithi082.stdout:3/929: link d9/d78/d88/d11e/ddb/d11b/l12e d9/db/d49/d4e/l143 0 2024-09-17T01:41:58.157 INFO:tasks.workunit.client.0.smithi082.stdout:9/895: dwrite d4/d27/d2d/d60/d11/d39/d29/d6d/ff2 [0,4194304] 0 2024-09-17T01:41:58.158 INFO:tasks.workunit.client.0.smithi082.stdout:5/991: mknod db/d1e/d5b/d83/d94/dc1/d126/c14a 0 2024-09-17T01:41:58.165 INFO:tasks.workunit.client.0.smithi082.stdout:3/930: mkdir d9/db/daa/df3/de7/d12c/d144 0 2024-09-17T01:41:58.170 INFO:tasks.workunit.client.0.smithi082.stdout:9/896: symlink d4/d27/d2d/d60/d11/d39/d29/l12d 0 2024-09-17T01:41:58.173 INFO:tasks.workunit.client.0.smithi082.stdout:8/821: getdents d3/dd/d18/d2d/d58/d85 0 2024-09-17T01:41:58.174 INFO:tasks.workunit.client.0.smithi082.stdout:8/822: chown d3/dd/d18/d2d/d3e/d4a/d6a/ca0 27 1 2024-09-17T01:41:58.182 INFO:tasks.workunit.client.0.smithi082.stdout:5/992: dread db/d2b/f36 [0,4194304] 0 2024-09-17T01:41:58.185 INFO:tasks.workunit.client.0.smithi082.stdout:5/993: symlink db/d1e/d20/d30/dc6/l14b 0 2024-09-17T01:41:58.187 INFO:tasks.workunit.client.0.smithi082.stdout:5/994: write db/d56/d29/d4f/f11d [262471,110305] 0 2024-09-17T01:41:58.187 INFO:tasks.workunit.client.0.smithi082.stdout:9/897: getdents d4/d27/d2d/d60/d11/d8d 0 2024-09-17T01:41:58.189 INFO:tasks.workunit.client.0.smithi082.stdout:8/823: dread d3/dd/d18/d51/f6f [0,4194304] 0 2024-09-17T01:41:58.192 INFO:tasks.workunit.client.0.smithi082.stdout:9/898: chown d4/d27/d36/d3b/db0/cb8 10087534 1 2024-09-17T01:41:58.196 INFO:tasks.workunit.client.0.smithi082.stdout:5/995: dwrite db/da7/db3/f104 [0,4194304] 0 2024-09-17T01:41:58.198 INFO:tasks.workunit.client.0.smithi082.stdout:8/824: dread d3/dd/d18/d2d/d3e/d4a/d68/fb7 [0,4194304] 0 2024-09-17T01:41:58.199 INFO:tasks.workunit.client.0.smithi082.stdout:9/899: read d4/d27/d2d/d60/d11/d39/fda [165093,37913] 0 2024-09-17T01:41:58.202 INFO:tasks.workunit.client.0.smithi082.stdout:9/900: read d4/d27/d2d/d60/d11/d8d/fb4 [1994607,43969] 0 2024-09-17T01:41:58.212 INFO:tasks.workunit.client.0.smithi082.stdout:3/931: dwrite d9/d78/d88/d11e/ddb/f103 [0,4194304] 0 2024-09-17T01:41:58.213 INFO:tasks.workunit.client.0.smithi082.stdout:8/825: dread d3/dd/d18/d3a/fd3 [0,4194304] 0 2024-09-17T01:41:58.213 INFO:tasks.workunit.client.0.smithi082.stdout:3/932: chown d9/db/d6d/fae 370 1 2024-09-17T01:41:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:57 smithi082 ceph-mon[28077]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 146 MiB/s wr, 409 op/s 2024-09-17T01:41:58.214 INFO:tasks.workunit.client.0.smithi082.stdout:9/901: creat d4/d27/d2d/d60/d11/d39/d29/d77/d88/d125/f12e x:0 0 0 2024-09-17T01:41:58.220 INFO:tasks.workunit.client.0.smithi082.stdout:5/996: write db/d1e/d20/d30/f33 [931113,99271] 0 2024-09-17T01:41:58.227 INFO:tasks.workunit.client.0.smithi082.stdout:3/933: write d9/db/d49/d4e/f57 [4486841,5213] 0 2024-09-17T01:41:58.228 INFO:tasks.workunit.client.0.smithi082.stdout:3/934: fsync d9/db/daf/dbf/f115 0 2024-09-17T01:41:58.229 INFO:tasks.workunit.client.0.smithi082.stdout:5/997: fsync db/d1e/d5b/d83/f10f 0 2024-09-17T01:41:58.230 INFO:tasks.workunit.client.0.smithi082.stdout:3/935: chown d9/db/daa/dec/cf4 2 1 2024-09-17T01:41:58.231 INFO:tasks.workunit.client.0.smithi082.stdout:9/902: rename d4/d27/d36/d3b/c5e to d4/d27/d2d/d60/c12f 0 2024-09-17T01:41:58.231 INFO:tasks.workunit.client.0.smithi082.stdout:3/936: fdatasync d9/db/d8f/f13a 0 2024-09-17T01:41:58.233 INFO:tasks.workunit.client.0.smithi082.stdout:3/937: chown d9/db/d49/d4e/d53/d5b/cd5 27312 1 2024-09-17T01:41:58.233 INFO:tasks.workunit.client.0.smithi082.stdout:5/998: mkdir db/d56/d29/d124/d14c 0 2024-09-17T01:41:58.235 INFO:tasks.workunit.client.0.smithi082.stdout:9/903: unlink d4/d27/d36/d3b/la2 0 2024-09-17T01:41:58.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/904: fdatasync d4/d27/d2d/d3d/fd4 0 2024-09-17T01:41:58.239 INFO:tasks.workunit.client.0.smithi082.stdout:8/826: truncate d3/f33 4123015 0 2024-09-17T01:41:58.239 INFO:tasks.workunit.client.0.smithi082.stdout:3/938: dwrite d9/db/daf/d69/d10c/f121 [0,4194304] 0 2024-09-17T01:41:58.252 INFO:tasks.workunit.client.0.smithi082.stdout:5/999: dwrite db/d56/d18/d98/f109 [0,4194304] 0 2024-09-17T01:41:58.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:57 smithi167 ceph-mon[35643]: pgmap v32: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 146 MiB/s wr, 409 op/s 2024-09-17T01:41:58.255 INFO:tasks.workunit.client.0.smithi082.stdout:9/905: creat d4/d27/d2d/d60/d11/d39/d29/f130 x:0 0 0 2024-09-17T01:41:58.258 INFO:tasks.workunit.client.0.smithi082.stdout:8/827: write d3/fb [4852125,4814] 0 2024-09-17T01:41:58.260 INFO:tasks.workunit.client.0.smithi082.stdout:3/939: rmdir d9/db/d26/dbd/d108 0 2024-09-17T01:41:58.262 INFO:tasks.workunit.client.0.smithi082.stdout:3/940: symlink d9/d35/l145 0 2024-09-17T01:41:58.263 INFO:tasks.workunit.client.0.smithi082.stdout:8/828: getdents d3/dd/d18/d2d/d3b 0 2024-09-17T01:41:58.264 INFO:tasks.workunit.client.0.smithi082.stdout:3/941: mkdir d9/d35/d63/d146 0 2024-09-17T01:41:58.267 INFO:tasks.workunit.client.0.smithi082.stdout:3/942: creat d9/db/d49/da4/f147 x:0 0 0 2024-09-17T01:41:58.267 INFO:tasks.workunit.client.0.smithi082.stdout:8/829: creat d3/dd/d18/d51/f107 x:0 0 0 2024-09-17T01:41:58.269 INFO:tasks.workunit.client.0.smithi082.stdout:3/943: readlink d9/d78/d88/d11e/ddb/d11b/l12e 0 2024-09-17T01:41:58.270 INFO:tasks.workunit.client.0.smithi082.stdout:8/830: chown d3/dd/d18/d2d/d3e/d4a/d68/cec 1354356 1 2024-09-17T01:41:58.276 INFO:tasks.workunit.client.0.smithi082.stdout:3/944: dwrite d9/db/d49/d4e/d53/f62 [0,4194304] 0 2024-09-17T01:41:58.277 INFO:tasks.workunit.client.0.smithi082.stdout:8/831: dwrite d3/dd/d18/d34/ff2 [0,4194304] 0 2024-09-17T01:41:58.280 INFO:tasks.workunit.client.0.smithi082.stdout:3/945: read - d9/db/daf/d69/d79/fd0 zero size 2024-09-17T01:41:58.284 INFO:tasks.workunit.client.0.smithi082.stdout:3/946: read d9/db/f85 [1046422,123511] 0 2024-09-17T01:41:58.286 INFO:tasks.workunit.client.0.smithi082.stdout:8/832: getdents d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86 0 2024-09-17T01:41:58.314 INFO:tasks.workunit.client.0.smithi082.stdout:8/833: unlink d3/dd/d18/d2d/d58/lc6 0 2024-09-17T01:41:58.315 INFO:tasks.workunit.client.0.smithi082.stdout:3/947: creat d9/f148 x:0 0 0 2024-09-17T01:41:58.321 INFO:tasks.workunit.client.0.smithi082.stdout:8/834: dwrite d3/dd/d18/d2d/d58/f83 [4194304,4194304] 0 2024-09-17T01:41:58.328 INFO:tasks.workunit.client.0.smithi082.stdout:8/835: dwrite d3/fb [0,4194304] 0 2024-09-17T01:41:58.331 INFO:tasks.workunit.client.0.smithi082.stdout:8/836: mkdir d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/d108 0 2024-09-17T01:41:58.332 INFO:tasks.workunit.client.0.smithi082.stdout:3/948: write d9/db/daf/d69/d79/fab [1033019,31694] 0 2024-09-17T01:41:58.335 INFO:tasks.workunit.client.0.smithi082.stdout:3/949: symlink d9/d35/d63/d146/l149 0 2024-09-17T01:41:58.336 INFO:tasks.workunit.client.0.smithi082.stdout:8/837: mknod d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/c109 0 2024-09-17T01:41:58.338 INFO:tasks.workunit.client.0.smithi082.stdout:3/950: mknod d9/d35/d63/c14a 0 2024-09-17T01:41:58.341 INFO:tasks.workunit.client.0.smithi082.stdout:3/951: write d9/db/d26/f120 [1480650,65953] 0 2024-09-17T01:41:58.342 INFO:tasks.workunit.client.0.smithi082.stdout:3/952: write d9/db/d49/f32 [2182180,43107] 0 2024-09-17T01:41:58.350 INFO:tasks.workunit.client.0.smithi082.stdout:3/953: getdents d9/d35 0 2024-09-17T01:41:58.350 INFO:tasks.workunit.client.0.smithi082.stdout:3/954: chown d9/f148 207528 1 2024-09-17T01:41:58.352 INFO:tasks.workunit.client.0.smithi082.stdout:8/838: write d3/dd/d18/d2d/d58/fda [703012,92031] 0 2024-09-17T01:41:58.355 INFO:tasks.workunit.client.0.smithi082.stdout:3/955: dread d9/db/daf/d69/f6a [0,4194304] 0 2024-09-17T01:41:58.359 INFO:tasks.workunit.client.0.smithi082.stdout:3/956: chown d9/l44 198 1 2024-09-17T01:41:58.362 INFO:tasks.workunit.client.0.smithi082.stdout:8/839: write d3/f76 [1102468,119420] 0 2024-09-17T01:41:58.366 INFO:tasks.workunit.client.0.smithi082.stdout:8/840: symlink d3/dd/d18/d2d/d3e/d4a/d66/d6e/dee/l10a 0 2024-09-17T01:41:58.367 INFO:tasks.workunit.client.0.smithi082.stdout:3/957: write d9/f21 [3936078,117776] 0 2024-09-17T01:41:58.368 INFO:tasks.workunit.client.0.smithi082.stdout:8/841: write d3/dd/d18/d3a/fd3 [3266977,21235] 0 2024-09-17T01:41:58.370 INFO:tasks.workunit.client.0.smithi082.stdout:8/842: write d3/dd/d18/d2d/d3e/d4a/d66/fe9 [275660,98086] 0 2024-09-17T01:41:58.373 INFO:tasks.workunit.client.0.smithi082.stdout:8/843: write d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e [5083572,105157] 0 2024-09-17T01:41:58.377 INFO:tasks.workunit.client.0.smithi082.stdout:3/958: write d9/db/daf/d69/d9c/dc2/ff8 [88779,130567] 0 2024-09-17T01:41:58.379 INFO:tasks.workunit.client.0.smithi082.stdout:3/959: dread - d9/db/d6d/de0/f10d zero size 2024-09-17T01:41:58.383 INFO:tasks.workunit.client.0.smithi082.stdout:3/960: dread d9/d35/d63/f97 [0,4194304] 0 2024-09-17T01:41:58.383 INFO:tasks.workunit.client.0.smithi082.stdout:2/977: sync 2024-09-17T01:41:58.383 INFO:tasks.workunit.client.0.smithi082.stdout:8/844: truncate d3/dd/d18/d2d/f53 3811759 0 2024-09-17T01:41:58.385 INFO:tasks.workunit.client.0.smithi082.stdout:2/978: chown d1/d17/d38/d42/d52/d78 7 1 2024-09-17T01:41:58.388 INFO:tasks.workunit.client.0.smithi082.stdout:3/961: dread d9/db/daa/df3/d11c/f122 [0,4194304] 0 2024-09-17T01:41:58.391 INFO:tasks.workunit.client.0.smithi082.stdout:3/962: creat d9/db/daa/df3/de7/d12c/f14b x:0 0 0 2024-09-17T01:41:58.393 INFO:tasks.workunit.client.0.smithi082.stdout:2/979: getdents d1/d17/d38/d42/d52/d78/da0 0 2024-09-17T01:41:58.395 INFO:tasks.workunit.client.0.smithi082.stdout:2/980: write d1/d17/d38/d5c/d7d/f108 [6258203,1890] 0 2024-09-17T01:41:58.396 INFO:tasks.workunit.client.0.smithi082.stdout:3/963: symlink d9/db/d6d/de0/l14c 0 2024-09-17T01:41:58.399 INFO:tasks.workunit.client.0.smithi082.stdout:3/964: mkdir d9/db/d49/da4/d14d 0 2024-09-17T01:41:58.403 INFO:tasks.workunit.client.0.smithi082.stdout:8/845: dwrite d3/dd/d18/d51/fa5 [0,4194304] 0 2024-09-17T01:41:58.411 INFO:tasks.workunit.client.0.smithi082.stdout:2/981: truncate d1/d17/d29/d50/fa5 494330 0 2024-09-17T01:41:58.413 INFO:tasks.workunit.client.0.smithi082.stdout:3/965: write d9/d35/d63/f97 [5188450,68342] 0 2024-09-17T01:41:58.418 INFO:tasks.workunit.client.0.smithi082.stdout:3/966: readlink d9/db/d49/le6 0 2024-09-17T01:41:58.419 INFO:tasks.workunit.client.0.smithi082.stdout:3/967: chown d9/db/d6d/de0 2669 1 2024-09-17T01:41:58.420 INFO:tasks.workunit.client.0.smithi082.stdout:3/968: chown d9/f6f 25589887 1 2024-09-17T01:41:58.423 INFO:tasks.workunit.client.0.smithi082.stdout:8/846: creat d3/dd/d18/d2d/f10b x:0 0 0 2024-09-17T01:41:58.424 INFO:tasks.workunit.client.0.smithi082.stdout:8/847: truncate d3/dd/ffb 645803 0 2024-09-17T01:41:58.424 INFO:tasks.workunit.client.0.smithi082.stdout:3/969: unlink d9/d35/f9f 0 2024-09-17T01:41:58.427 INFO:tasks.workunit.client.0.smithi082.stdout:2/982: link d1/d17/d60/dc6/f115 d1/d17/d60/dc6/de8/f13b 0 2024-09-17T01:41:58.431 INFO:tasks.workunit.client.0.smithi082.stdout:3/970: dwrite d9/db/f3e [4194304,4194304] 0 2024-09-17T01:41:58.432 INFO:tasks.workunit.client.0.smithi082.stdout:8/848: symlink d3/dd/d18/d2d/d3b/l10c 0 2024-09-17T01:41:58.437 INFO:tasks.workunit.client.0.smithi082.stdout:2/983: creat d1/d17/d29/ddc/d13a/f13c x:0 0 0 2024-09-17T01:41:58.437 INFO:tasks.workunit.client.0.smithi082.stdout:8/849: stat d3/dd/d18/d2d/d3e/d4a/d6a/c6d 0 2024-09-17T01:41:58.438 INFO:tasks.workunit.client.0.smithi082.stdout:2/984: stat d1/d5a/d6d/l10d 0 2024-09-17T01:41:58.438 INFO:tasks.workunit.client.0.smithi082.stdout:8/850: chown d3/dd/c54 3475 1 2024-09-17T01:41:58.443 INFO:tasks.workunit.client.0.smithi082.stdout:2/985: mknod d1/c13d 0 2024-09-17T01:41:58.444 INFO:tasks.workunit.client.0.smithi082.stdout:2/986: read - d1/d66/d85/fc1 zero size 2024-09-17T01:41:58.444 INFO:tasks.workunit.client.0.smithi082.stdout:8/851: dread - d3/dd/d18/d2d/d3e/d4a/d66/fd9 zero size 2024-09-17T01:41:58.448 INFO:tasks.workunit.client.0.smithi082.stdout:8/852: unlink d3/dd/d18/d51/db4/leb 0 2024-09-17T01:41:58.450 INFO:tasks.workunit.client.0.smithi082.stdout:8/853: write d3/dd/d18/d2d/f10b [181091,98586] 0 2024-09-17T01:41:58.453 INFO:tasks.workunit.client.0.smithi082.stdout:3/971: dread d9/db/d26/f3b [0,4194304] 0 2024-09-17T01:41:58.455 INFO:tasks.workunit.client.0.smithi082.stdout:8/854: mkdir d3/dd/d18/d2d/d3e/d10d 0 2024-09-17T01:41:58.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/855: unlink d3/dd/d18/d2d/d3b/fe5 0 2024-09-17T01:41:58.465 INFO:tasks.workunit.client.0.smithi082.stdout:8/856: dread d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fb0 [0,4194304] 0 2024-09-17T01:41:58.473 INFO:tasks.workunit.client.0.smithi082.stdout:8/857: getdents d3/dd/d18/d51/dae 0 2024-09-17T01:41:58.473 INFO:tasks.workunit.client.0.smithi082.stdout:8/858: write d3/f76 [1597981,13611] 0 2024-09-17T01:41:58.491 INFO:tasks.workunit.client.0.smithi082.stdout:3/972: write d9/db/daa/fed [409086,101882] 0 2024-09-17T01:41:58.492 INFO:tasks.workunit.client.0.smithi082.stdout:3/973: chown d9/l12 3 1 2024-09-17T01:41:58.498 INFO:tasks.workunit.client.0.smithi082.stdout:3/974: dwrite d9/db/daa/df3/de7/d12c/f14b [0,4194304] 0 2024-09-17T01:41:58.509 INFO:tasks.workunit.client.0.smithi082.stdout:8/859: truncate d3/dd/d18/d3a/fd3 2490993 0 2024-09-17T01:41:58.515 INFO:tasks.workunit.client.0.smithi082.stdout:8/860: rmdir d3/dd/d18/d2d/d60 39 2024-09-17T01:41:58.521 INFO:tasks.workunit.client.0.smithi082.stdout:8/861: getdents d3/dd/d18/d34 0 2024-09-17T01:41:58.531 INFO:tasks.workunit.client.0.smithi082.stdout:3/975: dwrite d9/db/daa/df3/d11c/f122 [0,4194304] 0 2024-09-17T01:41:58.539 INFO:tasks.workunit.client.0.smithi082.stdout:3/976: dwrite d9/db/d26/f120 [0,4194304] 0 2024-09-17T01:41:58.541 INFO:tasks.workunit.client.0.smithi082.stdout:8/862: truncate d3/dd/d18/d51/dae/fea 1805592 0 2024-09-17T01:41:58.545 INFO:tasks.workunit.client.0.smithi082.stdout:8/863: dread d3/dd/d18/d2d/d3e/d4a/d66/fe9 [0,4194304] 0 2024-09-17T01:41:58.546 INFO:tasks.workunit.client.0.smithi082.stdout:3/977: creat d9/db/daf/d69/d79/d86/f14e x:0 0 0 2024-09-17T01:41:58.547 INFO:tasks.workunit.client.0.smithi082.stdout:8/864: chown d3/dd/d18/d2d/d58/lbc 161 1 2024-09-17T01:41:58.552 INFO:tasks.workunit.client.0.smithi082.stdout:3/978: dread d9/db/daa/df3/de7/d12c/f14b [0,4194304] 0 2024-09-17T01:41:58.555 INFO:tasks.workunit.client.0.smithi082.stdout:3/979: creat d9/db/daf/d69/d79/d86/db5/df1/f14f x:0 0 0 2024-09-17T01:41:58.571 INFO:tasks.workunit.client.0.smithi082.stdout:3/980: write d9/d35/f43 [4187368,98150] 0 2024-09-17T01:41:58.572 INFO:tasks.workunit.client.0.smithi082.stdout:3/981: chown d9/db/daf/d69/d79/d86/fb0 2130467 1 2024-09-17T01:41:58.573 INFO:tasks.workunit.client.0.smithi082.stdout:3/982: chown d9/db/daf/d69/d79/d86 976 1 2024-09-17T01:41:58.576 INFO:tasks.workunit.client.0.smithi082.stdout:3/983: creat d9/db/daf/d69/d79/d86/db5/f150 x:0 0 0 2024-09-17T01:41:58.581 INFO:tasks.workunit.client.0.smithi082.stdout:3/984: dread d9/d35/d63/f97 [0,4194304] 0 2024-09-17T01:41:58.584 INFO:tasks.workunit.client.0.smithi082.stdout:3/985: mkdir d9/db/daa/d151 0 2024-09-17T01:41:58.587 INFO:tasks.workunit.client.0.smithi082.stdout:3/986: chown d9/db/daa/dec/l12a 29401 1 2024-09-17T01:41:58.595 INFO:tasks.workunit.client.0.smithi082.stdout:3/987: getdents d9/db/daf/d69 0 2024-09-17T01:41:58.597 INFO:tasks.workunit.client.0.smithi082.stdout:3/988: chown d9/d78/d88/d11e/f112 15 1 2024-09-17T01:41:58.598 INFO:tasks.workunit.client.0.smithi082.stdout:3/989: fsync d9/d35/d63/f97 0 2024-09-17T01:41:58.601 INFO:tasks.workunit.client.0.smithi082.stdout:3/990: mknod d9/db/daa/df3/de7/d12c/c152 0 2024-09-17T01:41:58.603 INFO:tasks.workunit.client.0.smithi082.stdout:3/991: fdatasync d9/db/f8a 0 2024-09-17T01:41:58.605 INFO:tasks.workunit.client.0.smithi082.stdout:3/992: rmdir d9/db/daf/d69/d79 39 2024-09-17T01:41:58.610 INFO:tasks.workunit.client.0.smithi082.stdout:3/993: mknod d9/d78/d88/c153 0 2024-09-17T01:41:58.616 INFO:tasks.workunit.client.0.smithi082.stdout:3/994: dwrite d9/db/d26/fa1 [0,4194304] 0 2024-09-17T01:41:58.620 INFO:tasks.workunit.client.0.smithi082.stdout:3/995: creat d9/db/daa/df3/de7/d118/d126/f154 x:0 0 0 2024-09-17T01:41:58.623 INFO:tasks.workunit.client.0.smithi082.stdout:3/996: stat d9/db/daf/d69/d9c/dc2/cdd 0 2024-09-17T01:41:58.638 INFO:tasks.workunit.client.0.smithi082.stdout:3/997: dwrite d9/db/daf/d69/d79/d86/db5/f114 [0,4194304] 0 2024-09-17T01:41:58.641 INFO:tasks.workunit.client.0.smithi082.stdout:3/998: mknod d9/db/d49/d4e/c155 0 2024-09-17T01:41:58.646 INFO:tasks.workunit.client.0.smithi082.stdout:3/999: write d9/f4d [4438629,108697] 0 2024-09-17T01:41:59.027 INFO:tasks.workunit.client.0.smithi082.stdout:0/976: sync 2024-09-17T01:41:59.030 INFO:tasks.workunit.client.0.smithi082.stdout:0/977: mkdir da/df/d2b/d59/d6f/da6/d136/d14d 0 2024-09-17T01:41:59.032 INFO:tasks.workunit.client.0.smithi082.stdout:0/978: read da/d1b/d23/d4d/f5e [809065,19385] 0 2024-09-17T01:41:59.048 INFO:tasks.workunit.client.0.smithi082.stdout:0/979: dread da/df/d71/f25 [0,4194304] 0 2024-09-17T01:41:59.074 INFO:tasks.workunit.client.0.smithi082.stdout:0/980: dwrite da/d1b/d23/d4d/f2a [4194304,4194304] 0 2024-09-17T01:41:59.084 INFO:tasks.workunit.client.0.smithi082.stdout:0/981: link da/df/d2b/f89 da/df/d71/d92/df7/f14e 0 2024-09-17T01:41:59.085 INFO:tasks.workunit.client.0.smithi082.stdout:6/992: sync 2024-09-17T01:41:59.086 INFO:tasks.workunit.client.0.smithi082.stdout:6/993: mknod d1/d7/d10/d4f/d8e/c154 0 2024-09-17T01:41:59.092 INFO:tasks.workunit.client.0.smithi082.stdout:6/994: dwrite d1/d7/d10/d4f/dc/d1d/d36/d7a/d87/f132 [0,4194304] 0 2024-09-17T01:41:59.093 INFO:tasks.workunit.client.0.smithi082.stdout:0/982: write da/df/d27/db5/f124 [5238031,66721] 0 2024-09-17T01:41:59.098 INFO:tasks.workunit.client.0.smithi082.stdout:0/983: write da/df/d2b/f85 [912623,3829] 0 2024-09-17T01:41:59.109 INFO:tasks.workunit.client.0.smithi082.stdout:0/984: dwrite da/df/d71/d92/d147/d148/f6c [0,4194304] 0 2024-09-17T01:41:59.115 INFO:tasks.workunit.client.0.smithi082.stdout:0/985: dread da/d80/f9e [0,4194304] 0 2024-09-17T01:41:59.119 INFO:tasks.workunit.client.0.smithi082.stdout:0/986: symlink da/df/d27/l14f 0 2024-09-17T01:41:59.120 INFO:tasks.workunit.client.0.smithi082.stdout:6/995: dread d1/d7/d10/d4f/dc/f88 [0,4194304] 0 2024-09-17T01:41:59.126 INFO:tasks.workunit.client.0.smithi082.stdout:6/996: dwrite d1/d7/d10/d4f/dc/d1d/d36/d3e/f58 [0,4194304] 0 2024-09-17T01:41:59.151 INFO:tasks.workunit.client.0.smithi082.stdout:6/997: creat d1/d7/d10/d4f/d8e/f155 x:0 0 0 2024-09-17T01:41:59.155 INFO:tasks.workunit.client.0.smithi082.stdout:6/998: creat d1/d7/d10/d4f/dc/d1d/d36/d3e/d42/dcf/f156 x:0 0 0 2024-09-17T01:41:59.156 INFO:tasks.workunit.client.0.smithi082.stdout:6/999: chown d1/l2 232121 1 2024-09-17T01:41:59.332 INFO:tasks.workunit.client.0.smithi082.stdout:8/865: sync 2024-09-17T01:41:59.332 INFO:tasks.workunit.client.0.smithi082.stdout:2/987: sync 2024-09-17T01:41:59.332 INFO:tasks.workunit.client.0.smithi082.stdout:9/906: sync 2024-09-17T01:41:59.333 INFO:tasks.workunit.client.0.smithi082.stdout:2/988: stat d1/d17/d29/d50/l11b 0 2024-09-17T01:41:59.335 INFO:tasks.workunit.client.0.smithi082.stdout:9/907: mkdir d4/d59/d63/dee/d127/d10e/d118/d131 0 2024-09-17T01:41:59.337 INFO:tasks.workunit.client.0.smithi082.stdout:2/989: dread - d1/d17/d60/dc6/f12a zero size 2024-09-17T01:41:59.338 INFO:tasks.workunit.client.0.smithi082.stdout:8/866: dwrite d3/dd/d18/d51/f107 [0,4194304] 0 2024-09-17T01:41:59.339 INFO:tasks.workunit.client.0.smithi082.stdout:9/908: creat d4/d27/d36/d3b/db0/f132 x:0 0 0 2024-09-17T01:41:59.343 INFO:tasks.workunit.client.0.smithi082.stdout:8/867: creat d3/dd/d18/d3a/f10e x:0 0 0 2024-09-17T01:41:59.346 INFO:tasks.workunit.client.0.smithi082.stdout:9/909: mknod d4/d27/d36/d3b/da9/c133 0 2024-09-17T01:41:59.348 INFO:tasks.workunit.client.0.smithi082.stdout:2/990: rename d1/d17/d38/d42/l4f to d1/d35/db1/ddf/dfe/l13e 0 2024-09-17T01:41:59.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/910: creat d4/d27/d2d/d60/d11/d39/d29/d77/d11b/f134 x:0 0 0 2024-09-17T01:41:59.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/911: write d4/f5f [480019,20207] 0 2024-09-17T01:41:59.352 INFO:tasks.workunit.client.0.smithi082.stdout:8/868: symlink d3/dd/d18/d2d/d3e/d4a/d66/l10f 0 2024-09-17T01:41:59.352 INFO:tasks.workunit.client.0.smithi082.stdout:9/912: readlink d4/d27/d36/d3b/l86 0 2024-09-17T01:41:59.353 INFO:tasks.workunit.client.0.smithi082.stdout:2/991: truncate d1/d5a/d6d/fe1 614127 0 2024-09-17T01:41:59.356 INFO:tasks.workunit.client.0.smithi082.stdout:2/992: creat d1/d17/d128/f13f x:0 0 0 2024-09-17T01:41:59.357 INFO:tasks.workunit.client.0.smithi082.stdout:8/869: truncate d3/dd/d18/d2d/d3e/d43/df6/fdd 614 0 2024-09-17T01:41:59.357 INFO:tasks.workunit.client.0.smithi082.stdout:8/870: readlink d3/dd/d18/d34/l2c 0 2024-09-17T01:41:59.358 INFO:tasks.workunit.client.0.smithi082.stdout:2/993: dread - d1/d17/d38/d42/f125 zero size 2024-09-17T01:41:59.361 INFO:tasks.workunit.client.0.smithi082.stdout:9/913: getdents d4/d27/d2d/d60/d11/d39/d29 0 2024-09-17T01:41:59.361 INFO:tasks.workunit.client.0.smithi082.stdout:9/914: chown d4/d27/d2d/d60/fa3 451 1 2024-09-17T01:41:59.363 INFO:tasks.workunit.client.0.smithi082.stdout:8/871: rename d3/dd/d18/d2d/d58/lbb to d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/d108/l110 0 2024-09-17T01:41:59.368 INFO:tasks.workunit.client.0.smithi082.stdout:8/872: mkdir d3/dd/d18/d51/dae/d111 0 2024-09-17T01:41:59.369 INFO:tasks.workunit.client.0.smithi082.stdout:9/915: mknod d4/dd2/c135 0 2024-09-17T01:41:59.371 INFO:tasks.workunit.client.0.smithi082.stdout:0/987: sync 2024-09-17T01:41:59.371 INFO:tasks.workunit.client.0.smithi082.stdout:8/873: symlink d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/l112 0 2024-09-17T01:41:59.374 INFO:tasks.workunit.client.0.smithi082.stdout:2/994: write d1/d10/f28 [1412491,46604] 0 2024-09-17T01:41:59.375 INFO:tasks.workunit.client.0.smithi082.stdout:0/988: truncate da/fe0 295582 0 2024-09-17T01:41:59.380 INFO:tasks.workunit.client.0.smithi082.stdout:2/995: fsync d1/d66/d85/f93 0 2024-09-17T01:41:59.382 INFO:tasks.workunit.client.0.smithi082.stdout:0/989: creat da/df/d27/db5/f150 x:0 0 0 2024-09-17T01:41:59.383 INFO:tasks.workunit.client.0.smithi082.stdout:0/990: chown da/d1b/d23/dea 85931 1 2024-09-17T01:41:59.384 INFO:tasks.workunit.client.0.smithi082.stdout:9/916: dwrite d4/d59/fe0 [0,4194304] 0 2024-09-17T01:41:59.386 INFO:tasks.workunit.client.0.smithi082.stdout:9/917: write d4/d27/d36/ff8 [1248514,28664] 0 2024-09-17T01:41:59.386 INFO:tasks.workunit.client.0.smithi082.stdout:2/996: creat d1/d17/d60/f140 x:0 0 0 2024-09-17T01:41:59.388 INFO:tasks.workunit.client.0.smithi082.stdout:8/874: creat d3/dd/f113 x:0 0 0 2024-09-17T01:41:59.389 INFO:tasks.workunit.client.0.smithi082.stdout:0/991: unlink da/d1b/cdd 0 2024-09-17T01:41:59.389 INFO:tasks.workunit.client.0.smithi082.stdout:0/992: readlink da/d80/lc2 0 2024-09-17T01:41:59.396 INFO:tasks.workunit.client.0.smithi082.stdout:0/993: rename da/df/d2b/d59/lbf to da/df/d2b/d9a/l151 0 2024-09-17T01:41:59.396 INFO:tasks.workunit.client.0.smithi082.stdout:2/997: mkdir d1/d35/d141 0 2024-09-17T01:41:59.403 INFO:tasks.workunit.client.0.smithi082.stdout:2/998: creat d1/d17/d38/d42/d52/d78/d10f/f142 x:0 0 0 2024-09-17T01:41:59.404 INFO:tasks.workunit.client.0.smithi082.stdout:8/875: write d3/dd/d18/d2d/d3e/d4a/d68/fb7 [795456,97447] 0 2024-09-17T01:41:59.404 INFO:tasks.workunit.client.0.smithi082.stdout:0/994: link da/d1b/d23/d42/d43/lf0 da/df/d2b/d59/d6f/da6/l152 0 2024-09-17T01:41:59.405 INFO:tasks.workunit.client.0.smithi082.stdout:2/999: dread - d1/d17/d38/d42/d52/d78/d10f/f142 zero size 2024-09-17T01:41:59.406 INFO:tasks.workunit.client.0.smithi082.stdout:8/876: stat d3/dd/l5e 0 2024-09-17T01:41:59.410 INFO:tasks.workunit.client.0.smithi082.stdout:8/877: chown d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/c109 49424876 1 2024-09-17T01:41:59.412 INFO:tasks.workunit.client.0.smithi082.stdout:9/918: dwrite d4/d27/d2d/d3d/f5c [4194304,4194304] 0 2024-09-17T01:41:59.413 INFO:tasks.workunit.client.0.smithi082.stdout:9/919: fdatasync d4/d27/d2d/d60/d11/d39/d44/fd3 0 2024-09-17T01:41:59.421 INFO:tasks.workunit.client.0.smithi082.stdout:9/920: dread d4/d27/d2d/d60/d11/d39/d29/d6d/fa1 [0,4194304] 0 2024-09-17T01:41:59.428 INFO:tasks.workunit.client.0.smithi082.stdout:8/878: symlink d3/dd/d18/d2d/d60/l114 0 2024-09-17T01:41:59.429 INFO:tasks.workunit.client.0.smithi082.stdout:8/879: chown d3/dd/d18/d2d/d3e/d43/df6/cb5 0 1 2024-09-17T01:41:59.430 INFO:tasks.workunit.client.0.smithi082.stdout:8/880: chown d3/dd/d18/d2d/d3e/d4a/d68/df7/lfc 1 1 2024-09-17T01:41:59.430 INFO:tasks.workunit.client.0.smithi082.stdout:9/921: creat d4/d59/d63/dee/d127/f136 x:0 0 0 2024-09-17T01:41:59.431 INFO:tasks.workunit.client.0.smithi082.stdout:9/922: chown d4/dd2/de1/cca 62395957 1 2024-09-17T01:41:59.432 INFO:tasks.workunit.client.0.smithi082.stdout:0/995: getdents da/df/d2b/d59/d6f/da6 0 2024-09-17T01:41:59.436 INFO:tasks.workunit.client.0.smithi082.stdout:0/996: unlink da/d1b/d23/d42/fe8 0 2024-09-17T01:41:59.438 INFO:tasks.workunit.client.0.smithi082.stdout:9/923: dwrite d4/d59/d63/dee/d127/d10e/d118/f42 [0,4194304] 0 2024-09-17T01:41:59.439 INFO:tasks.workunit.client.0.smithi082.stdout:8/881: rename d3/dd/d18/d51/db4 to d3/dd/d18/d115 0 2024-09-17T01:41:59.443 INFO:tasks.workunit.client.0.smithi082.stdout:0/997: rename da/d80/d77 to da/df/d27/db5/d153 0 2024-09-17T01:41:59.446 INFO:tasks.workunit.client.0.smithi082.stdout:9/924: dwrite d4/d59/d63/dee/d127/f11f [0,4194304] 0 2024-09-17T01:41:59.446 INFO:tasks.workunit.client.0.smithi082.stdout:8/882: mknod d3/dd/d18/d2d/d3e/d4a/c116 0 2024-09-17T01:41:59.448 INFO:tasks.workunit.client.0.smithi082.stdout:0/998: fsync da/df/d71/d92/fda 0 2024-09-17T01:41:59.454 INFO:tasks.workunit.client.0.smithi082.stdout:0/999: chown da/df/d2b/f89 26 1 2024-09-17T01:41:59.455 INFO:tasks.workunit.client.0.smithi082.stdout:9/925: symlink d4/d59/d63/dee/d127/d10e/d118/d131/l137 0 2024-09-17T01:41:59.458 INFO:tasks.workunit.client.0.smithi082.stdout:9/926: symlink d4/d27/d2d/d60/d11/d39/d29/d77/d88/d125/l138 0 2024-09-17T01:41:59.464 INFO:tasks.workunit.client.0.smithi082.stdout:9/927: creat d4/d27/d2d/d3d/d81/d117/d11c/d11e/f139 x:0 0 0 2024-09-17T01:41:59.467 INFO:tasks.workunit.client.0.smithi082.stdout:9/928: creat d4/d27/d2d/d3d/d81/d117/d11c/f13a x:0 0 0 2024-09-17T01:41:59.468 INFO:tasks.workunit.client.0.smithi082.stdout:8/883: dread d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/fde [0,4194304] 0 2024-09-17T01:41:59.469 INFO:tasks.workunit.client.0.smithi082.stdout:9/929: mknod d4/d27/d2d/d3d/c13b 0 2024-09-17T01:41:59.493 INFO:tasks.workunit.client.0.smithi082.stdout:8/884: write d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/fd0 [3805465,79970] 0 2024-09-17T01:41:59.498 INFO:tasks.workunit.client.0.smithi082.stdout:8/885: rename d3/dd/f26 to d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/f117 0 2024-09-17T01:41:59.499 INFO:tasks.workunit.client.0.smithi082.stdout:9/930: dwrite d4/d27/d2d/d60/d11/d39/d31/fb6 [0,4194304] 0 2024-09-17T01:41:59.501 INFO:tasks.workunit.client.0.smithi082.stdout:9/931: fdatasync d4/d27/d2d/d3d/d81/d117/d11c/f13a 0 2024-09-17T01:41:59.526 INFO:tasks.workunit.client.0.smithi082.stdout:9/932: dwrite d4/d27/d36/d3b/faf [0,4194304] 0 2024-09-17T01:41:59.535 INFO:tasks.workunit.client.0.smithi082.stdout:9/933: dwrite d4/d27/d36/f4e [0,4194304] 0 2024-09-17T01:41:59.535 INFO:tasks.workunit.client.0.smithi082.stdout:8/886: dread d3/f20 [0,4194304] 0 2024-09-17T01:41:59.537 INFO:tasks.workunit.client.0.smithi082.stdout:8/887: readlink d3/dd/d18/d3a/l91 0 2024-09-17T01:41:59.539 INFO:tasks.workunit.client.0.smithi082.stdout:8/888: chown d3/dd/d18/d2d/d3e/d4a/d6a/la6 780511 1 2024-09-17T01:41:59.540 INFO:tasks.workunit.client.0.smithi082.stdout:9/934: creat d4/d27/d95/de7/d100/f13c x:0 0 0 2024-09-17T01:41:59.541 INFO:tasks.workunit.client.0.smithi082.stdout:8/889: chown d3/dd/d18/d2d/d3e/d43/df6/db3/ddb/d106 392278 1 2024-09-17T01:41:59.547 INFO:tasks.workunit.client.0.smithi082.stdout:8/890: mkdir d3/dd/d18/d2d/d3e/d4a/d68/d118 0 2024-09-17T01:41:59.548 INFO:tasks.workunit.client.0.smithi082.stdout:9/935: dwrite d4/fae [0,4194304] 0 2024-09-17T01:41:59.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/891: dread - d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/f95 zero size 2024-09-17T01:41:59.553 INFO:tasks.workunit.client.0.smithi082.stdout:8/892: write d3/dd/d18/d2d/f10b [583725,19447] 0 2024-09-17T01:41:59.555 INFO:tasks.workunit.client.0.smithi082.stdout:9/936: rename d4/d27/d2d/d60/d11/d39/d29/d35/c10d to d4/d27/d36/c13d 0 2024-09-17T01:41:59.562 INFO:tasks.workunit.client.0.smithi082.stdout:8/893: dwrite d3/dd/f23 [0,4194304] 0 2024-09-17T01:41:59.565 INFO:tasks.workunit.client.0.smithi082.stdout:8/894: truncate d3/dd/d18/d2d/d3e/d43/df6/db3/ddb/fe8 731041 0 2024-09-17T01:41:59.567 INFO:tasks.workunit.client.0.smithi082.stdout:8/895: mknod d3/dd/d18/d51/dc5/c119 0 2024-09-17T01:41:59.570 INFO:tasks.workunit.client.0.smithi082.stdout:8/896: rmdir d3/dd/d18/d2d/d58 39 2024-09-17T01:41:59.573 INFO:tasks.workunit.client.0.smithi082.stdout:8/897: unlink d3/f76 0 2024-09-17T01:41:59.577 INFO:tasks.workunit.client.0.smithi082.stdout:8/898: mkdir d3/dd/d11a 0 2024-09-17T01:42:00.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:41:59 smithi082 ceph-mon[28077]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 82 MiB/s wr, 258 op/s 2024-09-17T01:42:00.190 INFO:tasks.workunit.client.0.smithi082.stdout:8/899: sync 2024-09-17T01:42:00.190 INFO:tasks.workunit.client.0.smithi082.stdout:9/937: sync 2024-09-17T01:42:00.192 INFO:tasks.workunit.client.0.smithi082.stdout:8/900: write d3/dd/d18/d2d/d3e/d4a/d66/f103 [771910,101325] 0 2024-09-17T01:42:00.194 INFO:tasks.workunit.client.0.smithi082.stdout:9/938: link d4/d59/d63/dee/d127/l123 d4/da6/l13e 0 2024-09-17T01:42:00.195 INFO:tasks.workunit.client.0.smithi082.stdout:9/939: chown d4/d27/d2d/d60/c22 67 1 2024-09-17T01:42:00.199 INFO:tasks.workunit.client.0.smithi082.stdout:9/940: unlink d4/d27/d36/d3b/db0/c10f 0 2024-09-17T01:42:00.212 INFO:tasks.workunit.client.0.smithi082.stdout:9/941: truncate d4/d27/d2d/d60/d11/d39/d31/f105 1078689 0 2024-09-17T01:42:00.214 INFO:tasks.workunit.client.0.smithi082.stdout:9/942: chown d4/d27/d2d/d60/d11/d37/c3e 164 1 2024-09-17T01:42:00.217 INFO:tasks.workunit.client.0.smithi082.stdout:9/943: mknod d4/d27/d2d/d60/d11/d39/d31/c13f 0 2024-09-17T01:42:00.232 INFO:tasks.workunit.client.0.smithi082.stdout:9/944: dwrite d4/d27/d2d/d60/d11/d8d/fa7 [0,4194304] 0 2024-09-17T01:42:00.236 INFO:tasks.workunit.client.0.smithi082.stdout:9/945: fdatasync d4/fd7 0 2024-09-17T01:42:00.243 INFO:tasks.workunit.client.0.smithi082.stdout:9/946: mknod d4/d27/d2d/d60/d11/c140 0 2024-09-17T01:42:00.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:41:59 smithi167 ceph-mon[35643]: pgmap v33: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 33 MiB/s rd, 82 MiB/s wr, 258 op/s 2024-09-17T01:42:00.264 INFO:tasks.workunit.client.0.smithi082.stdout:9/947: dread d4/d27/d2d/d60/f34 [0,4194304] 0 2024-09-17T01:42:00.265 INFO:tasks.workunit.client.0.smithi082.stdout:9/948: rmdir d4/d27/d95/de7 39 2024-09-17T01:42:00.267 INFO:tasks.workunit.client.0.smithi082.stdout:9/949: rename d4/d27/d2d/d60/d11/d39/d29 to d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/d141 22 2024-09-17T01:42:00.270 INFO:tasks.workunit.client.0.smithi082.stdout:9/950: mknod d4/d27/d2d/d60/d11/d39/d29/c142 0 2024-09-17T01:42:00.270 INFO:tasks.workunit.client.0.smithi082.stdout:9/951: read d4/f5f [1381326,113920] 0 2024-09-17T01:42:00.273 INFO:tasks.workunit.client.0.smithi082.stdout:9/952: fdatasync d4/d27/d2d/d60/d11/d39/d31/f40 0 2024-09-17T01:42:00.276 INFO:tasks.workunit.client.0.smithi082.stdout:9/953: truncate d4/d27/d2d/d3d/f85 490888 0 2024-09-17T01:42:00.280 INFO:tasks.workunit.client.0.smithi082.stdout:9/954: rename d4/d59/d63/dee/d12b to d4/d27/d2d/d60/d11/d39/d44/d143 0 2024-09-17T01:42:00.281 INFO:tasks.workunit.client.0.smithi082.stdout:9/955: mknod d4/d59/d63/ddf/c144 0 2024-09-17T01:42:00.283 INFO:tasks.workunit.client.0.smithi082.stdout:9/956: mknod d4/d59/c145 0 2024-09-17T01:42:00.285 INFO:tasks.workunit.client.0.smithi082.stdout:9/957: symlink d4/d27/d2d/d3d/d81/d117/d11c/l146 0 2024-09-17T01:42:00.288 INFO:tasks.workunit.client.0.smithi082.stdout:9/958: getdents d4/d27/d36/d3b 0 2024-09-17T01:42:00.290 INFO:tasks.workunit.client.0.smithi082.stdout:9/959: truncate d4/d27/d2d/d60/d11/f70 57355 0 2024-09-17T01:42:00.291 INFO:tasks.workunit.client.0.smithi082.stdout:9/960: fdatasync d4/d27/d36/d3b/fe8 0 2024-09-17T01:42:00.293 INFO:tasks.workunit.client.0.smithi082.stdout:9/961: symlink d4/deb/d12c/l147 0 2024-09-17T01:42:00.296 INFO:tasks.workunit.client.0.smithi082.stdout:9/962: symlink d4/d27/d2d/d60/d11/d39/l148 0 2024-09-17T01:42:00.300 INFO:tasks.workunit.client.0.smithi082.stdout:9/963: link d4/l12a d4/d27/d95/de7/l149 0 2024-09-17T01:42:00.300 INFO:tasks.workunit.client.0.smithi082.stdout:9/964: chown d4/f94 59 1 2024-09-17T01:42:00.306 INFO:tasks.workunit.client.0.smithi082.stdout:9/965: mkdir d4/d27/d2d/d60/d11/d39/d29/d77/d88/d125/d14a 0 2024-09-17T01:42:00.321 INFO:tasks.workunit.client.0.smithi082.stdout:9/966: dread d4/d27/d2d/d60/d11/d39/d44/fd3 [0,4194304] 0 2024-09-17T01:42:00.323 INFO:tasks.workunit.client.0.smithi082.stdout:9/967: rmdir d4/d27/d2d/d60/d11/d8d 39 2024-09-17T01:42:00.325 INFO:tasks.workunit.client.0.smithi082.stdout:9/968: mkdir d4/d27/d95/de7/d100/d14b 0 2024-09-17T01:42:00.328 INFO:tasks.workunit.client.0.smithi082.stdout:9/969: rename d4/d27/d2d/l87 to d4/d59/d63/ddf/l14c 0 2024-09-17T01:42:00.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/970: dwrite d4/d27/d2d/d60/d11/d39/d31/f7a [0,4194304] 0 2024-09-17T01:42:00.348 INFO:tasks.workunit.client.0.smithi082.stdout:9/971: chown d4/da6/lfb 117856 1 2024-09-17T01:42:00.349 INFO:tasks.workunit.client.0.smithi082.stdout:9/972: readlink d4/d27/d36/d3b/da9/lc3 0 2024-09-17T01:42:00.351 INFO:tasks.workunit.client.0.smithi082.stdout:9/973: readlink d4/d59/d63/dee/d127/l123 0 2024-09-17T01:42:00.352 INFO:tasks.workunit.client.0.smithi082.stdout:9/974: stat d4/deb/d12c/l147 0 2024-09-17T01:42:00.352 INFO:tasks.workunit.client.0.smithi082.stdout:9/975: read d4/fae [928447,105004] 0 2024-09-17T01:42:00.354 INFO:tasks.workunit.client.0.smithi082.stdout:9/976: fsync d4/d27/d2d/d60/d11/d39/d29/f130 0 2024-09-17T01:42:00.357 INFO:tasks.workunit.client.0.smithi082.stdout:9/977: dread d4/d27/d2d/d60/d11/d37/f3c [8388608,4194304] 0 2024-09-17T01:42:00.363 INFO:tasks.workunit.client.0.smithi082.stdout:9/978: truncate d4/d27/d2d/d60/d11/d39/f76 21393 0 2024-09-17T01:42:00.365 INFO:tasks.workunit.client.0.smithi082.stdout:9/979: dread - d4/d27/d2d/d60/d11/d39/d29/d6d/f104 zero size 2024-09-17T01:42:00.367 INFO:tasks.workunit.client.0.smithi082.stdout:9/980: creat d4/d59/d63/dee/f14d x:0 0 0 2024-09-17T01:42:00.377 INFO:tasks.workunit.client.0.smithi082.stdout:9/981: dwrite d4/da6/dc4/fcd [0,4194304] 0 2024-09-17T01:42:00.381 INFO:tasks.workunit.client.0.smithi082.stdout:9/982: unlink d4/d27/d2d/d3d/f8c 0 2024-09-17T01:42:00.389 INFO:tasks.workunit.client.0.smithi082.stdout:9/983: write d4/d27/d2d/d60/d11/d39/d29/d77/d88/dc1/fc8 [403630,25] 0 2024-09-17T01:42:00.391 INFO:tasks.workunit.client.0.smithi082.stdout:9/984: mknod d4/d27/d2d/d60/d11/d37/c14e 0 2024-09-17T01:42:00.392 INFO:tasks.workunit.client.0.smithi082.stdout:9/985: stat d4/d27/d2d/d60/d11/d8d/ldb 0 2024-09-17T01:42:00.393 INFO:tasks.workunit.client.0.smithi082.stdout:9/986: unlink d4/dd2/c135 0 2024-09-17T01:42:00.399 INFO:tasks.workunit.client.0.smithi082.stdout:9/987: dwrite d4/d27/d2d/d60/d11/d39/d29/d6d/f104 [0,4194304] 0 2024-09-17T01:42:00.403 INFO:tasks.workunit.client.0.smithi082.stdout:9/988: symlink d4/d27/d2d/l14f 0 2024-09-17T01:42:00.403 INFO:tasks.workunit.client.0.smithi082.stdout:9/989: chown d4/d59/d63/dee/d127/f136 128710040 1 2024-09-17T01:42:00.405 INFO:tasks.workunit.client.0.smithi082.stdout:9/990: mkdir d4/d27/d95/de7/d150 0 2024-09-17T01:42:00.411 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:42:00.411 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-17T01:42:00.412 INFO:tasks.workunit.client.0.smithi082.stdout:9/991: dwrite d4/d27/d2d/d60/d11/d39/d29/f130 [0,4194304] 0 2024-09-17T01:42:00.414 INFO:tasks.workunit.client.0.smithi082.stdout:9/992: unlink d4/d59/d63/ddf/l14c 0 2024-09-17T01:42:00.415 INFO:tasks.workunit.client.0.smithi082.stdout:9/993: write d4/d27/d2d/d60/d11/d39/d29/d6d/f90 [3813202,99267] 0 2024-09-17T01:42:00.425 INFO:tasks.workunit.client.0.smithi082.stdout:9/994: truncate d4/d27/d2d/d60/d11/d39/d29/d77/fa4 2888963 0 2024-09-17T01:42:00.427 INFO:tasks.workunit.client.0.smithi082.stdout:9/995: mkdir d4/d27/d2d/d60/d11/d151 0 2024-09-17T01:42:00.435 INFO:tasks.workunit.client.0.smithi082.stdout:8/901: sync 2024-09-17T01:42:00.439 INFO:tasks.workunit.client.0.smithi082.stdout:8/902: dread d3/dd/d18/d2d/f10b [0,4194304] 0 2024-09-17T01:42:00.442 INFO:tasks.workunit.client.0.smithi082.stdout:9/996: dwrite d4/d27/d2d/d3d/f85 [0,4194304] 0 2024-09-17T01:42:00.444 INFO:tasks.workunit.client.0.smithi082.stdout:9/997: truncate d4/fd7 839842 0 2024-09-17T01:42:00.447 INFO:tasks.workunit.client.0.smithi082.stdout:8/903: getdents d3/dd/d18/d2d/d3e/d43/df6/db3/dbe 0 2024-09-17T01:42:00.449 INFO:tasks.workunit.client.0.smithi082.stdout:8/904: write d3/dd/f23 [1965501,47746] 0 2024-09-17T01:42:00.452 INFO:tasks.workunit.client.0.smithi082.stdout:9/998: dwrite d4/d27/d2d/d3d/fa5 [0,4194304] 0 2024-09-17T01:42:00.453 INFO:tasks.workunit.client.0.smithi082.stdout:8/905: readlink d3/dd/d18/d2d/d3e/d4a/ld6 0 2024-09-17T01:42:00.454 INFO:tasks.workunit.client.0.smithi082.stdout:9/999: stat d4/d27/d36/d3b/l86 0 2024-09-17T01:42:00.458 INFO:tasks.workunit.client.0.smithi082.stdout:8/906: creat d3/dd/d18/d2d/d3e/d4a/d66/f11b x:0 0 0 2024-09-17T01:42:00.461 INFO:tasks.workunit.client.0.smithi082.stdout:8/907: mkdir d3/dd/d18/d2d/d3e/d43/d11c 0 2024-09-17T01:42:00.485 INFO:tasks.workunit.client.0.smithi082.stdout:8/908: dwrite d3/dd/d18/d2d/d3e/d4a/d66/fac [0,4194304] 0 2024-09-17T01:42:00.486 INFO:tasks.workunit.client.0.smithi082.stdout:8/909: stat d3/dd/d18/d2d/d3e/d43/df6/db3/dbe 0 2024-09-17T01:42:00.488 INFO:tasks.workunit.client.0.smithi082.stdout:8/910: symlink d3/dd/l11d 0 2024-09-17T01:42:00.491 INFO:tasks.workunit.client.0.smithi082.stdout:8/911: symlink d3/dd/d18/d51/dae/l11e 0 2024-09-17T01:42:00.491 INFO:tasks.workunit.client.0.smithi082.stdout:8/912: stat d3/f74 0 2024-09-17T01:42:00.499 INFO:tasks.workunit.client.0.smithi082.stdout:8/913: dwrite d3/dd/f84 [0,4194304] 0 2024-09-17T01:42:00.500 INFO:tasks.workunit.client.0.smithi082.stdout:8/914: dread - d3/fd7 zero size 2024-09-17T01:42:00.501 INFO:tasks.workunit.client.0.smithi082.stdout:8/915: chown d3/dd/d18/d51/dc5 1230 1 2024-09-17T01:42:00.507 INFO:tasks.workunit.client.0.smithi082.stdout:8/916: dread d3/fb [4194304,4194304] 0 2024-09-17T01:42:00.512 INFO:tasks.workunit.client.0.smithi082.stdout:8/917: creat d3/dd/d18/d2d/d58/d85/f11f x:0 0 0 2024-09-17T01:42:00.514 INFO:tasks.workunit.client.0.smithi082.stdout:8/918: stat d3/dd/d18/d51/dae/fea 0 2024-09-17T01:42:00.520 INFO:tasks.workunit.client.0.smithi082.stdout:8/919: write d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/f117 [428766,46259] 0 2024-09-17T01:42:00.521 INFO:tasks.workunit.client.0.smithi082.stdout:8/920: dread d3/dd/d18/d2d/d3e/d4a/f88 [0,4194304] 0 2024-09-17T01:42:00.521 INFO:tasks.workunit.client.0.smithi082.stdout:8/921: chown d3/ce0 29 1 2024-09-17T01:42:00.523 INFO:tasks.workunit.client.0.smithi082.stdout:8/922: write d3/fb [5171758,4063] 0 2024-09-17T01:42:00.525 INFO:tasks.workunit.client.0.smithi082.stdout:8/923: rmdir d3/dd 39 2024-09-17T01:42:00.541 INFO:tasks.workunit.client.0.smithi082.stdout:8/924: truncate d3/dd/d18/d51/dae/fd5 3361541 0 2024-09-17T01:42:00.543 INFO:tasks.workunit.client.0.smithi082.stdout:8/925: creat d3/dd/d18/d2d/d3e/d43/df6/f120 x:0 0 0 2024-09-17T01:42:00.544 INFO:tasks.workunit.client.0.smithi082.stdout:8/926: rmdir d3/dd/d18/d2d/d60 39 2024-09-17T01:42:00.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/927: link d3/dd/d18/lc8 d3/dd/d18/d2d/d60/l121 0 2024-09-17T01:42:00.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/928: rename d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/d108/l110 to d3/dd/d18/d2d/d3e/d4a/d66/d6e/dee/l122 0 2024-09-17T01:42:00.555 INFO:tasks.workunit.client.0.smithi082.stdout:8/929: unlink d3/dd/d18/d2d/d3e/d43/df6/cf1 0 2024-09-17T01:42:00.559 INFO:tasks.workunit.client.0.smithi082.stdout:8/930: link d3/dd/d18/d2d/d60/c75 d3/dd/d18/d2d/d3e/d43/c123 0 2024-09-17T01:42:00.580 INFO:tasks.workunit.client.0.smithi082.stdout:8/931: truncate d3/dd/d18/d51/dae/fd5 1281767 0 2024-09-17T01:42:00.585 INFO:tasks.workunit.client.0.smithi082.stdout:8/932: rename d3/dd/d18/d2d/d3b/l9d to d3/dd/d11a/l124 0 2024-09-17T01:42:00.591 INFO:tasks.workunit.client.0.smithi082.stdout:8/933: rename d3/dd/d18/d2d/d60/c75 to d3/dd/d18/d2d/d3e/d4a/d66/d6e/c125 0 2024-09-17T01:42:00.592 INFO:tasks.workunit.client.0.smithi082.stdout:8/934: fdatasync d3/dd/d18/d2d/d3b/f69 0 2024-09-17T01:42:00.607 INFO:tasks.workunit.client.0.smithi082.stdout:8/935: write d3/dd/fca [1272706,22541] 0 2024-09-17T01:42:00.613 INFO:tasks.workunit.client.0.smithi082.stdout:8/936: write d3/dd/f9f [9154405,66386] 0 2024-09-17T01:42:00.626 INFO:tasks.workunit.client.0.smithi082.stdout:8/937: dwrite d3/dd/d18/d2d/d3e/d43/df6/fdd [0,4194304] 0 2024-09-17T01:42:00.651 INFO:tasks.workunit.client.0.smithi082.stdout:8/938: dread d3/dd/f9f [0,4194304] 0 2024-09-17T01:42:00.653 INFO:tasks.workunit.client.0.smithi082.stdout:8/939: creat d3/dd/d18/d2d/d3e/d4a/dfe/f126 x:0 0 0 2024-09-17T01:42:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:00 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:00 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:01.290 INFO:tasks.workunit.client.0.smithi082.stdout:8/940: sync 2024-09-17T01:42:01.518 INFO:tasks.workunit.client.0.smithi082.stdout:8/941: sync 2024-09-17T01:42:01.544 INFO:tasks.workunit.client.0.smithi082.stdout:8/942: dread d3/dd/d18/d2d/d3e/d4a/fef [0,4194304] 0 2024-09-17T01:42:01.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/943: truncate d3/dd/d18/d3a/fd3 821178 0 2024-09-17T01:42:01.549 INFO:tasks.workunit.client.0.smithi082.stdout:8/944: chown d3/dd/d18/d34/ff2 126741887 1 2024-09-17T01:42:01.567 INFO:tasks.workunit.client.0.smithi082.stdout:8/945: dwrite d3/dd/d18/d2d/d3e/d43/f59 [0,4194304] 0 2024-09-17T01:42:01.570 INFO:tasks.workunit.client.0.smithi082.stdout:8/946: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/d86/d108/f127 x:0 0 0 2024-09-17T01:42:01.572 INFO:tasks.workunit.client.0.smithi082.stdout:8/947: truncate d3/dd/d18/d2d/d3e/d4a/f81 71564 0 2024-09-17T01:42:01.574 INFO:tasks.workunit.client.0.smithi082.stdout:8/948: mknod d3/dd/d18/d2d/d3e/d4a/d68/df7/c128 0 2024-09-17T01:42:01.576 INFO:tasks.workunit.client.0.smithi082.stdout:8/949: symlink d3/dd/d18/d2d/d60/l129 0 2024-09-17T01:42:01.578 INFO:tasks.workunit.client.0.smithi082.stdout:8/950: mknod d3/dd/d18/d2d/c12a 0 2024-09-17T01:42:01.580 INFO:tasks.workunit.client.0.smithi082.stdout:8/951: mknod d3/dd/c12b 0 2024-09-17T01:42:01.582 INFO:tasks.workunit.client.0.smithi082.stdout:8/952: stat d3/dd/d18/d2d/d3e/d4a/d66/d7b/f7e 0 2024-09-17T01:42:01.585 INFO:tasks.workunit.client.0.smithi082.stdout:8/953: dread d3/dd/d18/d2d/d3e/d43/f59 [0,4194304] 0 2024-09-17T01:42:01.590 INFO:tasks.workunit.client.0.smithi082.stdout:8/954: rename d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/c109 to d3/dd/d18/d2d/d3e/d43/d11c/c12c 0 2024-09-17T01:42:01.601 INFO:tasks.workunit.client.0.smithi082.stdout:8/955: write d3/dd/d18/d2d/d3e/d4a/d6a/f99 [695150,102448] 0 2024-09-17T01:42:01.603 INFO:tasks.workunit.client.0.smithi082.stdout:8/956: chown d3/dd/d18/d2d/d58/d85/cc1 29530 1 2024-09-17T01:42:01.608 INFO:tasks.workunit.client.0.smithi082.stdout:8/957: dwrite d3/dd/d18/d2d/d3e/d4a/d68/fc3 [0,4194304] 0 2024-09-17T01:42:01.616 INFO:tasks.workunit.client.0.smithi082.stdout:8/958: dwrite d3/dd/d18/d2d/d3e/f71 [0,4194304] 0 2024-09-17T01:42:01.617 INFO:tasks.workunit.client.0.smithi082.stdout:8/959: stat d3/dd/c54 0 2024-09-17T01:42:01.914 INFO:tasks.workunit.client.0.smithi082.stdout:8/960: sync 2024-09-17T01:42:01.920 INFO:tasks.workunit.client.0.smithi082.stdout:8/961: dwrite d3/dd/d18/d2d/d58/fda [0,4194304] 0 2024-09-17T01:42:01.933 INFO:tasks.workunit.client.0.smithi082.stdout:8/962: rename d3/dd/d18/d51/dc5/cd4 to d3/dd/d18/d2d/d3e/d43/c12d 0 2024-09-17T01:42:01.940 INFO:tasks.workunit.client.0.smithi082.stdout:8/963: dwrite d3/dd/d18/d2d/d3e/d4a/d66/f103 [0,4194304] 0 2024-09-17T01:42:01.944 INFO:tasks.workunit.client.0.smithi082.stdout:8/964: creat d3/dd/d18/d2d/d3e/d4a/d68/df7/f12e x:0 0 0 2024-09-17T01:42:01.946 INFO:tasks.workunit.client.0.smithi082.stdout:8/965: mknod d3/dd/d18/d2d/d3e/d43/df6/c12f 0 2024-09-17T01:42:01.949 INFO:tasks.workunit.client.0.smithi082.stdout:8/966: creat d3/dd/d18/d2d/d3e/d4a/d68/d118/f130 x:0 0 0 2024-09-17T01:42:01.957 INFO:tasks.workunit.client.0.smithi082.stdout:8/967: dwrite d3/dd/d18/d2d/d3e/d43/f104 [0,4194304] 0 2024-09-17T01:42:01.959 INFO:tasks.workunit.client.0.smithi082.stdout:8/968: mknod d3/dd/d18/d2d/d3e/d43/d11c/c131 0 2024-09-17T01:42:01.962 INFO:tasks.workunit.client.0.smithi082.stdout:8/969: mknod d3/dd/d18/d2d/d3e/d4a/c132 0 2024-09-17T01:42:01.969 INFO:tasks.workunit.client.0.smithi082.stdout:8/970: dwrite d3/dd/d18/d2d/d3e/d4a/d6a/f99 [0,4194304] 0 2024-09-17T01:42:01.974 INFO:tasks.workunit.client.0.smithi082.stdout:8/971: mkdir d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/d133 0 2024-09-17T01:42:01.976 INFO:tasks.workunit.client.0.smithi082.stdout:8/972: creat d3/dd/d18/d2d/d3e/d4a/d66/d6e/f134 x:0 0 0 2024-09-17T01:42:01.982 INFO:tasks.workunit.client.0.smithi082.stdout:8/973: dwrite d3/dd/f23 [4194304,4194304] 0 2024-09-17T01:42:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:01 smithi082 ceph-mon[28077]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 115 MiB/s wr, 372 op/s 2024-09-17T01:42:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:01 smithi167 ceph-mon[35643]: pgmap v34: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 46 MiB/s rd, 115 MiB/s wr, 372 op/s 2024-09-17T01:42:02.448 INFO:tasks.workunit.client.0.smithi082.stdout:8/974: sync 2024-09-17T01:42:02.452 INFO:tasks.workunit.client.0.smithi082.stdout:8/975: dread d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/fde [0,4194304] 0 2024-09-17T01:42:02.455 INFO:tasks.workunit.client.0.smithi082.stdout:8/976: rmdir d3/dd/d18/d2d/d3e/d43/df6/db3/ddb 39 2024-09-17T01:42:02.552 INFO:tasks.workunit.client.0.smithi082.stdout:8/977: write d3/dd/d18/d51/dae/fea [1750131,109970] 0 2024-09-17T01:42:02.564 INFO:tasks.workunit.client.0.smithi082.stdout:8/978: getdents d3/dd/d18/d2d/d3e/d4a/d66/d6e 0 2024-09-17T01:42:02.568 INFO:tasks.workunit.client.0.smithi082.stdout:8/979: mknod d3/dd/d18/d2d/d3e/d4a/d68/d118/c135 0 2024-09-17T01:42:02.570 INFO:tasks.workunit.client.0.smithi082.stdout:8/980: write d3/dd/d18/d2d/d3e/d4a/d68/df7/f12e [429674,3820] 0 2024-09-17T01:42:02.573 INFO:tasks.workunit.client.0.smithi082.stdout:8/981: mknod d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/c136 0 2024-09-17T01:42:02.647 INFO:tasks.workunit.client.0.smithi082.stdout:8/982: write d3/dd/d18/d2d/f94 [123790,11342] 0 2024-09-17T01:42:02.651 INFO:tasks.workunit.client.0.smithi082.stdout:8/983: truncate d3/dd/d18/d3a/fd3 1170636 0 2024-09-17T01:42:02.653 INFO:tasks.workunit.client.0.smithi082.stdout:8/984: write d3/dd/d18/d2d/d58/fda [3182715,109317] 0 2024-09-17T01:42:02.654 INFO:tasks.workunit.client.0.smithi082.stdout:8/985: readlink d3/dd/d18/d2d/d3e/d43/df6/lc4 0 2024-09-17T01:42:02.659 INFO:tasks.workunit.client.0.smithi082.stdout:8/986: write d3/dd/f27 [2161414,100248] 0 2024-09-17T01:42:02.667 INFO:tasks.workunit.client.0.smithi082.stdout:8/987: write d3/dd/d18/d2d/d3e/d43/fcd [904008,50150] 0 2024-09-17T01:42:02.670 INFO:tasks.workunit.client.0.smithi082.stdout:8/988: unlink d3/dd/d18/d34/c32 0 2024-09-17T01:42:02.673 INFO:tasks.workunit.client.0.smithi082.stdout:8/989: creat d3/dd/d18/d2d/d3e/d43/df6/db3/ddb/f137 x:0 0 0 2024-09-17T01:42:02.675 INFO:tasks.workunit.client.0.smithi082.stdout:8/990: creat d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf/f138 x:0 0 0 2024-09-17T01:42:02.677 INFO:tasks.workunit.client.0.smithi082.stdout:8/991: rmdir d3/dd/d18/d2d/d3e/d43/df6/db3/dbe/dcf 39 2024-09-17T01:42:02.678 INFO:tasks.workunit.client.0.smithi082.stdout:8/992: write d3/dd/d18/d2d/d3e/d4a/d68/df7/f12e [493141,64406] 0 2024-09-17T01:42:02.681 INFO:tasks.workunit.client.0.smithi082.stdout:8/993: creat d3/dd/d18/d2d/d60/f139 x:0 0 0 2024-09-17T01:42:02.683 INFO:tasks.workunit.client.0.smithi082.stdout:8/994: mkdir d3/dd/d18/d51/dc5/d13a 0 2024-09-17T01:42:02.686 INFO:tasks.workunit.client.0.smithi082.stdout:8/995: creat d3/dd/d18/d51/f13b x:0 0 0 2024-09-17T01:42:02.687 INFO:tasks.workunit.client.0.smithi082.stdout:8/996: chown d3/dd/d18/d2d/d3e/d4a/d66/cf3 185205472 1 2024-09-17T01:42:02.724 INFO:tasks.workunit.client.0.smithi082.stdout:8/997: truncate d3/dd/f23 6051935 0 2024-09-17T01:42:02.730 INFO:tasks.workunit.client.0.smithi082.stdout:8/998: link d3/fb d3/dd/d18/d3a/f13c 0 2024-09-17T01:42:02.733 INFO:tasks.workunit.client.0.smithi082.stdout:8/999: mknod d3/dd/d18/d51/c13d 0 2024-09-17T01:42:02.737 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm -rf -- ./tmp.H4QZ1BCB3F 2024-09-17T01:42:03.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:03 smithi082 ceph-mon[28077]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 75 MiB/s wr, 247 op/s 2024-09-17T01:42:04.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:03 smithi167 ceph-mon[35643]: pgmap v35: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 75 MiB/s wr, 247 op/s 2024-09-17T01:42:06.416 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 75 MiB/s wr, 247 op/s 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: Reconfiguring ceph-exporter.smithi167 (dependencies changed)... 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:06.417 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:06 smithi167 ceph-mon[35643]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: pgmap v36: 65 pgs: 65 active+clean; 2.5 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 32 MiB/s rd, 75 MiB/s wr, 247 op/s 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: Reconfiguring ceph-exporter.smithi167 (dependencies changed)... 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:06.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:06 smithi082 ceph-mon[28077]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:42:06.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 -- 172.21.15.82:0/318162414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 msgr2=0x7fddf4109850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:06.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 --2- 172.21.15.82:0/318162414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf4109850 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009880 tx=0x7fdde402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 -- 172.21.15.82:0/318162414 shutdown_connections 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 --2- 172.21.15.82:0/318162414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 0x7fddf4073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 --2- 172.21.15.82:0/318162414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf4109850 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.582+0000 7fddf8a76640 1 -- 172.21.15.82:0/318162414 >> 172.21.15.82:0/318162414 conn(0x7fddf406ea50 msgr2=0x7fddf4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.583+0000 7fddf8a76640 1 -- 172.21.15.82:0/318162414 shutdown_connections 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.583+0000 7fddf8a76640 1 -- 172.21.15.82:0/318162414 wait complete. 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.583+0000 7fddf8a76640 1 Processor -- start 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf8a76640 1 -- start start 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf8a76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf8a76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 0x7fddf410a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf8a76640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fddf4112fc0 con 0x7fddf4109450 2024-09-17T01:42:06.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf8a76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fddf4112e40 con 0x7fddf4109e20 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56120/0 (socket says 172.21.15.82:56120) 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf259c640 1 -- 172.21.15.82:0/2769464499 learned_addr learned my addr 172.21.15.82:0/2769464499 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.584+0000 7fddf1d9b640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 0x7fddf410a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf259c640 1 -- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 msgr2=0x7fddf410a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf259c640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 0x7fddf410a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf259c640 1 -- 172.21.15.82:0/2769464499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf410aa00 con 0x7fddf4109450 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf259c640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009230 tx=0x7fdde40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdde403f070 con 0x7fddf4109450 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf410ac90 con 0x7fddf4109450 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf410b1c0 con 0x7fddf4109450 2024-09-17T01:42:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdde40049d0 con 0x7fddf4109450 2024-09-17T01:42:06.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.585+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdde4035030 con 0x7fddf4109450 2024-09-17T01:42:06.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.586+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4109850 con 0x7fddf4109450 2024-09-17T01:42:06.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.588+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fdde4042070 con 0x7fddf4109450 2024-09-17T01:42:06.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.588+0000 7fdde37fe640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 0x7fdddc076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:06.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.588+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fdde40b7060 con 0x7fddf4109450 2024-09-17T01:42:06.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.589+0000 7fddf1d9b640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 0x7fdddc076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:06.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.589+0000 7fddf1d9b640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 0x7fdddc076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddf410bb80 tx=0x7fdde8005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:06.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.592+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fdde4082710 con 0x7fddf4109450 2024-09-17T01:42:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.918+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fddf4062630 con 0x7fdddc074a80 2024-09-17T01:42:06.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.920+0000 7fdde37fe640 1 -- 172.21.15.82:0/2769464499 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7fddf4062630 con 0x7fdddc074a80 2024-09-17T01:42:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 msgr2=0x7fdddc076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 0x7fdddc076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddf410bb80 tx=0x7fdde8005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 msgr2=0x7fddf410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009230 tx=0x7fdde40045e0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 shutdown_connections 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddf4109e20 0x7fddf410a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fdddc074a80 0x7fdddc076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 --2- 172.21.15.82:0/2769464499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddf4109450 0x7fddf410be00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 >> 172.21.15.82:0/2769464499 conn(0x7fddf406ea50 msgr2=0x7fddf410ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 shutdown_connections 2024-09-17T01:42:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:06.922+0000 7fddf8a76640 1 -- 172.21.15.82:0/2769464499 wait complete. 2024-09-17T01:42:06.931 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:42:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 -- 172.21.15.82:0/3497926023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98100860 msgr2=0x7fbc98100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 --2- 172.21.15.82:0/3497926023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98100860 0x7fbc98100c60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009880 tx=0x7fbc8802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 -- 172.21.15.82:0/3497926023 shutdown_connections 2024-09-17T01:42:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 --2- 172.21.15.82:0/3497926023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98101a60 0x7fbc98101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 --2- 172.21.15.82:0/3497926023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98100860 0x7fbc98100c60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 -- 172.21.15.82:0/3497926023 >> 172.21.15.82:0/3497926023 conn(0x7fbc980fc010 msgr2=0x7fbc980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 -- 172.21.15.82:0/3497926023 shutdown_connections 2024-09-17T01:42:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.032+0000 7fbc9e021640 1 -- 172.21.15.82:0/3497926023 wait complete. 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.033+0000 7fbc9e021640 1 Processor -- start 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.033+0000 7fbc9e021640 1 -- start start 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc9e021640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98100860 0x7fbc98197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc9e021640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc9e021640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981096a0 con 0x7fbc98101a60 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc9e021640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98109520 con 0x7fbc98100860 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56138/0 (socket says 172.21.15.82:56138) 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 -- 172.21.15.82:0/2864891264 learned_addr learned my addr 172.21.15.82:0/2864891264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc977fe640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98100860 0x7fbc98197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 -- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98100860 msgr2=0x7fbc98197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98100860 0x7fbc98197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.034+0000 7fbc96ffd640 1 -- 172.21.15.82:0/2864891264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc981980e0 con 0x7fbc98101a60 2024-09-17T01:42:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc96ffd640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00e970 tx=0x7fbc8c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c00cac0 con 0x7fbc98101a60 2024-09-17T01:42:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc8c0054e0 con 0x7fbc98101a60 2024-09-17T01:42:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9819cb20 con 0x7fbc98101a60 2024-09-17T01:42:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9819d0b0 con 0x7fbc98101a60 2024-09-17T01:42:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.035+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc8c010430 con 0x7fbc98101a60 2024-09-17T01:42:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.037+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc98100c60 con 0x7fbc98101a60 2024-09-17T01:42:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.038+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fbc8c0105d0 con 0x7fbc98101a60 2024-09-17T01:42:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.038+0000 7fbc94ff9640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 0x7fbc80076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.038+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fbc8c096a50 con 0x7fbc98101a60 2024-09-17T01:42:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.040+0000 7fbc977fe640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 0x7fbc80076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.040+0000 7fbc977fe640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 0x7fbc80076f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000c00 tx=0x7fbc88005a20 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.046+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbc8c062f50 con 0x7fbc98101a60 2024-09-17T01:42:07.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.321+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbc9806a420 con 0x7fbc80074ad0 2024-09-17T01:42:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.322+0000 7fbc94ff9640 1 -- 172.21.15.82:0/2864891264 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7fbc9806a420 con 0x7fbc80074ad0 2024-09-17T01:42:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 msgr2=0x7fbc80076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 0x7fbc80076f90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc88000c00 tx=0x7fbc88005a20 comp rx=0 tx=0).stop 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 msgr2=0x7fbc98197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00e970 tx=0x7fbc8c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 shutdown_connections 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fbc80074ad0 0x7fbc80076f90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc98101a60 0x7fbc98197a60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 --2- 172.21.15.82:0/2864891264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc98100860 0x7fbc98197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 >> 172.21.15.82:0/2864891264 conn(0x7fbc980fc010 msgr2=0x7fbc98069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 shutdown_connections 2024-09-17T01:42:07.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.324+0000 7fbc9e021640 1 -- 172.21.15.82:0/2864891264 wait complete. 2024-09-17T01:42:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 -- 172.21.15.82:0/4159970495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441023f0 msgr2=0x7f73441047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 --2- 172.21.15.82:0/4159970495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441023f0 0x7f73441047e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f73340098b0 tx=0x7f733402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 -- 172.21.15.82:0/4159970495 shutdown_connections 2024-09-17T01:42:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 --2- 172.21.15.82:0/4159970495 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7344104d20 0x7f7344107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 --2- 172.21.15.82:0/4159970495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73441023f0 0x7f73441047e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 -- 172.21.15.82:0/4159970495 >> 172.21.15.82:0/4159970495 conn(0x7f73440fc010 msgr2=0x7f73440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 -- 172.21.15.82:0/4159970495 shutdown_connections 2024-09-17T01:42:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.413+0000 7f734a3fc640 1 -- 172.21.15.82:0/4159970495 wait complete. 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 Processor -- start 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 -- start start 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 0x7f7344197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f734410a7e0 con 0x7f7344104d20 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f734a3fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f734410a660 con 0x7f73441023f0 2024-09-17T01:42:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f73437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f73437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47026/0 (socket says 172.21.15.82:47026) 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f73437fe640 1 -- 172.21.15.82:0/2376452031 learned_addr learned my addr 172.21.15.82:0/2376452031 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.414+0000 7f7343fff640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 0x7f7344197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73437fe640 1 -- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 msgr2=0x7f7344197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73437fe640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 0x7f7344197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73437fe640 1 -- 172.21.15.82:0/2376452031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73441980c0 con 0x7f7344104d20 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f7343fff640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 0x7f7344197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73437fe640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f733800e970 tx=0x7f733800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f733800cac0 con 0x7f7344104d20 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734419cb00 con 0x7f7344104d20 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73380054e0 con 0x7f7344104d20 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734419d090 con 0x7f7344104d20 2024-09-17T01:42:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.415+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7338010430 con 0x7f7344104d20 2024-09-17T01:42:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.416+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73300052c0 con 0x7f7344104d20 2024-09-17T01:42:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.417+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f733800cc60 con 0x7f7344104d20 2024-09-17T01:42:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.417+0000 7f73417fa640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 0x7f732c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.418+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f73380968e0 con 0x7f7344104d20 2024-09-17T01:42:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.418+0000 7f7343fff640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 0x7f732c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.418+0000 7f7343fff640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 0x7f732c076ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7334006010 tx=0x7f73340058d0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.422+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f7338061e70 con 0x7f7344104d20 2024-09-17T01:42:07.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.734+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7330000bf0 con 0x7f732c074a30 2024-09-17T01:42:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.744+0000 7f73417fa640 1 -- 172.21.15.82:0/2376452031 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7330000bf0 con 0x7f732c074a30 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (7m) 60s ago 8m 24.8M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 starting - - - - 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (8m) 61s ago 7m 5268k - 19.1.1-330-gc2ddf972 ebb0615149de e36c14e444a6 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 60s ago 8m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (7m) 61s ago 7m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (7m) 60s ago 8m 78.7M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (3m) 60s ago 3m 174M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (3m) 60s ago 3m 184M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:42:07.743 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (3m) 61s ago 3m 23.2M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (3m) 61s ago 3m 21.7M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:9283,8765,8443 running (9m) 60s ago 9m 244M - 19.1.1-330-gc2ddf972 ebb0615149de cbbffbd558c2 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (80s) 61s ago 7m 561M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 930ab8ac2a03 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (9m) 60s ago 10m 53.3M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (7m) 61s ago 7m 42.5M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (8m) 60s ago 8m 15.4M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (7m) 61s ago 7m 16.2M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 60s ago 6m 90.4M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 60s ago 6m 98.5M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 60s ago 5m 78.1M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (5m) 61s ago 5m 103M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (4m) 61s ago 4m 87.8M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (4m) 61s ago 4m 79.6M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:42:07.744 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 starting - - - - 2024-09-17T01:42:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 msgr2=0x7f732c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 0x7f732c076ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7334006010 tx=0x7f73340058d0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 msgr2=0x7f7344197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f733800e970 tx=0x7f733800ee30 comp rx=0 tx=0).stop 2024-09-17T01:42:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 shutdown_connections 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f732c074a30 0x7f732c076ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7344104d20 0x7f7344197a40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 --2- 172.21.15.82:0/2376452031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73441023f0 0x7f7344197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 >> 172.21.15.82:0/2376452031 conn(0x7f73440fc010 msgr2=0x7f73440fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 shutdown_connections 2024-09-17T01:42:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.746+0000 7f734a3fc640 1 -- 172.21.15.82:0/2376452031 wait complete. 2024-09-17T01:42:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 -- 172.21.15.82:0/1838420833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 msgr2=0x7ff740102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 --2- 172.21.15.82:0/1838420833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff740102fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff730009880 tx=0x7ff73002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 -- 172.21.15.82:0/1838420833 shutdown_connections 2024-09-17T01:42:07.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 --2- 172.21.15.82:0/1838420833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff740102fe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 --2- 172.21.15.82:0/1838420833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 0x7ff740101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 -- 172.21.15.82:0/1838420833 >> 172.21.15.82:0/1838420833 conn(0x7ff7400fd0f0 msgr2=0x7ff7400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:07.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 -- 172.21.15.82:0/1838420833 shutdown_connections 2024-09-17T01:42:07.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.833+0000 7ff748362640 1 -- 172.21.15.82:0/1838420833 wait complete. 2024-09-17T01:42:07.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 Processor -- start 2024-09-17T01:42:07.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 -- start start 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 0x7ff740197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff74010a7a0 con 0x7ff740102b60 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff748362640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff74010a620 con 0x7ff740101960 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff7458fd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff7458fd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47056/0 (socket says 172.21.15.82:47056) 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff7458fd640 1 -- 172.21.15.82:0/629155059 learned_addr learned my addr 172.21.15.82:0/629155059 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.834+0000 7ff7460fe640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 0x7ff740197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7458fd640 1 -- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 msgr2=0x7ff740197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7458fd640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 0x7ff740197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7458fd640 1 -- 172.21.15.82:0/629155059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff740198050 con 0x7ff740102b60 2024-09-17T01:42:07.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7458fd640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff730009230 tx=0x7ff7300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73003f070 con 0x7ff740102b60 2024-09-17T01:42:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff730004b80 con 0x7ff740102b60 2024-09-17T01:42:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff730035030 con 0x7ff740102b60 2024-09-17T01:42:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74019ca30 con 0x7ff740102b60 2024-09-17T01:42:07.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.835+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74019cfc0 con 0x7ff740102b60 2024-09-17T01:42:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.836+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff740101d60 con 0x7ff740102b60 2024-09-17T01:42:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.837+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff730042070 con 0x7ff740102b60 2024-09-17T01:42:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.838+0000 7ff7377fe640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 0x7ff72c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.838+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7ff7300b6df0 con 0x7ff740102b60 2024-09-17T01:42:07.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.838+0000 7ff7460fe640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 0x7ff72c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:07.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.839+0000 7ff7460fe640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 0x7ff72c076f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff73c005fd0 tx=0x7ff73c00b390 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:07.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:07.843+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ff730082400 con 0x7ff740102b60 2024-09-17T01:42:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.214+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff740062df0 con 0x7ff740102b60 2024-09-17T01:42:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.214+0000 7ff7377fe640 1 -- 172.21.15.82:0/629155059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7ff7300872b0 con 0x7ff740102b60 2024-09-17T01:42:08.213 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:42:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:42:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 13, 2024-09-17T01:42:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:42:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:42:08.215 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 msgr2=0x7ff72c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 0x7ff72c076f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff73c005fd0 tx=0x7ff73c00b390 comp rx=0 tx=0).stop 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 msgr2=0x7ff7401979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff730009230 tx=0x7ff7300046c0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 shutdown_connections 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff72c074a80 0x7ff72c076f40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff740102b60 0x7ff7401979d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 --2- 172.21.15.82:0/629155059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff740101960 0x7ff740197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 >> 172.21.15.82:0/629155059 conn(0x7ff7400fd0f0 msgr2=0x7ff740106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 shutdown_connections 2024-09-17T01:42:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.217+0000 7ff748362640 1 -- 172.21.15.82:0/629155059 wait complete. 2024-09-17T01:42:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.302+0000 7fe05ed72640 1 -- 172.21.15.82:0/2790970835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 msgr2=0x7fe058101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.302+0000 7fe05ed72640 1 --2- 172.21.15.82:0/2790970835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe058101ee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe044009880 tx=0x7fe04402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:08 smithi082 ceph-mon[28077]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 34 MiB/s rd, 82 MiB/s wr, 315 op/s 2024-09-17T01:42:08.302 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:08 smithi082 ceph-mon[28077]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 -- 172.21.15.82:0/2790970835 shutdown_connections 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 --2- 172.21.15.82:0/2790970835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe058101ee0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 --2- 172.21.15.82:0/2790970835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe058100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 -- 172.21.15.82:0/2790970835 >> 172.21.15.82:0/2790970835 conn(0x7fe0580fc010 msgr2=0x7fe0580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 -- 172.21.15.82:0/2790970835 shutdown_connections 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 -- 172.21.15.82:0/2790970835 wait complete. 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.303+0000 7fe05ed72640 1 Processor -- start 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05ed72640 1 -- start start 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05ed72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05ed72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe05819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05ed72640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581096a0 con 0x7fe058101a60 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05ed72640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe058109520 con 0x7fe058100860 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe057fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe05819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:08.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05cb0e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05cb0e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.304+0000 7fe05cb0e640 1 -- 172.21.15.82:0/3089458901 learned_addr learned my addr 172.21.15.82:0/3089458901 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe05cb0e640 1 -- 172.21.15.82:0/3089458901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 msgr2=0x7fe05819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe05cb0e640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe05819c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe05cb0e640 1 -- 172.21.15.82:0/3089458901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05819c7f0 con 0x7fe058100860 2024-09-17T01:42:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe05cb0e640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009f00 tx=0x7fe04c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04c00cac0 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe04c00cc60 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe058196030 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.305+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04c003820 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.306+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe058196590 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.307+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fe04c005020 con 0x7fe058100860 2024-09-17T01:42:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.307+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe058100c60 con 0x7fe058100860 2024-09-17T01:42:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.308+0000 7fe055ffb640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 0x7fe048076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.308+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fe04c09ac80 con 0x7fe058100860 2024-09-17T01:42:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.308+0000 7fe057fff640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 0x7fe048076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.309+0000 7fe057fff640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 0x7fe048076f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe0440058d0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.313+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe04c066310 con 0x7fe058100860 2024-09-17T01:42:08.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:08 smithi167 ceph-mon[35643]: pgmap v37: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 34 MiB/s rd, 82 MiB/s wr, 315 op/s 2024-09-17T01:42:08.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:08 smithi167 ceph-mon[35643]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:08.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.603+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe05802d7c0 con 0x7fe058100860 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.604+0000 7fe055ffb640 1 -- 172.21.15.82:0/3089458901 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7fe04c06b1c0 con 0x7fe058100860 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:08.603 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:42:08.604 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:42:08.605 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 msgr2=0x7fe048076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 0x7fe048076f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe044000c00 tx=0x7fe0440058d0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 msgr2=0x7fe05806a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009f00 tx=0x7fe04c00ed10 comp rx=0 tx=0).stop 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 shutdown_connections 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe048074a80 0x7fe048076f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe058101a60 0x7fe05819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 --2- 172.21.15.82:0/3089458901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe058100860 0x7fe05806a7d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 >> 172.21.15.82:0/3089458901 conn(0x7fe0580fc010 msgr2=0x7fe058104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 shutdown_connections 2024-09-17T01:42:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.607+0000 7fe05ed72640 1 -- 172.21.15.82:0/3089458901 wait complete. 2024-09-17T01:42:08.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.727+0000 7ffa01d10640 1 -- 172.21.15.82:0/3507468475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc0fffe0 msgr2=0x7ff9fc1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.727+0000 7ffa01d10640 1 --2- 172.21.15.82:0/3507468475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc1003e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009880 tx=0x7ff9f002a4b0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.727+0000 7ffa01d10640 1 -- 172.21.15.82:0/3507468475 shutdown_connections 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.727+0000 7ffa01d10640 1 --2- 172.21.15.82:0/3507468475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc1011e0 0x7ff9fc101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.727+0000 7ffa01d10640 1 --2- 172.21.15.82:0/3507468475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc1003e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.728+0000 7ffa01d10640 1 -- 172.21.15.82:0/3507468475 >> 172.21.15.82:0/3507468475 conn(0x7ff9fc0fb770 msgr2=0x7ff9fc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.728+0000 7ffa01d10640 1 -- 172.21.15.82:0/3507468475 shutdown_connections 2024-09-17T01:42:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.728+0000 7ffa01d10640 1 -- 172.21.15.82:0/3507468475 wait complete. 2024-09-17T01:42:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.729+0000 7ffa01d10640 1 Processor -- start 2024-09-17T01:42:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.730+0000 7ffa01d10640 1 -- start start 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ffa01d10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ffa01d10640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc1011e0 0x7ff9fc19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ffa01d10640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc108570 con 0x7ff9fc1011e0 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ffa01d10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc1083f0 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ff9fb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ff9fb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:48714/0 (socket says 172.21.15.82:48714) 2024-09-17T01:42:08.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ff9fb7fe640 1 -- 172.21.15.82:0/1304950470 learned_addr learned my addr 172.21.15.82:0/1304950470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ff9fb7fe640 1 -- 172.21.15.82:0/1304950470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc1011e0 msgr2=0x7ff9fc19e040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:42:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.731+0000 7ff9fb7fe640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc1011e0 0x7ff9fc19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.732+0000 7ff9fb7fe640 1 -- 172.21.15.82:0/1304950470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc19e6c0 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.732+0000 7ff9fb7fe640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aa20 tx=0x7ff9f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.732+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9f003f070 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.732+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9f0004b00 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.732+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc1a30a0 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.733+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9f0035030 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.733+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc1a3630 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.735+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9fc1003e0 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.735+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff9f0042070 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.736+0000 7ff9f8ff9640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 0x7ff9e4076d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:08.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.736+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7ff9f00b6a10 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.737+0000 7ff9faffd640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 0x7ff9e4076d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:08.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.738+0000 7ff9faffd640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 0x7ff9e4076d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005fd0 tx=0x7ff9ec005850 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:08.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.744+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7ff9f0082000 con 0x7ff9fc0fffe0 2024-09-17T01:42:08.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.989+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff9fc062630 con 0x7ff9e40748b0 2024-09-17T01:42:08.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.990+0000 7ff9f8ff9640 1 -- 172.21.15.82:0/1304950470 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+318 (secure 0 0 0) 0x7ff9fc062630 con 0x7ff9e40748b0 2024-09-17T01:42:08.989 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:42:08.989 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:42:08.989 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:42:08.989 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:42:08.990 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:42:08.990 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "1/23 daemons upgraded", 2024-09-17T01:42:08.990 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-09-17T01:42:08.990 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:42:08.990 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:42:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 msgr2=0x7ff9e4076d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 0x7ff9e4076d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005fd0 tx=0x7ff9ec005850 comp rx=0 tx=0).stop 2024-09-17T01:42:08.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 msgr2=0x7ff9fc19db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9f002aa20 tx=0x7ff9f00046c0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 shutdown_connections 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7ff9e40748b0 0x7ff9e4076d70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9fc1011e0 0x7ff9fc19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 --2- 172.21.15.82:0/1304950470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9fc0fffe0 0x7ff9fc19db00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.992+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 >> 172.21.15.82:0/1304950470 conn(0x7ff9fc0fb770 msgr2=0x7ff9fc1048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.993+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 shutdown_connections 2024-09-17T01:42:08.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:08.993+0000 7ffa01d10640 1 -- 172.21.15.82:0/1304950470 wait complete. 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 -- 172.21.15.82:0/1163857708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 msgr2=0x7f9d58100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/1163857708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58100c60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009880 tx=0x7f9d4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 -- 172.21.15.82:0/1163857708 shutdown_connections 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/1163857708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 0x7f9d58101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/1163857708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58100c60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 -- 172.21.15.82:0/1163857708 >> 172.21.15.82:0/1163857708 conn(0x7f9d580fc010 msgr2=0x7f9d580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 -- 172.21.15.82:0/1163857708 shutdown_connections 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.090+0000 7f9d5f04b640 1 -- 172.21.15.82:0/1163857708 wait complete. 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 Processor -- start 2024-09-17T01:42:09.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 -- start start 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 0x7f9d58102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58109680 con 0x7f9d58100860 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5f04b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58109500 con 0x7f9d58101a60 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5cde7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5cde7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47114/0 (socket says 172.21.15.82:47114) 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d5cde7640 1 -- 172.21.15.82:0/2086451109 learned_addr learned my addr 172.21.15.82:0/2086451109 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.091+0000 7f9d57fff640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 0x7f9d58102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5cde7640 1 -- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 msgr2=0x7f9d58102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:09.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5cde7640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 0x7f9d58102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5cde7640 1 -- 172.21.15.82:0/2086451109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d58103380 con 0x7f9d58100860 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5cde7640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006010 tx=0x7f9d4c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c03f070 con 0x7f9d58100860 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d4c0049d0 con 0x7f9d58100860 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d58103610 con 0x7f9d58100860 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d4c035030 con 0x7f9d58100860 2024-09-17T01:42:09.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.092+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d58103a80 con 0x7f9d58100860 2024-09-17T01:42:09.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.094+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d58100c60 con 0x7f9d58100860 2024-09-17T01:42:09.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.094+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9d4c042070 con 0x7f9d58100860 2024-09-17T01:42:09.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.094+0000 7f9d55ffb640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 0x7f9d48076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:09.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.095+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f9d4c0b6d20 con 0x7f9d58100860 2024-09-17T01:42:09.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.095+0000 7f9d57fff640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 0x7f9d48076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:09.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.095+0000 7f9d57fff640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 0x7f9d48076f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d58104500 tx=0x7f9d44005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.099+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f9d4c082330 con 0x7f9d58100860 2024-09-17T01:42:09.240 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:09 smithi167 ceph-mon[35643]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:09.240 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:09 smithi167 ceph-mon[35643]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:09.240 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:09 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/629155059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:42:09.240 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:09 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3089458901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:42:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:09 smithi082 ceph-mon[28077]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:09 smithi082 ceph-mon[28077]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/629155059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:42:09.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:09 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3089458901' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:42:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.466+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9d5819fa30 con 0x7f9d58100860 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.467+0000 7f9d55ffb640 1 -- 172.21.15.82:0/2086451109 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f9d4c0871e0 con 0x7f9d58100860 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:42:09.466 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:42:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 msgr2=0x7f9d48076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 0x7f9d48076f40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d58104500 tx=0x7f9d44005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 msgr2=0x7f9d58104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006010 tx=0x7f9d4c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 shutdown_connections 2024-09-17T01:42:09.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d58101a60 0x7f9d58102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f9d48074a80 0x7f9d48076f40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.469+0000 7f9d5f04b640 1 --2- 172.21.15.82:0/2086451109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d58100860 0x7f9d58104780 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:09.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.470+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 >> 172.21.15.82:0/2086451109 conn(0x7f9d580fc010 msgr2=0x7f9d58069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:09.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.470+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 shutdown_connections 2024-09-17T01:42:09.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:09.470+0000 7f9d5f04b640 1 -- 172.21.15.82:0/2086451109 wait complete. 2024-09-17T01:42:10.228 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:10 smithi167 ceph-mon[35643]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 16 MiB/s rd, 40 MiB/s wr, 182 op/s 2024-09-17T01:42:10.229 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:10 smithi167 ceph-mon[35643]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:10.229 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:10 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2086451109' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:42:10.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:10 smithi082 ceph-mon[28077]: pgmap v38: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 16 MiB/s rd, 40 MiB/s wr, 182 op/s 2024-09-17T01:42:10.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:10 smithi082 ceph-mon[28077]: from='client.24511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:10.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:10 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2086451109' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: Upgrade: Need to upgrade myself (mgr.smithi167.ysmbcy) 2024-09-17T01:42:11.650 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: Upgrade: Need to upgrade myself (mgr.smithi167.ysmbcy) 2024-09-17T01:42:11.651 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:11 smithi167 ceph-mon[35643]: pgmap v39: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 17 MiB/s rd, 41 MiB/s wr, 243 op/s 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:11.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: Upgrade: Need to upgrade myself (mgr.smithi167.ysmbcy) 2024-09-17T01:42:11.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: Upgrade: Need to upgrade myself (mgr.smithi167.ysmbcy) 2024-09-17T01:42:11.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:11 smithi082 ceph-mon[28077]: pgmap v39: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 17 MiB/s rd, 41 MiB/s wr, 243 op/s 2024-09-17T01:42:13.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: Upgrade: Updating mgr.smithi082.oppacm 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:12 smithi167 ceph-mon[35643]: Deploying daemon mgr.smithi082.oppacm on smithi082 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: Upgrade: Updating mgr.smithi082.oppacm 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi082.oppacm", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:12 smithi082 ceph-mon[28077]: Deploying daemon mgr.smithi082.oppacm on smithi082 2024-09-17T01:42:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:13 smithi082 ceph-mon[28077]: pgmap v40: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 129 op/s 2024-09-17T01:42:14.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:13 smithi167 ceph-mon[35643]: pgmap v40: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 129 op/s 2024-09-17T01:42:14.916 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:14 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:15.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:14 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:15 smithi082 ceph-mon[28077]: pgmap v41: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 129 op/s 2024-09-17T01:42:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:15 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:15 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:15 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:16.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:15 smithi167 ceph-mon[35643]: pgmap v41: 65 pgs: 65 active+clean; 1.7 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 129 op/s 2024-09-17T01:42:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:15 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:15 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:15 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:18.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:17 smithi082 ceph-mon[28077]: pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 3.9 MiB/s rd, 8.2 MiB/s wr, 183 op/s 2024-09-17T01:42:18.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:17 smithi167 ceph-mon[35643]: pgmap v42: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 3.9 MiB/s rd, 8.2 MiB/s wr, 183 op/s 2024-09-17T01:42:20.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:19 smithi082 ceph-mon[28077]: pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2024-09-17T01:42:20.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:19 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:20.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:19 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:20.251 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:19 smithi167 ceph-mon[35643]: pgmap v43: 65 pgs: 65 active+clean; 1.2 GiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2024-09-17T01:42:20.251 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:19 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:20.251 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:19 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:21.776 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T01:42:21.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T01:42:22.207 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:21 smithi167 ceph-mon[35643]: pgmap v44: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 171 op/s 2024-09-17T01:42:22.213 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:21 smithi082 ceph-mon[28077]: pgmap v44: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 171 op/s 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: Standby manager daemon smithi082.oppacm restarted 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: Standby manager daemon smithi082.oppacm started 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/crt"}]: dispatch 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/key"}]: dispatch 2024-09-17T01:42:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:22 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:42:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: Standby manager daemon smithi082.oppacm restarted 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: Standby manager daemon smithi082.oppacm started 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/crt"}]: dispatch 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi082.oppacm/key"}]: dispatch 2024-09-17T01:42:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:22 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:42:24.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:23 smithi167 ceph-mon[35643]: pgmap v45: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-17T01:42:24.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:23 smithi167 ceph-mon[35643]: mgrmap e26: smithi167.ysmbcy(active, since 85s), standbys: smithi082.oppacm 2024-09-17T01:42:24.421 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:23 smithi082 ceph-mon[28077]: pgmap v45: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-17T01:42:24.422 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:23 smithi082 ceph-mon[28077]: mgrmap e26: smithi167.ysmbcy(active, since 85s), standbys: smithi082.oppacm 2024-09-17T01:42:26.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:25 smithi167 ceph-mon[35643]: pgmap v46: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-17T01:42:26.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:25 smithi082 ceph-mon[28077]: pgmap v46: 65 pgs: 65 active+clean; 674 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-17T01:42:28.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:27 smithi167 ceph-mon[35643]: pgmap v47: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-17T01:42:28.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:27 smithi082 ceph-mon[28077]: pgmap v47: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-17T01:42:30.251 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:29 smithi167 ceph-mon[35643]: pgmap v48: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-17T01:42:30.251 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:29 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:30.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:29 smithi082 ceph-mon[28077]: pgmap v48: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 107 op/s 2024-09-17T01:42:30.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:29 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:32.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:31 smithi167 ceph-mon[35643]: pgmap v49: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-17T01:42:32.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:31 smithi167 ceph-mon[35643]: mgrmap e27: smithi167.ysmbcy(active, since 92s), standbys: smithi082.oppacm 2024-09-17T01:42:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:31 smithi082 ceph-mon[28077]: pgmap v49: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 152 op/s 2024-09-17T01:42:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:31 smithi082 ceph-mon[28077]: mgrmap e27: smithi167.ysmbcy(active, since 92s), standbys: smithi082.oppacm 2024-09-17T01:42:34.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:33 smithi167 ceph-mon[35643]: pgmap v50: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-17T01:42:34.389 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:33 smithi082 ceph-mon[28077]: pgmap v50: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-17T01:42:36.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:36 smithi167 ceph-mon[35643]: pgmap v51: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-17T01:42:36.463 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:36 smithi082 ceph-mon[28077]: pgmap v51: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-17T01:42:38.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:38 smithi167 ceph-mon[35643]: pgmap v52: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 139 op/s 2024-09-17T01:42:38.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:38 smithi082 ceph-mon[28077]: pgmap v52: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 139 op/s 2024-09-17T01:42:39.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 -- 172.21.15.82:0/476736704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8581023f0 msgr2=0x7fe8581047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 --2- 172.21.15.82:0/476736704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8581023f0 0x7fe8581047e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8540098b0 tx=0x7fe85402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 -- 172.21.15.82:0/476736704 shutdown_connections 2024-09-17T01:42:39.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 --2- 172.21.15.82:0/476736704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe858104d20 0x7fe858107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 --2- 172.21.15.82:0/476736704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8581023f0 0x7fe8581047e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 -- 172.21.15.82:0/476736704 >> 172.21.15.82:0/476736704 conn(0x7fe8580fc010 msgr2=0x7fe8580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 -- 172.21.15.82:0/476736704 shutdown_connections 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.564+0000 7fe8607d0640 1 -- 172.21.15.82:0/476736704 wait complete. 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 Processor -- start 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 -- start start 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 0x7fe858199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe85810a7e0 con 0x7fe858104d20 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe8607d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe85810a660 con 0x7fe8581023f0 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44128/0 (socket says 172.21.15.82:44128) 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 -- 172.21.15.82:0/2779888070 learned_addr learned my addr 172.21.15.82:0/2779888070 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:39.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85e56c640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 0x7fe858199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 -- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 msgr2=0x7fe858199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 0x7fe858199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85dd6b640 1 -- 172.21.15.82:0/2779888070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85819a2c0 con 0x7fe858104d20 2024-09-17T01:42:39.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.565+0000 7fe85e56c640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 0x7fe858199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe85dd6b640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe84800d6c0 tx=0x7fe84800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe848017070 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8480054e0 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85819ed00 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe848004b70 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.566+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85819f1d0 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.567+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8581027d0 con 0x7fe858104d20 2024-09-17T01:42:39.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.568+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7fe848010460 con 0x7fe858104d20 2024-09-17T01:42:39.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.569+0000 7fe84f7fe640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 0x7fe84407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.569+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7fe84809da00 con 0x7fe858104d20 2024-09-17T01:42:39.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.570+0000 7fe85e56c640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 0x7fe84407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.570+0000 7fe85e56c640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 0x7fe84407d440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe854000c00 tx=0x7fe854005a20 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.574+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fe848069230 con 0x7fe858104d20 2024-09-17T01:42:39.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.799+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe858062630 con 0x7fe84407af80 2024-09-17T01:42:39.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.801+0000 7fe84f7fe640 1 -- 172.21.15.82:0/2779888070 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fe858062630 con 0x7fe84407af80 2024-09-17T01:42:39.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.803+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 msgr2=0x7fe84407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.803+0000 7fe8607d0640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 0x7fe84407d440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe854000c00 tx=0x7fe854005a20 comp rx=0 tx=0).stop 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.803+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 msgr2=0x7fe858199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.803+0000 7fe8607d0640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe84800d6c0 tx=0x7fe84800db80 comp rx=0 tx=0).stop 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 shutdown_connections 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7fe84407af80 0x7fe84407d440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe858104d20 0x7fe858199c40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 --2- 172.21.15.82:0/2779888070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8581023f0 0x7fe858199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 >> 172.21.15.82:0/2779888070 conn(0x7fe8580fc010 msgr2=0x7fe858101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 shutdown_connections 2024-09-17T01:42:39.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.804+0000 7fe8607d0640 1 -- 172.21.15.82:0/2779888070 wait complete. 2024-09-17T01:42:39.810 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:42:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 -- 172.21.15.82:0/960642311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8100b30 msgr2=0x7f96e8100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 --2- 172.21.15.82:0/960642311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8100b30 0x7f96e8100fb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009880 tx=0x7f96dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 -- 172.21.15.82:0/960642311 shutdown_connections 2024-09-17T01:42:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 --2- 172.21.15.82:0/960642311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8100b30 0x7f96e8100fb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 --2- 172.21.15.82:0/960642311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101df0 0x7f96e81021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 -- 172.21.15.82:0/960642311 >> 172.21.15.82:0/960642311 conn(0x7f96e80fb770 msgr2=0x7f96e80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 -- 172.21.15.82:0/960642311 shutdown_connections 2024-09-17T01:42:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.901+0000 7f96ed95f640 1 -- 172.21.15.82:0/960642311 wait complete. 2024-09-17T01:42:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 Processor -- start 2024-09-17T01:42:39.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 -- start start 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8100b30 0x7f96e81952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8108590 con 0x7f96e8101df0 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.902+0000 7f96ed95f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8108410 con 0x7f96e8100b30 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44158/0 (socket says 172.21.15.82:44158) 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 -- 172.21.15.82:0/3400017405 learned_addr learned my addr 172.21.15.82:0/3400017405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:39.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e6ffd640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8100b30 0x7f96e81952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 -- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8100b30 msgr2=0x7f96e81952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8100b30 0x7f96e81952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 -- 172.21.15.82:0/3400017405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e8195e80 con 0x7f96e8101df0 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.903+0000 7f96e67fc640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006010 tx=0x7f96dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.904+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96dc03f070 con 0x7f96e8101df0 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.904+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e819a860 con 0x7f96e8101df0 2024-09-17T01:42:39.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.904+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e819adf0 con 0x7f96e8101df0 2024-09-17T01:42:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.904+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96dc0044d0 con 0x7f96e8101df0 2024-09-17T01:42:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.904+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f96dc035030 con 0x7f96e8101df0 2024-09-17T01:42:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.905+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d40052c0 con 0x7f96e8101df0 2024-09-17T01:42:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.906+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f96dc042070 con 0x7f96e8101df0 2024-09-17T01:42:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.906+0000 7f96ec95d640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 0x7f96d007f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.907+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f96dc0bea00 con 0x7f96e8101df0 2024-09-17T01:42:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.907+0000 7f96e6ffd640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 0x7f96d007f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:39.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.907+0000 7f96e6ffd640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 0x7f96d007f660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d80058c0 tx=0x7f96d800a2d0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:39.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:39.911+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f96dc08a230 con 0x7f96e8101df0 2024-09-17T01:42:40.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:40 smithi082 ceph-mon[28077]: pgmap v53: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 86 op/s 2024-09-17T01:42:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.252+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f96d4000bf0 con 0x7f96d007d1a0 2024-09-17T01:42:40.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.254+0000 7f96ec95d640 1 -- 172.21.15.82:0/3400017405 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f96d4000bf0 con 0x7f96d007d1a0 2024-09-17T01:42:40.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:40 smithi167 ceph-mon[35643]: pgmap v53: 65 pgs: 65 active+clean; 295 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 86 op/s 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 msgr2=0x7f96d007f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 0x7f96d007f660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f96d80058c0 tx=0x7f96d800a2d0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 msgr2=0x7f96e8195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006010 tx=0x7f96dc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 shutdown_connections 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f96d007d1a0 0x7f96d007f660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96e8101df0 0x7f96e8195800 secure :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f96dc006010 tx=0x7f96dc0048f0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 --2- 172.21.15.82:0/3400017405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8100b30 0x7f96e81952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 >> 172.21.15.82:0/3400017405 conn(0x7f96e80fb770 msgr2=0x7f96e81050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 shutdown_connections 2024-09-17T01:42:40.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.258+0000 7f96ed95f640 1 -- 172.21.15.82:0/3400017405 wait complete. 2024-09-17T01:42:40.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 -- 172.21.15.82:0/3734976073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 msgr2=0x7f4fd8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 --2- 172.21.15.82:0/3734976073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd8100c60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009880 tx=0x7f4fcc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 -- 172.21.15.82:0/3734976073 shutdown_connections 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 --2- 172.21.15.82:0/3734976073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 --2- 172.21.15.82:0/3734976073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd8100c60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 -- 172.21.15.82:0/3734976073 >> 172.21.15.82:0/3734976073 conn(0x7f4fd80fc010 msgr2=0x7f4fd80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 -- 172.21.15.82:0/3734976073 shutdown_connections 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.395+0000 7f4fdebea640 1 -- 172.21.15.82:0/3734976073 wait complete. 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 Processor -- start 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 -- start start 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdc986640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8109690 con 0x7f4fd8100860 2024-09-17T01:42:40.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.396+0000 7f4fdebea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8109510 con 0x7f4fd8101a60 2024-09-17T01:42:40.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44184/0 (socket says 172.21.15.82:44184) 2024-09-17T01:42:40.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 -- 172.21.15.82:0/4214739624 learned_addr learned my addr 172.21.15.82:0/4214739624 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:40.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fd7fff640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 -- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 msgr2=0x7f4fd8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 -- 172.21.15.82:0/4214739624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd8198080 con 0x7f4fd8100860 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fd7fff640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdc986640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fcc03f070 con 0x7f4fd8100860 2024-09-17T01:42:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fcc0049d0 con 0x7f4fd8100860 2024-09-17T01:42:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.397+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd819ca60 con 0x7f4fd8100860 2024-09-17T01:42:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.398+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fcc035030 con 0x7f4fd8100860 2024-09-17T01:42:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.398+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd819cff0 con 0x7f4fd8100860 2024-09-17T01:42:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.399+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd8100c60 con 0x7f4fd8100860 2024-09-17T01:42:40.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.400+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f4fcc042070 con 0x7f4fd8100860 2024-09-17T01:42:40.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.401+0000 7f4fd5ffb640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 0x7f4fc807d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.401+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f4fcc0be8f0 con 0x7f4fd8100860 2024-09-17T01:42:40.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.401+0000 7f4fd7fff640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 0x7f4fc807d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.402+0000 7f4fd7fff640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 0x7f4fc807d490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8198970 tx=0x7f4fc4005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.406+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f4fcc08a080 con 0x7f4fd8100860 2024-09-17T01:42:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.633+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4fd8062630 con 0x7f4fc807afd0 2024-09-17T01:42:40.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.644+0000 7f4fd5ffb640 1 -- 172.21.15.82:0/4214739624 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4fd8062630 con 0x7f4fc807afd0 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (7m) 18s ago 9m 24.5M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (63s) 18s ago 9m 8488k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (30s) 21s ago 8m 7734k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (9m) 18s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (8m) 21s ago 8m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (7m) 18s ago 9m 80.7M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (3m) 18s ago 3m 244M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (3m) 18s ago 3m 279M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (3m) 21s ago 3m 27.5M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (3m) 21s ago 3m 25.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (25s) 18s ago 10m 130M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:42:40.642 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (113s) 21s ago 8m 578M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 930ab8ac2a03 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (10m) 18s ago 10m 53.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (8m) 21s ago 8m 40.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (9m) 18s ago 9m 15.3M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (8m) 21s ago 8m 16.2M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 18s ago 7m 184M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 18s ago 6m 194M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 18s ago 6m 150M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (5m) 21s ago 5m 204M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (5m) 21s ago 5m 186M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (4m) 21s ago 4m 165M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:42:40.643 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (36s) 18s ago 8m 42.9M - 2.43.0 a07b618ecd1d 4e4bc234a0cb 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 msgr2=0x7f4fc807d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 0x7f4fc807d490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8198970 tx=0x7f4fc4005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 msgr2=0x7f4fd81974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 shutdown_connections 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd8101a60 0x7f4fd8197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f4fc807afd0 0x7f4fc807d490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 --2- 172.21.15.82:0/4214739624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8100860 0x7f4fd81974c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 >> 172.21.15.82:0/4214739624 conn(0x7f4fd80fc010 msgr2=0x7f4fd80fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 shutdown_connections 2024-09-17T01:42:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.646+0000 7f4fdebea640 1 -- 172.21.15.82:0/4214739624 wait complete. 2024-09-17T01:42:40.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 -- 172.21.15.82:0/3326598693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 msgr2=0x7f9268100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 --2- 172.21.15.82:0/3326598693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f9268100640 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9264009880 tx=0x7f926402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 -- 172.21.15.82:0/3326598693 shutdown_connections 2024-09-17T01:42:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 --2- 172.21.15.82:0/3326598693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 0x7f9268100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 --2- 172.21.15.82:0/3326598693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f9268100640 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 -- 172.21.15.82:0/3326598693 >> 172.21.15.82:0/3326598693 conn(0x7f92680fc010 msgr2=0x7f92680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 -- 172.21.15.82:0/3326598693 shutdown_connections 2024-09-17T01:42:40.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.737+0000 7f926faa1640 1 -- 172.21.15.82:0/3326598693 wait complete. 2024-09-17T01:42:40.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 Processor -- start 2024-09-17T01:42:40.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 -- start start 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 0x7f9268199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f926810c990 con 0x7f9268100240 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926faa1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f926810c810 con 0x7f9268100b80 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926d83d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926d83d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44192/0 (socket says 172.21.15.82:44192) 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.738+0000 7f926d83d640 1 -- 172.21.15.82:0/4232744955 learned_addr learned my addr 172.21.15.82:0/4232744955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926d03c640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 0x7f9268199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926d83d640 1 -- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 msgr2=0x7f9268199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926d83d640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 0x7f9268199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926d83d640 1 -- 172.21.15.82:0/4232744955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926819a290 con 0x7f9268100240 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926d83d640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9264006010 tx=0x7f9264004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f926403f070 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926819ec70 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92640049d0 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9264035030 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.739+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926819f1b0 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.741+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9268100640 con 0x7f9268100240 2024-09-17T01:42:40.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.741+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f9264042070 con 0x7f9268100240 2024-09-17T01:42:40.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.742+0000 7f925effd640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 0x7f925407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:40.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.742+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f92640bea30 con 0x7f9268100240 2024-09-17T01:42:40.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.742+0000 7f926d03c640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 0x7f925407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:40.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.743+0000 7f926d03c640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 0x7f925407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f926819ab80 tx=0x7f9258005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:40.746+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f926408a1e0 con 0x7f9268100240 2024-09-17T01:42:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.079+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f92681937a0 con 0x7f9268100240 2024-09-17T01:42:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.080+0000 7f925effd640 1 -- 172.21.15.82:0/4232744955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f926408f090 con 0x7f9268100240 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:42:41.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:42:41.080 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:42:41.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T01:42:41.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:42:41.080 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:42:41.080 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 msgr2=0x7f925407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 0x7f925407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f926819ab80 tx=0x7f9258005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 msgr2=0x7f92681996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9264006010 tx=0x7f9264004570 comp rx=0 tx=0).stop 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 shutdown_connections 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9268100b80 0x7f9268199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f925407af30 0x7f925407d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 --2- 172.21.15.82:0/4232744955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9268100240 0x7f92681996d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 >> 172.21.15.82:0/4232744955 conn(0x7f92680fc010 msgr2=0x7f9268108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 shutdown_connections 2024-09-17T01:42:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.082+0000 7f926faa1640 1 -- 172.21.15.82:0/4232744955 wait complete. 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 -- 172.21.15.82:0/2222329723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 msgr2=0x7f8fc410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 --2- 172.21.15.82:0/2222329723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc410c9a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009880 tx=0x7f8fb402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 -- 172.21.15.82:0/2222329723 shutdown_connections 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 --2- 172.21.15.82:0/2222329723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 0x7f8fc410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 --2- 172.21.15.82:0/2222329723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc410c9a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.192+0000 7f8fc966f640 1 -- 172.21.15.82:0/2222329723 >> 172.21.15.82:0/2222329723 conn(0x7f8fc406bdd0 msgr2=0x7f8fc406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.193+0000 7f8fc966f640 1 -- 172.21.15.82:0/2222329723 shutdown_connections 2024-09-17T01:42:41.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.193+0000 7f8fc966f640 1 -- 172.21.15.82:0/2222329723 wait complete. 2024-09-17T01:42:41.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.194+0000 7f8fc966f640 1 Processor -- start 2024-09-17T01:42:41.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.194+0000 7f8fc966f640 1 -- start start 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc966f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc966f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 0x7f8fc41a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44204/0 (socket says 172.21.15.82:44204) 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc2ffd640 1 -- 172.21.15.82:0/1701965485 learned_addr learned my addr 172.21.15.82:0/1701965485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc41150f0 con 0x7f8fc410c5a0 2024-09-17T01:42:41.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4114f70 con 0x7f8fc410d510 2024-09-17T01:42:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.195+0000 7f8fc27fc640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 0x7f8fc41a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.196+0000 7f8fc2ffd640 1 -- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 msgr2=0x7f8fc41a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.196+0000 7f8fc2ffd640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 0x7f8fc41a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.196+0000 7f8fc2ffd640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc41a2a90 con 0x7f8fc410c5a0 2024-09-17T01:42:41.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.196+0000 7f8fc2ffd640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009230 tx=0x7f8fb4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.197+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fb403f070 con 0x7f8fc410c5a0 2024-09-17T01:42:41.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.197+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8fb4004a90 con 0x7f8fc410c5a0 2024-09-17T01:42:41.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.197+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8fb4035030 con 0x7f8fc410c5a0 2024-09-17T01:42:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.197+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc41a7470 con 0x7f8fc410c5a0 2024-09-17T01:42:41.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.198+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc41a7a00 con 0x7f8fc410c5a0 2024-09-17T01:42:41.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.200+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc410c9a0 con 0x7f8fc410c5a0 2024-09-17T01:42:41.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.201+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f8fb4042070 con 0x7f8fc410c5a0 2024-09-17T01:42:41.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.202+0000 7f8fabfff640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 0x7f8fac07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.202+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f8fb40be8e0 con 0x7f8fc410c5a0 2024-09-17T01:42:41.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.203+0000 7f8fc27fc640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 0x7f8fac07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.204+0000 7f8fc27fc640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 0x7f8fac07d570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc41a3380 tx=0x7f8fb8005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.212+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f8fb408a0f0 con 0x7f8fc410c5a0 2024-09-17T01:42:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:41 smithi167 ceph-mon[35643]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:41 smithi167 ceph-mon[35643]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:41.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:41 smithi082 ceph-mon[28077]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:41.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:41 smithi082 ceph-mon[28077]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.519+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8fc419bf00 con 0x7f8fc410c5a0 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.520+0000 7f8fabfff640 1 -- 172.21.15.82:0/1701965485 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f8fb408efa0 con 0x7f8fc410c5a0 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:42:41.518 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:42:41.519 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:42:41.520 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:41.521 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:42:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:42:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 msgr2=0x7f8fac07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 0x7f8fac07d570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc41a3380 tx=0x7f8fb8005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 msgr2=0x7f8fc41a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009230 tx=0x7f8fb4004570 comp rx=0 tx=0).stop 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 shutdown_connections 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fc410d510 0x7f8fc41a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f8fac07b0b0 0x7f8fac07d570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 --2- 172.21.15.82:0/1701965485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fc410c5a0 0x7f8fc41a1ed0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 >> 172.21.15.82:0/1701965485 conn(0x7f8fc406bdd0 msgr2=0x7f8fc4110a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.522+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 shutdown_connections 2024-09-17T01:42:41.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.523+0000 7f8fc966f640 1 -- 172.21.15.82:0/1701965485 wait complete. 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 -- 172.21.15.82:0/1333476348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 msgr2=0x7f49241003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 --2- 172.21.15.82:0/1333476348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f49241003d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4914009880 tx=0x7f491402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 -- 172.21.15.82:0/1333476348 shutdown_connections 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 --2- 172.21.15.82:0/1333476348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 --2- 172.21.15.82:0/1333476348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f49241003d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 -- 172.21.15.82:0/1333476348 >> 172.21.15.82:0/1333476348 conn(0x7f49240fb760 msgr2=0x7f49240fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 -- 172.21.15.82:0/1333476348 shutdown_connections 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.617+0000 7f492a4c6640 1 -- 172.21.15.82:0/1333476348 wait complete. 2024-09-17T01:42:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 Processor -- start 2024-09-17T01:42:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 -- start start 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4924108580 con 0x7f49240fffd0 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f492a4c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4924108400 con 0x7f49241011d0 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f4923fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.618+0000 7f4923fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44212/0 (socket says 172.21.15.82:44212) 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f4923fff640 1 -- 172.21.15.82:0/2129276727 learned_addr learned my addr 172.21.15.82:0/2129276727 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f49237fe640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f4923fff640 1 -- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 msgr2=0x7f4924197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f4923fff640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f4923fff640 1 -- 172.21.15.82:0/2129276727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49241980c0 con 0x7f49240fffd0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f49237fe640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f4923fff640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4914006010 tx=0x7f49140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f491403f070 con 0x7f49240fffd0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49140049d0 con 0x7f49240fffd0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492419caa0 con 0x7f49240fffd0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.619+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4914035030 con 0x7f49240fffd0 2024-09-17T01:42:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.620+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492419d030 con 0x7f49240fffd0 2024-09-17T01:42:41.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.621+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49241003d0 con 0x7f49240fffd0 2024-09-17T01:42:41.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.621+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f4914042070 con 0x7f49240fffd0 2024-09-17T01:42:41.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.622+0000 7f49217fa640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 0x7f490c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.622+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f49140be8f0 con 0x7f49240fffd0 2024-09-17T01:42:41.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.622+0000 7f49237fe640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 0x7f490c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.623+0000 7f49237fe640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 0x7f490c07d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49241989b0 tx=0x7f4918010040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.627+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f491408a0a0 con 0x7f49240fffd0 2024-09-17T01:42:41.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.886+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 --> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4924062630 con 0x7f490c07af30 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.887+0000 7f49217fa640 1 -- 172.21.15.82:0/2129276727 <== mgr.24417 v2:172.21.15.167:6828/3660715592 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f4924062630 con 0x7f490c07af30 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:42:41.885 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mgr daemons", 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:42:41.886 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:42:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 msgr2=0x7f490c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 0x7f490c07d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49241989b0 tx=0x7f4918010040 comp rx=0 tx=0).stop 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 msgr2=0x7f4924197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4914006010 tx=0x7f49140045e0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 shutdown_connections 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49241011d0 0x7f4924197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f490c07af30 0x7f490c07d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 --2- 172.21.15.82:0/2129276727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240fffd0 0x7f4924197500 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 >> 172.21.15.82:0/2129276727 conn(0x7f49240fb760 msgr2=0x7f4924104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 shutdown_connections 2024-09-17T01:42:41.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.889+0000 7f492a4c6640 1 -- 172.21.15.82:0/2129276727 wait complete. 2024-09-17T01:42:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 -- 172.21.15.82:0/99160001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00100860 msgr2=0x7f3d00100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 --2- 172.21.15.82:0/99160001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00100860 0x7f3d00100c60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009880 tx=0x7f3cfc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 -- 172.21.15.82:0/99160001 shutdown_connections 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 --2- 172.21.15.82:0/99160001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00101a60 0x7f3d00101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 --2- 172.21.15.82:0/99160001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00100860 0x7f3d00100c60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 -- 172.21.15.82:0/99160001 >> 172.21.15.82:0/99160001 conn(0x7f3d000fc010 msgr2=0x7f3d000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 -- 172.21.15.82:0/99160001 shutdown_connections 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.984+0000 7f3d0743e640 1 -- 172.21.15.82:0/99160001 wait complete. 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 Processor -- start 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 -- start start 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00101a60 0x7f3d00197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00109680 con 0x7f3d00101a60 2024-09-17T01:42:41.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d0743e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00109500 con 0x7f3d00100860 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d051da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d051da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:32814/0 (socket says 172.21.15.82:32814) 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.985+0000 7f3d051da640 1 -- 172.21.15.82:0/3611199129 learned_addr learned my addr 172.21.15.82:0/3611199129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d049d9640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00101a60 0x7f3d00197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d051da640 1 -- 172.21.15.82:0/3611199129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00101a60 msgr2=0x7f3d00197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d051da640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00101a60 0x7f3d00197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d051da640 1 -- 172.21.15.82:0/3611199129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001980b0 con 0x7f3d00100860 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d051da640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc006010 tx=0x7f3cfc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc03f070 con 0x7f3d00100860 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d00102c80 con 0x7f3d00100860 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cfc0049d0 con 0x7f3d00100860 2024-09-17T01:42:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d00103210 con 0x7f3d00100860 2024-09-17T01:42:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.986+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc035030 con 0x7f3d00100860 2024-09-17T01:42:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.988+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce4005290 con 0x7f3d00100860 2024-09-17T01:42:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.988+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 27) ==== 103322+0+0 (secure 0 0 0) 0x7f3cfc042070 con 0x7f3d00100860 2024-09-17T01:42:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.989+0000 7f3cf67fc640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 0x7f3cec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:42:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.989+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5726+0+0 (secure 0 0 0) 0x7f3cfc0be970 con 0x7f3d00100860 2024-09-17T01:42:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.989+0000 7f3d049d9640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 0x7f3cec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:42:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.990+0000 7f3d049d9640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 0x7f3cec07d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d001989a0 tx=0x7f3cf0005f90 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:42:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:41.994+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f3cfc0c0e20 con 0x7f3d00100860 2024-09-17T01:42:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:42 smithi082 ceph-mon[28077]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:42 smithi082 ceph-mon[28077]: pgmap v54: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 122 op/s 2024-09-17T01:42:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:42 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4232744955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:42:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:42 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/1701965485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:42:42.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.350+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3ce4005580 con 0x7f3d00100860 2024-09-17T01:42:42.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.351+0000 7f3cf67fc640 1 -- 172.21.15.82:0/3611199129 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3cfc08a120 con 0x7f3d00100860 2024-09-17T01:42:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:42:42.349 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:42:42.349 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:42:42.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 msgr2=0x7f3cec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 0x7f3cec07d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d001989a0 tx=0x7f3cf0005f90 comp rx=0 tx=0).stop 2024-09-17T01:42:42.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 msgr2=0x7f3d001974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc006010 tx=0x7f3cfc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 shutdown_connections 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:6828/3660715592,v1:172.21.15.167:6829/3660715592] conn(0x7f3cec07af30 0x7f3cec07d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d00101a60 0x7f3d00197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 --2- 172.21.15.82:0/3611199129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d00100860 0x7f3d001974f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 >> 172.21.15.82:0/3611199129 conn(0x7f3d000fc010 msgr2=0x7f3d00069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 shutdown_connections 2024-09-17T01:42:42.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:42:42.353+0000 7f3d0743e640 1 -- 172.21.15.82:0/3611199129 wait complete. 2024-09-17T01:42:42.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:42 smithi167 ceph-mon[35643]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:42 smithi167 ceph-mon[35643]: pgmap v54: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 122 op/s 2024-09-17T01:42:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:42 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4232744955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:42:42.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:42 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/1701965485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:42:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:43 smithi082 ceph-mon[28077]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:43 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3611199129' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:42:43.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:43 smithi167 ceph-mon[35643]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:42:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:43 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3611199129' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:42:44.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:44 smithi082 ceph-mon[28077]: pgmap v55: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-17T01:42:44.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:44 smithi167 ceph-mon[35643]: pgmap v55: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-17T01:42:45.308 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:45 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:45.460 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:45 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: pgmap v56: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-17T01:42:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: Activating manager daemon smithi082.oppacm 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd='[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]': finished 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: mgrmap e28: smithi082.oppacm(active, starting, since 0.00678603s) 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:42:46.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:42:46.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:42:46.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:42:46.257 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:46 smithi167 ceph-mon[35643]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:42:46.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: pgmap v56: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 77 op/s 2024-09-17T01:42:46.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.368 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 172.21.15.167:0/3153320543' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: Activating manager daemon smithi082.oppacm 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24417 ' entity='mgr.smithi167.ysmbcy' cmd='[{"prefix": "mgr fail", "who": "smithi167.ysmbcy"}]': finished 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: mgrmap e28: smithi082.oppacm(active, starting, since 0.00678603s) 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"}]: dispatch 2024-09-17T01:42:46.369 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi082.oppacm", "id": "smithi082.oppacm"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T01:42:46.370 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:46 smithi082 ceph-mon[28077]: Manager daemon smithi082.oppacm is now available 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: mgrmap e29: smithi082.oppacm(active, since 1.00992s) 2024-09-17T01:42:47.360 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:42:47.361 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:47 smithi167 ceph-mon[35643]: pgmap v3: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/mirror_snapshot_schedule"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi082.oppacm/trash_purge_schedule"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: mgrmap e29: smithi082.oppacm(active, since 1.00992s) 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:42:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:47 smithi082 ceph-mon[28077]: pgmap v3: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:48.441 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:48 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:48.441 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:48 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:48.441 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:48 smithi167 ceph-mon[35643]: pgmap v4: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:48.441 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:48 smithi167 ceph-mon[35643]: mgrmap e30: smithi082.oppacm(active, since 2s) 2024-09-17T01:42:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:48 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:48 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:48 smithi082 ceph-mon[28077]: pgmap v4: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:48 smithi082 ceph-mon[28077]: mgrmap e30: smithi082.oppacm(active, since 2s) 2024-09-17T01:42:49.743 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:49 smithi082 ceph-mon[28077]: [17/Sep/2024:01:42:48] ENGINE Bus STARTING 2024-09-17T01:42:49.743 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:49 smithi082 ceph-mon[28077]: [17/Sep/2024:01:42:48] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:42:49.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:49 smithi167 ceph-mon[35643]: [17/Sep/2024:01:42:48] ENGINE Bus STARTING 2024-09-17T01:42:49.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:49 smithi167 ceph-mon[35643]: [17/Sep/2024:01:42:48] ENGINE Serving on http://172.21.15.82:8765 2024-09-17T01:42:50.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: [17/Sep/2024:01:42:48] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: [17/Sep/2024:01:42:48] ENGINE Bus STARTED 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: [17/Sep/2024:01:42:48] ENGINE Error in HTTPServer.serve 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Traceback (most recent call last): 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._run(expiration_interval) 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:42:50.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: s = self.context.wrap_socket( 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: return self.sslsocket_class._create( 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self.do_handshake() 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: self._sslobj.do_handshake() 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: pgmap v5: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: mgrmap e31: smithi082.oppacm(active, since 4s) 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:50.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:50.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: [17/Sep/2024:01:42:48] ENGINE Serving on https://172.21.15.82:7150 2024-09-17T01:42:50.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: [17/Sep/2024:01:42:48] ENGINE Bus STARTED 2024-09-17T01:42:50.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: [17/Sep/2024:01:42:48] ENGINE Error in HTTPServer.serve 2024-09-17T01:42:50.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Traceback (most recent call last): 2024-09-17T01:42:50.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._run(expiration_interval) 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T01:42:50.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T01:42:50.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T01:42:50.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: s = self.context.wrap_socket( 2024-09-17T01:42:50.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T01:42:50.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: return self.sslsocket_class._create( 2024-09-17T01:42:50.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self.do_handshake() 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: self._sslobj.do_handshake() 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: pgmap v5: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:50.857 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: mgrmap e31: smithi082.oppacm(active, since 4s) 2024-09-17T01:42:50.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:50.858 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:50 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:42:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:42:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:42:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:42:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:42:52.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:51 smithi082 ceph-mon[28077]: pgmap v6: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:52.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/453247579' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:42:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:51 smithi167 ceph-mon[35643]: pgmap v6: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:42:53.150 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:52 smithi082 ceph-mon[28077]: mgrmap e32: smithi082.oppacm(active, since 6s), standbys: smithi167.ysmbcy 2024-09-17T01:42:53.150 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:52 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:53.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:52 smithi167 ceph-mon[35643]: mgrmap e32: smithi082.oppacm(active, since 6s), standbys: smithi167.ysmbcy 2024-09-17T01:42:53.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:52 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr metadata", "who": "smithi167.ysmbcy", "id": "smithi167.ysmbcy"}]: dispatch 2024-09-17T01:42:53.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:53 smithi082 ceph-mon[28077]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 567 op/s 2024-09-17T01:42:54.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:53 smithi167 ceph-mon[35643]: pgmap v7: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 567 op/s 2024-09-17T01:42:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:56 smithi082 ceph-mon[28077]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 441 op/s 2024-09-17T01:42:57.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:56 smithi167 ceph-mon[35643]: pgmap v8: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 441 op/s 2024-09-17T01:42:58.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:42:58 smithi082 ceph-mon[28077]: pgmap v9: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 510 op/s 2024-09-17T01:42:59.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:42:58 smithi167 ceph-mon[35643]: pgmap v9: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 510 op/s 2024-09-17T01:43:00.933 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:00 smithi082 ceph-mon[28077]: pgmap v10: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-17T01:43:01.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:00 smithi167 ceph-mon[35643]: pgmap v10: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-17T01:43:01.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:01 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:02.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:01 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:02 smithi082 ceph-mon[28077]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-17T01:43:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:02 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:02 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:03.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:02 smithi167 ceph-mon[35643]: pgmap v11: 65 pgs: 65 active+clean; 310 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 467 op/s 2024-09-17T01:43:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:02 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:02 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:03 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:03 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:03 smithi082 ceph-mon[28077]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 626 op/s 2024-09-17T01:43:04.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:03 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:04.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:03 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:03 smithi167 ceph-mon[35643]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 626 op/s 2024-09-17T01:43:06.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:06 smithi082 ceph-mon[28077]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 295 op/s 2024-09-17T01:43:06.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:06 smithi167 ceph-mon[35643]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 295 op/s 2024-09-17T01:43:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:08 smithi082 ceph-mon[28077]: pgmap v14: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 407 op/s 2024-09-17T01:43:09.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:08 smithi167 ceph-mon[35643]: pgmap v14: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 407 op/s 2024-09-17T01:43:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:10 smithi082 ceph-mon[28077]: pgmap v15: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-17T01:43:11.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:10 smithi167 ceph-mon[35643]: pgmap v15: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-17T01:43:11.155 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-17T01:43:11.155 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-17T01:43:11.464 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.483+0000 7f175cc77640 1 -- 172.21.15.82:0/2770798606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1754031740 con 0x7f17581091a0 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 -- 172.21.15.82:0/2770798606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581091a0 msgr2=0x7f1758109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 --2- 172.21.15.82:0/2770798606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581091a0 0x7f1758109600 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1754009880 tx=0x7f175402a4b0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 -- 172.21.15.82:0/2770798606 shutdown_connections 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 --2- 172.21.15.82:0/2770798606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581091a0 0x7f1758109600 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 --2- 172.21.15.82:0/2770798606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17581083b0 0x7f17581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.484+0000 7f175fedd640 1 -- 172.21.15.82:0/2770798606 >> 172.21.15.82:0/2770798606 conn(0x7f17580771e0 msgr2=0x7f1758079620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.485+0000 7f175fedd640 1 -- 172.21.15.82:0/2770798606 shutdown_connections 2024-09-17T01:43:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.485+0000 7f175fedd640 1 -- 172.21.15.82:0/2770798606 wait complete. 2024-09-17T01:43:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 Processor -- start 2024-09-17T01:43:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 -- start start 2024-09-17T01:43:12.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17581091a0 0x7f1758082560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1758110d90 con 0x7f17581083b0 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175fedd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1758110c10 con 0x7f17581091a0 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175dc79640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175dc79640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39004/0 (socket says 172.21.15.82:39004) 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.486+0000 7f175dc79640 1 -- 172.21.15.82:0/3763681923 learned_addr learned my addr 172.21.15.82:0/3763681923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.487+0000 7f175dc79640 1 -- 172.21.15.82:0/3763681923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17581091a0 msgr2=0x7f1758082560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T01:43:12.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.487+0000 7f175dc79640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17581091a0 0x7f1758082560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.487+0000 7f175dc79640 1 -- 172.21.15.82:0/3763681923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1758082c00 con 0x7f17581083b0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.487+0000 7f175dc79640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e970 tx=0x7f174c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.488+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f174c00cac0 con 0x7f17581083b0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.488+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f174c00cc60 con 0x7f17581083b0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.488+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f174c018770 con 0x7f17581083b0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.488+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17581ab8a0 con 0x7f17581083b0 2024-09-17T01:43:12.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.488+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17581abd20 con 0x7f17581083b0 2024-09-17T01:43:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.491+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f174c010430 con 0x7f17581083b0 2024-09-17T01:43:12.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.491+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17581087b0 con 0x7f17581083b0 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.492+0000 7f174affd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 0x7f174407d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.492+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f174c09e940 con 0x7f17581083b0 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.493+0000 7f175d478640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 0x7f174407d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.494+0000 7f175d478640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 0x7f174407d610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1754006010 tx=0x7f1754000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.502+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f174c069dd0 con 0x7f17581083b0 2024-09-17T01:43:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.830+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1758062630 con 0x7f174407b150 2024-09-17T01:43:12.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:12 smithi082 ceph-mon[28077]: pgmap v16: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-17T01:43:12.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:12 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:12.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:12 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:12.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:12 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:12.828 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:12 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:12.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.831+0000 7f174affd640 1 -- 172.21.15.82:0/3763681923 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7f1758062630 con 0x7f174407b150 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 msgr2=0x7f174407d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 0x7f174407d610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1754006010 tx=0x7f1754000bc0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 msgr2=0x7f1758082020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f174c00e970 tx=0x7f174c00ee30 comp rx=0 tx=0).stop 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 shutdown_connections 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174407b150 0x7f174407d610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17581091a0 0x7f1758082560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 --2- 172.21.15.82:0/3763681923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17581083b0 0x7f1758082020 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 >> 172.21.15.82:0/3763681923 conn(0x7f17580771e0 msgr2=0x7f175810c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:12.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 shutdown_connections 2024-09-17T01:43:12.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.834+0000 7f175fedd640 1 -- 172.21.15.82:0/3763681923 wait complete. 2024-09-17T01:43:12.841 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 -- 172.21.15.82:0/68235941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 msgr2=0x7fbb74100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/68235941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb74100010 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009880 tx=0x7fbb6402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 -- 172.21.15.82:0/68235941 shutdown_connections 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/68235941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 0x7fbb74103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/68235941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb74100010 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 -- 172.21.15.82:0/68235941 >> 172.21.15.82:0/68235941 conn(0x7fbb740fb760 msgr2=0x7fbb740fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:12.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 -- 172.21.15.82:0/68235941 shutdown_connections 2024-09-17T01:43:12.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.930+0000 7fbb7aa26640 1 -- 172.21.15.82:0/68235941 wait complete. 2024-09-17T01:43:12.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 Processor -- start 2024-09-17T01:43:12.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 -- start start 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 0x7fbb74100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7410a7a0 con 0x7fbb740ffc10 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.931+0000 7fbb7aa26640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7410a620 con 0x7fbb74102bf0 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39024/0 (socket says 172.21.15.82:39024) 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 -- 172.21.15.82:0/824930892 learned_addr learned my addr 172.21.15.82:0/824930892 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:12.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb737fe640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 0x7fbb74100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 -- 172.21.15.82:0/824930892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 msgr2=0x7fbb74100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:12.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 0x7fbb74100ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:12.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 -- 172.21.15.82:0/824930892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7419b120 con 0x7fbb740ffc10 2024-09-17T01:43:12.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.932+0000 7fbb73fff640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006010 tx=0x7fbb640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.933+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb6403f070 con 0x7fbb740ffc10 2024-09-17T01:43:12.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.933+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb741010e0 con 0x7fbb740ffc10 2024-09-17T01:43:12.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.933+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb640049d0 con 0x7fbb740ffc10 2024-09-17T01:43:12.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.933+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb74101610 con 0x7fbb740ffc10 2024-09-17T01:43:12.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.933+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb64035030 con 0x7fbb740ffc10 2024-09-17T01:43:12.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.934+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb74100010 con 0x7fbb740ffc10 2024-09-17T01:43:12.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.935+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fbb64042070 con 0x7fbb740ffc10 2024-09-17T01:43:12.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.936+0000 7fbb717fa640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 0x7fbb5c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:12.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.936+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fbb640bec70 con 0x7fbb740ffc10 2024-09-17T01:43:12.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.937+0000 7fbb737fe640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 0x7fbb5c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:12.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.937+0000 7fbb737fe640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 0x7fbb5c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb74102260 tx=0x7fbb68005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:12.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:12.942+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fbb6408a100 con 0x7fbb740ffc10 2024-09-17T01:43:13.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:12 smithi167 ceph-mon[35643]: pgmap v16: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 270 op/s 2024-09-17T01:43:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:12 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:12 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:12 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:12 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:13.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.169+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbb741071c0 con 0x7fbb5c07b050 2024-09-17T01:43:13.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.170+0000 7fbb717fa640 1 -- 172.21.15.82:0/824930892 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7fbb741071c0 con 0x7fbb5c07b050 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 msgr2=0x7fbb5c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 0x7fbb5c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbb74102260 tx=0x7fbb68005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 msgr2=0x7fbb741024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbb64006010 tx=0x7fbb640045e0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 shutdown_connections 2024-09-17T01:43:13.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbb5c07b050 0x7fbb5c07d510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb74102bf0 0x7fbb74100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 --2- 172.21.15.82:0/824930892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb740ffc10 0x7fbb741024e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 >> 172.21.15.82:0/824930892 conn(0x7fbb740fb760 msgr2=0x7fbb740fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.173+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 shutdown_connections 2024-09-17T01:43:13.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.174+0000 7fbb7aa26640 1 -- 172.21.15.82:0/824930892 wait complete. 2024-09-17T01:43:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 -- 172.21.15.82:0/3368759849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194100a90 msgr2=0x7f7194100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 --2- 172.21.15.82:0/3368759849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194100a90 0x7f7194100f10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7184009880 tx=0x7f718402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 -- 172.21.15.82:0/3368759849 shutdown_connections 2024-09-17T01:43:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 --2- 172.21.15.82:0/3368759849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194100a90 0x7f7194100f10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 --2- 172.21.15.82:0/3368759849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194101e30 0x7f7194102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 -- 172.21.15.82:0/3368759849 >> 172.21.15.82:0/3368759849 conn(0x7f71940fb770 msgr2=0x7f71940fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 -- 172.21.15.82:0/3368759849 shutdown_connections 2024-09-17T01:43:13.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.273+0000 7f719c394640 1 -- 172.21.15.82:0/3368759849 wait complete. 2024-09-17T01:43:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 Processor -- start 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 -- start start 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194100a90 0x7f71941047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7194109690 con 0x7f7194101e30 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719c394640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7194109510 con 0x7f7194100a90 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719992f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719992f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39042/0 (socket says 172.21.15.82:39042) 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719992f640 1 -- 172.21.15.82:0/3795154762 learned_addr learned my addr 172.21.15.82:0/3795154762 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719a130640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194100a90 0x7f71941047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719992f640 1 -- 172.21.15.82:0/3795154762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194100a90 msgr2=0x7f71941047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.274+0000 7f719992f640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194100a90 0x7f71941047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f719992f640 1 -- 172.21.15.82:0/3795154762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941033c0 con 0x7f7194101e30 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f719992f640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7184006010 tx=0x7f71840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f718403f070 con 0x7f7194101e30 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71840049d0 con 0x7f7194101e30 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7184035030 con 0x7f7194101e30 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7194103650 con 0x7f7194101e30 2024-09-17T01:43:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.275+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7194103b80 con 0x7f7194101e30 2024-09-17T01:43:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.277+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7194100f10 con 0x7f7194101e30 2024-09-17T01:43:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.278+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f7184042070 con 0x7f7194101e30 2024-09-17T01:43:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.278+0000 7f718b7fe640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 0x7f718007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.279+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f71840beba0 con 0x7f7194101e30 2024-09-17T01:43:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.279+0000 7f719a130640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 0x7f718007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.279+0000 7f719a130640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 0x7f718007d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7194069c80 tx=0x7f7190005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.287+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f718408a0b0 con 0x7f7194101e30 2024-09-17T01:43:13.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.596+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7194100120 con 0x7f718007b0b0 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.612+0000 7f718b7fe640 1 -- 172.21.15.82:0/3795154762 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7194100120 con 0x7f718007b0b0 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (8m) 11s ago 9m 24.5M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (96s) 11s ago 10m 8530k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (63s) 23s ago 9m 8384k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (9m) 11s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (9m) 23s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (8m) 11s ago 9m 81.5M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:43:13.611 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (4m) 11s ago 4m 237M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (4m) 11s ago 4m 273M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (4m) 23s ago 4m 28.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (4m) 23s ago 4m 26.1M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (58s) 11s ago 11m 556M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (2m) 23s ago 8m 194M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 930ab8ac2a03 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (11m) 11s ago 11m 56.8M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 71972a136736 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (8m) 23s ago 8m 44.9M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (9m) 11s ago 9m 14.7M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (8m) 23s ago 8m 16.1M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 11s ago 7m 195M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (7m) 11s ago 7m 209M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 11s ago 6m 166M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:43:13.612 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (6m) 23s ago 6m 224M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:43:13.613 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (5m) 23s ago 5m 196M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:43:13.613 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (5m) 23s ago 5m 179M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:43:13.613 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (69s) 11s ago 9m 46.4M - 2.43.0 a07b618ecd1d 4e4bc234a0cb 2024-09-17T01:43:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 msgr2=0x7f718007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 0x7f718007d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7194069c80 tx=0x7f7190005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 msgr2=0x7f7194102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7184006010 tx=0x7f71840045e0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 shutdown_connections 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f718007b0b0 0x7f718007d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7194101e30 0x7f7194102e80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 --2- 172.21.15.82:0/3795154762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7194100a90 0x7f71941047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 >> 172.21.15.82:0/3795154762 conn(0x7f71940fb770 msgr2=0x7f71940ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 shutdown_connections 2024-09-17T01:43:13.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.615+0000 7f719c394640 1 -- 172.21.15.82:0/3795154762 wait complete. 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.675 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.676 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.676 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:13.676 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:13 smithi082 ceph-mon[28077]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 -- 172.21.15.82:0/2072077935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 msgr2=0x7f1764100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 --2- 172.21.15.82:0/2072077935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f1764100c60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1754009880 tx=0x7f175402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 -- 172.21.15.82:0/2072077935 shutdown_connections 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 --2- 172.21.15.82:0/2072077935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 0x7f1764101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 --2- 172.21.15.82:0/2072077935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f1764100c60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.709+0000 7f1769f64640 1 -- 172.21.15.82:0/2072077935 >> 172.21.15.82:0/2072077935 conn(0x7f17640fc010 msgr2=0x7f17640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:13.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.710+0000 7f1769f64640 1 -- 172.21.15.82:0/2072077935 shutdown_connections 2024-09-17T01:43:13.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.710+0000 7f1769f64640 1 -- 172.21.15.82:0/2072077935 wait complete. 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.710+0000 7f1769f64640 1 Processor -- start 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1769f64640 1 -- start start 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1769f64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1769f64640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 0x7f1764103120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1769f64640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17641096a0 con 0x7f1764100860 2024-09-17T01:43:13.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1769f64640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1764109520 con 0x7f1764101a60 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39054/0 (socket says 172.21.15.82:39054) 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 -- 172.21.15.82:0/2384607955 learned_addr learned my addr 172.21.15.82:0/2384607955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f1762ffd640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 0x7f1764103120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 -- 172.21.15.82:0/2384607955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 msgr2=0x7f1764103120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 0x7f1764103120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.711+0000 7f17637fe640 1 -- 172.21.15.82:0/2384607955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1764103660 con 0x7f1764100860 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f17637fe640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1754009230 tx=0x7f17540045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f175403f070 con 0x7f1764100860 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17641038f0 con 0x7f1764100860 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1754004a50 con 0x7f1764100860 2024-09-17T01:43:13.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1754035030 con 0x7f1764100860 2024-09-17T01:43:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.712+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1764103e20 con 0x7f1764100860 2024-09-17T01:43:13.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.713+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1764109e80 con 0x7f1764100860 2024-09-17T01:43:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.714+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f1754042070 con 0x7f1764100860 2024-09-17T01:43:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.715+0000 7f1760ff9640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 0x7f174c07d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.715+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f17540becf0 con 0x7f1764100860 2024-09-17T01:43:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.715+0000 7f1762ffd640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 0x7f174c07d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:13.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.715+0000 7f1762ffd640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 0x7f174c07d560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1764104770 tx=0x7f175800b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:13.720+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f175408a200 con 0x7f1764100860 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.conf 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Updating smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:14.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:13 smithi167 ceph-mon[35643]: Reconfiguring prometheus.smithi082 (dependencies changed)... 2024-09-17T01:43:14.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.054+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1764197200 con 0x7f1764100860 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.054+0000 7f1760ff9640 1 -- 172.21.15.82:0/2384607955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f175408f0b0 con 0x7f1764100860 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 12, 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:43:14.054 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:43:14.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.057+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 msgr2=0x7f174c07d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.057+0000 7f1769f64640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 0x7f174c07d560 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1764104770 tx=0x7f175800b390 comp rx=0 tx=0).stop 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.057+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 msgr2=0x7f17641049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.057+0000 7f1769f64640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1754009230 tx=0x7f17540045c0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 shutdown_connections 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f174c07b0a0 0x7f174c07d560 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1764101a60 0x7f1764103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 --2- 172.21.15.82:0/2384607955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1764100860 0x7f17641049f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 >> 172.21.15.82:0/2384607955 conn(0x7f17640fc010 msgr2=0x7f17640fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 shutdown_connections 2024-09-17T01:43:14.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.058+0000 7f1769f64640 1 -- 172.21.15.82:0/2384607955 wait complete. 2024-09-17T01:43:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 -- 172.21.15.82:0/1294146557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc100880 msgr2=0x7f5dfc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/1294146557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc100880 0x7f5dfc100c80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5dec009880 tx=0x7f5dec02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 -- 172.21.15.82:0/1294146557 shutdown_connections 2024-09-17T01:43:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/1294146557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc101a80 0x7f5dfc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/1294146557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc100880 0x7f5dfc100c80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 -- 172.21.15.82:0/1294146557 >> 172.21.15.82:0/1294146557 conn(0x7f5dfc0fc010 msgr2=0x7f5dfc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 -- 172.21.15.82:0/1294146557 shutdown_connections 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.149+0000 7f5e01b3e640 1 -- 172.21.15.82:0/1294146557 wait complete. 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 Processor -- start 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 -- start start 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 0x7f5dfc195340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc1085b0 con 0x7f5dfc101a80 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5e01b3e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc108430 con 0x7f5dfc100880 2024-09-17T01:43:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5df3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5df3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39072/0 (socket says 172.21.15.82:39072) 2024-09-17T01:43:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5df3fff640 1 -- 172.21.15.82:0/3036483063 learned_addr learned my addr 172.21.15.82:0/3036483063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.150+0000 7f5dfb7fe640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 0x7f5dfc195340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5dfb7fe640 1 -- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 msgr2=0x7f5dfc195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5dfb7fe640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5dfb7fe640 1 -- 172.21.15.82:0/3036483063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc195f00 con 0x7f5dfc100880 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5df3fff640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5dfb7fe640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 0x7f5dfc195340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006010 tx=0x7f5dec0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dec03f070 con 0x7f5dfc100880 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dfc19a8e0 con 0x7f5dfc100880 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.151+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dec0035f0 con 0x7f5dfc100880 2024-09-17T01:43:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.152+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dec035030 con 0x7f5dfc100880 2024-09-17T01:43:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.152+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dfc19ae70 con 0x7f5dfc100880 2024-09-17T01:43:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.153+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f5dec042070 con 0x7f5dfc100880 2024-09-17T01:43:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.153+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dfc100c80 con 0x7f5dfc100880 2024-09-17T01:43:14.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.154+0000 7f5df97fa640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 0x7f5de807f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.154+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f5dec0be1c0 con 0x7f5dfc100880 2024-09-17T01:43:14.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.154+0000 7f5df3fff640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 0x7f5de807f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.154+0000 7f5df3fff640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 0x7f5de807f730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc1967f0 tx=0x7f5de4005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.158+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f5dec089650 con 0x7f5dfc100880 2024-09-17T01:43:14.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.419+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5dfc18f3c0 con 0x7f5dfc100880 2024-09-17T01:43:14.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.420+0000 7f5df97fa640 1 -- 172.21.15.82:0/3036483063 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f5dec08e500 con 0x7f5dfc100880 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:43:14.422 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:43:14.423 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:14.424 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:14.425 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:14.425 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:14.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:14.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 msgr2=0x7f5de807f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 0x7f5de807f730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc1967f0 tx=0x7f5de4005f90 comp rx=0 tx=0).stop 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 msgr2=0x7f5dfc195340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 0x7f5dfc195340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006010 tx=0x7f5dec0045e0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 shutdown_connections 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5de807d270 0x7f5de807f730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dfc101a80 0x7f5dfc195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 --2- 172.21.15.82:0/3036483063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dfc100880 0x7f5dfc195340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 >> 172.21.15.82:0/3036483063 conn(0x7f5dfc0fc010 msgr2=0x7f5dfc105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 shutdown_connections 2024-09-17T01:43:14.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.423+0000 7f5e01b3e640 1 -- 172.21.15.82:0/3036483063 wait complete. 2024-09-17T01:43:14.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 -- 172.21.15.82:0/1360132749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 msgr2=0x7f61180fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 --2- 172.21.15.82:0/1360132749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f61180fffa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6110005fd0 tx=0x7f611002c810 comp rx=0 tx=0).stop 2024-09-17T01:43:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 -- 172.21.15.82:0/1360132749 shutdown_connections 2024-09-17T01:43:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 --2- 172.21.15.82:0/1360132749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 --2- 172.21.15.82:0/1360132749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f61180fffa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 -- 172.21.15.82:0/1360132749 >> 172.21.15.82:0/1360132749 conn(0x7f61180fb350 msgr2=0x7f61180fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 -- 172.21.15.82:0/1360132749 shutdown_connections 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.554+0000 7f611dbb3640 1 -- 172.21.15.82:0/1360132749 wait complete. 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.555+0000 7f611dbb3640 1 Processor -- start 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.555+0000 7f611dbb3640 1 -- start start 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f611dbb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f611dbb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f611dbb3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6118108570 con 0x7f61180ffba0 2024-09-17T01:43:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f611dbb3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61181083f0 con 0x7f6118100da0 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f61177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f61177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39082/0 (socket says 172.21.15.82:39082) 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f61177fe640 1 -- 172.21.15.82:0/2151662531 learned_addr learned my addr 172.21.15.82:0/2151662531 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.556+0000 7f6116ffd640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f6116ffd640 1 -- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 msgr2=0x7f6118073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f6116ffd640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f6116ffd640 1 -- 172.21.15.82:0/2151662531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6118073e20 con 0x7f6118100da0 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f61177fe640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f6116ffd640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118073780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61080099c0 tx=0x7f6108009e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6108007840 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.557+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61181a30d0 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.558+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181a3690 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.558+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6108005020 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.558+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6108004d30 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.561+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61040052c0 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.561+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f61080079e0 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.562+0000 7f6114ff9640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 0x7f610007d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.562+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f6108015030 con 0x7f6118100da0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.563+0000 7f61177fe640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 0x7f610007d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.564+0000 7f61177fe640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 0x7f610007d710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61100346a0 tx=0x7f611000c040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.571+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7f61080046c0 con 0x7f6118100da0 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/2384607955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:14 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/3036483063' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:43:14.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.799+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6104000bf0 con 0x7f610007b250 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.800+0000 7f6114ff9640 1 -- 172.21.15.82:0/2151662531 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+337 (secure 0 0 0) 0x7f6104000bf0 con 0x7f610007b250 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:43:14.798 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-09-17T01:43:14.799 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:43:14.799 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "2/23 daemons upgraded", 2024-09-17T01:43:14.799 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-09-17T01:43:14.799 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:43:14.799 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:43:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 msgr2=0x7f610007d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 0x7f610007d710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61100346a0 tx=0x7f611000c040 comp rx=0 tx=0).stop 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 msgr2=0x7f6118073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118073780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f61080099c0 tx=0x7f6108009e80 comp rx=0 tx=0).stop 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 shutdown_connections 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610007b250 0x7f610007d710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6118100da0 0x7f6118073780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 --2- 172.21.15.82:0/2151662531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61180ffba0 0x7f6118073240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 >> 172.21.15.82:0/2151662531 conn(0x7f61180fb350 msgr2=0x7f61180fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 shutdown_connections 2024-09-17T01:43:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.802+0000 7f611dbb3640 1 -- 172.21.15.82:0/2151662531 wait complete. 2024-09-17T01:43:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.893+0000 7fd69601b640 1 -- 172.21.15.82:0/514654410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 msgr2=0x7fd6901047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.893+0000 7fd69601b640 1 --2- 172.21.15.82:0/514654410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd6901047e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd6800098b0 tx=0x7fd68002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 -- 172.21.15.82:0/514654410 shutdown_connections 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 --2- 172.21.15.82:0/514654410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd690107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 --2- 172.21.15.82:0/514654410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd6901047e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 -- 172.21.15.82:0/514654410 >> 172.21.15.82:0/514654410 conn(0x7fd6900fc010 msgr2=0x7fd6900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 -- 172.21.15.82:0/514654410 shutdown_connections 2024-09-17T01:43:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 -- 172.21.15.82:0/514654410 wait complete. 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.894+0000 7fd69601b640 1 Processor -- start 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd69601b640 1 -- start start 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd69601b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd690197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd69601b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd69601b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd69010a7e0 con 0x7fd6901023f0 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd69601b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd69010a660 con 0x7fd690104d20 2024-09-17T01:43:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd68f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd690197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd68effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd68effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:60446/0 (socket says 172.21.15.82:60446) 2024-09-17T01:43:14.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.895+0000 7fd68effd640 1 -- 172.21.15.82:0/4290473635 learned_addr learned my addr 172.21.15.82:0/4290473635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:14.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68effd640 1 -- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 msgr2=0x7fd690197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68effd640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd690197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68effd640 1 -- 172.21.15.82:0/4290473635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd690197f20 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68effd640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd68400e970 tx=0x7fd68400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd68400cac0 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6840054e0 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69019c960 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.896+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd684010430 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.897+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69019cef0 con 0x7fd690104d20 2024-09-17T01:43:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.898+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69019d210 con 0x7fd690104d20 2024-09-17T01:43:14.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.898+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fd684004ec0 con 0x7fd690104d20 2024-09-17T01:43:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.899+0000 7fd68cff9640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 0x7fd67807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.899+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fd68409e930 con 0x7fd690104d20 2024-09-17T01:43:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.899+0000 7fd68f7fe640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 0x7fd67807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.900+0000 7fd68f7fe640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 0x7fd67807d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6800096c0 tx=0x7fd680000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:14.903+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195664 (secure 0 0 0) 0x7fd684069d40 con 0x7fd690104d20 2024-09-17T01:43:15.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: Reconfiguring daemon prometheus.smithi082 on smithi082 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 359 op/s 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/2384607955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:14 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3036483063' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:43:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.246+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd69019d5a0 con 0x7fd690104d20 2024-09-17T01:43:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.246+0000 7fd68cff9640 1 -- 172.21.15.82:0/4290473635 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fd69019d5a0 con 0x7fd690104d20 2024-09-17T01:43:15.244 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:15.244 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 msgr2=0x7fd67807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 0x7fd67807d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6800096c0 tx=0x7fd680000bc0 comp rx=0 tx=0).stop 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 msgr2=0x7fd6901978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd68400e970 tx=0x7fd68400ee30 comp rx=0 tx=0).stop 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 shutdown_connections 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd67807b0b0 0x7fd67807d570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd690104d20 0x7fd6901978a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 --2- 172.21.15.82:0/4290473635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6901023f0 0x7fd690197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 >> 172.21.15.82:0/4290473635 conn(0x7fd6900fc010 msgr2=0x7fd6900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 shutdown_connections 2024-09-17T01:43:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:15.249+0000 7fd69601b640 1 -- 172.21.15.82:0/4290473635 wait complete. 2024-09-17T01:43:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:15 smithi082 ceph-mon[28077]: from='client.? 172.21.15.82:0/4290473635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:43:16.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:15 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4290473635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:43:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:16 smithi082 ceph-mon[28077]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:16 smithi082 ceph-mon[28077]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-09-17T01:43:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:16 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:16 smithi167 ceph-mon[35643]: from='client.24595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:16 smithi167 ceph-mon[35643]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-09-17T01:43:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:16 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:18.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:18 smithi082 ceph-mon[28077]: pgmap v19: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 261 op/s 2024-09-17T01:43:19.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:18 smithi167 ceph-mon[35643]: pgmap v19: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 261 op/s 2024-09-17T01:43:20.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:43:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:43:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: pgmap v20: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-09-17T01:43:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:20 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: pgmap v20: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-09-17T01:43:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:20 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:21.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:21 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:43:21.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:21 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:43:21.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:21 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:21.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:21 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi167.ysmbcy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T01:43:21.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:21 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T01:43:21.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:21 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:21.876 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-17T01:43:21.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T01:43:22.158 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:22.159 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:43:22.192 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T01:43:22.192 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:43:22.226 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-17T01:43:22.226 DEBUG:teuthology.parallel:result is None 2024-09-17T01:43:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:22 smithi167 ceph-mon[35643]: Upgrade: Updating mgr.smithi167.ysmbcy 2024-09-17T01:43:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:22 smithi167 ceph-mon[35643]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:43:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:22 smithi167 ceph-mon[35643]: pgmap v21: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-09-17T01:43:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:22 smithi082 ceph-mon[28077]: Upgrade: Updating mgr.smithi167.ysmbcy 2024-09-17T01:43:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:22 smithi082 ceph-mon[28077]: Deploying daemon mgr.smithi167.ysmbcy on smithi167 2024-09-17T01:43:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:22 smithi082 ceph-mon[28077]: pgmap v21: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 150 op/s 2024-09-17T01:43:24.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:24 smithi167 ceph-mon[35643]: pgmap v22: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 228 op/s 2024-09-17T01:43:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:24 smithi082 ceph-mon[28077]: pgmap v22: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 228 op/s 2024-09-17T01:43:25.950 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:25 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:25.950 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:25 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:25.950 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:25 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:25.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:25 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:25.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:25 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:25.958 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:25 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:26.811 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:26 smithi167 ceph-mon[35643]: pgmap v23: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-09-17T01:43:26.856 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:26 smithi082 ceph-mon[28077]: pgmap v23: 65 pgs: 65 active+clean; 282 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-09-17T01:43:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:28 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:28 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:28 smithi082 ceph-mon[28077]: pgmap v24: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2024-09-17T01:43:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:28 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:28 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.726 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:28 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.726 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:28 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.726 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:28 smithi167 ceph-mon[35643]: pgmap v24: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 177 op/s 2024-09-17T01:43:28.726 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:28 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:28.726 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:28 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:30.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: pgmap v25: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 704 KiB/s rd, 618 KiB/s wr, 116 op/s 2024-09-17T01:43:30.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy restarted 2024-09-17T01:43:30.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:43:30.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:43:30.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:43:30.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:43:30.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:43:30.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:30.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:30 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: pgmap v25: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 704 KiB/s rd, 618 KiB/s wr, 116 op/s 2024-09-17T01:43:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy restarted 2024-09-17T01:43:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: Standby manager daemon smithi167.ysmbcy started 2024-09-17T01:43:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/crt"}]: dispatch 2024-09-17T01:43:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T01:43:30.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi167.ysmbcy/key"}]: dispatch 2024-09-17T01:43:30.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.? 172.21.15.167:0/3731645089' entity='mgr.smithi167.ysmbcy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T01:43:30.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:30.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:30 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: mgrmap e33: smithi082.oppacm(active, since 45s), standbys: smithi167.ysmbcy 2024-09-17T01:43:31.844 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.oppacm"}]: dispatch 2024-09-17T01:43:31.845 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.oppacm"}]': finished 2024-09-17T01:43:31.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi167.ysmbcy"}]: dispatch 2024-09-17T01:43:31.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi167.ysmbcy"}]': finished 2024-09-17T01:43:31.846 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:31 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: mgrmap e33: smithi082.oppacm(active, since 45s), standbys: smithi167.ysmbcy 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:31.886 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.oppacm"}]: dispatch 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi082.oppacm"}]': finished 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi167.ysmbcy"}]: dispatch 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi167.ysmbcy"}]': finished 2024-09-17T01:43:31.887 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:31 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:43:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:32 smithi082 ceph-mon[28077]: Upgrade: Setting container_image for all mgr 2024-09-17T01:43:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:32 smithi082 ceph-mon[28077]: pgmap v26: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 704 KiB/s rd, 618 KiB/s wr, 116 op/s 2024-09-17T01:43:33.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:32 smithi167 ceph-mon[35643]: Upgrade: Setting container_image for all mgr 2024-09-17T01:43:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:32 smithi167 ceph-mon[35643]: pgmap v26: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 704 KiB/s rd, 618 KiB/s wr, 116 op/s 2024-09-17T01:43:34.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:34 smithi082 ceph-mon[28077]: pgmap v27: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 705 KiB/s rd, 618 KiB/s wr, 117 op/s 2024-09-17T01:43:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:34 smithi167 ceph-mon[35643]: pgmap v27: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 705 KiB/s rd, 618 KiB/s wr, 117 op/s 2024-09-17T01:43:36.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:36 smithi082 ceph-mon[28077]: pgmap v28: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s rd, 87 KiB/s wr, 39 op/s 2024-09-17T01:43:36.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:36 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:36.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:36 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:43:36.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:36 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:43:36.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:36 smithi082 ceph-mon[28077]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:36.979 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:36 smithi167 ceph-mon[35643]: pgmap v28: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 194 KiB/s rd, 87 KiB/s wr, 39 op/s 2024-09-17T01:43:36.979 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:36 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:36.979 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:36 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:43:36.980 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:36 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:43:36.980 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:36 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:37.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:37 smithi082 ceph-mon[28077]: Upgrade: Updating mon.smithi082 2024-09-17T01:43:37.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:37 smithi082 ceph-mon[28077]: Deploying daemon mon.smithi082 on smithi082 2024-09-17T01:43:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:37 smithi167 ceph-mon[35643]: Upgrade: Updating mon.smithi082 2024-09-17T01:43:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:37 smithi167 ceph-mon[35643]: Deploying daemon mon.smithi082 on smithi082 2024-09-17T01:43:38.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:37 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:43:38.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[28073]: 2024-09-17T01:43:38.206+0000 7f7c091d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:43:38.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[28073]: 2024-09-17T01:43:38.206+0000 7f7c091d7640 -1 mon.smithi082@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T01:43:38.563 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 podman[92785]: 2024-09-17 01:43:38.298792858 +0000 UTC m=+0.184656804 container died 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:43:38.914 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 podman[92785]: 2024-09-17 01:43:38.673720455 +0000 UTC m=+0.559584389 container cleanup 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-17T01:43:38.914 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 bash[92785]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082 2024-09-17T01:43:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:38 smithi082 podman[92798]: 2024-09-17 01:43:38.916909994 +0000 UTC m=+0.621048078 container remove 71972a1367363ab0d4fd38f5b110268e8c1736377dd5d3954707ef033f318cdf (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731) 2024-09-17T01:43:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service: Deactivated successfully. 2024-09-17T01:43:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 systemd[1]: Stopped Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:43:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service: Consumed 11.572s CPU time. 2024-09-17T01:43:39.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 systemd[1]: Starting Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:43:39.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 podman[92938]: 2024-09-17 01:43:39.38005551 +0000 UTC m=+0.016169954 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:43:39.610 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 podman[92938]: 2024-09-17 01:43:39.501684511 +0000 UTC m=+0.137798982 container create 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 podman[92938]: 2024-09-17 01:43:39.820878536 +0000 UTC m=+0.456992975 container init 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 podman[92938]: 2024-09-17 01:43:39.824286699 +0000 UTC m=+0.460401126 container start 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev), process ceph-mon, pid 2 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: pidfile_write: ignore empty --pid-file 2024-09-17T01:43:39.861 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: load: jerasure load: lrc 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Git sha 0 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Compile date 2024-09-17 00:23:36 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: DB SUMMARY 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: DB Session ID: W0VTX5K66EM8WJ09YZNP 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1265 Bytes 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi082/store.db dir, Total Num: 1, files: 000029.sst 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi082/store.db: 000027.log size: 3288173 ; 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:43:39.862 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.env: 0x5609cbadad60 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.info_log: 0x5609d1a1d580 2024-09-17T01:43:39.863 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:43:39.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.statistics: (nil) 2024-09-17T01:43:39.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.use_fsync: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:43:39.865 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.db_log_dir: 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.wal_dir: 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.write_buffer_manager: 0x5609d1a21d60 2024-09-17T01:43:39.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.unordered_write: 0 2024-09-17T01:43:39.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.row_cache: None 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.wal_filter: None 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:43:39.868 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.wal_compression: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:43:39.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:43:39.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:43:39.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_open_files: -1 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Compression algorithms supported: 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kZSTD supported: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:43:39.872 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:43:39.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000015 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.merge_operator: 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_filter: None 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:43:39.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5609d1a1d1a0) 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_type: 0 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_index_type: 0 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_shortening: 1 2024-09-17T01:43:39.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: checksum: 4 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: no_block_cache: 0 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache: 0x5609cd9e1610 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_options: 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: capacity : 536870912 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_shard_bits : 4 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: strict_capacity_limit : 0 2024-09-17T01:43:39.876 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_cache_compressed: (nil) 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: persistent_cache: (nil) 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size: 4096 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_size_deviation: 10 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_restart_interval: 16 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: index_block_restart_interval: 1 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_block_size: 4096 2024-09-17T01:43:39.877 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: partition_filters: 0 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: use_delta_encoding: 1 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: filter_policy: bloomfilter 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: whole_key_filtering: 1 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: verify_compression: 0 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: format_version: 5 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_index_compression: 1 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: block_align: 0 2024-09-17T01:43:39.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_auto_readahead_size: 262144 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: prepopulate_block_cache: 0 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression: NoCompression 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:43:39.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.num_levels: 7 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:43:39.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:43:39.881 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:43:39.882 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:43:39.883 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:43:39.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:43:39.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:43:39.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:43:39.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:43:39.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:43:39.885 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:43:39.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:43:39.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:43:39.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:43:39.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:43:39.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:43:39.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:43:39.888 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:43:39.889 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:43:39.889 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:43:39.889 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:43:39.889 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:43:39.889 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:43:39.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.ttl: 2592000 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:43:39.891 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:43:39.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:43:39.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:43:39.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:43:39.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:43:39.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi082/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 31, last_sequence is 10448, log_number is 27,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 27 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 27 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 98d5634c-6893-407f-9da7-3e5914246905 2024-09-17T01:43:39.893 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537419860845, "job": 1, "event": "recovery_started", "wal_files": [27]} 2024-09-17T01:43:39.894 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #27 mode 2 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537419872767, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 32, "file_size": 3018619, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10449, "largest_seqno": 11783, "table_properties": {"data_size": 3011518, "index_size": 4584, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13376, "raw_average_key_size": 22, "raw_value_size": 2998423, "raw_average_value_size": 5108, "num_data_blocks": 209, "num_entries": 587, "num_filter_entries": 587, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726537419, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "98d5634c-6893-407f-9da7-3e5914246905", "db_session_id": "W0VTX5K66EM8WJ09YZNP", "orig_file_number": 32, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537419872919, "job": 1, "event": "recovery_finished"} 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:5047] Creating manifest 34 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi082/store.db/000027.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5609d1a40a80 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: DB pointer 0x5609d27e6000 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** DB Stats ** 2024-09-17T01:43:40.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L0 1/0 2.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: L6 1/0 5.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:43:40.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Sum 2/0 8.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 653.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** Compaction Stats [default] ** 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 653.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-17T01:43:40.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Cumulative compaction: 0.00 GB write, 173.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Interval compaction: 0.00 GB write, 173.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache BinnedLRUCache@0x5609cd9e1610#2 capacity: 512.00 MB usage: 6.12 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.54 KB,0.000293553%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: starting mon.smithi082 rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi082 fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:40.218 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???) e2 preinit fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:40.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).mds e14 new map 2024-09-17T01:43:40.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).mds e14 print_map 2024-09-17T01:43:40.219 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: e14 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: legacy client fscid: 1 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: fs_name cephfs 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: epoch 14 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:43:40.220 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: tableserver 0 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: root 0 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_timeout 60 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: session_autoclose 300 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_file_size 1099511627776 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_xattr_size 65536 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: required_client_features {} 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure 0 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: last_failure_osd_epoch 0 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: max_mds 2 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: in 0,1 2024-09-17T01:43:40.221 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: up {0=14576,1=24301} 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: failed 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: damaged 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: stopped 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: data_pools [3] 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: metadata_pool 2 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: inline_data enabled 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: balancer 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: bal_rank_mask -1 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: standby_count_wanted 1 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:40.222 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: [mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout: 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 ceph-mon[92957]: mon.smithi082@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 bash[92938]: 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 2024-09-17T01:43:40.223 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:39 smithi082 systemd[1]: Started Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:43:41.607 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:43:41.607 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:43:41.607 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:41.607 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: pgmap v30: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: mon.smithi082 calling monitor election 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: monmap epoch 2 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: min_mon_release 19 (squid) 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: election_strategy: 1 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:43:41.608 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: mgrmap e33: smithi082.oppacm(active, since 55s), standbys: smithi167.ysmbcy 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='' 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:41.609 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi082"}]: dispatch 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "mon metadata", "id": "smithi167"}]: dispatch 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: pgmap v30: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: mon.smithi082 calling monitor election 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: monmap epoch 2 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:43:41.610 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: min_mon_release 19 (squid) 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: election_strategy: 1 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: mgrmap e33: smithi082.oppacm(active, since 55s), standbys: smithi167.ysmbcy 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:41.611 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='' 2024-09-17T01:43:41.612 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:41.612 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:41 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:42.614 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:42 smithi082 ceph-mon[92957]: pgmap v31: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:43:42.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:42 smithi167 ceph-mon[35643]: pgmap v31: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:43:44.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:44 smithi082 ceph-mon[92957]: pgmap v32: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:43:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:44 smithi167 ceph-mon[35643]: pgmap v32: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-09-17T01:43:45.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 -- 172.21.15.82:0/1139656180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0100860 msgr2=0x7f49d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/1139656180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0100860 0x7f49d0100c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f49c00097e0 tx=0x7f49c002a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 -- 172.21.15.82:0/1139656180 shutdown_connections 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/1139656180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0101a60 0x7f49d0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/1139656180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0100860 0x7f49d0100c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 -- 172.21.15.82:0/1139656180 >> 172.21.15.82:0/1139656180 conn(0x7f49d00fc010 msgr2=0x7f49d00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 -- 172.21.15.82:0/1139656180 shutdown_connections 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 -- 172.21.15.82:0/1139656180 wait complete. 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.338+0000 7f49d4cc9640 1 Processor -- start 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49d4cc9640 1 -- start start 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49d4cc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49d4cc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 0x7f49d0199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49d4cc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f49d01096a0 con 0x7f49d0100860 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49d4cc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0109520 con 0x7f49d0101a60 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45650/0 (socket says 172.21.15.82:45650) 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 -- 172.21.15.82:0/649472445 learned_addr learned my addr 172.21.15.82:0/649472445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 -- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 msgr2=0x7f49d01996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 -- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 msgr2=0x7f49d01996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49ce59c640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49cdd9b640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 0x7f49d0199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49cdd9b640 1 -- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 msgr2=0x7f49d01996c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49cdd9b640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.339+0000 7f49cdd9b640 1 -- 172.21.15.82:0/649472445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d019a280 con 0x7f49d0101a60 2024-09-17T01:43:45.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49cdd9b640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 0x7f49d0199c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d6a0 tx=0x7f49c400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49c4017070 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d019ecc0 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49c40097c0 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f49c4003a90 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.340+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d019f1f0 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.341+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d0100c60 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.342+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f49c4009970 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.342+0000 7f49bf7fe640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 0x7f49b807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.342+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f49c409dc90 con 0x7f49d0101a60 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.342+0000 7f49ce59c640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 0x7f49b807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.343+0000 7f49ce59c640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 0x7f49b807d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49c00095f0 tx=0x7f49c0005af0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.347+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f49c4069260 con 0x7f49d0101a60 2024-09-17T01:43:45.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.547+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f49d0062630 con 0x7f49b807b050 2024-09-17T01:43:45.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.548+0000 7f49bf7fe640 1 -- 172.21.15.82:0/649472445 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f49d0062630 con 0x7f49b807b050 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 msgr2=0x7f49b807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 0x7f49b807d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49c00095f0 tx=0x7f49c0005af0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 msgr2=0x7f49d0199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 0x7f49d0199c00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d6a0 tx=0x7f49c400db60 comp rx=0 tx=0).stop 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 shutdown_connections 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f49b807b050 0x7f49b807d510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49d0101a60 0x7f49d0199c00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 --2- 172.21.15.82:0/649472445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49d0100860 0x7f49d01996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 >> 172.21.15.82:0/649472445 conn(0x7f49d00fc010 msgr2=0x7f49d00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 shutdown_connections 2024-09-17T01:43:45.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.551+0000 7f49d4cc9640 1 -- 172.21.15.82:0/649472445 wait complete. 2024-09-17T01:43:45.558 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:43:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 -- 172.21.15.82:0/2864023939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 msgr2=0x7f05dc1025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 --2- 172.21.15.82:0/2864023939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc1025f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f05d00097e0 tx=0x7f05d002a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 -- 172.21.15.82:0/2864023939 shutdown_connections 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 --2- 172.21.15.82:0/2864023939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 --2- 172.21.15.82:0/2864023939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc1025f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 -- 172.21.15.82:0/2864023939 >> 172.21.15.82:0/2864023939 conn(0x7f05dc0fc010 msgr2=0x7f05dc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 -- 172.21.15.82:0/2864023939 shutdown_connections 2024-09-17T01:43:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.634+0000 7f05e2c84640 1 -- 172.21.15.82:0/2864023939 wait complete. 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 Processor -- start 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 -- start start 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc19dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc110d90 con 0x7f05dc102b30 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05e2c84640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc110c10 con 0x7f05dc1001e0 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45658/0 (socket says 172.21.15.82:45658) 2024-09-17T01:43:45.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05dbfff640 1 -- 172.21.15.82:0/4076400653 learned_addr learned my addr 172.21.15.82:0/4076400653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.635+0000 7f05dbfff640 1 -- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 msgr2=0x7f05dc19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05dbfff640 1 -- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 msgr2=0x7f05dc19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05dbfff640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e0a20640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc19dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05dbfff640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e0a20640 1 -- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 msgr2=0x7f05dc19dff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e0a20640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e0a20640 1 -- 172.21.15.82:0/4076400653 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc19e670 con 0x7f05dc1001e0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e0a20640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc19dab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05d002a910 tx=0x7f05d00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d0040070 con 0x7f05dc1001e0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05d0030c00 con 0x7f05dc1001e0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc1a3050 con 0x7f05dc1001e0 2024-09-17T01:43:45.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.636+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d0003d50 con 0x7f05dc1001e0 2024-09-17T01:43:45.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.637+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc1a35e0 con 0x7f05dc1001e0 2024-09-17T01:43:45.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.638+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc1005e0 con 0x7f05dc1001e0 2024-09-17T01:43:45.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.638+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f05d0039040 con 0x7f05dc1001e0 2024-09-17T01:43:45.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.639+0000 7f05d9ffb640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 0x7f05cc07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.639+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f05d00bf810 con 0x7f05dc1001e0 2024-09-17T01:43:45.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.639+0000 7f05dbfff640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 0x7f05cc07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.640+0000 7f05dbfff640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 0x7f05cc07d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005fd0 tx=0x7f05c8005f40 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.643+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f05d008aca0 con 0x7f05dc1001e0 2024-09-17T01:43:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.838+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05dc103510 con 0x7f05cc07b050 2024-09-17T01:43:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.839+0000 7f05d9ffb640 1 -- 172.21.15.82:0/4076400653 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f05dc103510 con 0x7f05cc07b050 2024-09-17T01:43:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 msgr2=0x7f05cc07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 0x7f05cc07d510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005fd0 tx=0x7f05c8005f40 comp rx=0 tx=0).stop 2024-09-17T01:43:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 msgr2=0x7f05dc19dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc19dab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f05d002a910 tx=0x7f05d00045e0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 shutdown_connections 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f05cc07b050 0x7f05cc07d510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05dc102b30 0x7f05dc19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 --2- 172.21.15.82:0/4076400653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05dc1001e0 0x7f05dc19dab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 >> 172.21.15.82:0/4076400653 conn(0x7f05dc0fc010 msgr2=0x7f05dc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 shutdown_connections 2024-09-17T01:43:45.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.841+0000 7f05e2c84640 1 -- 172.21.15.82:0/4076400653 wait complete. 2024-09-17T01:43:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 -- 172.21.15.82:0/650534403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c100860 msgr2=0x7fdf3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 --2- 172.21.15.82:0/650534403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c100860 0x7fdf3c100c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf380097e0 tx=0x7fdf3802a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 -- 172.21.15.82:0/650534403 shutdown_connections 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 --2- 172.21.15.82:0/650534403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c101a60 0x7fdf3c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 --2- 172.21.15.82:0/650534403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c100860 0x7fdf3c100c60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.922+0000 7fdf4392c640 1 -- 172.21.15.82:0/650534403 >> 172.21.15.82:0/650534403 conn(0x7fdf3c0fc010 msgr2=0x7fdf3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.923+0000 7fdf4392c640 1 -- 172.21.15.82:0/650534403 shutdown_connections 2024-09-17T01:43:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.923+0000 7fdf4392c640 1 -- 172.21.15.82:0/650534403 wait complete. 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.923+0000 7fdf4392c640 1 Processor -- start 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.923+0000 7fdf4392c640 1 -- start start 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf4392c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf4392c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 0x7fdf3c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf4392c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c1096a0 con 0x7fdf3c100860 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf4392c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c109520 con 0x7fdf3c101a60 2024-09-17T01:43:45.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45670/0 (socket says 172.21.15.82:45670) 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 -- 172.21.15.82:0/1859957170 learned_addr learned my addr 172.21.15.82:0/1859957170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 -- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 msgr2=0x7fdf3c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 -- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 msgr2=0x7fdf3c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf416c8640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf40ec7640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 0x7fdf3c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf40ec7640 1 -- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 msgr2=0x7fdf3c1963d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf40ec7640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.924+0000 7fdf40ec7640 1 -- 172.21.15.82:0/1859957170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c196f90 con 0x7fdf3c101a60 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf40ec7640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 0x7fdf3c196910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000d6a0 tx=0x7fdf3000db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf30017070 con 0x7fdf3c101a60 2024-09-17T01:43:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c19b9d0 con 0x7fdf3c101a60 2024-09-17T01:43:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf300097c0 con 0x7fdf3c101a60 2024-09-17T01:43:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf30003a90 con 0x7fdf3c101a60 2024-09-17T01:43:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.925+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c19bf60 con 0x7fdf3c101a60 2024-09-17T01:43:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.926+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c100c60 con 0x7fdf3c101a60 2024-09-17T01:43:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.927+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fdf30009970 con 0x7fdf3c101a60 2024-09-17T01:43:45.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.928+0000 7fdf2e7fc640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 0x7fdf2807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:45.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.928+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fdf3009dd20 con 0x7fdf3c101a60 2024-09-17T01:43:45.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.928+0000 7fdf416c8640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 0x7fdf2807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:45.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.928+0000 7fdf416c8640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 0x7fdf2807d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf380095f0 tx=0x7fdf38005af0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:45.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:45.931+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdf30069270 con 0x7fdf3c101a60 2024-09-17T01:43:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.131+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdf3c0626f0 con 0x7fdf2807b050 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.153+0000 7fdf2e7fc640 1 -- 172.21.15.82:0/1859957170 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdf3c0626f0 con 0x7fdf2807b050 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (8m) 16s ago 10m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (2m) 16s ago 10m 8586k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (96s) 18s ago 9m 8434k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (10m) 16s ago 10m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de c510dbfbd20a 2024-09-17T01:43:46.152 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (9m) 18s ago 9m 6895k - 19.1.1-330-gc2ddf972 ebb0615149de 2e89c1391535 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (8m) 16s ago 10m 81.8M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (4m) 16s ago 4m 166M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (4m) 16s ago 4m 95.6M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (4m) 18s ago 4m 29.5M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (4m) 18s ago 4m 26.2M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (90s) 16s ago 11m 574M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (22s) 18s ago 9m 130M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 starting - - - 2048M 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (9m) 18s ago 9m 47.0M 2048M 19.1.1-330-gc2ddf972 ebb0615149de 3fc15257bb15 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (10m) 16s ago 10m 15.0M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (9m) 18s ago 9m 16.1M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:43:46.153 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (8m) 16s ago 8m 209M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (7m) 16s ago 7m 228M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (7m) 16s ago 7m 179M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (6m) 18s ago 6m 257M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (6m) 18s ago 6m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (5m) 18s ago 5m 192M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:43:46.154 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (27s) 16s ago 9m 44.3M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 msgr2=0x7fdf2807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 0x7fdf2807d510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdf380095f0 tx=0x7fdf38005af0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 msgr2=0x7fdf3c196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 0x7fdf3c196910 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000d6a0 tx=0x7fdf3000db60 comp rx=0 tx=0).stop 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 shutdown_connections 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdf2807b050 0x7fdf2807d510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3c101a60 0x7fdf3c196910 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 --2- 172.21.15.82:0/1859957170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf3c100860 0x7fdf3c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 >> 172.21.15.82:0/1859957170 conn(0x7fdf3c0fc010 msgr2=0x7fdf3c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 shutdown_connections 2024-09-17T01:43:46.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.155+0000 7fdf4392c640 1 -- 172.21.15.82:0/1859957170 wait complete. 2024-09-17T01:43:46.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 -- 172.21.15.82:0/753528727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 msgr2=0x7fa520102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 --2- 172.21.15.82:0/753528727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa520102fe0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5140097e0 tx=0x7fa51402a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 -- 172.21.15.82:0/753528727 shutdown_connections 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 --2- 172.21.15.82:0/753528727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa520102fe0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 --2- 172.21.15.82:0/753528727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 -- 172.21.15.82:0/753528727 >> 172.21.15.82:0/753528727 conn(0x7fa5200fd0f0 msgr2=0x7fa5200ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 -- 172.21.15.82:0/753528727 shutdown_connections 2024-09-17T01:43:46.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.241+0000 7fa5259dd640 1 -- 172.21.15.82:0/753528727 wait complete. 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 Processor -- start 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 -- start start 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa5200745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa52010a7a0 con 0x7fa520101960 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.242+0000 7fa5259dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa52010a620 con 0x7fa520102b60 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45688/0 (socket says 172.21.15.82:45688) 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 -- 172.21.15.82:0/555792344 learned_addr learned my addr 172.21.15.82:0/555792344 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51e7fc640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa5200745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 -- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 msgr2=0x7fa520075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:43:46.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 -- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 msgr2=0x7fa520075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51effd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51e7fc640 1 -- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 msgr2=0x7fa520075f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51e7fc640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51e7fc640 1 -- 172.21.15.82:0/555792344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa520074b20 con 0x7fa520102b60 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.243+0000 7fa51e7fc640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa5200745e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa51402a910 tx=0x7fa5140045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.244+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa514040070 con 0x7fa520102b60 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.244+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa514030c00 con 0x7fa520102b60 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.244+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa520074db0 con 0x7fa520102b60 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.244+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa514003d80 con 0x7fa520102b60 2024-09-17T01:43:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.244+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5200752e0 con 0x7fa520102b60 2024-09-17T01:43:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.245+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa520101d60 con 0x7fa520102b60 2024-09-17T01:43:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.245+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7fa514039040 con 0x7fa520102b60 2024-09-17T01:43:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.246+0000 7fa5249db640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 0x7fa50807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.246+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fa5140bf5b0 con 0x7fa520102b60 2024-09-17T01:43:46.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.246+0000 7fa51effd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 0x7fa50807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.246+0000 7fa51effd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 0x7fa50807d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa510005f80 tx=0x7fa510005f10 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.251+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa51408aa40 con 0x7fa520102b60 2024-09-17T01:43:46.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.518+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa520062df0 con 0x7fa520102b60 2024-09-17T01:43:46.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.519+0000 7fa5249db640 1 -- 172.21.15.82:0/555792344 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+839 (secure 0 0 0) 0x7fa51408f8f0 con 0x7fa520102b60 2024-09-17T01:43:46.518 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:43:46.518 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:43:46.518 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:43:46.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 11, 2024-09-17T01:43:46.520 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 3 2024-09-17T01:43:46.520 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:43:46.520 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 msgr2=0x7fa50807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 0x7fa50807d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa510005f80 tx=0x7fa510005f10 comp rx=0 tx=0).stop 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 msgr2=0x7fa5200745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa5200745e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa51402a910 tx=0x7fa5140045e0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 shutdown_connections 2024-09-17T01:43:46.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa50807b050 0x7fa50807d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa520102b60 0x7fa5200745e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 --2- 172.21.15.82:0/555792344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa520101960 0x7fa520075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 >> 172.21.15.82:0/555792344 conn(0x7fa5200fd0f0 msgr2=0x7fa520106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 shutdown_connections 2024-09-17T01:43:46.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.522+0000 7fa5259dd640 1 -- 172.21.15.82:0/555792344 wait complete. 2024-09-17T01:43:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 -- 172.21.15.82:0/3201473088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 msgr2=0x7f4198100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 --2- 172.21.15.82:0/3201473088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198100c60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4190009b60 tx=0x7f419002a770 comp rx=0 tx=0).stop 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 -- 172.21.15.82:0/3201473088 shutdown_connections 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 --2- 172.21.15.82:0/3201473088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198101a60 0x7f4198101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 --2- 172.21.15.82:0/3201473088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198100860 0x7f4198100c60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 -- 172.21.15.82:0/3201473088 >> 172.21.15.82:0/3201473088 conn(0x7f41980fc010 msgr2=0x7f41980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 -- 172.21.15.82:0/3201473088 shutdown_connections 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.607+0000 7f41a05ca640 1 -- 172.21.15.82:0/3201473088 wait complete. 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 Processor -- start 2024-09-17T01:43:46.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 -- start start 2024-09-17T01:43:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f419819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41981096a0 con 0x7f4198100860 2024-09-17T01:43:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f41a05ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4198109520 con 0x7f4198101a60 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45712/0 (socket says 172.21.15.82:45712) 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 -- 172.21.15.82:0/4010921161 learned_addr learned my addr 172.21.15.82:0/4010921161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 -- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 msgr2=0x7f419806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 -- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 msgr2=0x7f419806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419e366640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.608+0000 7f419db65640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f419819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f419db65640 1 -- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 msgr2=0x7f419806a790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f419db65640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f419db65640 1 -- 172.21.15.82:0/4010921161 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419819c7b0 con 0x7f4198101a60 2024-09-17T01:43:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f419db65640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f419819c1f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f418c00d6d0 tx=0x7f418c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418c017070 con 0x7f4198101a60 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f418c0097c0 con 0x7f4198101a60 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419819caa0 con 0x7f4198101a60 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418c003ad0 con 0x7f4198101a60 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.609+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419819d0b0 con 0x7f4198101a60 2024-09-17T01:43:46.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.610+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4198100c60 con 0x7f4198101a60 2024-09-17T01:43:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.611+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f418c003d80 con 0x7f4198101a60 2024-09-17T01:43:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.612+0000 7f41977fe640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 0x7f418007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.612+0000 7f419e366640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 0x7f418007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.612+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f418c09deb0 con 0x7f4198101a60 2024-09-17T01:43:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.612+0000 7f419e366640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 0x7f418007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4190030880 tx=0x7f4190005e30 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.616+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f418c069230 con 0x7f4198101a60 2024-09-17T01:43:46.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.837+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4198062df0 con 0x7f4198101a60 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: pgmap v33: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:46.836 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:46 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/555792344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.837+0000 7f41977fe640 1 -- 172.21.15.82:0/4010921161 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f418c06e0e0 con 0x7f4198101a60 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:46.837 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:43:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:43:46.839 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:46.840 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.839+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 msgr2=0x7f418007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 0x7f418007d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4190030880 tx=0x7f4190005e30 comp rx=0 tx=0).stop 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 msgr2=0x7f419819c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f419819c1f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f418c00d6d0 tx=0x7f418c00db90 comp rx=0 tx=0).stop 2024-09-17T01:43:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 shutdown_connections 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f418007b050 0x7f418007d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4198101a60 0x7f419819c1f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 --2- 172.21.15.82:0/4010921161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4198100860 0x7f419806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 >> 172.21.15.82:0/4010921161 conn(0x7f41980fc010 msgr2=0x7f4198104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 shutdown_connections 2024-09-17T01:43:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.840+0000 7f41a05ca640 1 -- 172.21.15.82:0/4010921161 wait complete. 2024-09-17T01:43:46.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- 172.21.15.82:0/1415059026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc101a60 msgr2=0x7f09dc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:46.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/1415059026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc101a60 0x7f09dc101ee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0097e0 tx=0x7f09cc02a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- 172.21.15.82:0/1415059026 shutdown_connections 2024-09-17T01:43:46.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/1415059026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc101a60 0x7f09dc101ee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/1415059026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc100860 0x7f09dc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- 172.21.15.82:0/1415059026 >> 172.21.15.82:0/1415059026 conn(0x7f09dc0fc010 msgr2=0x7f09dc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:46.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- 172.21.15.82:0/1415059026 shutdown_connections 2024-09-17T01:43:46.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- 172.21.15.82:0/1415059026 wait complete. 2024-09-17T01:43:46.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 Processor -- start 2024-09-17T01:43:46.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.929+0000 7f09e3e3a640 1 -- start start 2024-09-17T01:43:46.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e3e3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 0x7f09dc104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e3e3a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e3e3a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc1096a0 con 0x7f09dc101a60 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e3e3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc109520 con 0x7f09dc100860 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45724/0 (socket says 172.21.15.82:45724) 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 -- 172.21.15.82:0/3767779951 learned_addr learned my addr 172.21.15.82:0/3767779951 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e1bd6640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 0x7f09dc104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 -- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 msgr2=0x7f09dc102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 -- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 msgr2=0x7f09dc102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e13d5640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:46.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e1bd6640 1 -- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 msgr2=0x7f09dc102e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e1bd6640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e1bd6640 1 -- 172.21.15.82:0/3767779951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc103380 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.930+0000 7f09e1bd6640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 0x7f09dc104780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d6a0 tx=0x7f09d800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.931+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09d8017070 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.931+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc103670 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.931+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09d8009820 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.931+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09d8003a50 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.931+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc103c00 con 0x7f09dc100860 2024-09-17T01:43:46.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.932+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc100c60 con 0x7f09dc100860 2024-09-17T01:43:46.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.932+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f09d80099d0 con 0x7f09dc100860 2024-09-17T01:43:46.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.933+0000 7f09d2ffd640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 0x7f09c807d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:46.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.933+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f09d809ddc0 con 0x7f09dc100860 2024-09-17T01:43:46.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.933+0000 7f09e13d5640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 0x7f09c807d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:46.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.933+0000 7f09e13d5640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 0x7f09c807d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f09dc104500 tx=0x7f09cc030890 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:46.938+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f09d80691d0 con 0x7f09dc100860 2024-09-17T01:43:47.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: pgmap v33: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: from='client.24607 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T01:43:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:46 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/555792344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:47.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.153+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f09dc06a3e0 con 0x7f09c807b050 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.154+0000 7f09d2ffd640 1 -- 172.21.15.82:0/3767779951 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f09dc06a3e0 con 0x7f09c807b050 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:43:47.153 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr" 2024-09-17T01:43:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:43:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "3/23 daemons upgraded", 2024-09-17T01:43:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mon daemons", 2024-09-17T01:43:47.154 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:43:47.154 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:43:47.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 msgr2=0x7f09c807d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 0x7f09c807d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f09dc104500 tx=0x7f09cc030890 comp rx=0 tx=0).stop 2024-09-17T01:43:47.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 msgr2=0x7f09dc104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 0x7f09dc104780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09d800d6a0 tx=0x7f09d800db60 comp rx=0 tx=0).stop 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 shutdown_connections 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09c807b050 0x7f09c807d510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09dc101a60 0x7f09dc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 --2- 172.21.15.82:0/3767779951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09dc100860 0x7f09dc104780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 >> 172.21.15.82:0/3767779951 conn(0x7f09dc0fc010 msgr2=0x7f09dc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 shutdown_connections 2024-09-17T01:43:47.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.156+0000 7f09e3e3a640 1 -- 172.21.15.82:0/3767779951 wait complete. 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 -- 172.21.15.82:0/372386886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c101960 msgr2=0x7f5b0c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 --2- 172.21.15.82:0/372386886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c101960 0x7f5b0c101d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0097e0 tx=0x7f5afc02a3f0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 -- 172.21.15.82:0/372386886 shutdown_connections 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 --2- 172.21.15.82:0/372386886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c102b60 0x7f5b0c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 --2- 172.21.15.82:0/372386886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c101960 0x7f5b0c101d60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 -- 172.21.15.82:0/372386886 >> 172.21.15.82:0/372386886 conn(0x7f5b0c0fd0f0 msgr2=0x7f5b0c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 -- 172.21.15.82:0/372386886 shutdown_connections 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.239+0000 7f5b127f8640 1 -- 172.21.15.82:0/372386886 wait complete. 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 Processor -- start 2024-09-17T01:43:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 -- start start 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 0x7f5b0c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10a7a0 con 0x7f5b0c101960 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b127f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10a620 con 0x7f5b0c102b60 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34020/0 (socket says 172.21.15.82:34020) 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b0bfff640 1 -- 172.21.15.82:0/3003815512 learned_addr learned my addr 172.21.15.82:0/3003815512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.240+0000 7f5b0b7fe640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 0x7f5b0c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0bfff640 1 -- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 msgr2=0x7f5b0c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0bfff640 1 -- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 msgr2=0x7f5b0c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0bfff640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0bfff640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0b7fe640 1 -- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 msgr2=0x7f5b0c1974a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0b7fe640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0b7fe640 1 -- 172.21.15.82:0/3003815512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c198060 con 0x7f5b0c102b60 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b0b7fe640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 0x7f5b0c1979e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d6a0 tx=0x7f5b0000db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b00017070 con 0x7f5b0c102b60 2024-09-17T01:43:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c19caa0 con 0x7f5b0c102b60 2024-09-17T01:43:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b000097c0 con 0x7f5b0c102b60 2024-09-17T01:43:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b00003a90 con 0x7f5b0c102b60 2024-09-17T01:43:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.241+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c19d030 con 0x7f5b0c102b60 2024-09-17T01:43:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.242+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c101d60 con 0x7f5b0c102b60 2024-09-17T01:43:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.243+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f5b00009970 con 0x7f5b0c102b60 2024-09-17T01:43:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.244+0000 7f5b097fa640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 0x7f5af407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:43:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.244+0000 7f5b0bfff640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 0x7f5af407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:43:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.244+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f5b0009dd80 con 0x7f5b0c102b60 2024-09-17T01:43:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.244+0000 7f5b0bfff640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 0x7f5af407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0095f0 tx=0x7f5afc005af0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:43:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.248+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5b00069290 con 0x7f5b0c102b60 2024-09-17T01:43:47.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.501+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5b0c1915b0 con 0x7f5b0c102b60 2024-09-17T01:43:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.502+0000 7f5b097fa640 1 -- 172.21.15.82:0/3003815512 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f5b0006e140 con 0x7f5b0c102b60 2024-09-17T01:43:47.501 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:47.501 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:47.501 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 msgr2=0x7f5af407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 0x7f5af407d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0095f0 tx=0x7f5afc005af0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 msgr2=0x7f5b0c1979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:43:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 0x7f5b0c1979e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000d6a0 tx=0x7f5b0000db60 comp rx=0 tx=0).stop 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 shutdown_connections 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5af407b050 0x7f5af407d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b0c102b60 0x7f5b0c1979e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 --2- 172.21.15.82:0/3003815512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b0c101960 0x7f5b0c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 >> 172.21.15.82:0/3003815512 conn(0x7f5b0c0fd0f0 msgr2=0x7f5b0c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 shutdown_connections 2024-09-17T01:43:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:43:47.504+0000 7f5b127f8640 1 -- 172.21.15.82:0/3003815512 wait complete. 2024-09-17T01:43:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='client.24615 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:47.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/4010921161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:43:47.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:47 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3003815512' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='client.24611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='client.24615 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/4010921161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-17T01:43:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:47 smithi167 ceph-mon[35643]: from='client.? 172.21.15.82:0/3003815512' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-17T01:43:48.814 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:48 smithi082 ceph-mon[92957]: from='client.24627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:48.814 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:48 smithi082 ceph-mon[92957]: pgmap v34: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:43:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:48 smithi167 ceph-mon[35643]: from='client.24627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:43:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:48 smithi167 ceph-mon[35643]: pgmap v34: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:43:50.918 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: pgmap v35: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:50.918 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.918 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.918 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:50.918 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:50.919 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.919 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:50.919 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:50.919 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:50 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:43:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: pgmap v35: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T01:43:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:50.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T01:43:50.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "versions"}]: dispatch 2024-09-17T01:43:50.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: pgmap v36: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: Upgrade: Updating mon.smithi167 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:52.907 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:52 smithi167 ceph-mon[35643]: Deploying daemon mon.smithi167 on smithi167 2024-09-17T01:43:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: pgmap v36: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:43:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: Upgrade: Updating mon.smithi167 2024-09-17T01:43:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: from='mgr.24519 ' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T01:43:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T01:43:52.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T01:43:52.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:52 smithi082 ceph-mon[92957]: Deploying daemon mon.smithi167 on smithi167 2024-09-17T01:43:53.437 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 systemd[1]: Stopping Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:43:53.729 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167[35635]: 2024-09-17T01:43:53.439+0000 7f832d756640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi167 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:43:53.729 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167[35635]: 2024-09-17T01:43:53.439+0000 7f832d756640 -1 mon.smithi167@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T01:43:53.729 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 podman[76161]: 2024-09-17 01:43:53.500408236 +0000 UTC m=+0.176140443 container died 3fc15257bb15069770eb1e9b7635092a85813a82fdd8c41f66ed7f8fa5306566 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:43:54.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 podman[76161]: 2024-09-17 01:43:53.93128834 +0000 UTC m=+0.607020535 container cleanup 3fc15257bb15069770eb1e9b7635092a85813a82fdd8c41f66ed7f8fa5306566 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, CEPH_POINT_RELEASE=, RELEASE=squid-c2ddf97, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T01:43:54.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:53 smithi167 bash[76161]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167 2024-09-17T01:43:54.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 podman[76173]: 2024-09-17 01:43:54.133626997 +0000 UTC m=+0.633105562 container remove 3fc15257bb15069770eb1e9b7635092a85813a82fdd8c41f66ed7f8fa5306566 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:43:54.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi167.service: Deactivated successfully. 2024-09-17T01:43:54.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 systemd[1]: Stopped Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:43:54.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi167.service: Consumed 6.246s CPU time. 2024-09-17T01:43:54.906 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 systemd[1]: Starting Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:43:54.906 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 podman[76304]: 2024-09-17 01:43:54.683350859 +0000 UTC m=+0.015593524 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:43:54.906 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:54 smithi167 podman[76304]: 2024-09-17 01:43:54.802010347 +0000 UTC m=+0.134253056 container create ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:43:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 podman[76304]: 2024-09-17 01:43:55.021404213 +0000 UTC m=+0.353646887 container init ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T01:43:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 podman[76304]: 2024-09-17 01:43:55.024625666 +0000 UTC m=+0.356868330 container start ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-17T01:43:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T01:43:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev), process ceph-mon, pid 2 2024-09-17T01:43:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: pidfile_write: ignore empty --pid-file 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: load: jerasure load: lrc 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: RocksDB version: 7.9.2 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Git sha 0 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Compile date 2024-09-17 00:23:36 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: DB SUMMARY 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: DB Session ID: EQESV4IA10SFVP2OCUR9 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: CURRENT file: CURRENT 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi167/store.db dir, Total Num: 1, files: 000027.sst 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi167/store.db: 000025.log size: 550232 ; 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.error_if_exists: 0 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.create_if_missing: 0 2024-09-17T01:43:55.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.paranoid_checks: 1 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.env: 0x5571bb857d60 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.info_log: 0x5571c1ec1580 2024-09-17T01:43:55.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.statistics: (nil) 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.use_fsync: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_log_file_size: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_fallocate: 1 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T01:43:55.258 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.use_direct_reads: 0 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.db_log_dir: 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.wal_dir: 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T01:43:55.259 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.write_buffer_manager: 0x5571c1ec5d60 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T01:43:55.260 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.unordered_write: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.row_cache: None 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.wal_filter: None 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.two_write_queues: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T01:43:55.261 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.wal_compression: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.atomic_flush: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.log_readahead_size: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T01:43:55.262 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_background_jobs: 2 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_background_compactions: -1 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_subcompactions: 1 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T01:43:55.263 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_open_files: -1 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_background_flushes: -1 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Compression algorithms supported: 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kZSTD supported: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kXpressCompression supported: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kBZip2Compression supported: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kLZ4Compression supported: 1 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kZlibCompression supported: 1 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T01:43:55.264 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: kSnappyCompression supported: 1 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi167/store.db/MANIFEST-000010 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.merge_operator: 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_filter: None 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T01:43:55.265 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5571c1ec11a0) 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_type: 0 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: data_block_index_type: 0 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_shortening: 1 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: checksum: 4 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: no_block_cache: 0 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache: 0x5571bde85610 2024-09-17T01:43:55.266 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_options: 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: capacity : 536870912 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: num_shard_bits : 4 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: strict_capacity_limit : 0 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_cache_compressed: (nil) 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: persistent_cache: (nil) 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_size: 4096 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_size_deviation: 10 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_restart_interval: 16 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: index_block_restart_interval: 1 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: metadata_block_size: 4096 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: partition_filters: 0 2024-09-17T01:43:55.267 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: use_delta_encoding: 1 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: filter_policy: bloomfilter 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: whole_key_filtering: 1 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: verify_compression: 0 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: format_version: 5 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: enable_index_compression: 1 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: block_align: 0 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: max_auto_readahead_size: 262144 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: prepopulate_block_cache: 0 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: initial_auto_readahead_size: 8192 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T01:43:55.268 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression: NoCompression 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.num_levels: 7 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:43:55.269 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T01:43:55.270 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T01:43:55.271 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T01:43:55.272 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.inplace_update_support: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.bloom_locality: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.max_successive_merges: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T01:43:55.273 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.ttl: 2592000 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enable_blob_files: false 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.min_blob_size: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T01:43:55.274 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi167/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12245, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3318cc77-6367-425b-8da2-15138e2e6f56 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537435062590, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537435065868, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 321529, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12250, "largest_seqno": 12489, "table_properties": {"data_size": 319350, "index_size": 821, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 325, "raw_key_size": 2954, "raw_average_key_size": 24, "raw_value_size": 316594, "raw_average_value_size": 2660, "num_data_blocks": 36, "num_entries": 119, "num_filter_entries": 119, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726537435, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3318cc77-6367-425b-8da2-15138e2e6f56", "db_session_id": "EQESV4IA10SFVP2OCUR9", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726537435066001, "job": 1, "event": "recovery_finished"} 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi167/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T01:43:55.275 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5571c1ee4a80 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: DB pointer 0x5571c2c8a000 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** DB Stats ** 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-17T01:43:55.276 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: L0 1/0 313.99 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 187.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: L6 1/0 7.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Sum 2/0 7.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 187.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 187.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 187.2 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.277 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Cumulative compaction: 0.00 GB write, 47.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Interval compaction: 0.00 GB write, 47.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Block cache BinnedLRUCache@0x5571bde85610#2 capacity: 512.00 MB usage: 1.34 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.38 KB,7.30157e-05%) IndexBlock(1,0.95 KB,0.000181794%) Misc(1,0.00 KB,0%) 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: starting mon.smithi167 rank 1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi167 fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:55.278 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???) e2 preinit fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).mds e14 new map 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).mds e14 print_map 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: e14 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: legacy client fscid: 1 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: Filesystem 'cephfs' (1) 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: fs_name cephfs 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: epoch 14 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:43:55.279 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: tableserver 0 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: root 0 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: session_timeout 60 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: session_autoclose 300 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: max_file_size 1099511627776 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: max_xattr_size 65536 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: required_client_features {} 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: last_failure 0 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: last_failure_osd_epoch 0 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: max_mds 2 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: in 0,1 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: up {0=14576,1=24301} 2024-09-17T01:43:55.280 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: failed 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: damaged 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: stopped 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: data_pools [3] 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: metadata_pool 2 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: inline_data enabled 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: balancer 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: bal_rank_mask -1 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: standby_count_wanted 1 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: [mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: [mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: [mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: [mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:43:55.281 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout: 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 ceph-mon[76323]: mon.smithi167@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 bash[76304]: ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 2024-09-17T01:43:55.282 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:55 smithi167 systemd[1]: Started Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: pgmap v37: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: mon.smithi167 calling monitor election 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: mon.smithi082 calling monitor election 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: monmap epoch 2 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:43:56.427 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: min_mon_release 19 (squid) 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: election_strategy: 1 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: mgrmap e33: smithi082.oppacm(active, since 69s), standbys: smithi167.ysmbcy 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:56.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:43:56.429 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:56 smithi167 ceph-mon[76323]: pgmap v38: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:56.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: pgmap v37: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: mon.smithi167 calling monitor election 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: mon.smithi082 calling monitor election 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: mon.smithi082 is new leader, mons smithi082,smithi167 in quorum (ranks 0,1) 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: monmap epoch 2 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: fsid 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: last_changed 2024-09-17T01:34:21.979662+0000 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: created 2024-09-17T01:31:52.621485+0000 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: min_mon_release 19 (squid) 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: election_strategy: 1 2024-09-17T01:43:56.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.smithi082 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.smithi167 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2 up:standby-replay 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: osdmap e47: 6 total, 6 up, 6 in 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: mgrmap e33: smithi082.oppacm(active, since 69s), standbys: smithi167.ysmbcy 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:43:56.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:56 smithi082 ceph-mon[92957]: pgmap v38: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:43:58.884 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:58 smithi167 ceph-mon[76323]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:43:58.884 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:58 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.884 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:58 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.884 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:58 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.884 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:43:58 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:58 smithi082 ceph-mon[92957]: pgmap v39: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:43:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:58 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:58 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:58 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:43:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:43:58 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:00 smithi082 ceph-mon[92957]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:01.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:00 smithi167 ceph-mon[76323]: pgmap v40: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"} : dispatch 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi167"} : dispatch 2024-09-17T01:44:01.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi167"}]': finished 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.886 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"} : dispatch 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi082"}]': finished 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi167"} : dispatch 2024-09-17T01:44:01.887 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi167"}]': finished 2024-09-17T01:44:02.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:02 smithi167 ceph-mon[76323]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:44:02.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:02 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all mon 2024-09-17T01:44:02.896 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:02 smithi082 ceph-mon[92957]: pgmap v41: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:44:02.896 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:02 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all mon 2024-09-17T01:44:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: Upgrade: Updating crash.smithi082 (1/2) 2024-09-17T01:44:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T01:44:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:04.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: Deploying daemon crash.smithi082 on smithi082 2024-09-17T01:44:04.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:03 smithi082 ceph-mon[92957]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: Upgrade: Updating crash.smithi082 (1/2) 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi082", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: Deploying daemon crash.smithi082 on smithi082 2024-09-17T01:44:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:03 smithi167 ceph-mon[76323]: pgmap v42: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:06.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:06 smithi082 ceph-mon[92957]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:06.908 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:06 smithi167 ceph-mon[76323]: pgmap v43: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:07.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:07.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:08.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:08 smithi167 ceph-mon[76323]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:44:08.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:08.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T01:44:08.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:08 smithi082 ceph-mon[92957]: pgmap v44: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:44:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi167", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-17T01:44:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:09.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:09 smithi167 ceph-mon[76323]: Upgrade: Updating crash.smithi167 (2/2) 2024-09-17T01:44:09.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:09 smithi167 ceph-mon[76323]: Deploying daemon crash.smithi167 on smithi167 2024-09-17T01:44:09.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:09 smithi082 ceph-mon[92957]: Upgrade: Updating crash.smithi167 (2/2) 2024-09-17T01:44:09.867 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:09 smithi082 ceph-mon[92957]: Deploying daemon crash.smithi167 on smithi167 2024-09-17T01:44:10.819 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:10 smithi167 ceph-mon[76323]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:10 smithi082 ceph-mon[92957]: pgmap v45: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:12.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:12.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:12 smithi167 ceph-mon[76323]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:44:12.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:12.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:12.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:12 smithi082 ceph-mon[92957]: pgmap v46: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:44:14.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:14 smithi082 ceph-mon[92957]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:14.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:14.884 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:15.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:14 smithi167 ceph-mon[76323]: pgmap v47: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:16.027 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: pgmap v48: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:17.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 -- 172.21.15.82:0/3858054980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504101a60 msgr2=0x7f2504101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 --2- 172.21.15.82:0/3858054980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504101a60 0x7f2504101ee0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009880 tx=0x7f24f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 -- 172.21.15.82:0/3858054980 shutdown_connections 2024-09-17T01:44:17.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 --2- 172.21.15.82:0/3858054980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504101a60 0x7f2504101ee0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 --2- 172.21.15.82:0/3858054980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504100860 0x7f2504100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 -- 172.21.15.82:0/3858054980 >> 172.21.15.82:0/3858054980 conn(0x7f25040fc010 msgr2=0x7f25040fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 -- 172.21.15.82:0/3858054980 shutdown_connections 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.591+0000 7f250b37a640 1 -- 172.21.15.82:0/3858054980 wait complete. 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 Processor -- start 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 -- start start 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504101a60 0x7f2504197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25041096a0 con 0x7f2504100860 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f250b37a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2504109520 con 0x7f2504101a60 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f2509116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f2509116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51720/0 (socket says 172.21.15.82:51720) 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f2509116640 1 -- 172.21.15.82:0/2500121716 learned_addr learned my addr 172.21.15.82:0/2500121716 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.592+0000 7f2508915640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504101a60 0x7f2504197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f2509116640 1 -- 172.21.15.82:0/2500121716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504101a60 msgr2=0x7f2504197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f2509116640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504101a60 0x7f2504197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f2509116640 1 -- 172.21.15.82:0/2500121716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041980e0 con 0x7f2504100860 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f2509116640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f250000d8d0 tx=0x7f250000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2500017070 con 0x7f2504100860 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f250000be10 con 0x7f2504100860 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f250000f3c0 con 0x7f2504100860 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250419cb20 con 0x7f2504100860 2024-09-17T01:44:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.593+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250419d080 con 0x7f2504100860 2024-09-17T01:44:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.594+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2504100c60 con 0x7f2504100860 2024-09-17T01:44:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.595+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 33) ==== 103422+0+0 (secure 0 0 0) 0x7f250001a070 con 0x7f2504100860 2024-09-17T01:44:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.595+0000 7f24fa7fc640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 0x7f24f007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.596+0000 7f2508915640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 0x7f24f007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.596+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f250009dc70 con 0x7f2504100860 2024-09-17T01:44:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.596+0000 7f2508915640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 0x7f24f007d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24f4000c00 tx=0x7f24f40058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:17.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.601+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2500069180 con 0x7f2504100860 2024-09-17T01:44:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.739+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f25000107b0 con 0x7f2504100860 2024-09-17T01:44:17.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.808+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f250406a970 con 0x7f24f007b0b0 2024-09-17T01:44:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.809+0000 7f24fa7fc640 1 -- 172.21.15.82:0/2500121716 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+402 (secure 0 0 0) 0x7f250406a970 con 0x7f24f007b0b0 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 msgr2=0x7f24f007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 0x7f24f007d570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24f4000c00 tx=0x7f24f40058d0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 msgr2=0x7f2504197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f250000d8d0 tx=0x7f250000dd90 comp rx=0 tx=0).stop 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 shutdown_connections 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f24f007b0b0 0x7f24f007d570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2504101a60 0x7f2504197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 --2- 172.21.15.82:0/2500121716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2504100860 0x7f2504197520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 >> 172.21.15.82:0/2500121716 conn(0x7f25040fc010 msgr2=0x7f250406a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 shutdown_connections 2024-09-17T01:44:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.812+0000 7f250b37a640 1 -- 172.21.15.82:0/2500121716 wait complete. 2024-09-17T01:44:17.819 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:44:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 -- 172.21.15.82:0/3786982085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 msgr2=0x7f6568100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 --2- 172.21.15.82:0/3786982085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568100c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6558009880 tx=0x7f655802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 -- 172.21.15.82:0/3786982085 shutdown_connections 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 --2- 172.21.15.82:0/3786982085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 --2- 172.21.15.82:0/3786982085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568100c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 -- 172.21.15.82:0/3786982085 >> 172.21.15.82:0/3786982085 conn(0x7f65680fc010 msgr2=0x7f65680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 -- 172.21.15.82:0/3786982085 shutdown_connections 2024-09-17T01:44:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.897+0000 7f656d00d640 1 -- 172.21.15.82:0/3786982085 wait complete. 2024-09-17T01:44:17.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 Processor -- start 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 -- start start 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f65681096a0 con 0x7f6568100860 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f656d00d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6568109520 con 0x7f6568101a60 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f6566d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f6566d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51744/0 (socket says 172.21.15.82:51744) 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f6566d9d640 1 -- 172.21.15.82:0/2467810638 learned_addr learned my addr 172.21.15.82:0/2467810638 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.898+0000 7f655ffff640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6566d9d640 1 -- 172.21.15.82:0/2467810638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 msgr2=0x7f6568197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6566d9d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:17.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6566d9d640 1 -- 172.21.15.82:0/2467810638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65681980e0 con 0x7f6568100860 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f655ffff640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6566d9d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6558006010 tx=0x7f65580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f655803f070 con 0x7f6568100860 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656819cac0 con 0x7f6568100860 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65580044d0 con 0x7f6568100860 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6558035030 con 0x7f6568100860 2024-09-17T01:44:17.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.899+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656819d050 con 0x7f6568100860 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.900+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6568100c60 con 0x7f6568100860 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.901+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6558042070 con 0x7f6568100860 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.901+0000 7f6564d99640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.901+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f65580bec30 con 0x7f6568100860 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.901+0000 7f655ffff640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:17.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.902+0000 7f655ffff640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 0x7f655407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6550005fd0 tx=0x7f6550005ea0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:17.906+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f655808a2e0 con 0x7f6568100860 2024-09-17T01:44:18.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.101+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f656806a930 con 0x7f655407af30 2024-09-17T01:44:18.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.102+0000 7f6564d99640 1 -- 172.21.15.82:0/2467810638 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+402 (secure 0 0 0) 0x7f656806a930 con 0x7f655407af30 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 msgr2=0x7f655407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 0x7f655407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6550005fd0 tx=0x7f6550005ea0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 msgr2=0x7f6568197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6558006010 tx=0x7f65580048f0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 shutdown_connections 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f655407af30 0x7f655407d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6568101a60 0x7f6568197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 --2- 172.21.15.82:0/2467810638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6568100860 0x7f6568197520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 >> 172.21.15.82:0/2467810638 conn(0x7f65680fc010 msgr2=0x7f656806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 shutdown_connections 2024-09-17T01:44:18.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.105+0000 7f656d00d640 1 -- 172.21.15.82:0/2467810638 wait complete. 2024-09-17T01:44:18.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 -- 172.21.15.82:0/1724914718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 msgr2=0x7feea0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 --2- 172.21.15.82:0/1724914718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea0100c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fee90009c20 tx=0x7fee9002a970 comp rx=0 tx=0).stop 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 -- 172.21.15.82:0/1724914718 shutdown_connections 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 --2- 172.21.15.82:0/1724914718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 0x7feea0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 --2- 172.21.15.82:0/1724914718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea0100c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 -- 172.21.15.82:0/1724914718 >> 172.21.15.82:0/1724914718 conn(0x7feea00fc010 msgr2=0x7feea00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 -- 172.21.15.82:0/1724914718 shutdown_connections 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.187+0000 7feea71e3640 1 -- 172.21.15.82:0/1724914718 wait complete. 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 Processor -- start 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 -- start start 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 0x7feea019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feea0109680 con 0x7feea0100860 2024-09-17T01:44:18.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea71e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feea0109500 con 0x7feea0101a60 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea4f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea4f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51756/0 (socket says 172.21.15.82:51756) 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7feea4f7f640 1 -- 172.21.15.82:0/1545571790 learned_addr learned my addr 172.21.15.82:0/1545571790 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.188+0000 7fee9ffff640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 0x7feea019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea4f7f640 1 -- 172.21.15.82:0/1545571790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 msgr2=0x7feea019e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea4f7f640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 0x7feea019e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea4f7f640 1 -- 172.21.15.82:0/1545571790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea019eb40 con 0x7feea0100860 2024-09-17T01:44:18.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea4f7f640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee90006010 tx=0x7fee9002f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee90047070 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea019ed10 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee90003e30 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee90034070 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.189+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea019f1c0 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.190+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea0100c60 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.191+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fee9004a070 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.192+0000 7fee9dffb640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 0x7fee8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.192+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fee900bec80 con 0x7feea0100860 2024-09-17T01:44:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.192+0000 7fee9ffff640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 0x7fee8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.192+0000 7fee9ffff640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 0x7fee8c07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feea006a510 tx=0x7fee8800b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.196+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fee9003f070 con 0x7feea0100860 2024-09-17T01:44:18.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.385+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7feea0106010 con 0x7fee8c07af30 2024-09-17T01:44:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.396+0000 7fee9dffb640 1 -- 172.21.15.82:0/1545571790 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7feea0106010 con 0x7fee8c07af30 2024-09-17T01:44:18.394 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (9m) 2s ago 10m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (2m) 2s ago 11m 8644k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (2m) 4s ago 10m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (12s) 2s ago 11m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (7s) 4s ago 10m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (9m) 2s ago 10m 79.2M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (5m) 2s ago 5m 150M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (5m) 2s ago 5m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (5m) 4s ago 5m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (5m) 4s ago 5m 26.4M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (2m) 2s ago 12m 578M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (54s) 4s ago 10m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:44:18.395 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (39s) 2s ago 12m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (23s) 4s ago 9m 91.4M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (10m) 2s ago 10m 15.0M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (10m) 4s ago 10m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (8m) 2s ago 8m 210M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 922b337abf09 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (8m) 2s ago 8m 229M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (7m) 2s ago 7m 181M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (7m) 4s ago 7m 257M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (6m) 4s ago 6m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (6m) 4s ago 6m 193M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:44:18.396 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (59s) 2s ago 10m 56.3M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:44:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 msgr2=0x7fee8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 0x7fee8c07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feea006a510 tx=0x7fee8800b390 comp rx=0 tx=0).stop 2024-09-17T01:44:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 msgr2=0x7feea006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fee90006010 tx=0x7fee9002f660 comp rx=0 tx=0).stop 2024-09-17T01:44:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 shutdown_connections 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fee8c07af30 0x7fee8c07d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feea0101a60 0x7feea019e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 --2- 172.21.15.82:0/1545571790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feea0100860 0x7feea006a790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.398+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 >> 172.21.15.82:0/1545571790 conn(0x7feea00fc010 msgr2=0x7feea00fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.399+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 shutdown_connections 2024-09-17T01:44:18.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.399+0000 7feea71e3640 1 -- 172.21.15.82:0/1545571790 wait complete. 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 -- 172.21.15.82:0/3603356525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 msgr2=0x7f59e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 --2- 172.21.15.82:0/3603356525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e0100c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009880 tx=0x7f59dc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 -- 172.21.15.82:0/3603356525 shutdown_connections 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 --2- 172.21.15.82:0/3603356525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 0x7f59e0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 --2- 172.21.15.82:0/3603356525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e0100c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 -- 172.21.15.82:0/3603356525 >> 172.21.15.82:0/3603356525 conn(0x7f59e00fc010 msgr2=0x7f59e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 -- 172.21.15.82:0/3603356525 shutdown_connections 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.486+0000 7f59e83e0640 1 -- 172.21.15.82:0/3603356525 wait complete. 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 Processor -- start 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 -- start start 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 0x7f59e0197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59e01096a0 con 0x7f59e0100860 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e83e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59e0109520 con 0x7f59e0101a60 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51778/0 (socket says 172.21.15.82:51778) 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 -- 172.21.15.82:0/4271208477 learned_addr learned my addr 172.21.15.82:0/4271208477 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e597b640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 0x7f59e0197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 -- 172.21.15.82:0/4271208477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 msgr2=0x7f59e0197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 0x7f59e0197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.487+0000 7f59e617c640 1 -- 172.21.15.82:0/4271208477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e01980b0 con 0x7f59e0100860 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59e617c640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59dc006010 tx=0x7f59dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59dc03f070 con 0x7f59e0100860 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59dc004a50 con 0x7f59e0100860 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e019ca90 con 0x7f59e0100860 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59dc035030 con 0x7f59e0100860 2024-09-17T01:44:18.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.488+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e019d020 con 0x7f59e0100860 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.489+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e0100c60 con 0x7f59e0100860 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.489+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f59dc042070 con 0x7f59e0100860 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.490+0000 7f59d77fe640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 0x7f59cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.490+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f59dc0bea20 con 0x7f59e0100860 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.490+0000 7f59e597b640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 0x7f59cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.490+0000 7f59e597b640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 0x7f59cc07d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f59e01989a0 tx=0x7f59d000b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.495+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f59dc004c00 con 0x7f59e0100860 2024-09-17T01:44:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.748+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f59e019d250 con 0x7f59e0100860 2024-09-17T01:44:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.748+0000 7f59d77fe640 1 -- 172.21.15.82:0/4271208477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f59dc08a0d0 con 0x7f59e0100860 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:44:18.747 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 10, 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:44:18.748 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.750+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 msgr2=0x7f59cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.750+0000 7f59e83e0640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 0x7f59cc07d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f59e01989a0 tx=0x7f59d000b390 comp rx=0 tx=0).stop 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.750+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 msgr2=0x7f59e01974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.750+0000 7f59e83e0640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59dc006010 tx=0x7f59dc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 shutdown_connections 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f59cc07af30 0x7f59cc07d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59e0101a60 0x7f59e0197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 --2- 172.21.15.82:0/4271208477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59e0100860 0x7f59e01974f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 >> 172.21.15.82:0/4271208477 conn(0x7f59e00fc010 msgr2=0x7f59e0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 shutdown_connections 2024-09-17T01:44:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.751+0000 7f59e83e0640 1 -- 172.21.15.82:0/4271208477 wait complete. 2024-09-17T01:44:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 -- 172.21.15.82:0/3227941158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4100860 msgr2=0x7f72c4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 --2- 172.21.15.82:0/3227941158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4100860 0x7f72c4100c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009880 tx=0x7f72b402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 -- 172.21.15.82:0/3227941158 shutdown_connections 2024-09-17T01:44:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 --2- 172.21.15.82:0/3227941158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4101a60 0x7f72c4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 --2- 172.21.15.82:0/3227941158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4100860 0x7f72c4100c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 -- 172.21.15.82:0/3227941158 >> 172.21.15.82:0/3227941158 conn(0x7f72c40fc010 msgr2=0x7f72c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 -- 172.21.15.82:0/3227941158 shutdown_connections 2024-09-17T01:44:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.832+0000 7f72c9b19640 1 -- 172.21.15.82:0/3227941158 wait complete. 2024-09-17T01:44:18.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 Processor -- start 2024-09-17T01:44:18.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 -- start start 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4100860 0x7f72c406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4109680 con 0x7f72c4101a60 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c9b19640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4109500 con 0x7f72c4100860 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51790/0 (socket says 172.21.15.82:51790) 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c2ffd640 1 -- 172.21.15.82:0/2445391491 learned_addr learned my addr 172.21.15.82:0/2445391491 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.833+0000 7f72c37fe640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4100860 0x7f72c406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c2ffd640 1 -- 172.21.15.82:0/2445391491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4100860 msgr2=0x7f72c406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c2ffd640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4100860 0x7f72c406aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c2ffd640 1 -- 172.21.15.82:0/2445391491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c4198000 con 0x7f72c4101a60 2024-09-17T01:44:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c2ffd640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c8d0 tx=0x7f72b800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72b80079b0 con 0x7f72c4101a60 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c419ec80 con 0x7f72c4101a60 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72b80054e0 con 0x7f72c4101a60 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72b8004e40 con 0x7f72c4101a60 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.834+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c419f1e0 con 0x7f72c4101a60 2024-09-17T01:44:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.835+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c4100c60 con 0x7f72c4101a60 2024-09-17T01:44:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.836+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f72b8007b50 con 0x7f72c4101a60 2024-09-17T01:44:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.836+0000 7f72c0ff9640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 0x7f72ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.836+0000 7f72c37fe640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 0x7f72ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.836+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f72b809df80 con 0x7f72c4101a60 2024-09-17T01:44:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.837+0000 7f72c37fe640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 0x7f72ac07d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72b4000c00 tx=0x7f72b4005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:18.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:18.843+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f72b8014030 con 0x7f72c4101a60 2024-09-17T01:44:18.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:18 smithi082 ceph-mon[92957]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-17T01:44:18.943 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:18 smithi082 ceph-mon[92957]: mgrmap e34: smithi082.oppacm(active, since 92s), standbys: smithi167.ysmbcy 2024-09-17T01:44:18.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:18.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:18 smithi167 ceph-mon[76323]: pgmap v49: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-17T01:44:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:18 smithi167 ceph-mon[76323]: mgrmap e34: smithi082.oppacm(active, since 92s), standbys: smithi167.ysmbcy 2024-09-17T01:44:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:19.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.064+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f72c4062df0 con 0x7f72c4101a60 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.064+0000 7f72c0ff9640 1 -- 172.21.15.82:0/2445391491 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f72b8069630 con 0x7f72c4101a60 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:44:19.063 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:44:19.064 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:44:19.065 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:19.066 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:44:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.066+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 msgr2=0x7f72ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.066+0000 7f72c9b19640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 0x7f72ac07d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72b4000c00 tx=0x7f72b4005a20 comp rx=0 tx=0).stop 2024-09-17T01:44:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 msgr2=0x7f72c419e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f72b800c8d0 tx=0x7f72b800cd90 comp rx=0 tx=0).stop 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 shutdown_connections 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72ac07af30 0x7f72ac07d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72c4101a60 0x7f72c419e620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 --2- 172.21.15.82:0/2445391491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72c4100860 0x7f72c406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 >> 172.21.15.82:0/2445391491 conn(0x7f72c40fc010 msgr2=0x7f72c4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 shutdown_connections 2024-09-17T01:44:19.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.067+0000 7f72c9b19640 1 -- 172.21.15.82:0/2445391491 wait complete. 2024-09-17T01:44:19.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1185839247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 msgr2=0x7fdab81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1185839247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab81047e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80098b0 tx=0x7fdaa802a4d0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1185839247 shutdown_connections 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1185839247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 0x7fdab8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1185839247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab81047e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1185839247 >> 172.21.15.82:0/1185839247 conn(0x7fdab80fc010 msgr2=0x7fdab80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1185839247 shutdown_connections 2024-09-17T01:44:19.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.153+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1185839247 wait complete. 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 Processor -- start 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 -- start start 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 0x7fdab8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdab810a7e0 con 0x7fdab81023f0 2024-09-17T01:44:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdabcbc8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdab810a660 con 0x7fdab8104d20 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdab659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdab659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51802/0 (socket says 172.21.15.82:51802) 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdab659c640 1 -- 172.21.15.82:0/1647804272 learned_addr learned my addr 172.21.15.82:0/1647804272 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.154+0000 7fdab5d9b640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 0x7fdab8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdab659c640 1 -- 172.21.15.82:0/1647804272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 msgr2=0x7fdab8197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdab659c640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 0x7fdab8197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdab659c640 1 -- 172.21.15.82:0/1647804272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab81980c0 con 0x7fdab81023f0 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdab659c640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099d0 tx=0x7fdaa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaa803f070 con 0x7fdab81023f0 2024-09-17T01:44:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab819caa0 con 0x7fdab81023f0 2024-09-17T01:44:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab819d030 con 0x7fdab81023f0 2024-09-17T01:44:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdaa8004a40 con 0x7fdab81023f0 2024-09-17T01:44:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.155+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaa8035030 con 0x7fdab81023f0 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.156+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda980052c0 con 0x7fdab81023f0 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.157+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdaa8042070 con 0x7fdab81023f0 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.158+0000 7fdaa77fe640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 0x7fdaa007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.158+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7fdaa80bea00 con 0x7fdab81023f0 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.158+0000 7fdab5d9b640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 0x7fdaa007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.158+0000 7fdab5d9b640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 0x7fdaa007d440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdab81989b0 tx=0x7fdaac00b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.163+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdaa808a130 con 0x7fdab81023f0 2024-09-17T01:44:19.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.368+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda98000bf0 con 0x7fdaa007af80 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.369+0000 7fdaa77fe640 1 -- 172.21.15.82:0/1647804272 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+402 (secure 0 0 0) 0x7fda98000bf0 con 0x7fdaa007af80 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:44:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:44:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "6/23 daemons upgraded", 2024-09-17T01:44:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading crash daemons", 2024-09-17T01:44:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:44:19.368 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:44:19.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 msgr2=0x7fdaa007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 0x7fdaa007d440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdab81989b0 tx=0x7fdaac00b390 comp rx=0 tx=0).stop 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 msgr2=0x7fdab8197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099d0 tx=0x7fdaa80046c0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 shutdown_connections 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdaa007af80 0x7fdaa007d440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdab8104d20 0x7fdab8197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 --2- 172.21.15.82:0/1647804272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab81023f0 0x7fdab8197500 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 >> 172.21.15.82:0/1647804272 conn(0x7fdab80fc010 msgr2=0x7fdab80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 shutdown_connections 2024-09-17T01:44:19.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.371+0000 7fdabcbc8640 1 -- 172.21.15.82:0/1647804272 wait complete. 2024-09-17T01:44:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 -- 172.21.15.82:0/3855969231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990104d80 msgr2=0x7f3990107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 --2- 172.21.15.82:0/3855969231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990104d80 0x7f3990107170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3984009880 tx=0x7f398402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 -- 172.21.15.82:0/3855969231 shutdown_connections 2024-09-17T01:44:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 --2- 172.21.15.82:0/3855969231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990104d80 0x7f3990107170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 --2- 172.21.15.82:0/3855969231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990102450 0x7f3990104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 -- 172.21.15.82:0/3855969231 >> 172.21.15.82:0/3855969231 conn(0x7f39900fc010 msgr2=0x7f39900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 -- 172.21.15.82:0/3855969231 shutdown_connections 2024-09-17T01:44:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.457+0000 7f39964d7640 1 -- 172.21.15.82:0/3855969231 wait complete. 2024-09-17T01:44:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 Processor -- start 2024-09-17T01:44:19.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 -- start start 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990104d80 0x7f39901979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f399010a720 con 0x7f3990102450 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f39964d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f399010a5a0 con 0x7f3990104d80 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f398ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f398ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51826/0 (socket says 172.21.15.82:51826) 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f398ffff640 1 -- 172.21.15.82:0/1926450764 learned_addr learned my addr 172.21.15.82:0/1926450764 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.458+0000 7f398f7fe640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990104d80 0x7f39901979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398ffff640 1 -- 172.21.15.82:0/1926450764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990104d80 msgr2=0x7f39901979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398ffff640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990104d80 0x7f39901979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398ffff640 1 -- 172.21.15.82:0/1926450764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990197fb0 con 0x7f3990102450 2024-09-17T01:44:19.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398ffff640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398000c8a0 tx=0x7f398000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39800079b0 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3980007b50 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399019ca20 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3980018700 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.459+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399019cf80 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.460+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3990102830 con 0x7f3990102450 2024-09-17T01:44:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.461+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3980007d00 con 0x7f3990102450 2024-09-17T01:44:19.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.462+0000 7f398d7fa640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 0x7f397807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:19.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.462+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5984+0+0 (secure 0 0 0) 0x7f398009e1c0 con 0x7f3990102450 2024-09-17T01:44:19.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.462+0000 7f398f7fe640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 0x7f397807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:19.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.463+0000 7f398f7fe640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 0x7f397807d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3984009230 tx=0x7f39840058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.469+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3980014030 con 0x7f3990102450 2024-09-17T01:44:19.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.729+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f399019d990 con 0x7f3990102450 2024-09-17T01:44:19.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.729+0000 7f398d7fa640 1 -- 172.21.15.82:0/1926450764 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3980069870 con 0x7f3990102450 2024-09-17T01:44:19.728 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:44:19.728 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:44:19.728 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 msgr2=0x7f397807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 0x7f397807d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3984009230 tx=0x7f39840058d0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 msgr2=0x7f3990197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f398000c8a0 tx=0x7f398000cd60 comp rx=0 tx=0).stop 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 shutdown_connections 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f397807af30 0x7f397807d3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3990104d80 0x7f39901979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 --2- 172.21.15.82:0/1926450764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3990102450 0x7f3990197480 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:19.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 >> 172.21.15.82:0/1926450764 conn(0x7f39900fc010 msgr2=0x7f39900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:19.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 shutdown_connections 2024-09-17T01:44:19.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:19.732+0000 7f39964d7640 1 -- 172.21.15.82:0/1926450764 wait complete. 2024-09-17T01:44:19.981 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:19 smithi082 ceph-mon[92957]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:19.981 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:19 smithi082 ceph-mon[92957]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:19.981 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:19 smithi082 ceph-mon[92957]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:19.981 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:19 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/4271208477' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:19.981 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:19 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2445391491' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:44:20.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:19 smithi167 ceph-mon[76323]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:20.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:19 smithi167 ceph-mon[76323]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:20.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:19 smithi167 ceph-mon[76323]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:20.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:19 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/4271208477' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:20.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:19 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2445391491' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1926450764' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all crash 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi167"} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi167"}]': finished 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-17T01:44:21.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:44:21.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:20 smithi167 ceph-mon[76323]: Upgrade: osd.0 is safe to restart 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: pgmap v50: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1926450764' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:21.034 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all crash 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi082"}]': finished 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi167"} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi167"}]': finished 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-17T01:44:21.035 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:20 smithi082 ceph-mon[92957]: Upgrade: osd.0 is safe to restart 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: Upgrade: Updating osd.0 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:22 smithi167 ceph-mon[76323]: Deploying daemon osd.0 on smithi082 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: pgmap v51: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: Upgrade: Updating osd.0 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:23.078 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:22 smithi082 ceph-mon[92957]: Deploying daemon osd.0 on smithi082 2024-09-17T01:44:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:24 smithi167 ceph-mon[76323]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:44:25.026 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:24 smithi082 ceph-mon[92957]: pgmap v52: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-09-17T01:44:25.027 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:24 smithi082 systemd[1]: Stopping Ceph osd.0 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:44:25.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:25 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:44:25.028+0000 7fc52095b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:44:25.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:25 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:44:25.028+0000 7fc52095b640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-17T01:44:25.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:25 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[50834]: 2024-09-17T01:44:25.028+0000 7fc52095b640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:44:26.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:25 smithi167 ceph-mon[76323]: osd.0 marked itself down and dead 2024-09-17T01:44:26.188 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:25 smithi082 ceph-mon[92957]: osd.0 marked itself down and dead 2024-09-17T01:44:26.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:26 smithi082 podman[101377]: 2024-09-17 01:44:26.190720773 +0000 UTC m=+1.284103995 container died 922b337abf091de0ccc711fdd7d9864170948a0bb198d833e48df7e40175a306 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, org.label-schema.vendor=CentOS, ceph=True) 2024-09-17T01:44:26.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:26 smithi082 ceph-mon[92957]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-17T01:44:26.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:26 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:44:26.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:26 smithi082 ceph-mon[92957]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T01:44:26.879 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:26 smithi082 podman[101377]: 2024-09-17 01:44:26.578512343 +0000 UTC m=+1.671895565 container cleanup 922b337abf091de0ccc711fdd7d9864170948a0bb198d833e48df7e40175a306 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-17T01:44:26.879 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:26 smithi082 bash[101377]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:44:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:26 smithi167 ceph-mon[76323]: pgmap v53: 65 pgs: 65 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-17T01:44:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:26 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:44:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:26 smithi167 ceph-mon[76323]: osdmap e48: 6 total, 5 up, 6 in 2024-09-17T01:44:27.202 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:26 smithi082 podman[101391]: 2024-09-17 01:44:26.880395159 +0000 UTC m=+0.685429100 container remove 922b337abf091de0ccc711fdd7d9864170948a0bb198d833e48df7e40175a306 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:44:27.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.107797607 +0000 UTC m=+0.015935511 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:44:27.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.206290821 +0000 UTC m=+0.114428752 container create f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:44:27.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:27 smithi082 ceph-mon[92957]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:44:27.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:27 smithi082 ceph-mon[92957]: pgmap v56: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-17T01:44:27.965 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.493473539 +0000 UTC m=+0.401611428 container init f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-17T01:44:27.965 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.496931899 +0000 UTC m=+0.405069793 container start f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T01:44:27.965 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.584120392 +0000 UTC m=+0.492258290 container attach f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:44:27.965 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:27 smithi082 podman[101480]: 2024-09-17 01:44:27.688452808 +0000 UTC m=+0.596590701 container died f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T01:44:28.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:27 smithi167 ceph-mon[76323]: osdmap e49: 6 total, 5 up, 6 in 2024-09-17T01:44:28.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:27 smithi167 ceph-mon[76323]: pgmap v56: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 4 op/s 2024-09-17T01:44:28.714 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 podman[101504]: 2024-09-17 01:44:28.354901353 +0000 UTC m=+0.660015640 container remove f98b966e7ba8028ed4ff8ceb69e5a6b475b3bd3b9462d34a65af1c038c126d1d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:44:28.714 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-17T01:44:28.714 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 systemd[1]: Stopped Ceph osd.0 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:44:28.714 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.0.service: Consumed 52.591s CPU time. 2024-09-17T01:44:28.714 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 systemd[1]: Starting Ceph osd.0 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:44:29.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:28 smithi167 ceph-mon[76323]: Health check failed: Reduced data availability: 28 pgs peering (PG_AVAILABILITY) 2024-09-17T01:44:29.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:28 smithi082 ceph-mon[92957]: Health check failed: Reduced data availability: 28 pgs peering (PG_AVAILABILITY) 2024-09-17T01:44:29.089 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 podman[101604]: 2024-09-17 01:44:28.700147441 +0000 UTC m=+0.016226819 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:44:29.089 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:28 smithi082 podman[101604]: 2024-09-17 01:44:28.822550826 +0000 UTC m=+0.138630195 container create 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:44:29.089 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 podman[101604]: 2024-09-17 01:44:29.091657064 +0000 UTC m=+0.407736432 container init 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T01:44:29.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 podman[101604]: 2024-09-17 01:44:29.095463244 +0000 UTC m=+0.411542614 container start 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:44:29.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 podman[101604]: 2024-09-17 01:44:29.19172182 +0000 UTC m=+0.507801210 container attach 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-17T01:44:29.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:44:29.465 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 bash[101604]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:44:29.465 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:44:29.465 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:29 smithi082 bash[101604]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:44:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:29 smithi167 ceph-mon[76323]: pgmap v57: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:44:30.058 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:29 smithi082 ceph-mon[92957]: pgmap v57: 65 pgs: 34 peering, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-17T01:44:30.351 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:44:30.351 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:44:30.351 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:44:30.351 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:44:30.686 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:44:30.686 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:44:30.686 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:44:30.687 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:44:30.687 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:44:30.687 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-17T01:44:30.687 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:44:30.687 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T01:44:30.688 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate[101619]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:44:30.688 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 bash[101604]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-17T01:44:30.688 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:30 smithi082 podman[101604]: 2024-09-17 01:44:30.381910366 +0000 UTC m=+1.697989737 container died 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:44:31.347 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 podman[101754]: 2024-09-17 01:44:31.012408062 +0000 UTC m=+0.624353057 container remove 1ade7389f71f77cd26e54f6c0f0ef76316f25f9eca2e4b04a9e42ed573bbc66c (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-17T01:44:31.347 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 podman[101812]: 2024-09-17 01:44:31.119699284 +0000 UTC m=+0.015628529 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:44:31.347 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 podman[101812]: 2024-09-17 01:44:31.246808265 +0000 UTC m=+0.142737498 container create cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-17T01:44:31.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 podman[101812]: 2024-09-17 01:44:31.507606629 +0000 UTC m=+0.403535868 container init cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:44:31.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 podman[101812]: 2024-09-17 01:44:31.511107072 +0000 UTC m=+0.407036307 container start cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T01:44:31.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 ceph-osd[101831]: -- 172.21.15.82:0/1083255009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f91f2f01e0 con 0x55f91e579180 2024-09-17T01:44:31.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 bash[101812]: cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 2024-09-17T01:44:31.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:31 smithi082 systemd[1]: Started Ceph osd.0 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:44:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: pgmap v58: 65 pgs: 10 active+undersized, 5 peering, 19 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/312 objects degraded (17.949%) 2024-09-17T01:44:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: pgmap v58: 65 pgs: 10 active+undersized, 5 peering, 19 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 56/312 objects degraded (17.949%) 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:33.403 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:33 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 56/312 objects degraded (17.949%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:33.404 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:33 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:44:33.154+0000 7fad620d6640 -1 Falling back to public interface 2024-09-17T01:44:33.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:33 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 56/312 objects degraded (17.949%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:34 smithi082 ceph-mon[92957]: pgmap v59: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:34.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:34 smithi167 ceph-mon[76323]: pgmap v59: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:35.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:35 smithi082 ceph-mon[92957]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:44:35.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:35 smithi167 ceph-mon[76323]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-17T01:44:36.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:36 smithi082 ceph-mon[92957]: pgmap v60: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:36.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:36 smithi167 ceph-mon[76323]: pgmap v60: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.154 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:38.155 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:39.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:38 smithi167 ceph-mon[76323]: pgmap v61: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:39.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:38 smithi082 ceph-mon[92957]: pgmap v61: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:39.096 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:38 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:44:38.929+0000 7fad620d6640 -1 osd.0 47 log_to_monitors true 2024-09-17T01:44:39.982 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:39 smithi082 ceph-mon[92957]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T01:44:39.982 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:44:39 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:44:39.747+0000 7fad55e4e640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:44:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:39 smithi167 ceph-mon[76323]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-17T01:44:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: pgmap v62: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:44:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: pgmap v62: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 58/312 objects degraded (18.590%) 2024-09-17T01:44:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T01:44:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: osdmap e50: 6 total, 5 up, 6 in 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 58/312 objects degraded (18.590%), 20 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:44:41.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:44:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131] boot 2024-09-17T01:44:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T01:44:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T01:44:42.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:44:42.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:41 smithi082 ceph-mon[92957]: pgmap v65: 65 pgs: 21 peering, 9 active+undersized, 4 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: osd.0 [v2:172.21.15.82:6802/2875960131,v1:172.21.15.82:6803/2875960131] boot 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: osdmap e51: 6 total, 6 up, 6 in 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:44:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-17T01:44:42.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:41 smithi167 ceph-mon[76323]: pgmap v65: 65 pgs: 21 peering, 9 active+undersized, 4 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:44:43.174 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:42 smithi167 ceph-mon[76323]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:44:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:42 smithi082 ceph-mon[92957]: osdmap e52: 6 total, 6 up, 6 in 2024-09-17T01:44:44.135 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:43 smithi167 ceph-mon[76323]: pgmap v67: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 7/312 objects degraded (2.244%) 2024-09-17T01:44:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:43 smithi082 ceph-mon[92957]: pgmap v67: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s; 7/312 objects degraded (2.244%) 2024-09-17T01:44:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:44 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:45.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:44 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:44:46.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:45 smithi082 ceph-mon[92957]: pgmap v68: 65 pgs: 25 peering, 40 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:44:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:45 smithi167 ceph-mon[76323]: pgmap v68: 65 pgs: 25 peering, 40 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 2 op/s 2024-09-17T01:44:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:46 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded) 2024-09-17T01:44:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:47.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:46 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded) 2024-09-17T01:44:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:44:48.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:47 smithi082 ceph-mon[92957]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:44:48.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:47 smithi167 ceph-mon[76323]: pgmap v69: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:44:49.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 -- 172.21.15.82:0/290509421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c104d40 msgr2=0x7fb48c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 --2- 172.21.15.82:0/290509421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c104d40 0x7fb48c107130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0098b0 tx=0x7fb47c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 -- 172.21.15.82:0/290509421 shutdown_connections 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 --2- 172.21.15.82:0/290509421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c104d40 0x7fb48c107130 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 --2- 172.21.15.82:0/290509421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c102410 0x7fb48c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 -- 172.21.15.82:0/290509421 >> 172.21.15.82:0/290509421 conn(0x7fb48c0fc010 msgr2=0x7fb48c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 -- 172.21.15.82:0/290509421 shutdown_connections 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.823+0000 7fb494017640 1 -- 172.21.15.82:0/290509421 wait complete. 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 Processor -- start 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 -- start start 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c104d40 0x7fb48c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:49.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c10a7d0 con 0x7fb48c102410 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb494017640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c10a650 con 0x7fb48c104d40 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb491db3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb491db3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41804/0 (socket says 172.21.15.82:41804) 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb491db3640 1 -- 172.21.15.82:0/213340333 learned_addr learned my addr 172.21.15.82:0/213340333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.824+0000 7fb4915b2640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c104d40 0x7fb48c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb491db3640 1 -- 172.21.15.82:0/213340333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c104d40 msgr2=0x7fb48c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb491db3640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c104d40 0x7fb48c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:49.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb491db3640 1 -- 172.21.15.82:0/213340333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c1980f0 con 0x7fb48c102410 2024-09-17T01:44:49.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb491db3640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb48800d6f0 tx=0x7fb48800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:49.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb488017070 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48c19cb30 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb48800de00 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb488004bb0 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.825+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb48c19d090 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.826+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48c1027f0 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.827+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb488009a30 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.827+0000 7fb482ffd640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 0x7fb47807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.828+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7fb48809db00 con 0x7fb48c102410 2024-09-17T01:44:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.828+0000 7fb4915b2640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 0x7fb47807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.828+0000 7fb4915b2640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 0x7fb47807d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009880 tx=0x7fb47c0058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:49.832+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb4880691b0 con 0x7fb48c102410 2024-09-17T01:44:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.047+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb48c1056c0 con 0x7fb47807af30 2024-09-17T01:44:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.049+0000 7fb482ffd640 1 -- 172.21.15.82:0/213340333 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb48c1056c0 con 0x7fb47807af30 2024-09-17T01:44:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 msgr2=0x7fb47807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 0x7fb47807d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009880 tx=0x7fb47c0058d0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 msgr2=0x7fb48c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb48800d6f0 tx=0x7fb48800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 shutdown_connections 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb47807af30 0x7fb47807d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb48c104d40 0x7fb48c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 --2- 172.21.15.82:0/213340333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb48c102410 0x7fb48c197530 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 >> 172.21.15.82:0/213340333 conn(0x7fb48c0fc010 msgr2=0x7fb48c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 shutdown_connections 2024-09-17T01:44:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.051+0000 7fb494017640 1 -- 172.21.15.82:0/213340333 wait complete. 2024-09-17T01:44:50.058 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:44:50.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.137+0000 7efce183e640 1 -- 172.21.15.82:0/3844543674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 msgr2=0x7efcdc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.137+0000 7efce183e640 1 --2- 172.21.15.82:0/3844543674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc100c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efccc009880 tx=0x7efccc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- 172.21.15.82:0/3844543674 shutdown_connections 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 --2- 172.21.15.82:0/3844543674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 --2- 172.21.15.82:0/3844543674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc100c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- 172.21.15.82:0/3844543674 >> 172.21.15.82:0/3844543674 conn(0x7efcdc0fc010 msgr2=0x7efcdc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- 172.21.15.82:0/3844543674 shutdown_connections 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- 172.21.15.82:0/3844543674 wait complete. 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 Processor -- start 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- start start 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc1096a0 con 0x7efcdc100860 2024-09-17T01:44:50.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.138+0000 7efce183e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcdc109520 con 0x7efcdc101a60 2024-09-17T01:44:50.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41826/0 (socket says 172.21.15.82:41826) 2024-09-17T01:44:50.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 -- 172.21.15.82:0/2617419269 learned_addr learned my addr 172.21.15.82:0/2617419269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcda7fc640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 -- 172.21.15.82:0/2617419269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 msgr2=0x7efcdc196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 -- 172.21.15.82:0/2617419269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcdc196f90 con 0x7efcdc100860 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcda7fc640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efcdaffd640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efccc006010 tx=0x7efccc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efccc035070 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcdc069ca0 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efccc0035f0 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efccc031830 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.139+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcdc06a230 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.140+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcdc109e80 con 0x7efcdc100860 2024-09-17T01:44:50.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.141+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efccc0037a0 con 0x7efcdc100860 2024-09-17T01:44:50.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.141+0000 7efce083c640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 0x7efcc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.142+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7efccc03e070 con 0x7efcdc100860 2024-09-17T01:44:50.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.142+0000 7efcda7fc640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 0x7efcc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.142+0000 7efcda7fc640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 0x7efcc407d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcdc197880 tx=0x7efcd0005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.146+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efccc08bb30 con 0x7efcdc100860 2024-09-17T01:44:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.345+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efcdc190500 con 0x7efcc407af30 2024-09-17T01:44:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.346+0000 7efce083c640 1 -- 172.21.15.82:0/2617419269 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7efcdc190500 con 0x7efcc407af30 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.348+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 msgr2=0x7efcc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.348+0000 7efce183e640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 0x7efcc407d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcdc197880 tx=0x7efcd0005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.348+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 msgr2=0x7efcdc1963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.348+0000 7efce183e640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efccc006010 tx=0x7efccc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 shutdown_connections 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7efcc407af30 0x7efcc407d3f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc101a60 0x7efcdc196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 --2- 172.21.15.82:0/2617419269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcdc100860 0x7efcdc1963d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 >> 172.21.15.82:0/2617419269 conn(0x7efcdc0fc010 msgr2=0x7efcdc104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 shutdown_connections 2024-09-17T01:44:50.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.349+0000 7efce183e640 1 -- 172.21.15.82:0/2617419269 wait complete. 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 -- 172.21.15.82:0/27305336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 msgr2=0x7f77f41047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 --2- 172.21.15.82:0/27305336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f41047e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77e40098b0 tx=0x7f77e402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 -- 172.21.15.82:0/27305336 shutdown_connections 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 --2- 172.21.15.82:0/27305336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 --2- 172.21.15.82:0/27305336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f41047e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 -- 172.21.15.82:0/27305336 >> 172.21.15.82:0/27305336 conn(0x7f77f40fc010 msgr2=0x7f77f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 -- 172.21.15.82:0/27305336 shutdown_connections 2024-09-17T01:44:50.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.433+0000 7f77f88c0640 1 -- 172.21.15.82:0/27305336 wait complete. 2024-09-17T01:44:50.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 Processor -- start 2024-09-17T01:44:50.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 -- start start 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f41003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410a7e0 con 0x7f77f41023f0 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f88c0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77f410a660 con 0x7f77f4104d20 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41836/0 (socket says 172.21.15.82:41836) 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 -- 172.21.15.82:0/3494920393 learned_addr learned my addr 172.21.15.82:0/3494920393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f1d9b640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f41003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 -- 172.21.15.82:0/3494920393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 msgr2=0x7f77f41003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f41003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 -- 172.21.15.82:0/3494920393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41008e0 con 0x7f77f41023f0 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f1d9b640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:50.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.434+0000 7f77f259c640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77e40099d0 tx=0x7f77e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.435+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77e403f070 con 0x7f77f41023f0 2024-09-17T01:44:50.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.435+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f4100b70 con 0x7f77f41023f0 2024-09-17T01:44:50.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.435+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77e4004a40 con 0x7f77f41023f0 2024-09-17T01:44:50.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.435+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77e4035030 con 0x7f77f41023f0 2024-09-17T01:44:50.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.435+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41010a0 con 0x7f77f41023f0 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.436+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f41027d0 con 0x7f77f41023f0 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.437+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f77e4042070 con 0x7f77f41023f0 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.437+0000 7f77e37fe640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 0x7f77dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.437+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7f77e40beb90 con 0x7f77f41023f0 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.437+0000 7f77f1d9b640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 0x7f77dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.438+0000 7f77f1d9b640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 0x7f77dc07d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77e80058c0 tx=0x7f77e8005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.442+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f77e408a240 con 0x7f77f41023f0 2024-09-17T01:44:50.602 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:50 smithi082 ceph-mon[92957]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:50.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.631+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f77f4105700 con 0x7f77dc07af30 2024-09-17T01:44:50.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.641+0000 7f77e37fe640 1 -- 172.21.15.82:0/3494920393 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f77f4105700 con 0x7f77dc07af30 2024-09-17T01:44:50.639 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:44:50.639 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (9m) 13s ago 11m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:44:50.639 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (3m) 13s ago 11m 8669k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:44:50.639 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (2m) 36s ago 10m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (44s) 13s ago 11m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (39s) 36s ago 10m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (9m) 13s ago 11m 81.0M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (6m) 13s ago 6m 148M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (5m) 13s ago 5m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (6m) 36s ago 6m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (5m) 36s ago 5m 26.4M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (2m) 13s ago 12m 580M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (86s) 36s ago 10m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (71s) 13s ago 12m 110M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (55s) 36s ago 10m 91.4M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (11m) 13s ago 11m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (10m) 36s ago 10m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:44:50.640 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (19s) 13s ago 9m 79.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (8m) 13s ago 8m 229M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 339d7e7d3e73 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (8m) 13s ago 8m 181M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (7m) 36s ago 7m 257M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (7m) 36s ago 7m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (7m) 36s ago 7m 193M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:44:50.641 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (91s) 13s ago 10m 62.6M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 msgr2=0x7f77dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 0x7f77dc07d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77e80058c0 tx=0x7f77e8005850 comp rx=0 tx=0).stop 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 msgr2=0x7f77f4101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77e40099d0 tx=0x7f77e40046c0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 shutdown_connections 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f77dc07af30 0x7f77dc07d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77f4104d20 0x7f77f41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 --2- 172.21.15.82:0/3494920393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77f41023f0 0x7f77f4101ce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.643+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 >> 172.21.15.82:0/3494920393 conn(0x7f77f40fc010 msgr2=0x7f77f40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.644+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 shutdown_connections 2024-09-17T01:44:50.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.644+0000 7f77f88c0640 1 -- 172.21.15.82:0/3494920393 wait complete. 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 -- 172.21.15.82:0/2365507071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58101a60 msgr2=0x7fed58101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/2365507071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58101a60 0x7fed58101ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed44009880 tx=0x7fed4402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 -- 172.21.15.82:0/2365507071 shutdown_connections 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/2365507071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58101a60 0x7fed58101ee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/2365507071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58100860 0x7fed58100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 -- 172.21.15.82:0/2365507071 >> 172.21.15.82:0/2365507071 conn(0x7fed580fc010 msgr2=0x7fed580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 -- 172.21.15.82:0/2365507071 shutdown_connections 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.726+0000 7fed5ea7e640 1 -- 172.21.15.82:0/2365507071 wait complete. 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 Processor -- start 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 -- start start 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58101a60 0x7fed58102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed58109720 con 0x7fed58100860 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5ea7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed581095a0 con 0x7fed58101a60 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5c81a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5c81a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41864/0 (socket says 172.21.15.82:41864) 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed5c81a640 1 -- 172.21.15.82:0/3844763253 learned_addr learned my addr 172.21.15.82:0/3844763253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.727+0000 7fed57fff640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58101a60 0x7fed58102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5c81a640 1 -- 172.21.15.82:0/3844763253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58101a60 msgr2=0x7fed58102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5c81a640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58101a60 0x7fed58102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5c81a640 1 -- 172.21.15.82:0/3844763253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed58103380 con 0x7fed58100860 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5c81a640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00b3d0 tx=0x7fed4c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed4c015020 con 0x7fed58100860 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed4c011af0 con 0x7fed58100860 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed58103670 con 0x7fed58100860 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed4c010da0 con 0x7fed58100860 2024-09-17T01:44:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.728+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed58103c50 con 0x7fed58100860 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.729+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed58100c60 con 0x7fed58100860 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.730+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fed4c018020 con 0x7fed58100860 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.730+0000 7fed55ffb640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 0x7fed4807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.730+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7fed4c09d8f0 con 0x7fed58100860 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.730+0000 7fed57fff640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 0x7fed4807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.731+0000 7fed57fff640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 0x7fed4807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed44004ee0 tx=0x7fed44005df0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.735+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fed4c01f020 con 0x7fed58100860 2024-09-17T01:44:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.981+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fed5819fd60 con 0x7fed58100860 2024-09-17T01:44:50.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.981+0000 7fed55ffb640 1 -- 172.21.15.82:0/3844763253 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fed4c068fa0 con 0x7fed58100860 2024-09-17T01:44:50.979 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 1 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:44:50.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:44:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:44:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 9, 2024-09-17T01:44:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 5 2024-09-17T01:44:50.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:44:50.981 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 msgr2=0x7fed4807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 0x7fed4807d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed44004ee0 tx=0x7fed44005df0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 msgr2=0x7fed58104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00b3d0 tx=0x7fed4c00b890 comp rx=0 tx=0).stop 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 shutdown_connections 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fed4807af30 0x7fed4807d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed58101a60 0x7fed58102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 --2- 172.21.15.82:0/3844763253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed58100860 0x7fed58104780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 >> 172.21.15.82:0/3844763253 conn(0x7fed580fc010 msgr2=0x7fed58069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:50.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 shutdown_connections 2024-09-17T01:44:50.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:50.984+0000 7fed5ea7e640 1 -- 172.21.15.82:0/3844763253 wait complete. 2024-09-17T01:44:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:50 smithi167 ceph-mon[76323]: pgmap v70: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- 172.21.15.82:0/1296213884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 msgr2=0x7ff484100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 --2- 172.21.15.82:0/1296213884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff484100c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff474009c20 tx=0x7ff47402a970 comp rx=0 tx=0).stop 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- 172.21.15.82:0/1296213884 shutdown_connections 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 --2- 172.21.15.82:0/1296213884 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 --2- 172.21.15.82:0/1296213884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff484100c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- 172.21.15.82:0/1296213884 >> 172.21.15.82:0/1296213884 conn(0x7ff4840fc010 msgr2=0x7ff4840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- 172.21.15.82:0/1296213884 shutdown_connections 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- 172.21.15.82:0/1296213884 wait complete. 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 Processor -- start 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 -- start start 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.065+0000 7ff48b49a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff48b49a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff48b49a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4841096a0 con 0x7ff484100860 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff48b49a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff484109520 con 0x7ff484101a60 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41894/0 (socket says 172.21.15.82:41894) 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 -- 172.21.15.82:0/740038574 learned_addr learned my addr 172.21.15.82:0/740038574 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff488a35640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 -- 172.21.15.82:0/740038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 msgr2=0x7ff484197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 -- 172.21.15.82:0/740038574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4841980b0 con 0x7ff484100860 2024-09-17T01:44:51.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff488a35640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:44:51.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff489236640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff474006010 tx=0x7ff47402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff474047070 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff474003e30 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48419ca90 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff474034070 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.066+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48419d020 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.067+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff484100c60 con 0x7ff484100860 2024-09-17T01:44:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.068+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff47404a070 con 0x7ff484100860 2024-09-17T01:44:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.068+0000 7ff4827fc640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 0x7ff46c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.069+0000 7ff488a35640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 0x7ff46c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.069+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7ff4740bebb0 con 0x7ff484100860 2024-09-17T01:44:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.069+0000 7ff488a35640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 0x7ff46c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4841989a0 tx=0x7ff478005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.073+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff47403f070 con 0x7ff484100860 2024-09-17T01:44:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.285+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff48419d320 con 0x7ff484100860 2024-09-17T01:44:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.286+0000 7ff4827fc640 1 -- 172.21.15.82:0/740038574 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7ff47408a2e0 con 0x7ff484100860 2024-09-17T01:44:51.284 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:44:51.284 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:44:51.285 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:44:51.286 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:51.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:44:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:44:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 msgr2=0x7ff46c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 0x7ff46c07d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4841989a0 tx=0x7ff478005f90 comp rx=0 tx=0).stop 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 msgr2=0x7ff4841974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff474006010 tx=0x7ff47402f5d0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 shutdown_connections 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff46c07af80 0x7ff46c07d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff484101a60 0x7ff484197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 --2- 172.21.15.82:0/740038574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff484100860 0x7ff4841974f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 >> 172.21.15.82:0/740038574 conn(0x7ff4840fc010 msgr2=0x7ff484069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 shutdown_connections 2024-09-17T01:44:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.288+0000 7ff48b49a640 1 -- 172.21.15.82:0/740038574 wait complete. 2024-09-17T01:44:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- 172.21.15.82:0/1724931535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44100860 msgr2=0x7f9c44100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/1724931535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44100860 0x7f9c44100c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009880 tx=0x7f9c3402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- 172.21.15.82:0/1724931535 shutdown_connections 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/1724931535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44101a60 0x7f9c44101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/1724931535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44100860 0x7f9c44100c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- 172.21.15.82:0/1724931535 >> 172.21.15.82:0/1724931535 conn(0x7f9c440fc010 msgr2=0x7f9c440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- 172.21.15.82:0/1724931535 shutdown_connections 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- 172.21.15.82:0/1724931535 wait complete. 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 Processor -- start 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.372+0000 7f9c49dd7640 1 -- start start 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c49dd7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44100860 0x7f9c4406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c49dd7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c49dd7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44109680 con 0x7f9c44101a60 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c49dd7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44109500 con 0x7f9c44100860 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41916/0 (socket says 172.21.15.82:41916) 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 -- 172.21.15.82:0/2150129923 learned_addr learned my addr 172.21.15.82:0/2150129923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c437fe640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44100860 0x7f9c4406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 -- 172.21.15.82:0/2150129923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44100860 msgr2=0x7f9c4406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44100860 0x7f9c4406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 -- 172.21.15.82:0/2150129923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4419c740 con 0x7f9c44101a60 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c3bfff640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c8d0 tx=0x7f9c2c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.373+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c2c0079b0 con 0x7f9c44101a60 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.374+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c2c0054e0 con 0x7f9c44101a60 2024-09-17T01:44:51.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.374+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4419ca30 con 0x7f9c44101a60 2024-09-17T01:44:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.374+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c2c004e40 con 0x7f9c44101a60 2024-09-17T01:44:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.374+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4419cfc0 con 0x7f9c44101a60 2024-09-17T01:44:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.375+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44100c60 con 0x7f9c44101a60 2024-09-17T01:44:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.375+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9c2c007b50 con 0x7f9c44101a60 2024-09-17T01:44:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.376+0000 7f9c417fa640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 0x7f9c3007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.376+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7f9c2c09df70 con 0x7f9c44101a60 2024-09-17T01:44:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.376+0000 7f9c437fe640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 0x7f9c3007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.376+0000 7f9c437fe640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 0x7f9c3007d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c00 tx=0x7f9c34005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.380+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9c2c014030 con 0x7f9c44101a60 2024-09-17T01:44:51.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.575+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9c4419d2d0 con 0x7f9c3007af30 2024-09-17T01:44:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.576+0000 7f9c417fa640 1 -- 172.21.15.82:0/2150129923 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9c4419d2d0 con 0x7f9c3007af30 2024-09-17T01:44:51.574 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:44:51.574 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "7/23 daemons upgraded", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:44:51.575 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.578+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 msgr2=0x7f9c3007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.578+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 0x7f9c3007d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c34000c00 tx=0x7f9c34005a20 comp rx=0 tx=0).stop 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 msgr2=0x7f9c4419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c8d0 tx=0x7f9c2c00cd90 comp rx=0 tx=0).stop 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 shutdown_connections 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9c3007af30 0x7f9c3007d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c44101a60 0x7f9c4419c200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 --2- 172.21.15.82:0/2150129923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c44100860 0x7f9c4406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 >> 172.21.15.82:0/2150129923 conn(0x7f9c440fc010 msgr2=0x7f9c440fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 shutdown_connections 2024-09-17T01:44:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.579+0000 7f9c49dd7640 1 -- 172.21.15.82:0/2150129923 wait complete. 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.659+0000 7fdc12374640 1 -- 172.21.15.82:0/3088542091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c101a60 msgr2=0x7fdc0c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.659+0000 7fdc12374640 1 --2- 172.21.15.82:0/3088542091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c101a60 0x7fdc0c101ee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009880 tx=0x7fdc0002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 -- 172.21.15.82:0/3088542091 shutdown_connections 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 --2- 172.21.15.82:0/3088542091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c101a60 0x7fdc0c101ee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 --2- 172.21.15.82:0/3088542091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c100860 0x7fdc0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 -- 172.21.15.82:0/3088542091 >> 172.21.15.82:0/3088542091 conn(0x7fdc0c0fc010 msgr2=0x7fdc0c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 -- 172.21.15.82:0/3088542091 shutdown_connections 2024-09-17T01:44:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 -- 172.21.15.82:0/3088542091 wait complete. 2024-09-17T01:44:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 Processor -- start 2024-09-17T01:44:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.660+0000 7fdc12374640 1 -- start start 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc12374640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc12374640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c101a60 0x7fdc0c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc12374640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c109680 con 0x7fdc0c100860 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc12374640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c109500 con 0x7fdc0c101a60 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41928/0 (socket says 172.21.15.82:41928) 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 -- 172.21.15.82:0/963998552 learned_addr learned my addr 172.21.15.82:0/963998552 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:44:51.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0b7fe640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c101a60 0x7fdc0c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 -- 172.21.15.82:0/963998552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c101a60 msgr2=0x7fdc0c19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c101a60 0x7fdc0c19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 -- 172.21.15.82:0/963998552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c19c760 con 0x7fdc0c100860 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc0bfff640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c920 tx=0x7fdbfc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc007a10 con 0x7fdc0c100860 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.661+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c19ca50 con 0x7fdc0c100860 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.662+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdbfc007bb0 con 0x7fdc0c100860 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.662+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbfc00f450 con 0x7fdc0c100860 2024-09-17T01:44:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.662+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c19cfe0 con 0x7fdc0c100860 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.663+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c100c60 con 0x7fdc0c100860 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.663+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fdbfc003ea0 con 0x7fdc0c100860 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.664+0000 7fdc097fa640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 0x7fdbf407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.664+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5984+0+0 (secure 0 0 0) 0x7fdbfc09e0e0 con 0x7fdc0c100860 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.664+0000 7fdc0b7fe640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 0x7fdbf407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:44:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.664+0000 7fdc0b7fe640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 0x7fdbf407d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06a510 tx=0x7fdc00005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:44:51.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.668+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fdbfc069790 con 0x7fdc0c100860 2024-09-17T01:44:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.912+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdc0c02d7c0 con 0x7fdc0c100860 2024-09-17T01:44:51.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:51 smithi082 ceph-mon[92957]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:51.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:51 smithi082 ceph-mon[92957]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:51.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:51 smithi082 ceph-mon[92957]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:51.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:51 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3844763253' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:51.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:51 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/740038574' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:44:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.913+0000 7fdc097fa640 1 -- 172.21.15.82:0/963998552 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fdbfc06e640 con 0x7fdc0c100860 2024-09-17T01:44:51.912 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:44:51.912 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:44:51.912 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 msgr2=0x7fdbf407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 0x7fdbf407d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c06a510 tx=0x7fdc00005a20 comp rx=0 tx=0).stop 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 msgr2=0x7fdc0c06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c920 tx=0x7fdbfc00cde0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 shutdown_connections 2024-09-17T01:44:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fdbf407af30 0x7fdbf407d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c101a60 0x7fdc0c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 --2- 172.21.15.82:0/963998552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc0c100860 0x7fdc0c06a790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:44:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 >> 172.21.15.82:0/963998552 conn(0x7fdc0c0fc010 msgr2=0x7fdc0c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:44:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 shutdown_connections 2024-09-17T01:44:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:44:51.915+0000 7fdc12374640 1 -- 172.21.15.82:0/963998552 wait complete. 2024-09-17T01:44:52.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:51 smithi167 ceph-mon[76323]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:52.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:51 smithi167 ceph-mon[76323]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:52.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:51 smithi167 ceph-mon[76323]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:52.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:51 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3844763253' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:44:52.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:51 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/740038574' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:44:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:52 smithi082 ceph-mon[92957]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:44:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:52 smithi082 ceph-mon[92957]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:52 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/963998552' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:44:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:52 smithi167 ceph-mon[76323]: pgmap v71: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:44:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:52 smithi167 ceph-mon[76323]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:44:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:52 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/963998552' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:44:54.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:54 smithi082 ceph-mon[92957]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:44:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:54 smithi167 ceph-mon[76323]: pgmap v72: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:44:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:56 smithi082 ceph-mon[92957]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:44:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T01:44:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:56 smithi167 ceph-mon[76323]: pgmap v73: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:44:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-17T01:44:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:57.770 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:57 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:44:57.770 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:57 smithi082 ceph-mon[92957]: Upgrade: osd.1 is safe to restart 2024-09-17T01:44:57.771 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:57.771 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T01:44:57.771 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:57 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-17T01:44:58.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:57 smithi167 ceph-mon[76323]: Upgrade: osd.1 is safe to restart 2024-09-17T01:44:58.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:44:58.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-17T01:44:58.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:44:58.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:58 smithi167 ceph-mon[76323]: Upgrade: Updating osd.1 2024-09-17T01:44:58.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:58 smithi167 ceph-mon[76323]: Deploying daemon osd.1 on smithi082 2024-09-17T01:44:58.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:44:58 smithi167 ceph-mon[76323]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:44:58.766 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:58 smithi082 ceph-mon[92957]: Upgrade: Updating osd.1 2024-09-17T01:44:58.767 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:58 smithi082 ceph-mon[92957]: Deploying daemon osd.1 on smithi082 2024-09-17T01:44:58.767 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:44:58 smithi082 ceph-mon[92957]: pgmap v74: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:45:00.404 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:00 smithi082 systemd[1]: Stopping Ceph osd.1 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:45:00.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:00 smithi082 ceph-mon[92957]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:45:00.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:00 smithi082 ceph-mon[92957]: osd.1 marked itself down and dead 2024-09-17T01:45:00.714 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:00 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:45:00.405+0000 7f31d89c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:45:00.714 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:00 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:45:00.405+0000 7f31d89c1640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-17T01:45:00.714 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:00 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[58546]: 2024-09-17T01:45:00.405+0000 7f31d89c1640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:45:01.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:00 smithi167 ceph-mon[76323]: pgmap v75: 65 pgs: 65 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:45:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:00 smithi167 ceph-mon[76323]: osd.1 marked itself down and dead 2024-09-17T01:45:01.416 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:01 smithi082 podman[106518]: 2024-09-17 01:45:01.12122506 +0000 UTC m=+0.824636607 container died 339d7e7d3e7342a5f4f0f026b010e2a4502c32ddf38654200bf6c81da9db72e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-c2ddf97, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T01:45:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:01 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:45:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:01 smithi082 ceph-mon[92957]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T01:45:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:01.715 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:01 smithi082 podman[106518]: 2024-09-17 01:45:01.506139055 +0000 UTC m=+1.209550575 container cleanup 339d7e7d3e7342a5f4f0f026b010e2a4502c32ddf38654200bf6c81da9db72e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:45:01.715 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:01 smithi082 bash[106518]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:45:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:01 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:45:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:01 smithi167 ceph-mon[76323]: osdmap e53: 6 total, 5 up, 6 in 2024-09-17T01:45:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:02.158 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:01 smithi082 podman[106533]: 2024-09-17 01:45:01.816188496 +0000 UTC m=+0.698687174 container remove 339d7e7d3e7342a5f4f0f026b010e2a4502c32ddf38654200bf6c81da9db72e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:45:02.442 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.063688098 +0000 UTC m=+0.016111818 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:02.442 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.208954396 +0000 UTC m=+0.161378147 container create b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:45:02.442 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.44489298 +0000 UTC m=+0.397316691 container init b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:45:02.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:02 smithi082 ceph-mon[92957]: pgmap v77: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-17T01:45:02.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:02 smithi082 ceph-mon[92957]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:45:02.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:02 smithi082 ceph-mon[92957]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-09-17T01:45:02.715 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.448289008 +0000 UTC m=+0.400712714 container start b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-17T01:45:02.715 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.53653902 +0000 UTC m=+0.488962729 container attach b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:45:02.715 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:02 smithi082 podman[106620]: 2024-09-17 01:45:02.638605875 +0000 UTC m=+0.591029592 container died b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T01:45:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:02 smithi167 ceph-mon[76323]: pgmap v77: 65 pgs: 20 peering, 4 stale+active+clean, 41 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s 2024-09-17T01:45:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:02 smithi167 ceph-mon[76323]: osdmap e54: 6 total, 5 up, 6 in 2024-09-17T01:45:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:02 smithi167 ceph-mon[76323]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-09-17T01:45:03.176 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106642]: 2024-09-17 01:45:03.157182422 +0000 UTC m=+0.512416076 container remove b6d811b1f4df586df0482a56e581a922840de16f63a33108d8d0ebba87192316 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:45:03.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-17T01:45:03.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 systemd[1]: Stopped Ceph osd.1 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:45:03.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.1.service: Consumed 59.676s CPU time. 2024-09-17T01:45:03.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 systemd[1]: Starting Ceph osd.1 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:45:03.908 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106739]: 2024-09-17 01:45:03.505701246 +0000 UTC m=+0.016147986 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:03.908 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106739]: 2024-09-17 01:45:03.63330734 +0000 UTC m=+0.143754107 container create ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:45:03.908 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106739]: 2024-09-17 01:45:03.910934563 +0000 UTC m=+0.421381290 container init ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:45:04.214 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106739]: 2024-09-17 01:45:03.914440312 +0000 UTC m=+0.424887041 container start ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:45:04.214 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:03 smithi082 podman[106739]: 2024-09-17 01:45:03.994281873 +0000 UTC m=+0.504728612 container attach ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:45:04.214 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:04.214 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 bash[106739]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:04.215 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:04.215 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 bash[106739]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:04.875 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:04 smithi082 ceph-mon[92957]: pgmap v79: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2024-09-17T01:45:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:04 smithi167 ceph-mon[76323]: pgmap v79: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 3 op/s 2024-09-17T01:45:05.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:45:05.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 bash[106739]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:45:05.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:45:05.177 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:04 smithi082 bash[106739]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:45:05.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:45:05.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 bash[106739]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:45:05.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:45:05.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 bash[106739]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:45:05.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 bash[106739]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 bash[106739]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate[106754]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 bash[106739]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-17T01:45:05.465 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 podman[106739]: 2024-09-17 01:45:05.207992232 +0000 UTC m=+1.718438965 container died ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:45:05.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:05 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 4/312 objects degraded (1.282%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:06.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:05 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 4/312 objects degraded (1.282%), 2 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:06.195 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:05 smithi082 podman[106893]: 2024-09-17 01:45:05.882018638 +0000 UTC m=+0.667612238 container remove ce2ae01cea9ff1dcc0b4fea0073979e096dfb4ab7f19b17764f1e91abcd96750 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-17T01:45:06.195 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 podman[106951]: 2024-09-17 01:45:05.999190902 +0000 UTC m=+0.016676822 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:06.195 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 podman[106951]: 2024-09-17 01:45:06.09973155 +0000 UTC m=+0.117217463 container create 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True) 2024-09-17T01:45:06.640 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 podman[106951]: 2024-09-17 01:45:06.310534745 +0000 UTC m=+0.328020666 container init 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:45:06.640 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 podman[106951]: 2024-09-17 01:45:06.313749659 +0000 UTC m=+0.331235571 container start 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:45:06.640 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 ceph-osd[106970]: -- 172.21.15.82:0/4277233610 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce2fd881e0 con 0x55ce2f00f180 2024-09-17T01:45:06.641 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 bash[106951]: 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 2024-09-17T01:45:06.641 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:06 smithi082 systemd[1]: Started Ceph osd.1 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:45:06.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:06 smithi082 ceph-mon[92957]: pgmap v80: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/312 objects degraded (1.282%) 2024-09-17T01:45:06.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:06.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:06.641 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:06 smithi167 ceph-mon[76323]: pgmap v80: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/312 objects degraded (1.282%) 2024-09-17T01:45:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:07.944 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:07 smithi082 ceph-mon[92957]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-17T01:45:08.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:07 smithi167 ceph-mon[76323]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-17T01:45:08.464 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:08 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:45:08.198+0000 7f6bb26cf640 -1 Falling back to public interface 2024-09-17T01:45:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:08 smithi082 ceph-mon[92957]: pgmap v81: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:08 smithi167 ceph-mon[76323]: pgmap v81: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:10.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:10 smithi082 ceph-mon[92957]: pgmap v82: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:10 smithi167 ceph-mon[76323]: pgmap v82: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:12.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:12 smithi082 ceph-mon[92957]: pgmap v83: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:12.616 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.617 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:12 smithi167 ceph-mon[76323]: pgmap v83: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:14.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:14 smithi082 ceph-mon[92957]: pgmap v84: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:14 smithi167 ceph-mon[76323]: pgmap v84: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:15.115 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:14 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:45:14.970+0000 7f6bb26cf640 -1 osd.1 52 log_to_monitors true 2024-09-17T01:45:15.964 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:45:15.579+0000 7f6ba6447640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:45:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:15.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:15 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 46/312 objects degraded (14.744%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:16.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:16.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:15 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T01:45:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:45:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:45:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: pgmap v85: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:45:16.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:45:16.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:45:16.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:16.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: pgmap v85: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46/312 objects degraded (14.744%) 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: osdmap e55: 6 total, 5 up, 6 in 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: from='osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:17.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:17 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:45:17.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:17 smithi082 ceph-mon[92957]: osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214] boot 2024-09-17T01:45:17.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:17 smithi082 ceph-mon[92957]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T01:45:17.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:17 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T01:45:17.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:17 smithi082 ceph-mon[92957]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:45:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:17 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:45:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:17 smithi167 ceph-mon[76323]: osd.1 [v2:172.21.15.82:6810/4123622214,v1:172.21.15.82:6811/4123622214] boot 2024-09-17T01:45:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:17 smithi167 ceph-mon[76323]: osdmap e56: 6 total, 6 up, 6 in 2024-09-17T01:45:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:17 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-17T01:45:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:17 smithi167 ceph-mon[76323]: osdmap e57: 6 total, 6 up, 6 in 2024-09-17T01:45:18.866 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:18 smithi082 ceph-mon[92957]: pgmap v88: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 46/312 objects degraded (14.744%) 2024-09-17T01:45:18.868 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:18 smithi167 ceph-mon[76323]: pgmap v88: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 46/312 objects degraded (14.744%) 2024-09-17T01:45:20.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:20 smithi082 ceph-mon[92957]: pgmap v90: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/312 objects degraded (14.744%) 2024-09-17T01:45:21.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:20 smithi167 ceph-mon[76323]: pgmap v90: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 46/312 objects degraded (14.744%) 2024-09-17T01:45:21.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:21 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:22.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 -- 172.21.15.82:0/162263315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 msgr2=0x7f8950102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 --2- 172.21.15.82:0/162263315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950102fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8938009880 tx=0x7f893802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 -- 172.21.15.82:0/162263315 shutdown_connections 2024-09-17T01:45:22.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 --2- 172.21.15.82:0/162263315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950102fe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 --2- 172.21.15.82:0/162263315 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f8950101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 -- 172.21.15.82:0/162263315 >> 172.21.15.82:0/162263315 conn(0x7f89500fd0f0 msgr2=0x7f89500ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 -- 172.21.15.82:0/162263315 shutdown_connections 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.002+0000 7f8955b28640 1 -- 172.21.15.82:0/162263315 wait complete. 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 Processor -- start 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 -- start start 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f89501974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f895010a7a0 con 0x7f8950102b60 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8955b28640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f895010a620 con 0x7f8950101960 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54834/0 (socket says 172.21.15.82:54834) 2024-09-17T01:45:22.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 -- 172.21.15.82:0/4031636926 learned_addr learned my addr 172.21.15.82:0/4031636926 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f894f7fe640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f89501974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 -- 172.21.15.82:0/4031636926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 msgr2=0x7f89501974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f89501974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f8946ffd640 1 -- 172.21.15.82:0/4031636926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950198080 con 0x7f8950102b60 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.003+0000 7f894f7fe640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f89501974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f8946ffd640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8938006010 tx=0x7f89380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f893803f070 con 0x7f8950102b60 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895019ca60 con 0x7f8950102b60 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89380044d0 con 0x7f8950102b60 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8938035030 con 0x7f8950102b60 2024-09-17T01:45:22.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.004+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895019cff0 con 0x7f8950102b60 2024-09-17T01:45:22.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:21 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.005+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8950101d60 con 0x7f8950102b60 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.006+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8938042070 con 0x7f8950102b60 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.006+0000 7f894d7fa640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 0x7f893c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.006+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f89380becc0 con 0x7f8950102b60 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.006+0000 7f894f7fe640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 0x7f893c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.007+0000 7f894f7fe640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 0x7f893c07d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89400058c0 tx=0x7f8940005d50 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.011+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f893808a370 con 0x7f8950102b60 2024-09-17T01:45:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.202+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8950062630 con 0x7f893c07af30 2024-09-17T01:45:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.204+0000 7f894d7fa640 1 -- 172.21.15.82:0/4031636926 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8950062630 con 0x7f893c07af30 2024-09-17T01:45:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 msgr2=0x7f893c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 0x7f893c07d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89400058c0 tx=0x7f8940005d50 comp rx=0 tx=0).stop 2024-09-17T01:45:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 msgr2=0x7f8950197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8938006010 tx=0x7f89380048f0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 shutdown_connections 2024-09-17T01:45:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f893c07af30 0x7f893c07d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8950102b60 0x7f8950197a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 --2- 172.21.15.82:0/4031636926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8950101960 0x7f89501974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 >> 172.21.15.82:0/4031636926 conn(0x7f89500fd0f0 msgr2=0x7f8950106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 shutdown_connections 2024-09-17T01:45:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.206+0000 7f8955b28640 1 -- 172.21.15.82:0/4031636926 wait complete. 2024-09-17T01:45:22.213 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:45:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.288+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/1536773426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4102b60 msgr2=0x7ff4f4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.288+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/1536773426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4102b60 0x7ff4f4102fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009880 tx=0x7ff4e802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/1536773426 shutdown_connections 2024-09-17T01:45:22.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/1536773426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4102b60 0x7ff4f4102fe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/1536773426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4101960 0x7ff4f4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/1536773426 >> 172.21.15.82:0/1536773426 conn(0x7ff4f40fd0f0 msgr2=0x7ff4f40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/1536773426 shutdown_connections 2024-09-17T01:45:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/1536773426 wait complete. 2024-09-17T01:45:22.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 Processor -- start 2024-09-17T01:45:22.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.289+0000 7ff4f8ef4640 1 -- start start 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f8ef4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f8ef4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4102b60 0x7ff4f41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f8ef4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f410a7a0 con 0x7ff4f4101960 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f8ef4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f410a620 con 0x7ff4f4102b60 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54852/0 (socket says 172.21.15.82:54852) 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 -- 172.21.15.82:0/247004747 learned_addr learned my addr 172.21.15.82:0/247004747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f1d9b640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4102b60 0x7ff4f41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 -- 172.21.15.82:0/247004747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4102b60 msgr2=0x7ff4f41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4102b60 0x7ff4f41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 -- 172.21.15.82:0/247004747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f4198050 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f259c640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c8f0 tx=0x7ff4e400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e4004020 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f419ca90 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4e40041c0 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.290+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4e40047a0 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.291+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f419d020 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.291+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f4101d60 con 0x7ff4f4101960 2024-09-17T01:45:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.292+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff4e4004370 con 0x7ff4f4101960 2024-09-17T01:45:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.293+0000 7ff4e37fe640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 0x7ff4dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.293+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7ff4e409de50 con 0x7ff4f4101960 2024-09-17T01:45:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.293+0000 7ff4f1d9b640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 0x7ff4dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.293+0000 7ff4f1d9b640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 0x7ff4dc07d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4198940 tx=0x7ff4e8005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.297+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff4e4014030 con 0x7ff4f4101960 2024-09-17T01:45:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.490+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff4f40626f0 con 0x7ff4dc07af30 2024-09-17T01:45:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.491+0000 7ff4e37fe640 1 -- 172.21.15.82:0/247004747 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff4f40626f0 con 0x7ff4dc07af30 2024-09-17T01:45:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 msgr2=0x7ff4dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 0x7ff4dc07d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4198940 tx=0x7ff4e8005a20 comp rx=0 tx=0).stop 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 msgr2=0x7ff4f4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c8f0 tx=0x7ff4e400cdb0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 shutdown_connections 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4dc07af30 0x7ff4dc07d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4f4102b60 0x7ff4f41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 --2- 172.21.15.82:0/247004747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4f4101960 0x7ff4f4197490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.493+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 >> 172.21.15.82:0/247004747 conn(0x7ff4f40fd0f0 msgr2=0x7ff4f4105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.494+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 shutdown_connections 2024-09-17T01:45:22.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.494+0000 7ff4f8ef4640 1 -- 172.21.15.82:0/247004747 wait complete. 2024-09-17T01:45:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 -- 172.21.15.82:0/2691714108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 msgr2=0x7f1900104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 --2- 172.21.15.82:0/2691714108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f1900104840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009880 tx=0x7f18f002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 -- 172.21.15.82:0/2691714108 shutdown_connections 2024-09-17T01:45:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 --2- 172.21.15.82:0/2691714108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 --2- 172.21.15.82:0/2691714108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f1900104840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 -- 172.21.15.82:0/2691714108 >> 172.21.15.82:0/2691714108 conn(0x7f19000fc010 msgr2=0x7f19000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 -- 172.21.15.82:0/2691714108 shutdown_connections 2024-09-17T01:45:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.575+0000 7f19061e4640 1 -- 172.21.15.82:0/2691714108 wait complete. 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 Processor -- start 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 -- start start 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f190010a770 con 0x7f1900102450 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f19061e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f190010a5f0 con 0x7f1900104d80 2024-09-17T01:45:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54874/0 (socket says 172.21.15.82:54874) 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18ff7fe640 1 -- 172.21.15.82:0/3206516588 learned_addr learned my addr 172.21.15.82:0/3206516588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18f7fff640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18ff7fe640 1 -- 172.21.15.82:0/3206516588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 msgr2=0x7f1900197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.576+0000 7f18ff7fe640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f18ff7fe640 1 -- 172.21.15.82:0/3206516588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900198080 con 0x7f1900102450 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f18ff7fe640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f18f0006010 tx=0x7f18f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f003f070 con 0x7f1900102450 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18f00044d0 con 0x7f1900102450 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190019cac0 con 0x7f1900102450 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f0035030 con 0x7f1900102450 2024-09-17T01:45:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.577+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190019d050 con 0x7f1900102450 2024-09-17T01:45:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.578+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900102830 con 0x7f1900102450 2024-09-17T01:45:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.579+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f18f0042070 con 0x7f1900102450 2024-09-17T01:45:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.579+0000 7f18fd7fa640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.579+0000 7f18f7fff640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.579+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f18f00bec90 con 0x7f1900102450 2024-09-17T01:45:22.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.580+0000 7f18f7fff640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1900198970 tx=0x7f18e8005c60 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.584+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f18f008a340 con 0x7f1900102450 2024-09-17T01:45:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.769+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1900105700 con 0x7f18ec07af30 2024-09-17T01:45:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.778+0000 7f18fd7fa640 1 -- 172.21.15.82:0/3206516588 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1900105700 con 0x7f18ec07af30 2024-09-17T01:45:22.776 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:45:22.776 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (10m) 11s ago 11m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (3m) 11s ago 12m 8715k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (3m) 68s ago 11m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (76s) 11s ago 12m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (72s) 68s ago 11m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (10m) 11s ago 11m 81.2M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (6m) 11s ago 6m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (6m) 11s ago 6m 96.1M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (6m) 68s ago 6m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (6m) 68s ago 6m 26.4M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (3m) 11s ago 13m 585M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (118s) 68s ago 11m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (103s) 11s ago 13m 111M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:45:22.777 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (88s) 68s ago 11m 91.4M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (12m) 11s ago 12m 15.1M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (11m) 68s ago 11m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (51s) 11s ago 9m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (16s) 11s ago 9m 80.4M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (8m) 11s ago 8m 180M 1216M 19.1.1-330-gc2ddf972 ebb0615149de 171acdbc1cc3 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (8m) 68s ago 8m 257M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (8m) 68s ago 8m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (7m) 68s ago 7m 193M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:45:22.778 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 11s ago 11m 67.0M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 msgr2=0x7f18ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1900198970 tx=0x7f18e8005c60 comp rx=0 tx=0).stop 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 msgr2=0x7f19001974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f18f0006010 tx=0x7f18f00048f0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 shutdown_connections 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 --2- 172.21.15.82:0/3206516588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f19001974c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 >> 172.21.15.82:0/3206516588 conn(0x7f19000fc010 msgr2=0x7f19000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 shutdown_connections 2024-09-17T01:45:22.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.781+0000 7f19061e4640 1 -- 172.21.15.82:0/3206516588 wait complete. 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.860+0000 7f1d5514d640 1 -- 172.21.15.82:0/4261734822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 msgr2=0x7f1d50101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.860+0000 7f1d5514d640 1 --2- 172.21.15.82:0/4261734822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d50101d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009880 tx=0x7f1d4002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 -- 172.21.15.82:0/4261734822 shutdown_connections 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 --2- 172.21.15.82:0/4261734822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 --2- 172.21.15.82:0/4261734822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d50101d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 -- 172.21.15.82:0/4261734822 >> 172.21.15.82:0/4261734822 conn(0x7f1d500fd0f0 msgr2=0x7f1d500ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:22.859 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:22 smithi082 ceph-mon[92957]: pgmap v91: 65 pgs: 5 active+undersized, 3 active+undersized+degraded, 57 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 7/312 objects degraded (2.244%) 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 -- 172.21.15.82:0/4261734822 shutdown_connections 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.861+0000 7f1d5514d640 1 -- 172.21.15.82:0/4261734822 wait complete. 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 Processor -- start 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 -- start start 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010a7a0 con 0x7f1d50101960 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d5514d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010a620 con 0x7f1d50102b60 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d4ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d4ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54882/0 (socket says 172.21.15.82:54882) 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d4ed9d640 1 -- 172.21.15.82:0/2571434350 learned_addr learned my addr 172.21.15.82:0/2571434350 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:22.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.862+0000 7f1d4e59c640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d4ed9d640 1 -- 172.21.15.82:0/2571434350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 msgr2=0x7f1d50197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d4ed9d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d4ed9d640 1 -- 172.21.15.82:0/2571434350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d501980a0 con 0x7f1d50101960 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d4e59c640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d4ed9d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006010 tx=0x7f1d400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d4003f070 con 0x7f1d50101960 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5019ca80 con 0x7f1d50101960 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d40004a50 con 0x7f1d50101960 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d40035030 con 0x7f1d50101960 2024-09-17T01:45:22.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.863+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5019d010 con 0x7f1d50101960 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.864+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d50101d60 con 0x7f1d50101960 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.865+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1d40042070 con 0x7f1d50101960 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.865+0000 7f1d37fff640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 0x7f1d3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.866+0000 7f1d4e59c640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 0x7f1d3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.866+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f1d400bead0 con 0x7f1d50101960 2024-09-17T01:45:22.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.866+0000 7f1d4e59c640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 0x7f1d3807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d440058c0 tx=0x7f1d44005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:22.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:22.870+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1d40004c00 con 0x7f1d50101960 2024-09-17T01:45:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:22 smithi167 ceph-mon[76323]: pgmap v91: 65 pgs: 5 active+undersized, 3 active+undersized+degraded, 57 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 7/312 objects degraded (2.244%) 2024-09-17T01:45:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.118+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1d50062fb0 con 0x7f1d50101960 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.119+0000 7f1d37fff640 1 -- 172.21.15.82:0/2571434350 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f1d4008a180 con 0x7f1d50101960 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:45:23.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 8, 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:45:23.118 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 msgr2=0x7f1d3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 0x7f1d3807d3f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d440058c0 tx=0x7f1d44005850 comp rx=0 tx=0).stop 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 msgr2=0x7f1d501974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d40006010 tx=0x7f1d400045e0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 shutdown_connections 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1d3807af30 0x7f1d3807d3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d50102b60 0x7f1d50197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 --2- 172.21.15.82:0/2571434350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d50101960 0x7f1d501974e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 >> 172.21.15.82:0/2571434350 conn(0x7f1d500fd0f0 msgr2=0x7f1d50106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 shutdown_connections 2024-09-17T01:45:23.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.121+0000 7f1d5514d640 1 -- 172.21.15.82:0/2571434350 wait complete. 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.202+0000 7f98610bf640 1 -- 172.21.15.82:0/2852637455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 msgr2=0x7f985c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.202+0000 7f98610bf640 1 --2- 172.21.15.82:0/2852637455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c101d60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f984c009880 tx=0x7f984c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 -- 172.21.15.82:0/2852637455 shutdown_connections 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 --2- 172.21.15.82:0/2852637455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 --2- 172.21.15.82:0/2852637455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c101d60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 -- 172.21.15.82:0/2852637455 >> 172.21.15.82:0/2852637455 conn(0x7f985c0fd0f0 msgr2=0x7f985c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 -- 172.21.15.82:0/2852637455 shutdown_connections 2024-09-17T01:45:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 -- 172.21.15.82:0/2852637455 wait complete. 2024-09-17T01:45:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.203+0000 7f98610bf640 1 Processor -- start 2024-09-17T01:45:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f98610bf640 1 -- start start 2024-09-17T01:45:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f98610bf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f98610bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f98610bf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f985c10a800 con 0x7f985c101960 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f98610bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f985c10a680 con 0x7f985c102b60 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54898/0 (socket says 172.21.15.82:54898) 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 -- 172.21.15.82:0/1529910504 learned_addr learned my addr 172.21.15.82:0/1529910504 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985a59c640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 -- 172.21.15.82:0/1529910504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 msgr2=0x7f985c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 -- 172.21.15.82:0/1529910504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c1980d0 con 0x7f985c101960 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985a59c640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.204+0000 7f985ad9d640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f984c006010 tx=0x7f984c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.205+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f984c03f070 con 0x7f985c101960 2024-09-17T01:45:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.205+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c19cab0 con 0x7f985c101960 2024-09-17T01:45:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.205+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f984c0044d0 con 0x7f985c101960 2024-09-17T01:45:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.205+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f984c035030 con 0x7f985c101960 2024-09-17T01:45:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.205+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c19d040 con 0x7f985c101960 2024-09-17T01:45:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.206+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c101d60 con 0x7f985c101960 2024-09-17T01:45:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.206+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f984c042070 con 0x7f985c101960 2024-09-17T01:45:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.207+0000 7f9853fff640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 0x7f984807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.207+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f984c0bec30 con 0x7f985c101960 2024-09-17T01:45:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.207+0000 7f985a59c640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 0x7f984807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.207+0000 7f985a59c640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 0x7f984807d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844008040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.211+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f984c08a2e0 con 0x7f985c101960 2024-09-17T01:45:23.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.420+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f985c062df0 con 0x7f985c101960 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.421+0000 7f9853fff640 1 -- 172.21.15.82:0/1529910504 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f984c08f190 con 0x7f985c101960 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:23.419 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:45:23.420 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:45:23.421 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:23.422 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:45:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 msgr2=0x7f984807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 0x7f984807d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9844006fd0 tx=0x7f9844008040 comp rx=0 tx=0).stop 2024-09-17T01:45:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 msgr2=0x7f985c197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f984c006010 tx=0x7f984c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 shutdown_connections 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f984807af30 0x7f984807d3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f985c102b60 0x7f985c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 --2- 172.21.15.82:0/1529910504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f985c101960 0x7f985c197510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 >> 172.21.15.82:0/1529910504 conn(0x7f985c0fd0f0 msgr2=0x7f985c105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 shutdown_connections 2024-09-17T01:45:23.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.423+0000 7f98610bf640 1 -- 172.21.15.82:0/1529910504 wait complete. 2024-09-17T01:45:23.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 -- 172.21.15.82:0/3403225558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88100ad0 msgr2=0x7f9f88100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3403225558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88100ad0 0x7f9f88100f50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009880 tx=0x7f9f7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 -- 172.21.15.82:0/3403225558 shutdown_connections 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3403225558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88100ad0 0x7f9f88100f50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3403225558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88101e70 0x7f9f88102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 -- 172.21.15.82:0/3403225558 >> 172.21.15.82:0/3403225558 conn(0x7f9f880fb770 msgr2=0x7f9f880fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 -- 172.21.15.82:0/3403225558 shutdown_connections 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 -- 172.21.15.82:0/3403225558 wait complete. 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.506+0000 7f9f8e981640 1 Processor -- start 2024-09-17T01:45:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f8e981640 1 -- start start 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f8e981640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88100ad0 0x7f9f88104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f8e981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f8e981640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f881096a0 con 0x7f9f88101e70 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f8e981640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9f88109520 con 0x7f9f88100ad0 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54914/0 (socket says 172.21.15.82:54914) 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 -- 172.21.15.82:0/3600228912 learned_addr learned my addr 172.21.15.82:0/3600228912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f87fff640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88100ad0 0x7f9f88104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 -- 172.21.15.82:0/3600228912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88100ad0 msgr2=0x7f9f88104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88100ad0 0x7f9f88104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.507+0000 7f9f877fe640 1 -- 172.21.15.82:0/3600228912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f88103400 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f877fe640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006010 tx=0x7f9f7c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c03f070 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f7c004a50 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f88103690 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f7c035030 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.508+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f88103bc0 con 0x7f9f88101e70 2024-09-17T01:45:23.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.509+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f88100f50 con 0x7f9f88101e70 2024-09-17T01:45:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.510+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9f7c042070 con 0x7f9f88101e70 2024-09-17T01:45:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.510+0000 7f9f857fa640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 0x7f9f7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.510+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f9f7c0bea20 con 0x7f9f88101e70 2024-09-17T01:45:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.510+0000 7f9f87fff640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 0x7f9f7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.511+0000 7f9f87fff640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 0x7f9f7007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f88069f90 tx=0x7f9f7800b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.515+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9f7c004c00 con 0x7f9f88101e70 2024-09-17T01:45:23.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.710+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9f88100140 con 0x7f9f7007af30 2024-09-17T01:45:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:23 smithi082 ceph-mon[92957]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:23 smithi082 ceph-mon[92957]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:23 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2571434350' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:23.709 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:23 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1529910504' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:45:23.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.711+0000 7f9f857fa640 1 -- 172.21.15.82:0/3600228912 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9f88100140 con 0x7f9f7007af30 2024-09-17T01:45:23.709 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "8/23 daemons upgraded", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:45:23.710 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 msgr2=0x7f9f7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 0x7f9f7007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f88069f90 tx=0x7f9f7800b390 comp rx=0 tx=0).stop 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 msgr2=0x7f9f88102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c006010 tx=0x7f9f7c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 shutdown_connections 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9f7007af30 0x7f9f7007d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f88101e70 0x7f9f88102ec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 --2- 172.21.15.82:0/3600228912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f88100ad0 0x7f9f88104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 >> 172.21.15.82:0/3600228912 conn(0x7f9f880fb770 msgr2=0x7f9f880ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 shutdown_connections 2024-09-17T01:45:23.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.714+0000 7f9f8e981640 1 -- 172.21.15.82:0/3600228912 wait complete. 2024-09-17T01:45:23.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 -- 172.21.15.82:0/1116912713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 msgr2=0x7f1a40100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/1116912713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40100f50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1a34009c20 tx=0x7f1a3402a970 comp rx=0 tx=0).stop 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 -- 172.21.15.82:0/1116912713 shutdown_connections 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/1116912713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40100f50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/1116912713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 -- 172.21.15.82:0/1116912713 >> 172.21.15.82:0/1116912713 conn(0x7f1a400fb770 msgr2=0x7f1a400fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 -- 172.21.15.82:0/1116912713 shutdown_connections 2024-09-17T01:45:23.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.794+0000 7f1a44bf0640 1 -- 172.21.15.82:0/1116912713 wait complete. 2024-09-17T01:45:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 Processor -- start 2024-09-17T01:45:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 -- start start 2024-09-17T01:45:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4010a830 con 0x7f1a40100ad0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a44bf0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4010a6b0 con 0x7f1a40101e70 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a3e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a3e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54932/0 (socket says 172.21.15.82:54932) 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.795+0000 7f1a3e59c640 1 -- 172.21.15.82:0/3991920918 learned_addr learned my addr 172.21.15.82:0/3991920918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3dd9b640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3e59c640 1 -- 172.21.15.82:0/3991920918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 msgr2=0x7f1a40197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3e59c640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3e59c640 1 -- 172.21.15.82:0/3991920918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a401981d0 con 0x7f1a40100ad0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3dd9b640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a3e59c640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b3d0 tx=0x7f1a3800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a38015020 con 0x7f1a40100ad0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4019cc10 con 0x7f1a40100ad0 2024-09-17T01:45:23.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a38011af0 con 0x7f1a40100ad0 2024-09-17T01:45:23.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a38010da0 con 0x7f1a40100ad0 2024-09-17T01:45:23.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.796+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4019d1a0 con 0x7f1a40100ad0 2024-09-17T01:45:23.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.797+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a40100fd0 con 0x7f1a40100ad0 2024-09-17T01:45:23.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.798+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1a38018020 con 0x7f1a40100ad0 2024-09-17T01:45:23.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.798+0000 7f1a2f7fe640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 0x7f1a2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:23.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.798+0000 7f1a3dd9b640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 0x7f1a2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:23.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.798+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5984+0+0 (secure 0 0 0) 0x7f1a3809da60 con 0x7f1a40100ad0 2024-09-17T01:45:23.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.799+0000 7f1a3dd9b640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 0x7f1a2807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a34006010 tx=0x7f1a340093f0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:23.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:23.803+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1a3801f020 con 0x7f1a40100ad0 2024-09-17T01:45:23.962 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:23 smithi167 ceph-mon[76323]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:23.963 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:23 smithi167 ceph-mon[76323]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:23.963 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:23 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2571434350' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:23.963 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:23 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1529910504' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:45:24.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.047+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1a40191640 con 0x7f1a40100ad0 2024-09-17T01:45:24.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.048+0000 7f1a2f7fe640 1 -- 172.21.15.82:0/3991920918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f1a38069110 con 0x7f1a40100ad0 2024-09-17T01:45:24.047 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:45:24.047 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:45:24.047 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:45:24.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 msgr2=0x7f1a2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 0x7f1a2807d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a34006010 tx=0x7f1a340093f0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 msgr2=0x7f1a40197610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:24.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a3800b3d0 tx=0x7f1a3800b890 comp rx=0 tx=0).stop 2024-09-17T01:45:24.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 shutdown_connections 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1a2807af30 0x7f1a2807d3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a40101e70 0x7f1a40197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 --2- 172.21.15.82:0/3991920918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a40100ad0 0x7f1a40197610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 >> 172.21.15.82:0/3991920918 conn(0x7f1a400fb770 msgr2=0x7f1a40105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 shutdown_connections 2024-09-17T01:45:24.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:24.050+0000 7f1a44bf0640 1 -- 172.21.15.82:0/3991920918 wait complete. 2024-09-17T01:45:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:24 smithi082 ceph-mon[92957]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:24 smithi082 ceph-mon[92957]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-17T01:45:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:24 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded) 2024-09-17T01:45:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:24 smithi082 ceph-mon[92957]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:24 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3991920918' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:45:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:24 smithi167 ceph-mon[76323]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:24 smithi167 ceph-mon[76323]: pgmap v92: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-17T01:45:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:24 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/312 objects degraded (2.244%), 3 pgs degraded) 2024-09-17T01:45:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:24 smithi167 ceph-mon[76323]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:24 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3991920918' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:45:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:26 smithi082 ceph-mon[92957]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 916 B/s rd, 1 op/s 2024-09-17T01:45:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:26 smithi167 ceph-mon[76323]: pgmap v93: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 916 B/s rd, 1 op/s 2024-09-17T01:45:28.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:28 smithi082 ceph-mon[92957]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:45:29.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:28 smithi167 ceph-mon[76323]: pgmap v94: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:45:30.934 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:30 smithi082 ceph-mon[92957]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:45:30.934 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T01:45:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:30 smithi167 ceph-mon[76323]: pgmap v95: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-17T01:45:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-17T01:45:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:31 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:45:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:31 smithi082 ceph-mon[92957]: Upgrade: osd.2 is safe to restart 2024-09-17T01:45:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:31.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:31 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-17T01:45:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:31 smithi167 ceph-mon[76323]: Upgrade: osd.2 is safe to restart 2024-09-17T01:45:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-17T01:45:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: Upgrade: Updating osd.2 2024-09-17T01:45:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-17T01:45:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:32.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:32 smithi082 ceph-mon[92957]: Deploying daemon osd.2 on smithi082 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: pgmap v96: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: Upgrade: Updating osd.2 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:32 smithi167 ceph-mon[76323]: Deploying daemon osd.2 on smithi082 2024-09-17T01:45:34.815 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:34 smithi082 ceph-mon[92957]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:45:34.815 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:34 smithi082 systemd[1]: Stopping Ceph osd.2 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:45:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:34 smithi167 ceph-mon[76323]: pgmap v97: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:45:35.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:45:34.824+0000 7fcc6e35a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:45:35.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:45:34.824+0000 7fcc6e35a640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-17T01:45:35.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[66156]: 2024-09-17T01:45:34.824+0000 7fcc6e35a640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:45:35.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:35 smithi082 ceph-mon[92957]: osd.2 marked itself down and dead 2024-09-17T01:45:36.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:35 smithi167 ceph-mon[76323]: osd.2 marked itself down and dead 2024-09-17T01:45:36.557 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:36 smithi082 podman[112084]: 2024-09-17 01:45:36.229451854 +0000 UTC m=+1.512769738 container died 171acdbc1cc37ff9586bf82e37fb1447d213c94d6126d9a3a7f6b9568d32d691 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:45:36.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:36 smithi082 ceph-mon[92957]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:45:36.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:36 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:45:36.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:36 smithi082 ceph-mon[92957]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T01:45:36.853 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:36 smithi082 podman[112084]: 2024-09-17 01:45:36.659223715 +0000 UTC m=+1.942541585 container cleanup 171acdbc1cc37ff9586bf82e37fb1447d213c94d6126d9a3a7f6b9568d32d691 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:45:36.853 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:36 smithi082 bash[112084]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:45:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:36 smithi167 ceph-mon[76323]: pgmap v98: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:45:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:36 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:45:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:36 smithi167 ceph-mon[76323]: osdmap e58: 6 total, 5 up, 6 in 2024-09-17T01:45:37.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:36 smithi082 podman[112112]: 2024-09-17 01:45:36.852587811 +0000 UTC m=+0.619711193 container remove 171acdbc1cc37ff9586bf82e37fb1447d213c94d6126d9a3a7f6b9568d32d691 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-c2ddf97, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:45:37.545 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.253410617 +0000 UTC m=+0.096449559 container create e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-17T01:45:37.545 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.173287786 +0000 UTC m=+0.016326738 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:37.546 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.472603654 +0000 UTC m=+0.315642600 container init e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T01:45:37.546 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.476314398 +0000 UTC m=+0.319353341 container start e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:45:37.546 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.547461433 +0000 UTC m=+0.390500386 container attach e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-17T01:45:37.957 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:37 smithi082 ceph-mon[92957]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:45:37.957 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:37 smithi082 podman[112199]: 2024-09-17 01:45:37.666037263 +0000 UTC m=+0.509076205 container died e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-17T01:45:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:37 smithi167 ceph-mon[76323]: osdmap e59: 6 total, 5 up, 6 in 2024-09-17T01:45:38.714 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 podman[112222]: 2024-09-17 01:45:38.301168701 +0000 UTC m=+0.625585215 container remove e46b9988a5343be2d75ba6dabf877c4d2325568d7f441a4087dfd9ce64de099d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-17T01:45:38.714 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-17T01:45:38.715 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 systemd[1]: Stopped Ceph osd.2 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:45:38.715 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.2.service: Consumed 46.058s CPU time. 2024-09-17T01:45:38.715 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 systemd[1]: Starting Ceph osd.2 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:45:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:38 smithi167 ceph-mon[76323]: pgmap v101: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:45:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:38 smithi167 ceph-mon[76323]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:45:39.086 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:38 smithi082 ceph-mon[92957]: pgmap v101: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:45:39.086 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:38 smithi082 ceph-mon[92957]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-17T01:45:39.086 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 podman[112321]: 2024-09-17 01:45:38.642231932 +0000 UTC m=+0.016141620 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:39.086 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:38 smithi082 podman[112321]: 2024-09-17 01:45:38.819298484 +0000 UTC m=+0.193208164 container create f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-17T01:45:39.086 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 podman[112321]: 2024-09-17 01:45:39.088687541 +0000 UTC m=+0.462597218 container init f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-17T01:45:39.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 podman[112321]: 2024-09-17 01:45:39.092399315 +0000 UTC m=+0.466308995 container start f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-17T01:45:39.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 podman[112321]: 2024-09-17 01:45:39.188478713 +0000 UTC m=+0.562388401 container attach f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T01:45:39.465 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:39.465 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 bash[112321]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:39.465 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:39.465 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:39 smithi082 bash[112321]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:45:40.352 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:45:40.352 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:45:40.352 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:45:40.352 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-17T01:45:40.690 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:45:40.691 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T01:45:40.691 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate[112336]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:45:40.691 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 bash[112321]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-17T01:45:40.691 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:40 smithi082 podman[112321]: 2024-09-17 01:45:40.38258237 +0000 UTC m=+1.756492054 container died f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True) 2024-09-17T01:45:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:40 smithi082 ceph-mon[92957]: pgmap v102: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:45:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:40 smithi167 ceph-mon[76323]: pgmap v102: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:45:41.249 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 podman[112486]: 2024-09-17 01:45:41.000656974 +0000 UTC m=+0.612331460 container remove f72b4da09443c7b3a60627882b4344abd6156af4ea5aa537c09e626b5699a37f (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:45:41.249 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 podman[112544]: 2024-09-17 01:45:41.113701341 +0000 UTC m=+0.016045219 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:45:41.249 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 podman[112544]: 2024-09-17 01:45:41.251879517 +0000 UTC m=+0.154223462 container create 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T01:45:41.510 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 podman[112544]: 2024-09-17 01:45:41.479501539 +0000 UTC m=+0.381845413 container init 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0) 2024-09-17T01:45:41.511 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 podman[112544]: 2024-09-17 01:45:41.482715305 +0000 UTC m=+0.385059180 container start 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0) 2024-09-17T01:45:41.964 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 ceph-osd[112563]: -- 172.21.15.82:0/1721326905 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d57ff21e0 con 0x555d57279180 2024-09-17T01:45:41.964 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 bash[112544]: 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d 2024-09-17T01:45:41.964 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:41 smithi082 systemd[1]: Started Ceph osd.2 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:45:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: pgmap v103: 65 pgs: 13 active+undersized, 4 peering, 10 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/312 objects degraded (9.936%) 2024-09-17T01:45:42.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:42.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:42.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:42.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 31/312 objects degraded (9.936%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:42.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:42 smithi082 ceph-mon[92957]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: pgmap v103: 65 pgs: 13 active+undersized, 4 peering, 10 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 31/312 objects degraded (9.936%) 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 31/312 objects degraded (9.936%), 10 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:42 smithi167 ceph-mon[76323]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-17T01:45:43.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:43 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:45:43.127+0000 7f044c6ec640 -1 Falling back to public interface 2024-09-17T01:45:44.741 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:44 smithi082 ceph-mon[92957]: pgmap v104: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:44 smithi167 ceph-mon[76323]: pgmap v104: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:46 smithi082 ceph-mon[92957]: pgmap v105: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:46 smithi167 ceph-mon[76323]: pgmap v105: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:45:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:48.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:48 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:48.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:48 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:48.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:48 smithi167 ceph-mon[76323]: pgmap v106: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:48.604 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:48 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:48.604 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:48 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:48.604 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:48 smithi082 ceph-mon[92957]: pgmap v106: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:49.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:49 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:45:49.059+0000 7f044c6ec640 -1 osd.2 57 log_to_monitors true 2024-09-17T01:45:49.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:49 smithi167 ceph-mon[76323]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-17T01:45:49.677 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:49 smithi082 ceph-mon[92957]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-17T01:45:49.677 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:45:49 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:45:49.253+0000 7f044446c640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:45:50.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:50 smithi167 ceph-mon[76323]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:45:50.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:50 smithi167 ceph-mon[76323]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:45:50.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:50 smithi167 ceph-mon[76323]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:45:50.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:50 smithi167 ceph-mon[76323]: pgmap v108: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:50.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:50 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:50.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:50 smithi082 ceph-mon[92957]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T01:45:50.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:50 smithi082 ceph-mon[92957]: osdmap e60: 6 total, 5 up, 6 in 2024-09-17T01:45:50.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:50 smithi082 ceph-mon[92957]: from='osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi082", "root=default"]} : dispatch 2024-09-17T01:45:50.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:50 smithi082 ceph-mon[92957]: pgmap v108: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 41/312 objects degraded (13.141%) 2024-09-17T01:45:50.536 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:50 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 41/312 objects degraded (13.141%), 13 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035] boot 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:45:51.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:51 smithi167 ceph-mon[76323]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:45:51.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:45:51.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: osd.2 [v2:172.21.15.82:6818/261719035,v1:172.21.15.82:6819/261719035] boot 2024-09-17T01:45:51.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: osdmap e61: 6 total, 6 up, 6 in 2024-09-17T01:45:51.712 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:45:51.713 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:51 smithi082 ceph-mon[92957]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:45:52.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:52 smithi167 ceph-mon[76323]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:45:52.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:52 smithi167 ceph-mon[76323]: pgmap v111: 65 pgs: 3 peering, 8 active+undersized, 10 active+undersized+degraded, 44 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 32/312 objects degraded (10.256%) 2024-09-17T01:45:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:52 smithi082 ceph-mon[92957]: osdmap e62: 6 total, 6 up, 6 in 2024-09-17T01:45:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:52 smithi082 ceph-mon[92957]: pgmap v111: 65 pgs: 3 peering, 8 active+undersized, 10 active+undersized+degraded, 44 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 5 op/s; 32/312 objects degraded (10.256%) 2024-09-17T01:45:54.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 -- 172.21.15.82:0/497098471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c074c50 msgr2=0x7fac8c0750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 --2- 172.21.15.82:0/497098471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c074c50 0x7fac8c0750b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009880 tx=0x7fac7c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 -- 172.21.15.82:0/497098471 shutdown_connections 2024-09-17T01:45:54.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 --2- 172.21.15.82:0/497098471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c074c50 0x7fac8c0750b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 --2- 172.21.15.82:0/497098471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c076220 0x7fac8c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.145+0000 7fac93954640 1 -- 172.21.15.82:0/497098471 >> 172.21.15.82:0/497098471 conn(0x7fac8c0fd0f0 msgr2=0x7fac8c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 -- 172.21.15.82:0/497098471 shutdown_connections 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 -- 172.21.15.82:0/497098471 wait complete. 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 Processor -- start 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 -- start start 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c074c50 0x7fac8c19dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.146+0000 7fac93954640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac93954640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c110da0 con 0x7fac8c076220 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac93954640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c110c20 con 0x7fac8c074c50 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37526/0 (socket says 172.21.15.82:37526) 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 -- 172.21.15.82:0/3841442253 learned_addr learned my addr 172.21.15.82:0/3841442253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac916f0640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c074c50 0x7fac8c19dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 -- 172.21.15.82:0/3841442253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c074c50 msgr2=0x7fac8c19dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c074c50 0x7fac8c19dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 -- 172.21.15.82:0/3841442253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c19e6a0 con 0x7fac8c076220 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac90eef640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac7c006010 tx=0x7fac7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac7c03f070 con 0x7fac8c076220 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac7c004ac0 con 0x7fac8c076220 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c1a3080 con 0x7fac8c076220 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.147+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac7c035030 con 0x7fac8c076220 2024-09-17T01:45:54.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.148+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1a3610 con 0x7fac8c076220 2024-09-17T01:45:54.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.149+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c0750b0 con 0x7fac8c076220 2024-09-17T01:45:54.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.149+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fac7c042070 con 0x7fac8c076220 2024-09-17T01:45:54.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.150+0000 7fac827fc640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 0x7fac7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.150+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7fac7c0bea80 con 0x7fac8c076220 2024-09-17T01:45:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.150+0000 7fac916f0640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 0x7fac7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.150+0000 7fac916f0640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 0x7fac7807d440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c076600 tx=0x7fac8800b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.155+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fac7c08a1b0 con 0x7fac8c076220 2024-09-17T01:45:54.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.347+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac8c062630 con 0x7fac7807af80 2024-09-17T01:45:54.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.348+0000 7fac827fc640 1 -- 172.21.15.82:0/3841442253 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fac8c062630 con 0x7fac7807af80 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 msgr2=0x7fac7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 0x7fac7807d440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fac8c076600 tx=0x7fac8800b390 comp rx=0 tx=0).stop 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 msgr2=0x7fac8c19e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac7c006010 tx=0x7fac7c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 shutdown_connections 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fac7807af80 0x7fac7807d440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac8c076220 0x7fac8c19e020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 --2- 172.21.15.82:0/3841442253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac8c074c50 0x7fac8c19dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 >> 172.21.15.82:0/3841442253 conn(0x7fac8c0fd0f0 msgr2=0x7fac8c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.350+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 shutdown_connections 2024-09-17T01:45:54.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.351+0000 7fac93954640 1 -- 172.21.15.82:0/3841442253 wait complete. 2024-09-17T01:45:54.357 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 -- 172.21.15.82:0/416151419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 msgr2=0x7f0590102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 --2- 172.21.15.82:0/416151419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f0590102fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0578009880 tx=0x7f057802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 -- 172.21.15.82:0/416151419 shutdown_connections 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 --2- 172.21.15.82:0/416151419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f0590102fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 --2- 172.21.15.82:0/416151419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 0x7f0590101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 -- 172.21.15.82:0/416151419 >> 172.21.15.82:0/416151419 conn(0x7f05900fd0f0 msgr2=0x7f05900ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 -- 172.21.15.82:0/416151419 shutdown_connections 2024-09-17T01:45:54.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 -- 172.21.15.82:0/416151419 wait complete. 2024-09-17T01:45:54.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.434+0000 7f059543f640 1 Processor -- start 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f059543f640 1 -- start start 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f059543f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 0x7f0590197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f059543f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f059543f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f059010a780 con 0x7f0590102b60 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f059543f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f059010a600 con 0x7f0590101960 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37548/0 (socket says 172.21.15.82:37548) 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 -- 172.21.15.82:0/3176905818 learned_addr learned my addr 172.21.15.82:0/3176905818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058effd640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 0x7f0590197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 -- 172.21.15.82:0/3176905818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 msgr2=0x7f0590197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 0x7f0590197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.435+0000 7f058e7fc640 1 -- 172.21.15.82:0/3176905818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0590198030 con 0x7f0590102b60 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f058e7fc640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0578006010 tx=0x7f05780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f057803f070 con 0x7f0590102b60 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059019ca10 con 0x7f0590102b60 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059019cfa0 con 0x7f0590102b60 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05780044d0 con 0x7f0590102b60 2024-09-17T01:45:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.436+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0578035030 con 0x7f0590102b60 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.437+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05700052c0 con 0x7f0590102b60 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.438+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0578042070 con 0x7f0590102b60 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.438+0000 7f0587fff640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 0x7f057c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.438+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7f05780bebe0 con 0x7f0590102b60 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.438+0000 7f058effd640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 0x7f057c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.439+0000 7f058effd640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 0x7f057c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0580005db0 tx=0x7f0580005d40 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.443+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f057808a310 con 0x7f0590102b60 2024-09-17T01:45:54.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.634+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0570000bf0 con 0x7f057c07af80 2024-09-17T01:45:54.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.635+0000 7f0587fff640 1 -- 172.21.15.82:0/3176905818 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0570000bf0 con 0x7f057c07af80 2024-09-17T01:45:54.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 msgr2=0x7f057c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 0x7f057c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0580005db0 tx=0x7f0580005d40 comp rx=0 tx=0).stop 2024-09-17T01:45:54.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 msgr2=0x7f05901979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0578006010 tx=0x7f05780048f0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 shutdown_connections 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f057c07af80 0x7f057c07d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0590102b60 0x7f05901979b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 --2- 172.21.15.82:0/3176905818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0590101960 0x7f0590197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 >> 172.21.15.82:0/3176905818 conn(0x7f05900fd0f0 msgr2=0x7f0590105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 shutdown_connections 2024-09-17T01:45:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.637+0000 7f059543f640 1 -- 172.21.15.82:0/3176905818 wait complete. 2024-09-17T01:45:54.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:54 smithi082 ceph-mon[92957]: pgmap v112: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 22/312 objects degraded (7.051%) 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 -- 172.21.15.82:0/2495214753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508100860 msgr2=0x7ff508100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/2495214753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508100860 0x7ff508100c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009880 tx=0x7ff4f802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 -- 172.21.15.82:0/2495214753 shutdown_connections 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/2495214753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508101a60 0x7ff508101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/2495214753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508100860 0x7ff508100c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 -- 172.21.15.82:0/2495214753 >> 172.21.15.82:0/2495214753 conn(0x7ff5080fc010 msgr2=0x7ff5080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 -- 172.21.15.82:0/2495214753 shutdown_connections 2024-09-17T01:45:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.719+0000 7ff50e1c9640 1 -- 172.21.15.82:0/2495214753 wait complete. 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 Processor -- start 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 -- start start 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 0x7ff5081974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff508109680 con 0x7ff508101a60 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff50e1c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff508109500 con 0x7ff508100860 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37566/0 (socket says 172.21.15.82:37566) 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 -- 172.21.15.82:0/208580786 learned_addr learned my addr 172.21.15.82:0/208580786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:54.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff5077fe640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 0x7ff5081974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 -- 172.21.15.82:0/208580786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 msgr2=0x7ff5081974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 0x7ff5081974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff4fffff640 1 -- 172.21.15.82:0/208580786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5081980b0 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.720+0000 7ff5077fe640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 0x7ff5081974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff4fffff640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000d8d0 tx=0x7ff4f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4f0017070 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4f0010460 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4f000f5f0 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50819caf0 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.721+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50819d080 con 0x7ff508101a60 2024-09-17T01:45:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.722+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff508100c60 con 0x7ff508101a60 2024-09-17T01:45:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.723+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff4f0009a30 con 0x7ff508101a60 2024-09-17T01:45:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.723+0000 7ff5057fa640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.723+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7ff4f009de20 con 0x7ff508101a60 2024-09-17T01:45:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.723+0000 7ff5077fe640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.724+0000 7ff5077fe640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 0x7ff4f407d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.728+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff4f00694d0 con 0x7ff508101a60 2024-09-17T01:45:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.913+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff50806a400 con 0x7ff4f407af30 2024-09-17T01:45:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.922+0000 7ff5057fa640 1 -- 172.21.15.82:0/208580786 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff50806a400 con 0x7ff4f407af30 2024-09-17T01:45:54.920 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:45:54.920 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (10m) 8s ago 12m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (4m) 8s ago 12m 8762k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (3m) 100s ago 11m 8493k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (108s) 8s ago 12m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (104s) 100s ago 11m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (10m) 8s ago 12m 81.1M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (7m) 8s ago 7m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (7m) 8s ago 7m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (7m) 100s ago 7m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (6m) 100s ago 6m 26.4M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (3m) 8s ago 13m 586M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (2m) 100s ago 11m 520M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (2m) 8s ago 13m 113M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:45:54.921 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (2m) 100s ago 11m 91.4M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (12m) 8s ago 12m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (11m) 100s ago 11m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (83s) 8s ago 10m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (48s) 8s ago 9m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (13s) 8s ago 9m 80.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (9m) 100s ago 9m 257M 2240M 19.1.1-330-gc2ddf972 ebb0615149de d02d904ea0f2 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (8m) 100s ago 8m 215M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (8m) 100s ago 8m 193M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:45:54.922 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 8s ago 12m 69.2M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 msgr2=0x7ff4f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 0x7ff4f407d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c00 tx=0x7ff4f8005a20 comp rx=0 tx=0).stop 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 msgr2=0x7ff508197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000d8d0 tx=0x7ff4f000dd90 comp rx=0 tx=0).stop 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 shutdown_connections 2024-09-17T01:45:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff508101a60 0x7ff508197a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 --2- 172.21.15.82:0/208580786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff508100860 0x7ff5081974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 >> 172.21.15.82:0/208580786 conn(0x7ff5080fc010 msgr2=0x7ff508069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 shutdown_connections 2024-09-17T01:45:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:54.925+0000 7ff50e1c9640 1 -- 172.21.15.82:0/208580786 wait complete. 2024-09-17T01:45:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:54 smithi167 ceph-mon[76323]: pgmap v112: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 22/312 objects degraded (7.051%) 2024-09-17T01:45:55.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- 172.21.15.82:0/362715148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 msgr2=0x7f9494104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 --2- 172.21.15.82:0/362715148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f9494104800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f94840098b0 tx=0x7f948402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- 172.21.15.82:0/362715148 shutdown_connections 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 --2- 172.21.15.82:0/362715148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 0x7f9494107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 --2- 172.21.15.82:0/362715148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f9494104800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- 172.21.15.82:0/362715148 >> 172.21.15.82:0/362715148 conn(0x7f94940fc010 msgr2=0x7f94940fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- 172.21.15.82:0/362715148 shutdown_connections 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- 172.21.15.82:0/362715148 wait complete. 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 Processor -- start 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.006+0000 7f949ae4a640 1 -- start start 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f949ae4a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f949ae4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 0x7f9494197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f949ae4a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f949410a7e0 con 0x7f9494102410 2024-09-17T01:45:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f949ae4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f949410a660 con 0x7f9494104d40 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37584/0 (socket says 172.21.15.82:37584) 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 -- 172.21.15.82:0/1055558120 learned_addr learned my addr 172.21.15.82:0/1055558120 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9493fff640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 0x7f9494197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 -- 172.21.15.82:0/1055558120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 msgr2=0x7f9494197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 0x7f9494197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 -- 172.21.15.82:0/1055558120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9494198160 con 0x7f9494102410 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9498be6640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94840099d0 tx=0x7f94840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f948403f070 con 0x7f9494102410 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949419cb40 con 0x7f9494102410 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94840035f0 con 0x7f9494102410 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.007+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9484035030 con 0x7f9494102410 2024-09-17T01:45:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.008+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949419d0d0 con 0x7f9494102410 2024-09-17T01:45:55.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.009+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94941027f0 con 0x7f9494102410 2024-09-17T01:45:55.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.009+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9484042070 con 0x7f9494102410 2024-09-17T01:45:55.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.010+0000 7f9491ffb640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 0x7f947c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.010+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7f94840be930 con 0x7f9494102410 2024-09-17T01:45:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.010+0000 7f9493fff640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 0x7f947c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.010+0000 7f9493fff640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 0x7f947c07d3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9494198a50 tx=0x7f9488005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.014+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9484089fe0 con 0x7f9494102410 2024-09-17T01:45:55.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.262+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f949419d460 con 0x7f9494102410 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.262+0000 7f9491ffb640 1 -- 172.21.15.82:0/1055558120 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f948408c500 con 0x7f9494102410 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:45:55.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 3, 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 3 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 7, 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 7 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:45:55.262 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:45:55.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 msgr2=0x7f947c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 0x7f947c07d3f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9494198a50 tx=0x7f9488005f90 comp rx=0 tx=0).stop 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 msgr2=0x7f94941975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94840099d0 tx=0x7f94840045e0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 shutdown_connections 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f947c07af30 0x7f947c07d3f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9494104d40 0x7f9494197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 --2- 172.21.15.82:0/1055558120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494102410 0x7f94941975a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 >> 172.21.15.82:0/1055558120 conn(0x7f94940fc010 msgr2=0x7f94940fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 shutdown_connections 2024-09-17T01:45:55.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.265+0000 7f949ae4a640 1 -- 172.21.15.82:0/1055558120 wait complete. 2024-09-17T01:45:55.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 -- 172.21.15.82:0/3642932123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858101a80 msgr2=0x7fb858101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 --2- 172.21.15.82:0/3642932123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858101a80 0x7fb858101f00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb840009880 tx=0x7fb84002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 -- 172.21.15.82:0/3642932123 shutdown_connections 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 --2- 172.21.15.82:0/3642932123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858101a80 0x7fb858101f00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 --2- 172.21.15.82:0/3642932123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb858100880 0x7fb858100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 -- 172.21.15.82:0/3642932123 >> 172.21.15.82:0/3642932123 conn(0x7fb8580fc010 msgr2=0x7fb8580fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 -- 172.21.15.82:0/3642932123 shutdown_connections 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 -- 172.21.15.82:0/3642932123 wait complete. 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.346+0000 7fb85e314640 1 Processor -- start 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 -- start start 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb858101a80 0x7fb85819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb858109740 con 0x7fb858100880 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb8581095c0 con 0x7fb858101a80 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37602/0 (socket says 172.21.15.82:37602) 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 -- 172.21.15.82:0/1098717343 learned_addr learned my addr 172.21.15.82:0/1098717343 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 -- 172.21.15.82:0/1098717343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb858101a80 msgr2=0x7fb85819c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb858101a80 0x7fb85819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 -- 172.21.15.82:0/1098717343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85819c860 con 0x7fb858100880 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb857fff640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b3d0 tx=0x7fb84800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb848015020 con 0x7fb858100880 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb848011af0 con 0x7fb858100880 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85819cb50 con 0x7fb858100880 2024-09-17T01:45:55.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.347+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb848010d90 con 0x7fb858100880 2024-09-17T01:45:55.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.348+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85819d160 con 0x7fb858100880 2024-09-17T01:45:55.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.349+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858100c80 con 0x7fb858100880 2024-09-17T01:45:55.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.349+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb848018020 con 0x7fb858100880 2024-09-17T01:45:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.350+0000 7fb855ffb640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 0x7fb84407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.350+0000 7fb84ffff640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 0x7fb84407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.350+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7fb84809da60 con 0x7fb858100880 2024-09-17T01:45:55.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.350+0000 7fb84ffff640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 0x7fb84407d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8400096c0 tx=0x7fb840000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.354+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb84801f020 con 0x7fb858100880 2024-09-17T01:45:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.567+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb858190550 con 0x7fb858100880 2024-09-17T01:45:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.567+0000 7fb855ffb640 1 -- 172.21.15.82:0/1098717343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7fb848069080 con 0x7fb858100880 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:45:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:45:55.567 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:45:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:45:55.569 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:55.570 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:55.570 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:55.570 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:45:55.570 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:55.570 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:45:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:45:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 msgr2=0x7fb84407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 0x7fb84407d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8400096c0 tx=0x7fb840000bc0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 msgr2=0x7fb85806afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b3d0 tx=0x7fb84800b890 comp rx=0 tx=0).stop 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 shutdown_connections 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb84407af30 0x7fb84407d3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb858101a80 0x7fb85819c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 --2- 172.21.15.82:0/1098717343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb858100880 0x7fb85806afb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 >> 172.21.15.82:0/1098717343 conn(0x7fb8580fc010 msgr2=0x7fb858104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 shutdown_connections 2024-09-17T01:45:55.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.570+0000 7fb85e314640 1 -- 172.21.15.82:0/1098717343 wait complete. 2024-09-17T01:45:55.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 -- 172.21.15.82:0/1699076432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50101960 msgr2=0x7fbc50101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 --2- 172.21.15.82:0/1699076432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50101960 0x7fbc50101d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009880 tx=0x7fbc4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 -- 172.21.15.82:0/1699076432 shutdown_connections 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 --2- 172.21.15.82:0/1699076432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50102b60 0x7fbc50102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 --2- 172.21.15.82:0/1699076432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50101960 0x7fbc50101d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 -- 172.21.15.82:0/1699076432 >> 172.21.15.82:0/1699076432 conn(0x7fbc500fd0f0 msgr2=0x7fbc500ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 -- 172.21.15.82:0/1699076432 shutdown_connections 2024-09-17T01:45:55.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.654+0000 7fbc57771640 1 -- 172.21.15.82:0/1699076432 wait complete. 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 Processor -- start 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 -- start start 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 0x7fbc50197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5010a780 con 0x7fbc50102b60 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc57771640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5010a600 con 0x7fbc50101960 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37612/0 (socket says 172.21.15.82:37612) 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 -- 172.21.15.82:0/3320246404 learned_addr learned my addr 172.21.15.82:0/3320246404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc5550d640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 0x7fbc50197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 -- 172.21.15.82:0/3320246404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 msgr2=0x7fbc50197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 0x7fbc50197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc54d0c640 1 -- 172.21.15.82:0/3320246404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50198050 con 0x7fbc50102b60 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.655+0000 7fbc5550d640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 0x7fbc50197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc54d0c640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000d8d0 tx=0x7fbc4000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc40017070 con 0x7fbc50102b60 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc40010460 con 0x7fbc50102b60 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5019ca90 con 0x7fbc50102b60 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc4000f5f0 con 0x7fbc50102b60 2024-09-17T01:45:55.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.656+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5019d020 con 0x7fbc50102b60 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.657+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc50101d60 con 0x7fbc50102b60 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.658+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbc40009a30 con 0x7fbc50102b60 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.658+0000 7fbc467fc640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 0x7fbc3c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.658+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7fbc4009de20 con 0x7fbc50102b60 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.658+0000 7fbc5550d640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 0x7fbc3c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.659+0000 7fbc5550d640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 0x7fbc3c07d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0096c0 tx=0x7fbc4c009650 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.663+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbc400694d0 con 0x7fbc50102b60 2024-09-17T01:45:55.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.854+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbc50062630 con 0x7fbc3c07af30 2024-09-17T01:45:55.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:55 smithi082 ceph-mon[92957]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:55.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:55 smithi082 ceph-mon[92957]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:55.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:55 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 22/312 objects degraded (7.051%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:55.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:55 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1055558120' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:55.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.856+0000 7fbc467fc640 1 -- 172.21.15.82:0/3320246404 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fbc50062630 con 0x7fbc3c07af30 2024-09-17T01:45:55.855 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:45:55.855 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:45:55.855 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:45:55.855 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:45:55.856 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:45:55.856 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:45:55.856 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:45:55.856 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:45:55.856 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:45:55.857 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "9/23 daemons upgraded", 2024-09-17T01:45:55.857 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:45:55.857 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:45:55.857 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:45:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 msgr2=0x7fbc3c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 0x7fbc3c07d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0096c0 tx=0x7fbc4c009650 comp rx=0 tx=0).stop 2024-09-17T01:45:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 msgr2=0x7fbc501979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000d8d0 tx=0x7fbc4000dd90 comp rx=0 tx=0).stop 2024-09-17T01:45:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 shutdown_connections 2024-09-17T01:45:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbc3c07af30 0x7fbc3c07d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc50102b60 0x7fbc501979d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 --2- 172.21.15.82:0/3320246404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc50101960 0x7fbc50197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 >> 172.21.15.82:0/3320246404 conn(0x7fbc500fd0f0 msgr2=0x7fbc50105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 shutdown_connections 2024-09-17T01:45:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.858+0000 7fbc57771640 1 -- 172.21.15.82:0/3320246404 wait complete. 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 -- 172.21.15.82:0/2291526098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 msgr2=0x7f5d40104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 --2- 172.21.15.82:0/2291526098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d40104fa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009880 tx=0x7f5d3002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 -- 172.21.15.82:0/2291526098 shutdown_connections 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 --2- 172.21.15.82:0/2291526098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d40104fa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 --2- 172.21.15.82:0/2291526098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d401025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 -- 172.21.15.82:0/2291526098 >> 172.21.15.82:0/2291526098 conn(0x7f5d400fc010 msgr2=0x7f5d400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 -- 172.21.15.82:0/2291526098 shutdown_connections 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.939+0000 7f5d4704e640 1 -- 172.21.15.82:0/2291526098 wait complete. 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 Processor -- start 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 -- start start 2024-09-17T01:45:55.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d4019dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40110d90 con 0x7f5d40102b30 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d4704e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40110c10 con 0x7f5d401001e0 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37636/0 (socket says 172.21.15.82:37636) 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.940+0000 7f5d37fff640 1 -- 172.21.15.82:0/185556856 learned_addr learned my addr 172.21.15.82:0/185556856 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d44dea640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d4019dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d37fff640 1 -- 172.21.15.82:0/185556856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 msgr2=0x7f5d4019dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d37fff640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d4019dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d37fff640 1 -- 172.21.15.82:0/185556856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4019e6a0 con 0x7f5d40102b30 2024-09-17T01:45:55.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d44dea640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d4019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d37fff640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006010 tx=0x7f5d300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d3003f070 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d401a3080 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d30004ac0 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.941+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d30035030 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.942+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401a3610 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.942+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d401005e0 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.943+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5d30042070 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.944+0000 7f5d35ffb640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 0x7f5d2807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.944+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5984+0+0 (secure 0 0 0) 0x7f5d300beb60 con 0x7f5d40102b30 2024-09-17T01:45:55.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.944+0000 7f5d44dea640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 0x7f5d2807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:45:55.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.944+0000 7f5d44dea640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 0x7f5d2807d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009b40 tx=0x7f5d3c005e50 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:45:55.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:55.948+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5d3008a250 con 0x7f5d40102b30 2024-09-17T01:45:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:55 smithi167 ceph-mon[76323]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:55 smithi167 ceph-mon[76323]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:55 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 22/312 objects degraded (7.051%), 7 pgs degraded (PG_DEGRADED) 2024-09-17T01:45:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:55 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1055558120' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:45:56.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.192+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5d401a3a20 con 0x7f5d40102b30 2024-09-17T01:45:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.193+0000 7f5d35ffb640 1 -- 172.21.15.82:0/185556856 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f5d3008f100 con 0x7f5d40102b30 2024-09-17T01:45:56.191 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:45:56.191 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:45:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 msgr2=0x7f5d2807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 0x7f5d2807d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009b40 tx=0x7f5d3c005e50 comp rx=0 tx=0).stop 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 msgr2=0x7f5d4019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006010 tx=0x7f5d300046c0 comp rx=0 tx=0).stop 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 shutdown_connections 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5d2807af80 0x7f5d2807d440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:56.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d40102b30 0x7f5d4019e020 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 --2- 172.21.15.82:0/185556856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d401001e0 0x7f5d4019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:45:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 >> 172.21.15.82:0/185556856 conn(0x7f5d400fc010 msgr2=0x7f5d400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:45:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 shutdown_connections 2024-09-17T01:45:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:45:56.195+0000 7f5d4704e640 1 -- 172.21.15.82:0/185556856 wait complete. 2024-09-17T01:45:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:56 smithi082 ceph-mon[92957]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:56 smithi082 ceph-mon[92957]: pgmap v113: 65 pgs: 3 peering, 62 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-17T01:45:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:56 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/312 objects degraded (7.051%), 7 pgs degraded) 2024-09-17T01:45:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:56 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1098717343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:45:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:56 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/185556856' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:45:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:56 smithi167 ceph-mon[76323]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:56 smithi167 ceph-mon[76323]: pgmap v113: 65 pgs: 3 peering, 62 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-17T01:45:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:56 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/312 objects degraded (7.051%), 7 pgs degraded) 2024-09-17T01:45:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:56 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1098717343' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:45:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:56 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/185556856' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:45:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:57 smithi082 ceph-mon[92957]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:57 smithi167 ceph-mon[76323]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:45:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:45:58 smithi082 ceph-mon[92957]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:45:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:45:58 smithi167 ceph-mon[76323]: pgmap v114: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:46:00.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:00 smithi082 ceph-mon[92957]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:46:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:00 smithi167 ceph-mon[76323]: pgmap v115: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:46:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:02 smithi082 ceph-mon[92957]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:46:02.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:02.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:02.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:02 smithi167 ceph-mon[76323]: pgmap v116: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-17T01:46:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:04 smithi082 ceph-mon[92957]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:46:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:04 smithi167 ceph-mon[76323]: pgmap v117: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:46:05.895 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:05 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T01:46:05.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:05 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-17T01:46:06.898 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:06 smithi167 ceph-mon[76323]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:46:06.898 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:06 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:46:06.898 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:06 smithi167 ceph-mon[76323]: Upgrade: osd.3 is safe to restart 2024-09-17T01:46:06.898 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:06 smithi082 ceph-mon[92957]: pgmap v118: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:46:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:06 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-17T01:46:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:06 smithi082 ceph-mon[92957]: Upgrade: osd.3 is safe to restart 2024-09-17T01:46:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: Upgrade: Updating osd.3 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: Deploying daemon osd.3 on smithi167 2024-09-17T01:46:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:08 smithi167 ceph-mon[76323]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: Upgrade: Updating osd.3 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: Deploying daemon osd.3 on smithi167 2024-09-17T01:46:08.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:08 smithi082 ceph-mon[92957]: pgmap v119: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:46:10.238 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:09 smithi167 systemd[1]: Stopping Ceph osd.3 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:46:10.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:10 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:46:10.256+0000 7f5d1cfee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:46:10.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:10 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:46:10.256+0000 7f5d1cfee640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-17T01:46:10.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:10 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[41570]: 2024-09-17T01:46:10.256+0000 7f5d1cfee640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:46:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:10 smithi082 ceph-mon[92957]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:46:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:10 smithi082 ceph-mon[92957]: osd.3 marked itself down and dead 2024-09-17T01:46:10.976 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:10 smithi167 ceph-mon[76323]: pgmap v120: 65 pgs: 65 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:46:10.976 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:10 smithi167 ceph-mon[76323]: osd.3 marked itself down and dead 2024-09-17T01:46:11.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:10 smithi167 podman[84095]: 2024-09-17 01:46:10.97900237 +0000 UTC m=+0.832451979 container died d02d904ea0f2e44f0e9d695e42bb725552cf53394e1ab623dd82067384107b9a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-c2ddf97, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:46:11.706 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:11 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:46:11.706 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:11 smithi167 ceph-mon[76323]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T01:46:11.706 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:11 smithi167 podman[84095]: 2024-09-17 01:46:11.473414214 +0000 UTC m=+1.326863808 container cleanup d02d904ea0f2e44f0e9d695e42bb725552cf53394e1ab623dd82067384107b9a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:46:11.706 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:11 smithi167 bash[84095]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:46:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:11 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:46:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:11 smithi082 ceph-mon[92957]: osdmap e63: 6 total, 5 up, 6 in 2024-09-17T01:46:12.004 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:11 smithi167 podman[84122]: 2024-09-17 01:46:11.708443353 +0000 UTC m=+0.731364362 container remove d02d904ea0f2e44f0e9d695e42bb725552cf53394e1ab623dd82067384107b9a (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-17T01:46:12.268 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:11.943162298 +0000 UTC m=+0.016219458 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:12.268 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:12.142777261 +0000 UTC m=+0.215834421 container create 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:46:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:12 smithi167 ceph-mon[76323]: pgmap v122: 65 pgs: 9 peering, 9 stale+active+clean, 47 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:46:12.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:12 smithi167 ceph-mon[76323]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-17T01:46:12.755 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:12 smithi167 ceph-mon[76323]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:46:12.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:12.378867288 +0000 UTC m=+0.451924456 container init 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:46:12.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:12.382141723 +0000 UTC m=+0.455198884 container start 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:46:12.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:12.453603539 +0000 UTC m=+0.526660708 container attach 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:46:12.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:12 smithi167 podman[84210]: 2024-09-17 01:46:12.582017022 +0000 UTC m=+0.655074185 container died 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:46:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:12 smithi082 ceph-mon[92957]: pgmap v122: 65 pgs: 9 peering, 9 stale+active+clean, 47 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:46:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:12 smithi082 ceph-mon[92957]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-17T01:46:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:12 smithi082 ceph-mon[92957]: osdmap e64: 6 total, 5 up, 6 in 2024-09-17T01:46:13.155 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84233]: 2024-09-17 01:46:13.140681622 +0000 UTC m=+0.546880827 container remove 5d2b29e7fd67d6652b275ddd5ea201dcc8787e2f259975037607e2639fa225d0 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:46:13.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-17T01:46:13.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 systemd[1]: Stopped Ceph osd.3 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:46:13.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 3.760s CPU time. 2024-09-17T01:46:13.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 systemd[1]: Starting Ceph osd.3 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:46:13.909 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84333]: 2024-09-17 01:46:13.491006299 +0000 UTC m=+0.016262833 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:13.909 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84333]: 2024-09-17 01:46:13.60007015 +0000 UTC m=+0.125326675 container create c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:46:13.909 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84333]: 2024-09-17 01:46:13.827580156 +0000 UTC m=+0.352836690 container init c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-17T01:46:13.909 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84333]: 2024-09-17 01:46:13.83097786 +0000 UTC m=+0.356234390 container start c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T01:46:13.909 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 podman[84333]: 2024-09-17 01:46:13.91087859 +0000 UTC m=+0.436135113 container attach c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-17T01:46:14.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:14.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 bash[84333]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:14.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:14.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:13 smithi167 bash[84333]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:14.913 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:14 smithi167 ceph-mon[76323]: pgmap v124: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:46:14.913 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:14 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:46:14.913 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:14 smithi167 bash[84333]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:46:14.913 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:14 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:46:14.914 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:14 smithi167 bash[84333]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-17T01:46:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:14 smithi082 ceph-mon[92957]: pgmap v124: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 bash[84333]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 bash[84333]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 bash[84333]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-17T01:46:15.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:46:15.255 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 bash[84333]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T01:46:15.255 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate[84348]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:46:15.255 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 bash[84333]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-17T01:46:15.255 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 podman[84333]: 2024-09-17 01:46:15.13436948 +0000 UTC m=+1.659626015 container died c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-17T01:46:15.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:15 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 14/312 objects degraded (4.487%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:15 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 14/312 objects degraded (4.487%), 5 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:16.202 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:15 smithi167 podman[84494]: 2024-09-17 01:46:15.809066699 +0000 UTC m=+0.664251487 container remove c808299270b246d9baf3909492fb44de483d77042b5c034c18712e26543d0930 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:46:16.202 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 podman[84552]: 2024-09-17 01:46:15.916113102 +0000 UTC m=+0.015567532 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:16.202 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 podman[84552]: 2024-09-17 01:46:16.026517218 +0000 UTC m=+0.125971642 container create 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: pgmap v125: 65 pgs: 6 active+undersized, 18 peering, 2 stale+active+clean, 5 active+undersized+degraded, 34 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 14/312 objects degraded (4.487%) 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:16.754 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 podman[84552]: 2024-09-17 01:46:16.404417142 +0000 UTC m=+0.503871567 container init 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:46:16.754 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 podman[84552]: 2024-09-17 01:46:16.407663285 +0000 UTC m=+0.507117699 container start 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T01:46:16.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 ceph-osd[84572]: -- 172.21.15.167:0/2136145443 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558be569a1e0 con 0x558be4921180 2024-09-17T01:46:16.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 bash[84552]: 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb 2024-09-17T01:46:16.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:16 smithi167 systemd[1]: Started Ceph osd.3 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: pgmap v125: 65 pgs: 6 active+undersized, 18 peering, 2 stale+active+clean, 5 active+undersized+degraded, 34 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 14/312 objects degraded (4.487%) 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:17.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:17 smithi082 ceph-mon[92957]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-17T01:46:17.989 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:17 smithi167 ceph-mon[76323]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-17T01:46:18.659 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:18 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:46:18.297+0000 7f83002cb640 -1 Falling back to public interface 2024-09-17T01:46:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:18 smithi082 ceph-mon[92957]: pgmap v126: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-17T01:46:19.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:18 smithi167 ceph-mon[76323]: pgmap v126: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-17T01:46:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:20 smithi167 ceph-mon[76323]: pgmap v127: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-17T01:46:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:20 smithi082 ceph-mon[92957]: pgmap v127: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 66/312 objects degraded (21.154%) 2024-09-17T01:46:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:20.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:22.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:22 smithi082 ceph-mon[92957]: pgmap v128: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:22 smithi167 ceph-mon[76323]: pgmap v128: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:24.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:46:24.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T01:46:24.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:24 smithi082 ceph-mon[92957]: pgmap v129: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 686 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-17T01:46:24.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:24 smithi167 ceph-mon[76323]: pgmap v129: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 686 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:25.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:25 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:25.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:25 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:25.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:25 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:46:25.100+0000 7f83002cb640 -1 osd.3 62 log_to_monitors true 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- 172.21.15.82:0/2731850951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c074bf0 msgr2=0x7feb6c075050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 --2- 172.21.15.82:0/2731850951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c074bf0 0x7feb6c075050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb54009880 tx=0x7feb5402a530 comp rx=0 tx=0).stop 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- 172.21.15.82:0/2731850951 shutdown_connections 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 --2- 172.21.15.82:0/2731850951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c074bf0 0x7feb6c075050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 --2- 172.21.15.82:0/2731850951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c0761c0 0x7feb6c074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- 172.21.15.82:0/2731850951 >> 172.21.15.82:0/2731850951 conn(0x7feb6c0fd0f0 msgr2=0x7feb6c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- 172.21.15.82:0/2731850951 shutdown_connections 2024-09-17T01:46:26.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- 172.21.15.82:0/2731850951 wait complete. 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 Processor -- start 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- start start 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 0x7feb6c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c10c980 con 0x7feb6c0761c0 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb71e10640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c10c800 con 0x7feb6c074bf0 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb63fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb63fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55540/0 (socket says 172.21.15.82:55540) 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.288+0000 7feb63fff640 1 -- 172.21.15.82:0/1042669877 learned_addr learned my addr 172.21.15.82:0/1042669877 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb6b7fe640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 0x7feb6c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb63fff640 1 -- 172.21.15.82:0/1042669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 msgr2=0x7feb6c1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb63fff640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 0x7feb6c1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb63fff640 1 -- 172.21.15.82:0/1042669877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c19a2a0 con 0x7feb6c0761c0 2024-09-17T01:46:26.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb6b7fe640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 0x7feb6c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:26.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb63fff640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb54006010 tx=0x7feb540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb5403f070 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb540044d0 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb54035030 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c19ec80 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.289+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c19f1c0 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.291+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c075050 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.291+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7feb54042070 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.292+0000 7feb697fa640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 0x7feb5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.292+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5984+0+0 (secure 0 0 0) 0x7feb540becc0 con 0x7feb6c0761c0 2024-09-17T01:46:26.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.292+0000 7feb6b7fe640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 0x7feb5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.292+0000 7feb6b7fe640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 0x7feb5807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0058c0 tx=0x7feb5c005ec0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.297+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7feb5408a370 con 0x7feb6c0761c0 2024-09-17T01:46:26.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:26 smithi082 ceph-mon[92957]: from='osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T01:46:26.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:26 smithi082 ceph-mon[92957]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T01:46:26.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:26 smithi082 ceph-mon[92957]: pgmap v130: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.493+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feb6c062630 con 0x7feb5807af30 2024-09-17T01:46:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.495+0000 7feb697fa640 1 -- 172.21.15.82:0/1042669877 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7feb6c062630 con 0x7feb5807af30 2024-09-17T01:46:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 msgr2=0x7feb5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 0x7feb5807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0058c0 tx=0x7feb5c005ec0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 msgr2=0x7feb6c199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb54006010 tx=0x7feb540048f0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 shutdown_connections 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7feb5807af30 0x7feb5807d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb6c0761c0 0x7feb6c199c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 --2- 172.21.15.82:0/1042669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb6c074bf0 0x7feb6c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 >> 172.21.15.82:0/1042669877 conn(0x7feb6c0fd0f0 msgr2=0x7feb6c107a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 shutdown_connections 2024-09-17T01:46:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.497+0000 7feb71e10640 1 -- 172.21.15.82:0/1042669877 wait complete. 2024-09-17T01:46:26.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:46:26 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:46:26.111+0000 7f82f804b640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:46:26.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:26 smithi167 ceph-mon[76323]: from='osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T01:46:26.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:26 smithi167 ceph-mon[76323]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-17T01:46:26.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:26 smithi167 ceph-mon[76323]: pgmap v130: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:26.504 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:46:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.579+0000 7fd7d8273640 1 -- 172.21.15.82:0/3840428152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d01023f0 msgr2=0x7fd7d01047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.579+0000 7fd7d8273640 1 --2- 172.21.15.82:0/3840428152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d01023f0 0x7fd7d01047e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009c50 tx=0x7fd7c002a9a0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- 172.21.15.82:0/3840428152 shutdown_connections 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 --2- 172.21.15.82:0/3840428152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d0104d20 0x7fd7d0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 --2- 172.21.15.82:0/3840428152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d01023f0 0x7fd7d01047e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- 172.21.15.82:0/3840428152 >> 172.21.15.82:0/3840428152 conn(0x7fd7d00fc010 msgr2=0x7fd7d00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- 172.21.15.82:0/3840428152 shutdown_connections 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- 172.21.15.82:0/3840428152 wait complete. 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 Processor -- start 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- start start 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d01023f0 0x7fd7d0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010a7e0 con 0x7fd7d0104d20 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d8273640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010a660 con 0x7fd7d01023f0 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.580+0000 7fd7d580e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55560/0 (socket says 172.21.15.82:55560) 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 -- 172.21.15.82:0/1915598535 learned_addr learned my addr 172.21.15.82:0/1915598535 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d600f640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d01023f0 0x7fd7d0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 -- 172.21.15.82:0/1915598535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d01023f0 msgr2=0x7fd7d0197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d01023f0 0x7fd7d0197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 -- 172.21.15.82:0/1915598535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d01980c0 con 0x7fd7d0104d20 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d580e640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400d6c0 tx=0x7fd7c400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c4017070 con 0x7fd7d0104d20 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7c40054e0 con 0x7fd7d0104d20 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d019cb00 con 0x7fd7d0104d20 2024-09-17T01:46:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c4004b70 con 0x7fd7d0104d20 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.581+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d019d110 con 0x7fd7d0104d20 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.582+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d01027d0 con 0x7fd7d0104d20 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.583+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd7c4009820 con 0x7fd7d0104d20 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.583+0000 7fd7cf7fe640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 0x7fd7b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.583+0000 7fd7d600f640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 0x7fd7b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.583+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5984+0+0 (secure 0 0 0) 0x7fd7c409db90 con 0x7fd7d0104d20 2024-09-17T01:46:26.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.584+0000 7fd7d600f640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 0x7fd7b807d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002f860 tx=0x7fd7c0005ef0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.588+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd7c4069240 con 0x7fd7d0104d20 2024-09-17T01:46:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.782+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd7d0105680 con 0x7fd7b807af30 2024-09-17T01:46:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.783+0000 7fd7cf7fe640 1 -- 172.21.15.82:0/1915598535 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fd7d0105680 con 0x7fd7b807af30 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 msgr2=0x7fd7b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 0x7fd7b807d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002f860 tx=0x7fd7c0005ef0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 msgr2=0x7fd7d0197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400d6c0 tx=0x7fd7c400db80 comp rx=0 tx=0).stop 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 shutdown_connections 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd7b807af30 0x7fd7b807d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7d0104d20 0x7fd7d0197a40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 --2- 172.21.15.82:0/1915598535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd7d01023f0 0x7fd7d0197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 >> 172.21.15.82:0/1915598535 conn(0x7fd7d00fc010 msgr2=0x7fd7d00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 shutdown_connections 2024-09-17T01:46:26.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.790+0000 7fd7d8273640 1 -- 172.21.15.82:0/1915598535 wait complete. 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.871+0000 7f0a0eade640 1 -- 172.21.15.82:0/926518056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 msgr2=0x7f0a08107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.871+0000 7f0a0eade640 1 --2- 172.21.15.82:0/926518056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a08107170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009c20 tx=0x7f09f802a970 comp rx=0 tx=0).stop 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- 172.21.15.82:0/926518056 shutdown_connections 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 --2- 172.21.15.82:0/926518056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a08107170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 --2- 172.21.15.82:0/926518056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- 172.21.15.82:0/926518056 >> 172.21.15.82:0/926518056 conn(0x7f0a080fc010 msgr2=0x7f0a080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- 172.21.15.82:0/926518056 shutdown_connections 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- 172.21.15.82:0/926518056 wait complete. 2024-09-17T01:46:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 Processor -- start 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- start start 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0810a720 con 0x7f0a08104d80 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a0eade640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0810a5a0 con 0x7f0a08102450 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a07fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.872+0000 7f0a07fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55582/0 (socket says 172.21.15.82:55582) 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a07fff640 1 -- 172.21.15.82:0/3152056142 learned_addr learned my addr 172.21.15.82:0/3152056142 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a0c87a640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a07fff640 1 -- 172.21.15.82:0/3152056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 msgr2=0x7f0a08197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a07fff640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a07fff640 1 -- 172.21.15.82:0/3152056142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08198040 con 0x7f0a08104d80 2024-09-17T01:46:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a0c87a640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a07fff640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006010 tx=0x7f09f802f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09f8047070 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09f8003e30 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0819ca80 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09f8034070 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.873+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0819d090 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.874+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a08102830 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.875+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f09f804a070 con 0x7f0a08104d80 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.876+0000 7f0a05ffb640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 0x7f09f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.876+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5984+0+0 (secure 0 0 0) 0x7f09f80bee10 con 0x7f0a08104d80 2024-09-17T01:46:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.876+0000 7f0a0c87a640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 0x7f09f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.876+0000 7f0a0c87a640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 0x7f09f407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a000058c0 tx=0x7f0a00005ec0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:26.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:26.880+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f09f803f070 con 0x7f0a08104d80 2024-09-17T01:46:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.064+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0a08105760 con 0x7f09f407af30 2024-09-17T01:46:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.075+0000 7f0a05ffb640 1 -- 172.21.15.82:0/3152056142 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0a08105760 con 0x7f09f407af30 2024-09-17T01:46:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:46:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (11m) 40s ago 12m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:46:27.073 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (4m) 40s ago 13m 8762k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (4m) 7s ago 12m 8665k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (2m) 40s ago 13m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (2m) 7s ago 12m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (11m) 40s ago 12m 81.1M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (7m) 40s ago 7m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (7m) 40s ago 7m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (7m) 7s ago 7m 29.7M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (7m) 7s ago 7m 26.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (4m) 40s ago 14m 586M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (3m) 7s ago 12m 522M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (2m) 40s ago 14m 113M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (2m) 7s ago 12m 103M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (13m) 40s ago 13m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:46:27.074 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (12m) 7s ago 12m 16.2M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (115s) 40s ago 10m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (81s) 40s ago 10m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (45s) 40s ago 9m 80.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (11s) 7s ago 9m 79.5M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (9m) 7s ago 9m 218M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 42ed89cf83c0 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (8m) 7s ago 8m 192M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:46:27.075 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 40s ago 12m 69.2M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 msgr2=0x7f09f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 0x7f09f407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0a000058c0 tx=0x7f0a00005ec0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 msgr2=0x7f0a081979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09f8006010 tx=0x7f09f802f730 comp rx=0 tx=0).stop 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 shutdown_connections 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f09f407af30 0x7f09f407d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a08104d80 0x7f0a081979c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 --2- 172.21.15.82:0/3152056142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a08102450 0x7f0a08197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 >> 172.21.15.82:0/3152056142 conn(0x7f0a080fc010 msgr2=0x7f0a080fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 shutdown_connections 2024-09-17T01:46:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.077+0000 7f0a0eade640 1 -- 172.21.15.82:0/3152056142 wait complete. 2024-09-17T01:46:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.169+0000 7f2384763640 1 -- 172.21.15.82:0/2186111488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 msgr2=0x7f237c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.169+0000 7f2384763640 1 --2- 172.21.15.82:0/2186111488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c101ee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2370009880 tx=0x7f237002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- 172.21.15.82:0/2186111488 shutdown_connections 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 --2- 172.21.15.82:0/2186111488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c101ee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 --2- 172.21.15.82:0/2186111488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 0x7f237c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- 172.21.15.82:0/2186111488 >> 172.21.15.82:0/2186111488 conn(0x7f237c0fc010 msgr2=0x7f237c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- 172.21.15.82:0/2186111488 shutdown_connections 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- 172.21.15.82:0/2186111488 wait complete. 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 Processor -- start 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- start start 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 0x7f237c06ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f237c109720 con 0x7f237c101a60 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2384763640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1095a0 con 0x7f237c100860 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.170+0000 7f2381cfe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55596/0 (socket says 172.21.15.82:55596) 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 -- 172.21.15.82:0/2003269326 learned_addr learned my addr 172.21.15.82:0/2003269326 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f23824ff640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 0x7f237c06ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 -- 172.21.15.82:0/2003269326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 msgr2=0x7f237c06ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 0x7f237c06ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 -- 172.21.15.82:0/2003269326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c19c820 con 0x7f237c101a60 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2381cfe640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2370006010 tx=0x7f23700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f237003f070 con 0x7f237c101a60 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c19cab0 con 0x7f237c101a60 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23700044d0 con 0x7f237c101a60 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2370035030 con 0x7f237c101a60 2024-09-17T01:46:27.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.171+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c19d060 con 0x7f237c101a60 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.172+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c100c40 con 0x7f237c101a60 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.173+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2370042070 con 0x7f237c101a60 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.173+0000 7f237b7fe640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 0x7f236407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.174+0000 7f23824ff640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 0x7f236407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.174+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f23700bec90 con 0x7f237c101a60 2024-09-17T01:46:27.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.174+0000 7f23824ff640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 0x7f236407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f237c1018c0 tx=0x7f2374009110 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.178+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f237008a2b0 con 0x7f237c101a60 2024-09-17T01:46:27.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:27 smithi082 ceph-mon[92957]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:46:27.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:27 smithi082 ceph-mon[92957]: from='osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:27.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:27 smithi082 ceph-mon[92957]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:46:27.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:27 smithi082 ceph-mon[92957]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:27.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:27 smithi082 ceph-mon[92957]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.433+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f237c190530 con 0x7f237c101a60 2024-09-17T01:46:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.433+0000 7f237b7fe640 1 -- 172.21.15.82:0/2003269326 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f237008f160 con 0x7f237c101a60 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:46:27.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 6, 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 8 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:46:27.433 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 msgr2=0x7f236407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 0x7f236407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f237c1018c0 tx=0x7f2374009110 comp rx=0 tx=0).stop 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 msgr2=0x7f237c19c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2370006010 tx=0x7f23700048f0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 shutdown_connections 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f236407af30 0x7f236407d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c101a60 0x7f237c19c230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 --2- 172.21.15.82:0/2003269326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f237c100860 0x7f237c06ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 >> 172.21.15.82:0/2003269326 conn(0x7f237c0fc010 msgr2=0x7f237c104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 shutdown_connections 2024-09-17T01:46:27.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.436+0000 7f2384763640 1 -- 172.21.15.82:0/2003269326 wait complete. 2024-09-17T01:46:27.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:27 smithi167 ceph-mon[76323]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-17T01:46:27.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:27 smithi167 ceph-mon[76323]: from='osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:27.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:27 smithi167 ceph-mon[76323]: osdmap e65: 6 total, 5 up, 6 in 2024-09-17T01:46:27.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:27 smithi167 ceph-mon[76323]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:27.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:27 smithi167 ceph-mon[76323]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 -- 172.21.15.82:0/3389575134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4102b60 msgr2=0x7f4bd4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 --2- 172.21.15.82:0/3389575134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4102b60 0x7f4bd4102fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009880 tx=0x7f4bc002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 -- 172.21.15.82:0/3389575134 shutdown_connections 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 --2- 172.21.15.82:0/3389575134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4102b60 0x7f4bd4102fe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 --2- 172.21.15.82:0/3389575134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4101960 0x7f4bd4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 -- 172.21.15.82:0/3389575134 >> 172.21.15.82:0/3389575134 conn(0x7f4bd40fd0f0 msgr2=0x7f4bd40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 -- 172.21.15.82:0/3389575134 shutdown_connections 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.518+0000 7f4bdac83640 1 -- 172.21.15.82:0/3389575134 wait complete. 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 Processor -- start 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 -- start start 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 0x7f4bd41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd410a7a0 con 0x7f4bd4101960 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bdac83640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd410a620 con 0x7f4bd4102b60 2024-09-17T01:46:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bd8a1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bd8a1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49738/0 (socket says 172.21.15.82:49738) 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bd8a1f640 1 -- 172.21.15.82:0/2021009042 learned_addr learned my addr 172.21.15.82:0/2021009042 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.519+0000 7f4bd3fff640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 0x7f4bd41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd8a1f640 1 -- 172.21.15.82:0/2021009042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 msgr2=0x7f4bd41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd8a1f640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 0x7f4bd41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd8a1f640 1 -- 172.21.15.82:0/2021009042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4198050 con 0x7f4bd4101960 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd3fff640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 0x7f4bd41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd8a1f640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800d8d0 tx=0x7f4bc800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bc8017070 con 0x7f4bd4101960 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bc800be10 con 0x7f4bd4101960 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd419ca90 con 0x7f4bd4101960 2024-09-17T01:46:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bc800f3c0 con 0x7f4bd4101960 2024-09-17T01:46:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.520+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd419d020 con 0x7f4bd4101960 2024-09-17T01:46:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.521+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd4101d60 con 0x7f4bd4101960 2024-09-17T01:46:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.522+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4bc801a070 con 0x7f4bd4101960 2024-09-17T01:46:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.522+0000 7f4bd1ffb640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 0x7f4bc407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.523+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f4bc809daa0 con 0x7f4bd4101960 2024-09-17T01:46:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.523+0000 7f4bd3fff640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 0x7f4bc407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.523+0000 7f4bd3fff640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 0x7f4bc407d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4198940 tx=0x7f4bc0005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.527+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4bc80691d0 con 0x7f4bd4101960 2024-09-17T01:46:27.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.739+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4bd402d7c0 con 0x7f4bd4101960 2024-09-17T01:46:27.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.739+0000 7f4bd1ffb640 1 -- 172.21.15.82:0/2021009042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f4bc806e080 con 0x7f4bd4101960 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:46:27.738 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:46:27.739 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:46:27.740 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:27.741 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 msgr2=0x7f4bc407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 0x7f4bc407d440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4198940 tx=0x7f4bc0005a20 comp rx=0 tx=0).stop 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 msgr2=0x7f4bd4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800d8d0 tx=0x7f4bc800dd90 comp rx=0 tx=0).stop 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 shutdown_connections 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4bc407af80 0x7f4bc407d440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4bd4102b60 0x7f4bd41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 --2- 172.21.15.82:0/2021009042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd4101960 0x7f4bd4197490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 >> 172.21.15.82:0/2021009042 conn(0x7f4bd40fd0f0 msgr2=0x7f4bd4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.742+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 shutdown_connections 2024-09-17T01:46:27.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.743+0000 7f4bdac83640 1 -- 172.21.15.82:0/2021009042 wait complete. 2024-09-17T01:46:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- 172.21.15.82:0/1168856382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 msgr2=0x7f2368101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 --2- 172.21.15.82:0/1168856382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368101ee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f235c009880 tx=0x7f235c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- 172.21.15.82:0/1168856382 shutdown_connections 2024-09-17T01:46:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 --2- 172.21.15.82:0/1168856382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368101ee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 --2- 172.21.15.82:0/1168856382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 0x7f2368100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- 172.21.15.82:0/1168856382 >> 172.21.15.82:0/1168856382 conn(0x7f23680fc010 msgr2=0x7f23680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- 172.21.15.82:0/1168856382 shutdown_connections 2024-09-17T01:46:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- 172.21.15.82:0/1168856382 wait complete. 2024-09-17T01:46:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 Processor -- start 2024-09-17T01:46:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.824+0000 7f236e552640 1 -- start start 2024-09-17T01:46:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f236e552640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 0x7f23681975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f236e552640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f236e552640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2368109720 con 0x7f2368101a60 2024-09-17T01:46:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f236e552640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23681095a0 con 0x7f2368100860 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49758/0 (socket says 172.21.15.82:49758) 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 -- 172.21.15.82:0/801268540 learned_addr learned my addr 172.21.15.82:0/801268540 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f2367fff640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 0x7f23681975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 -- 172.21.15.82:0/801268540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 msgr2=0x7f23681975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 0x7f23681975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 -- 172.21.15.82:0/801268540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368198160 con 0x7f2368101a60 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.825+0000 7f23677fe640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f235c006010 tx=0x7f235c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.826+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f235c03f070 con 0x7f2368101a60 2024-09-17T01:46:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.826+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236819cb40 con 0x7f2368101a60 2024-09-17T01:46:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.826+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f235c0044d0 con 0x7f2368101a60 2024-09-17T01:46:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.826+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f235c035030 con 0x7f2368101a60 2024-09-17T01:46:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.826+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236819d150 con 0x7f2368101a60 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.827+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2368100c40 con 0x7f2368101a60 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.827+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f235c042070 con 0x7f2368101a60 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.828+0000 7f23657fa640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 0x7f235007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.828+0000 7f2367fff640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 0x7f235007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.828+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5984+0+0 (secure 0 0 0) 0x7f235c0beb60 con 0x7f2368101a60 2024-09-17T01:46:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.828+0000 7f2367fff640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 0x7f235007d440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23681018c0 tx=0x7f2358009110 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:27.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:27.833+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f235c08a290 con 0x7f2368101a60 2024-09-17T01:46:28.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.024+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f236806a970 con 0x7f235007af80 2024-09-17T01:46:28.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.025+0000 7f23657fa640 1 -- 172.21.15.82:0/801268540 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f236806a970 con 0x7f235007af80 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "10/23 daemons upgraded", 2024-09-17T01:46:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:46:28.025 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:46:28.025 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.027+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 msgr2=0x7f235007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.027+0000 7f236e552640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 0x7f235007d440 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23681018c0 tx=0x7f2358009110 comp rx=0 tx=0).stop 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.027+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 msgr2=0x7f2368197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.027+0000 7f236e552640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f235c006010 tx=0x7f235c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 shutdown_connections 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f235007af80 0x7f235007d440 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2368101a60 0x7f2368197ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 --2- 172.21.15.82:0/801268540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2368100860 0x7f23681975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 >> 172.21.15.82:0/801268540 conn(0x7f23680fc010 msgr2=0x7f236806a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 shutdown_connections 2024-09-17T01:46:28.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.028+0000 7f236e552640 1 -- 172.21.15.82:0/801268540 wait complete. 2024-09-17T01:46:28.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 -- 172.21.15.82:0/1829832592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580733f0 msgr2=0x7fd458073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1829832592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580733f0 0x7fd458073870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009880 tx=0x7fd44c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 -- 172.21.15.82:0/1829832592 shutdown_connections 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1829832592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4580733f0 0x7fd458073870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1829832592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4581094e0 0x7fd4581098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 -- 172.21.15.82:0/1829832592 >> 172.21.15.82:0/1829832592 conn(0x7fd45806ed60 msgr2=0x7fd4580711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.119+0000 7fd45cfea640 1 -- 172.21.15.82:0/1829832592 shutdown_connections 2024-09-17T01:46:28.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.120+0000 7fd45cfea640 1 -- 172.21.15.82:0/1829832592 wait complete. 2024-09-17T01:46:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 Processor -- start 2024-09-17T01:46:28.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 -- start start 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581094e0 0x7fd45810a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd458113020 con 0x7fd4581094e0 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.121+0000 7fd45cfea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd458112ea0 con 0x7fd4580733f0 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.82:55696/0 (socket says 172.21.15.82:55696) 2024-09-17T01:46:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 -- 172.21.15.82:0/1471197149 learned_addr learned my addr 172.21.15.82:0/1471197149 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd455d9b640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581094e0 0x7fd45810a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 -- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581094e0 msgr2=0x7fd45810a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581094e0 0x7fd45810a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.122+0000 7fd45659c640 1 -- 172.21.15.82:0/1471197149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45810aa00 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd45659c640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd44800d8d0 tx=0x7fd44800dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd448017020 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45810acf0 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45810b250 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd448010460 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.123+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd448005020 con 0x7fd4580733f0 2024-09-17T01:46:28.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.124+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4380052c0 con 0x7fd4580733f0 2024-09-17T01:46:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.126+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd44801a020 con 0x7fd4580733f0 2024-09-17T01:46:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.126+0000 7fd4477fe640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 0x7fd44007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.126+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5984+0+0 (secure 0 0 0) 0x7fd44809d970 con 0x7fd4580733f0 2024-09-17T01:46:28.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.126+0000 7fd455d9b640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 0x7fd44007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:28.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.127+0000 7fd455d9b640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 0x7fd44007d450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006010 tx=0x7fd44c02a9a0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.134+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd448021030 con 0x7fd4580733f0 2024-09-17T01:46:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.379+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd438005880 con 0x7fd4580733f0 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498] boot 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-17T01:46:28.378 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2003269326' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:28.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: pgmap v133: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:28.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2021009042' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:46:28.379 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:28 smithi082 ceph-mon[92957]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.380+0000 7fd4477fe640 1 -- 172.21.15.82:0/1471197149 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1428 (secure 0 0 0) 0x7fd448069160 con 0x7fd4580733f0 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 66/312 objects degraded (21.154%), 19 pgs degraded 2024-09-17T01:46:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-17T01:46:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-17T01:46:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.382+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 msgr2=0x7fd44007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.382+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 0x7fd44007d450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006010 tx=0x7fd44c02a9a0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 msgr2=0x7fd45810be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd44800d8d0 tx=0x7fd44800dd90 comp rx=0 tx=0).stop 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 shutdown_connections 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd44007af90 0x7fd44007d450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581094e0 0x7fd45810a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 --2- 172.21.15.82:0/1471197149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4580733f0 0x7fd45810be00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 >> 172.21.15.82:0/1471197149 conn(0x7fd45806ed60 msgr2=0x7fd45810ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 shutdown_connections 2024-09-17T01:46:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:28.383+0000 7fd45cfea640 1 -- 172.21.15.82:0/1471197149 wait complete. 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: osd.3 [v2:172.21.15.167:6800/338043498,v1:172.21.15.167:6801/338043498] boot 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: osdmap e66: 6 total, 6 up, 6 in 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-17T01:46:28.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2003269326' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:28.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: pgmap v133: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 66/312 objects degraded (21.154%) 2024-09-17T01:46:28.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2021009042' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:46:28.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:28 smithi167 ceph-mon[76323]: osdmap e67: 6 total, 6 up, 6 in 2024-09-17T01:46:29.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:29 smithi082 ceph-mon[92957]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:29.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:29 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1471197149' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:46:29.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:29 smithi167 ceph-mon[76323]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:29.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:29 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1471197149' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:46:30.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:30 smithi082 ceph-mon[92957]: pgmap v135: 65 pgs: 18 active+undersized, 17 active+undersized+degraded, 30 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 62/312 objects degraded (19.872%) 2024-09-17T01:46:30.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:30 smithi167 ceph-mon[76323]: pgmap v135: 65 pgs: 18 active+undersized, 17 active+undersized+degraded, 30 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 62/312 objects degraded (19.872%) 2024-09-17T01:46:31.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:31 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 62/312 objects degraded (19.872%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:31.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:31 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 62/312 objects degraded (19.872%), 17 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:32 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:32.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:32 smithi082 ceph-mon[92957]: pgmap v136: 65 pgs: 4 active+undersized, 2 active+undersized+degraded, 59 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 5 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:46:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:32 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:32.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:32 smithi167 ceph-mon[76323]: pgmap v136: 65 pgs: 4 active+undersized, 2 active+undersized+degraded, 59 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 5 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:46:33.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:33 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/312 objects degraded (2.885%), 2 pgs degraded) 2024-09-17T01:46:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:33 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/312 objects degraded (2.885%), 2 pgs degraded) 2024-09-17T01:46:34.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:34 smithi082 ceph-mon[92957]: pgmap v137: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:46:35.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:34 smithi167 ceph-mon[76323]: pgmap v137: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:46:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:36 smithi082 ceph-mon[92957]: pgmap v138: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 971 B/s rd, 1 op/s 2024-09-17T01:46:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:36 smithi167 ceph-mon[76323]: pgmap v138: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 971 B/s rd, 1 op/s 2024-09-17T01:46:38.798 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:38 smithi167 ceph-mon[76323]: pgmap v139: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:46:38.798 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:38 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T01:46:38.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:38 smithi082 ceph-mon[92957]: pgmap v139: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-17T01:46:38.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:38 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-17T01:46:39.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:39 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:46:39.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:39 smithi167 ceph-mon[76323]: Upgrade: osd.4 is safe to restart 2024-09-17T01:46:39.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:39.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-17T01:46:39.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:39.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:39 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-17T01:46:39.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:39 smithi082 ceph-mon[92957]: Upgrade: osd.4 is safe to restart 2024-09-17T01:46:39.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:39.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-17T01:46:39.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:40 smithi082 ceph-mon[92957]: Upgrade: Updating osd.4 2024-09-17T01:46:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:40 smithi082 ceph-mon[92957]: Deploying daemon osd.4 on smithi167 2024-09-17T01:46:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:40 smithi082 ceph-mon[92957]: pgmap v140: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:46:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:40 smithi167 ceph-mon[76323]: Upgrade: Updating osd.4 2024-09-17T01:46:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:40 smithi167 ceph-mon[76323]: Deploying daemon osd.4 on smithi167 2024-09-17T01:46:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:40 smithi167 ceph-mon[76323]: pgmap v140: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:46:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:42 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:42.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:42 smithi167 ceph-mon[76323]: pgmap v141: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-17T01:46:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:42 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:42 smithi082 ceph-mon[92957]: pgmap v141: 65 pgs: 65 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-17T01:46:42.556 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:42 smithi167 systemd[1]: Stopping Ceph osd.4 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:46:43.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:42 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:46:42.561+0000 7f4764966640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:46:43.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:42 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:46:42.562+0000 7f4764966640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-17T01:46:43.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:42 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[48003]: 2024-09-17T01:46:42.562+0000 7f4764966640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:46:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:43 smithi082 ceph-mon[92957]: osd.4 marked itself down and dead 2024-09-17T01:46:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:43 smithi167 ceph-mon[76323]: osd.4 marked itself down and dead 2024-09-17T01:46:43.826 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:43 smithi167 podman[88744]: 2024-09-17 01:46:43.553254149 +0000 UTC m=+1.096341820 container died 42ed89cf83c0cece3581580c43902bfa0072fd61c8de671f76c5bf43edbd4cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:46:44.180 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:43 smithi167 podman[88744]: 2024-09-17 01:46:43.928473169 +0000 UTC m=+1.471560829 container cleanup 42ed89cf83c0cece3581580c43902bfa0072fd61c8de671f76c5bf43edbd4cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-c2ddf97, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T01:46:44.180 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:43 smithi167 bash[88744]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:46:44.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:44 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:46:44.494 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:44 smithi082 ceph-mon[92957]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:46:44.495 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:44 smithi082 ceph-mon[92957]: pgmap v143: 65 pgs: 6 stale+active+clean, 59 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:46:44.504 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88772]: 2024-09-17 01:46:44.207154795 +0000 UTC m=+0.653565609 container remove 42ed89cf83c0cece3581580c43902bfa0072fd61c8de671f76c5bf43edbd4cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:46:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:44 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:46:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:44 smithi167 ceph-mon[76323]: osdmap e68: 6 total, 5 up, 6 in 2024-09-17T01:46:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:44 smithi167 ceph-mon[76323]: pgmap v143: 65 pgs: 6 stale+active+clean, 59 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:46:44.850 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.443534325 +0000 UTC m=+0.015779990 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:44.850 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.541609529 +0000 UTC m=+0.113855201 container create aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-17T01:46:44.850 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.752674546 +0000 UTC m=+0.324920221 container init aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-17T01:46:44.850 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.755932203 +0000 UTC m=+0.328177873 container start aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:46:44.850 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.852535935 +0000 UTC m=+0.424781615 container attach aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:46:45.190 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:44 smithi167 podman[88858]: 2024-09-17 01:46:44.94463054 +0000 UTC m=+0.516876208 container died aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:46:45.450 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:45 smithi167 ceph-mon[76323]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:46:45.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:45 smithi082 ceph-mon[92957]: osdmap e69: 6 total, 5 up, 6 in 2024-09-17T01:46:45.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 podman[88880]: 2024-09-17 01:46:45.456483398 +0000 UTC m=+0.505614240 container remove aa0a6ec3df55338f9d1e3ddb949d60810a426c4af13a125cba8852d47598096d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-17T01:46:45.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-17T01:46:45.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 systemd[1]: Stopped Ceph osd.4 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:46:45.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.4.service: Consumed 51.993s CPU time. 2024-09-17T01:46:45.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 systemd[1]: Starting Ceph osd.4 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:46:46.191 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 podman[88981]: 2024-09-17 01:46:45.787759047 +0000 UTC m=+0.015828752 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:46.191 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:45 smithi167 podman[88981]: 2024-09-17 01:46:45.890921327 +0000 UTC m=+0.118991065 container create 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T01:46:46.192 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 podman[88981]: 2024-09-17 01:46:46.093528387 +0000 UTC m=+0.321598083 container init 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T01:46:46.192 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 podman[88981]: 2024-09-17 01:46:46.096755729 +0000 UTC m=+0.324825430 container start 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-17T01:46:46.192 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 podman[88981]: 2024-09-17 01:46:46.19401274 +0000 UTC m=+0.422082447 container attach 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:46:46.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:46 smithi082 ceph-mon[92957]: pgmap v145: 65 pgs: 6 active+undersized, 3 stale+active+clean, 4 active+undersized+degraded, 52 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 10/312 objects degraded (3.205%) 2024-09-17T01:46:46.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:46.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:46.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:46 smithi167 ceph-mon[76323]: pgmap v145: 65 pgs: 6 active+undersized, 3 stale+active+clean, 4 active+undersized+degraded, 52 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 10/312 objects degraded (3.205%) 2024-09-17T01:46:46.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:46.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:46:46.504 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:46.504 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 bash[88981]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:46.504 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:46.504 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:46 smithi167 bash[88981]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:46:47.366 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 10/312 objects degraded (3.205%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:47.366 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:46:47.366 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:46:47.367 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:46:47.367 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-17T01:46:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:47 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 10/312 objects degraded (3.205%), 4 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-17T01:46:47.695 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:46:47.696 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T01:46:47.696 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate[88996]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:46:47.696 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 bash[88981]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-17T01:46:47.696 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:47 smithi167 podman[88981]: 2024-09-17 01:46:47.400089159 +0000 UTC m=+1.628158861 container died 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T01:46:48.346 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:48 smithi167 ceph-mon[76323]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:48.346 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 podman[89128]: 2024-09-17 01:46:48.007148191 +0000 UTC m=+0.596240496 container remove 4e891113c6312ef10477cb40ccaf8643d637179abad32b89d252bfcbbd519bbc (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:46:48.346 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 podman[89188]: 2024-09-17 01:46:48.11636928 +0000 UTC m=+0.016107251 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:46:48.346 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 podman[89188]: 2024-09-17 01:46:48.21767868 +0000 UTC m=+0.117416676 container create ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:46:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:48 smithi082 ceph-mon[92957]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:48.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 podman[89188]: 2024-09-17 01:46:48.455019246 +0000 UTC m=+0.354757217 container init ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:46:48.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 podman[89188]: 2024-09-17 01:46:48.45838922 +0000 UTC m=+0.358127174 container start ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True) 2024-09-17T01:46:48.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 ceph-osd[89208]: -- 172.21.15.167:0/1014202410 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef3cce61e0 con 0x55ef3bf6ed00 2024-09-17T01:46:48.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 bash[89188]: ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 2024-09-17T01:46:48.754 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:48 smithi167 systemd[1]: Started Ceph osd.4 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:46:49.892 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:49 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:49.892 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:49 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:49.892 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:49 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:49 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:49 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:49.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:49 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:50.606 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:50 smithi167 ceph-mon[76323]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:50.607 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:50 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:46:50.353+0000 7f94931cf640 -1 Falling back to public interface 2024-09-17T01:46:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:50 smithi082 ceph-mon[92957]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:52.643 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.643 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.644 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:52 smithi167 ceph-mon[76323]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 859 B/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:52.644 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.644 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:52 smithi082 ceph-mon[92957]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 859 B/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:52.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:54.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:54 smithi167 ceph-mon[76323]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:54.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:54 smithi082 ceph-mon[92957]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:55.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:55.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:55.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:55 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded (PG_DEGRADED) 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:56.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:56.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:55 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T01:46:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:56 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:46:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:56 smithi082 ceph-mon[92957]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:46:56.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:56 smithi082 ceph-mon[92957]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:56 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:46:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:56 smithi167 ceph-mon[76323]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-17T01:46:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:56 smithi167 ceph-mon[76323]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:57.588 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:46:57.328+0000 7f94931cf640 -1 osd.4 67 log_to_monitors true 2024-09-17T01:46:57.959 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:57 smithi082 ceph-mon[92957]: from='osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T01:46:57.960 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:57 smithi082 ceph-mon[92957]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T01:46:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:57 smithi167 ceph-mon[76323]: from='osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T01:46:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:57 smithi167 ceph-mon[76323]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-17T01:46:58.005 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:46:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:46:57.621+0000 7f948af4f640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:46:58.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/2861559731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88101960 msgr2=0x7f8c88101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/2861559731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88101960 0x7f8c88101d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009880 tx=0x7f8c7802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/2861559731 shutdown_connections 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/2861559731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88102b60 0x7f8c88102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/2861559731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88101960 0x7f8c88101d60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/2861559731 >> 172.21.15.82:0/2861559731 conn(0x7f8c880fd0f0 msgr2=0x7f8c880ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/2861559731 shutdown_connections 2024-09-17T01:46:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.475+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/2861559731 wait complete. 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 Processor -- start 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 -- start start 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88101960 0x7f8c88075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8810a780 con 0x7f8c88102b60 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.476+0000 7f8c8e6e7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8810a600 con 0x7f8c88101960 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37248/0 (socket says 172.21.15.82:37248) 2024-09-17T01:46:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 -- 172.21.15.82:0/812128217 learned_addr learned my addr 172.21.15.82:0/812128217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c87fff640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88101960 0x7f8c88075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 -- 172.21.15.82:0/812128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88101960 msgr2=0x7f8c88075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88101960 0x7f8c88075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 -- 172.21.15.82:0/812128217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c88074b20 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c877fe640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c8a0 tx=0x7f8c7c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c0079b0 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c7c007b50 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c88074e10 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c018700 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.477+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c880753a0 con 0x7f8c88102b60 2024-09-17T01:46:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.479+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c88101d60 con 0x7f8c88102b60 2024-09-17T01:46:58.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.479+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8c7c007d00 con 0x7f8c88102b60 2024-09-17T01:46:58.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.480+0000 7f8c857fa640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 0x7f8c7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.480+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5984+0+0 (secure 0 0 0) 0x7f8c7c09e160 con 0x7f8c88102b60 2024-09-17T01:46:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.480+0000 7f8c87fff640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 0x7f8c7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.480+0000 7f8c87fff640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 0x7f8c7007d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009230 tx=0x7f8c780058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.485+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8c7c014030 con 0x7f8c88102b60 2024-09-17T01:46:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.687+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8c88062630 con 0x7f8c7007af30 2024-09-17T01:46:58.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.689+0000 7f8c857fa640 1 -- 172.21.15.82:0/812128217 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f8c88062630 con 0x7f8c7007af30 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 msgr2=0x7f8c7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 0x7f8c7007d3f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009230 tx=0x7f8c780058d0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 msgr2=0x7f8c880745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c8a0 tx=0x7f8c7c00cd60 comp rx=0 tx=0).stop 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 shutdown_connections 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f8c7007af30 0x7f8c7007d3f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c88102b60 0x7f8c880745e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 --2- 172.21.15.82:0/812128217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c88101960 0x7f8c88075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 >> 172.21.15.82:0/812128217 conn(0x7f8c880fd0f0 msgr2=0x7f8c88105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:58.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 shutdown_connections 2024-09-17T01:46:58.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.691+0000 7f8c8e6e7640 1 -- 172.21.15.82:0/812128217 wait complete. 2024-09-17T01:46:58.698 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:46:58.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 -- 172.21.15.82:0/2424113527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c102c00 msgr2=0x7f5a4c103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 --2- 172.21.15.82:0/2424113527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c102c00 0x7f5a4c103080 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009880 tx=0x7f5a4002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 -- 172.21.15.82:0/2424113527 shutdown_connections 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 --2- 172.21.15.82:0/2424113527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c102c00 0x7f5a4c103080 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 --2- 172.21.15.82:0/2424113527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 -- 172.21.15.82:0/2424113527 >> 172.21.15.82:0/2424113527 conn(0x7f5a4c0fb770 msgr2=0x7f5a4c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 -- 172.21.15.82:0/2424113527 shutdown_connections 2024-09-17T01:46:58.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.774+0000 7f5a53afd640 1 -- 172.21.15.82:0/2424113527 wait complete. 2024-09-17T01:46:58.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:58 smithi082 ceph-mon[92957]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:58.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:58 smithi082 ceph-mon[92957]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:46:58.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:58 smithi082 ceph-mon[92957]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:46:58.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:58 smithi082 ceph-mon[92957]: from='osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:58.774 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:58 smithi082 ceph-mon[92957]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 Processor -- start 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 -- start start 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 0x7f5a4c100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c10a820 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a53afd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c10a6a0 con 0x7f5a4c102c00 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37264/0 (socket says 172.21.15.82:37264) 2024-09-17T01:46:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 -- 172.21.15.82:0/155781577 learned_addr learned my addr 172.21.15.82:0/155781577 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51098640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 0x7f5a4c100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 -- 172.21.15.82:0/155781577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 msgr2=0x7f5a4c100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 0x7f5a4c100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51899640 1 -- 172.21.15.82:0/155781577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c1010f0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.775+0000 7f5a51098640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 0x7f5a4c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a51899640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800b3d0 tx=0x7f5a4800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a48015020 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c1013e0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a48011af0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c1019f0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.776+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a48010da0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.777+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a300052c0 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.778+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5a48018020 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.778+0000 7f5a3effd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 0x7f5a3807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.778+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7f5a4809d870 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.778+0000 7f5a51098640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 0x7f5a3807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:58.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.779+0000 7f5a51098640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 0x7f5a3807d440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c102270 tx=0x7f5a40005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.783+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5a4801f020 con 0x7f5a4c0ffc20 2024-09-17T01:46:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.976+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5a30000bf0 con 0x7f5a3807af80 2024-09-17T01:46:58.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.977+0000 7f5a3effd640 1 -- 172.21.15.82:0/155781577 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5a30000bf0 con 0x7f5a3807af80 2024-09-17T01:46:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 msgr2=0x7f5a3807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 0x7f5a3807d440 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c102270 tx=0x7f5a40005a20 comp rx=0 tx=0).stop 2024-09-17T01:46:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 msgr2=0x7f5a4c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800b3d0 tx=0x7f5a4800b890 comp rx=0 tx=0).stop 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 shutdown_connections 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5a3807af80 0x7f5a3807d440 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a4c102c00 0x7f5a4c100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 --2- 172.21.15.82:0/155781577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a4c0ffc20 0x7f5a4c1024f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 >> 172.21.15.82:0/155781577 conn(0x7f5a4c0fb770 msgr2=0x7f5a4c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 shutdown_connections 2024-09-17T01:46:58.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:58.979+0000 7f5a53afd640 1 -- 172.21.15.82:0/155781577 wait complete. 2024-09-17T01:46:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:58 smithi167 ceph-mon[76323]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:46:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:58 smithi167 ceph-mon[76323]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-17T01:46:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:58 smithi167 ceph-mon[76323]: osdmap e70: 6 total, 5 up, 6 in 2024-09-17T01:46:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:58 smithi167 ceph-mon[76323]: from='osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:58 smithi167 ceph-mon[76323]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 -- 172.21.15.82:0/626072701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4102b60 msgr2=0x7f68c4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/626072701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4102b60 0x7f68c4102fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009880 tx=0x7f68b402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 -- 172.21.15.82:0/626072701 shutdown_connections 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/626072701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4102b60 0x7f68c4102fe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/626072701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4101960 0x7f68c4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 -- 172.21.15.82:0/626072701 >> 172.21.15.82:0/626072701 conn(0x7f68c40fd0f0 msgr2=0x7f68c40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 -- 172.21.15.82:0/626072701 shutdown_connections 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.062+0000 7f68cc3eb640 1 -- 172.21.15.82:0/626072701 wait complete. 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 Processor -- start 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 -- start start 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4102b60 0x7f68c41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68c410a7a0 con 0x7f68c4101960 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68cc3eb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68c410a620 con 0x7f68c4102b60 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68ca187640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68ca187640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37278/0 (socket says 172.21.15.82:37278) 2024-09-17T01:46:59.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68ca187640 1 -- 172.21.15.82:0/3055842973 learned_addr learned my addr 172.21.15.82:0/3055842973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:59.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68c9986640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4102b60 0x7f68c41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68ca187640 1 -- 172.21.15.82:0/3055842973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4102b60 msgr2=0x7f68c41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.063+0000 7f68ca187640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4102b60 0x7f68c41979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68ca187640 1 -- 172.21.15.82:0/3055842973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c4198050 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68ca187640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68c000d8d0 tx=0x7f68c000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c0017070 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c419ca90 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68c000be10 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68c000f3c0 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.064+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c419d020 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.065+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c4101d60 con 0x7f68c4101960 2024-09-17T01:46:59.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.066+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f68c001a070 con 0x7f68c4101960 2024-09-17T01:46:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.066+0000 7f68bb7fe640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 0x7f68b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.066+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7f68c009db90 con 0x7f68c4101960 2024-09-17T01:46:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.066+0000 7f68c9986640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 0x7f68b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.067+0000 7f68c9986640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 0x7f68b007d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006010 tx=0x7f68b4000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.071+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f68c0069240 con 0x7f68c4101960 2024-09-17T01:46:59.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.252+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f68c4062630 con 0x7f68b007af30 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.262+0000 7f68bb7fe640 1 -- 172.21.15.82:0/3055842973 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f68c4062630 con 0x7f68b007af30 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (11m) 72s ago 13m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (5m) 72s ago 13m 8762k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (4m) 7s ago 12m 8702k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (2m) 72s ago 13m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (2m) 7s ago 12m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (11m) 72s ago 13m 81.1M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:46:59.260 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (8m) 72s ago 8m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (8m) 72s ago 8m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (8m) 7s ago 8m 29.4M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (8m) 7s ago 8m 26.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (4m) 72s ago 14m 586M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (3m) 7s ago 12m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (3m) 72s ago 15m 113M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (3m) 7s ago 12m 104M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (13m) 72s ago 13m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (12m) 7s ago 12m 16.4M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (2m) 72s ago 11m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (113s) 72s ago 10m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:46:59.261 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (78s) 72s ago 10m 80.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:46:59.262 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (43s) 7s ago 10m 162M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:46:59.262 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (11s) 7s ago 9m 79.1M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:46:59.262 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (9m) 7s ago 9m 192M 2240M 19.1.1-330-gc2ddf972 ebb0615149de 9810d2d739fc 2024-09-17T01:46:59.262 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (3m) 72s ago 13m 69.2M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:46:59.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 msgr2=0x7f68b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 0x7f68b007d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f68b4006010 tx=0x7f68b4000bc0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 msgr2=0x7f68c4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68c000d8d0 tx=0x7f68c000dd90 comp rx=0 tx=0).stop 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 shutdown_connections 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f68b007af30 0x7f68b007d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c4102b60 0x7f68c41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 --2- 172.21.15.82:0/3055842973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68c4101960 0x7f68c4197490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 >> 172.21.15.82:0/3055842973 conn(0x7f68c40fd0f0 msgr2=0x7f68c4106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 shutdown_connections 2024-09-17T01:46:59.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.264+0000 7f68cc3eb640 1 -- 172.21.15.82:0/3055842973 wait complete. 2024-09-17T01:46:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- 172.21.15.82:0/974583483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 msgr2=0x7fec08102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 --2- 172.21.15.82:0/974583483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec08102fe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7febf8009880 tx=0x7febf802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- 172.21.15.82:0/974583483 shutdown_connections 2024-09-17T01:46:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 --2- 172.21.15.82:0/974583483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec08102fe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 --2- 172.21.15.82:0/974583483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 0x7fec08101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- 172.21.15.82:0/974583483 >> 172.21.15.82:0/974583483 conn(0x7fec080fd110 msgr2=0x7fec080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- 172.21.15.82:0/974583483 shutdown_connections 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- 172.21.15.82:0/974583483 wait complete. 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 Processor -- start 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.344+0000 7fec10794640 1 -- start start 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec10794640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 0x7fec081974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec10794640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec10794640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec0810a7a0 con 0x7fec08102b60 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec10794640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec0810a620 con 0x7fec08101960 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37292/0 (socket says 172.21.15.82:37292) 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 -- 172.21.15.82:0/358548260 learned_addr learned my addr 172.21.15.82:0/358548260 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:59.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0e530640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 0x7fec081974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 -- 172.21.15.82:0/358548260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 msgr2=0x7fec081974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 0x7fec081974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 -- 172.21.15.82:0/358548260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08198060 con 0x7fec08102b60 2024-09-17T01:46:59.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.345+0000 7fec0dd2f640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febf8006010 tx=0x7febf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.346+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febf803f070 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.346+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0819ca40 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.346+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7febf8004ac0 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.346+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febf8035030 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.346+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0819cfd0 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.347+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec08101d60 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.347+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7febf8042070 con 0x7fec08102b60 2024-09-17T01:46:59.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.348+0000 7febff7fe640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 0x7febf407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.348+0000 7fec0e530640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 0x7febf407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.348+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5984+0+0 (secure 0 0 0) 0x7febf80bebc0 con 0x7fec08102b60 2024-09-17T01:46:59.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.349+0000 7fec0e530640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 0x7febf407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec04005fd0 tx=0x7fec04005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.353+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7febf808a270 con 0x7fec08102b60 2024-09-17T01:46:59.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.595+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fec0802d7c0 con 0x7fec08102b60 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.596+0000 7febff7fe640 1 -- 172.21.15.82:0/358548260 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7febf808f120 con 0x7fec08102b60 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:46:59.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 1, 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 5 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 5, 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 9 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:46:59.595 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:46:59.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 msgr2=0x7febf407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 0x7febf407d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec04005fd0 tx=0x7fec04005850 comp rx=0 tx=0).stop 2024-09-17T01:46:59.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 msgr2=0x7fec081979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febf8006010 tx=0x7febf80046c0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 shutdown_connections 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7febf407af30 0x7febf407d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec08102b60 0x7fec081979e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 --2- 172.21.15.82:0/358548260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec08101960 0x7fec081974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 >> 172.21.15.82:0/358548260 conn(0x7fec080fd110 msgr2=0x7fec08106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 shutdown_connections 2024-09-17T01:46:59.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.598+0000 7fec10794640 1 -- 172.21.15.82:0/358548260 wait complete. 2024-09-17T01:46:59.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 -- 172.21.15.82:0/4244759949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120100860 msgr2=0x7f6120100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 --2- 172.21.15.82:0/4244759949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120100860 0x7f6120100c60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f611c009880 tx=0x7f611c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 -- 172.21.15.82:0/4244759949 shutdown_connections 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 --2- 172.21.15.82:0/4244759949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120101a60 0x7f6120101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 --2- 172.21.15.82:0/4244759949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120100860 0x7f6120100c60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 -- 172.21.15.82:0/4244759949 >> 172.21.15.82:0/4244759949 conn(0x7f61200fc010 msgr2=0x7f61200fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 -- 172.21.15.82:0/4244759949 shutdown_connections 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.691+0000 7f612706c640 1 -- 172.21.15.82:0/4244759949 wait complete. 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 Processor -- start 2024-09-17T01:46:59.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 -- start start 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 0x7f61201974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6120109680 con 0x7f6120101a60 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f612706c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6120109500 con 0x7f6120100860 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37318/0 (socket says 172.21.15.82:37318) 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 -- 172.21.15.82:0/2953823745 learned_addr learned my addr 172.21.15.82:0/2953823745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6124e08640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 0x7f61201974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 -- 172.21.15.82:0/2953823745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 msgr2=0x7f61201974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 0x7f61201974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6117fff640 1 -- 172.21.15.82:0/2953823745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6120198080 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.692+0000 7f6124e08640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 0x7f61201974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f6117fff640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f611000d8d0 tx=0x7f611000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6110017030 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6110004020 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612019cac0 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61100047a0 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.693+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612019d050 con 0x7f6120101a60 2024-09-17T01:46:59.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.694+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6120100c60 con 0x7f6120101a60 2024-09-17T01:46:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.694+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f61100041d0 con 0x7f6120101a60 2024-09-17T01:46:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.695+0000 7f6115ffb640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 0x7f610807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.695+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5984+0+0 (secure 0 0 0) 0x7f6110018070 con 0x7f6120101a60 2024-09-17T01:46:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.695+0000 7f6124e08640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 0x7f610807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.696+0000 7f6124e08640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 0x7f610807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.700+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6110069500 con 0x7f6120101a60 2024-09-17T01:46:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.913+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f612019d8d0 con 0x7f6120101a60 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862] boot 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:46:59.911 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/358548260' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:46:59.912 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:46:59 smithi082 ceph-mon[92957]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T01:46:59.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.913+0000 7f6115ffb640 1 -- 172.21.15.82:0/2953823745 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2041 (secure 0 0 0) 0x7f611006e3b0 con 0x7f6120101a60 2024-09-17T01:46:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:e14 2024-09-17T01:46:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:38:59:737794+0000 2024-09-17T01:46:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:46:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 14 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:38:59.660302+0000 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:46:59.913 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:46:59.914 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576,24301 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{0:14590} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.82:6828/1373202472,v1:172.21.15.82:6829/1373202472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:24315} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.167:6826/85255941,v1:172.21.15.167:6827/85255941] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 14 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 msgr2=0x7f610807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 0x7f610807d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f611c000c00 tx=0x7f611c005a20 comp rx=0 tx=0).stop 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 msgr2=0x7f6120197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f611000d8d0 tx=0x7f611000dd90 comp rx=0 tx=0).stop 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 shutdown_connections 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f610807af30 0x7f610807d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6120101a60 0x7f6120197a00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 --2- 172.21.15.82:0/2953823745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6120100860 0x7f61201974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.915+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 >> 172.21.15.82:0/2953823745 conn(0x7f61200fc010 msgr2=0x7f6120069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.916+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 shutdown_connections 2024-09-17T01:46:59.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.916+0000 7f612706c640 1 -- 172.21.15.82:0/2953823745 wait complete. 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- 172.21.15.82:0/1542544013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 msgr2=0x7f6124101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 --2- 172.21.15.82:0/1542544013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f6124101dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6110009880 tx=0x7f611002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- 172.21.15.82:0/1542544013 shutdown_connections 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 --2- 172.21.15.82:0/1542544013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f6124101dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 --2- 172.21.15.82:0/1542544013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f6124100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- 172.21.15.82:0/1542544013 >> 172.21.15.82:0/1542544013 conn(0x7f61240fbed0 msgr2=0x7f61240fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- 172.21.15.82:0/1542544013 shutdown_connections 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- 172.21.15.82:0/1542544013 wait complete. 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 Processor -- start 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.998+0000 7f6129da1640 1 -- start start 2024-09-17T01:46:59.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6129da1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f612406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6129da1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6129da1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6124109580 con 0x7f6124101940 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6129da1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6124109400 con 0x7f6124100740 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37330/0 (socket says 172.21.15.82:37330) 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 -- 172.21.15.82:0/3503031129 learned_addr learned my addr 172.21.15.82:0/3503031129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6128d9f640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f612406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 -- 172.21.15.82:0/3503031129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 msgr2=0x7f612406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f612406aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 -- 172.21.15.82:0/3503031129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612419c630 con 0x7f6124101940 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6128d9f640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f612406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6123fff640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6110006010 tx=0x7f61100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f611003f070 con 0x7f6124101940 2024-09-17T01:46:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612419c8c0 con 0x7f6124101940 2024-09-17T01:47:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6110004ac0 con 0x7f6124101940 2024-09-17T01:47:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:46:59.999+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6110035030 con 0x7f6124101940 2024-09-17T01:47:00.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.000+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612419cdf0 con 0x7f6124101940 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.001+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6124100b40 con 0x7f6124101940 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.001+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6110042070 con 0x7f6124101940 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.002+0000 7f6121ffb640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 0x7f611407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.002+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5984+0+0 (secure 0 0 0) 0x7f61100bec70 con 0x7f6124101940 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.002+0000 7f6128d9f640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 0x7f611407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:00.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.002+0000 7f6128d9f640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 0x7f611407d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61241017a0 tx=0x7f6118005e70 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: osd.4 [v2:172.21.15.167:6808/1190054862,v1:172.21.15.167:6809/1190054862] boot 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: osdmap e71: 6 total, 6 up, 6 in 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/358548260' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:00.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:46:59 smithi167 ceph-mon[76323]: osdmap e72: 6 total, 6 up, 6 in 2024-09-17T01:47:00.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.006+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f611008a290 con 0x7f6124101940 2024-09-17T01:47:00.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.202+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6124105ea0 con 0x7f611407af30 2024-09-17T01:47:00.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.203+0000 7f6121ffb640 1 -- 172.21.15.82:0/3503031129 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f6124105ea0 con 0x7f611407af30 2024-09-17T01:47:00.201 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:47:00.201 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:47:00.201 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "11/23 daemons upgraded", 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:47:00.202 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 msgr2=0x7f611407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 0x7f611407d3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61241017a0 tx=0x7f6118005e70 comp rx=0 tx=0).stop 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 msgr2=0x7f612419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6110006010 tx=0x7f61100046c0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 shutdown_connections 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f611407af30 0x7f611407d3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6124101940 0x7f612419c070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 --2- 172.21.15.82:0/3503031129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6124100740 0x7f612406aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.205+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 >> 172.21.15.82:0/3503031129 conn(0x7f61240fbed0 msgr2=0x7f61240fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.206+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 shutdown_connections 2024-09-17T01:47:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.206+0000 7f6129da1640 1 -- 172.21.15.82:0/3503031129 wait complete. 2024-09-17T01:47:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 -- 172.21.15.82:0/57467193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 msgr2=0x7ff4d01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 --2- 172.21.15.82:0/57467193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d01021f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009c20 tx=0x7ff4c802a970 comp rx=0 tx=0).stop 2024-09-17T01:47:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 -- 172.21.15.82:0/57467193 shutdown_connections 2024-09-17T01:47:00.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 --2- 172.21.15.82:0/57467193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 0x7ff4d0100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 --2- 172.21.15.82:0/57467193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d01021f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 -- 172.21.15.82:0/57467193 >> 172.21.15.82:0/57467193 conn(0x7ff4d00fb770 msgr2=0x7ff4d00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 -- 172.21.15.82:0/57467193 shutdown_connections 2024-09-17T01:47:00.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.288+0000 7ff4d5074640 1 -- 172.21.15.82:0/57467193 wait complete. 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 Processor -- start 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 -- start start 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 0x7ff4d01004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d01096a0 con 0x7ff4d0101df0 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4d5074640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d0109520 con 0x7ff4d0100b30 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37348/0 (socket says 172.21.15.82:37348) 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 -- 172.21.15.82:0/176010464 learned_addr learned my addr 172.21.15.82:0/176010464 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ced9d640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 0x7ff4d01004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 -- 172.21.15.82:0/176010464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 msgr2=0x7ff4d01004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 0x7ff4d01004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.289+0000 7ff4ce59c640 1 -- 172.21.15.82:0/176010464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d019c810 con 0x7ff4d0101df0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4ce59c640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c920 tx=0x7ff4b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4b80079b0 con 0x7ff4d0101df0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d019cb00 con 0x7ff4d0101df0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4b80054e0 con 0x7ff4d0101df0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4b8004e10 con 0x7ff4d0101df0 2024-09-17T01:47:00.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.290+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d019d110 con 0x7ff4d0101df0 2024-09-17T01:47:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.291+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d0100fb0 con 0x7ff4d0101df0 2024-09-17T01:47:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.292+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff4b8005020 con 0x7ff4d0101df0 2024-09-17T01:47:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.292+0000 7ff4c7fff640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 0x7ff4bc07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.292+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5984+0+0 (secure 0 0 0) 0x7ff4b809df80 con 0x7ff4d0101df0 2024-09-17T01:47:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.292+0000 7ff4ced9d640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 0x7ff4bc07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.293+0000 7ff4ced9d640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 0x7ff4bc07d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f80 tx=0x7ff4c802f9f0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.297+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff4b8014030 con 0x7ff4d0101df0 2024-09-17T01:47:00.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.542+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff4d0062df0 con 0x7ff4d0101df0 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.542+0000 7ff4c7fff640 1 -- 172.21.15.82:0/176010464 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1207 (secure 0 0 0) 0x7ff4b8069630 con 0x7ff4d0101df0 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/312 objects degraded (16.667%), 15 pgs degraded 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-17T01:47:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-17T01:47:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 msgr2=0x7ff4bc07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 0x7ff4bc07d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8000f80 tx=0x7ff4c802f9f0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 msgr2=0x7ff4d019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800c920 tx=0x7ff4b800cde0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 shutdown_connections 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4bc07aed0 0x7ff4bc07d390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4d0101df0 0x7ff4d019c2d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 --2- 172.21.15.82:0/176010464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4d0100b30 0x7ff4d01004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 >> 172.21.15.82:0/176010464 conn(0x7ff4d00fb770 msgr2=0x7ff4d01050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 shutdown_connections 2024-09-17T01:47:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:00.545+0000 7ff4d5074640 1 -- 172.21.15.82:0/176010464 wait complete. 2024-09-17T01:47:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:00 smithi082 ceph-mon[92957]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:00.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:00 smithi082 ceph-mon[92957]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:00.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:00 smithi082 ceph-mon[92957]: pgmap v154: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:47:00.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:00 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2953823745' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:47:00.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:00 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/176010464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:47:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:00 smithi167 ceph-mon[76323]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:00 smithi167 ceph-mon[76323]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:00 smithi167 ceph-mon[76323]: pgmap v154: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 52/312 objects degraded (16.667%) 2024-09-17T01:47:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:00 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2953823745' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:47:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:00 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/176010464' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:47:01.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:01 smithi082 ceph-mon[92957]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:01.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:01.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:01 smithi167 ceph-mon[76323]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:02 smithi082 ceph-mon[92957]: pgmap v156: 65 pgs: 1 peering, 7 active+undersized, 3 active+undersized+degraded, 54 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 5 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:47:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:02 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 9/312 objects degraded (2.885%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:02 smithi167 ceph-mon[76323]: pgmap v156: 65 pgs: 1 peering, 7 active+undersized, 3 active+undersized+degraded, 54 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 5 op/s; 9/312 objects degraded (2.885%) 2024-09-17T01:47:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:02 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 9/312 objects degraded (2.885%), 3 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:03.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:03 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/312 objects degraded (2.885%), 3 pgs degraded) 2024-09-17T01:47:04.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:03 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/312 objects degraded (2.885%), 3 pgs degraded) 2024-09-17T01:47:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:04 smithi082 ceph-mon[92957]: pgmap v157: 65 pgs: 1 peering, 64 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:47:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:04 smithi167 ceph-mon[76323]: pgmap v157: 65 pgs: 1 peering, 64 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-17T01:47:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:06 smithi082 ceph-mon[92957]: pgmap v158: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:47:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:06 smithi167 ceph-mon[76323]: pgmap v158: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-17T01:47:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:08 smithi082 ceph-mon[92957]: pgmap v159: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:47:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:08 smithi167 ceph-mon[76323]: pgmap v159: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:47:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:10 smithi082 ceph-mon[92957]: pgmap v160: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:47:10.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T01:47:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:10 smithi167 ceph-mon[76323]: pgmap v160: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-17T01:47:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-17T01:47:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:11 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:47:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:11 smithi082 ceph-mon[92957]: Upgrade: osd.5 is safe to restart 2024-09-17T01:47:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:11 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:11 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-17T01:47:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:11 smithi167 ceph-mon[76323]: Upgrade: osd.5 is safe to restart 2024-09-17T01:47:12.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:11 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:12.688 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:12 smithi167 ceph-mon[76323]: pgmap v161: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:47:12.689 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:12.689 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-17T01:47:12.689 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:12 smithi082 ceph-mon[92957]: pgmap v161: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:47:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-17T01:47:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:13 smithi082 ceph-mon[92957]: Upgrade: Updating osd.5 2024-09-17T01:47:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:13 smithi082 ceph-mon[92957]: Deploying daemon osd.5 on smithi167 2024-09-17T01:47:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:13 smithi167 ceph-mon[76323]: Upgrade: Updating osd.5 2024-09-17T01:47:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:13 smithi167 ceph-mon[76323]: Deploying daemon osd.5 on smithi167 2024-09-17T01:47:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:14 smithi082 ceph-mon[92957]: pgmap v162: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:47:15.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:14 smithi167 ceph-mon[76323]: pgmap v162: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:47:15.005 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:14 smithi167 systemd[1]: Stopping Ceph osd.5 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:47:15.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:47:15.003+0000 7f75c146c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:47:15.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:47:15.003+0000 7f75c146c640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-17T01:47:15.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:15 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[54645]: 2024-09-17T01:47:15.003+0000 7f75c146c640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:47:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:15 smithi082 ceph-mon[92957]: osd.5 marked itself down and dead 2024-09-17T01:47:16.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:15 smithi167 ceph-mon[76323]: osd.5 marked itself down and dead 2024-09-17T01:47:16.393 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:16 smithi167 podman[93852]: 2024-09-17 01:47:16.064333275 +0000 UTC m=+1.179041149 container stop 9810d2d739fc5f2dde8d46e1d9da9c1245c5f3201d2b2da0f8df51e7f3f8ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-c2ddf97, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-17T01:47:16.393 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:16 smithi167 podman[93852]: 2024-09-17 01:47:16.093788764 +0000 UTC m=+1.208496653 container died 9810d2d739fc5f2dde8d46e1d9da9c1245c5f3201d2b2da0f8df51e7f3f8ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, ceph=True) 2024-09-17T01:47:16.694 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:16 smithi167 podman[93852]: 2024-09-17 01:47:16.512173538 +0000 UTC m=+1.626881400 container cleanup 9810d2d739fc5f2dde8d46e1d9da9c1245c5f3201d2b2da0f8df51e7f3f8ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-17T01:47:16.694 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:16 smithi167 bash[93852]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:47:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:16 smithi082 ceph-mon[92957]: pgmap v163: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:47:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:16 smithi082 ceph-mon[92957]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:47:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:16 smithi082 ceph-mon[92957]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T01:47:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:16.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:17.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:16 smithi167 ceph-mon[76323]: pgmap v163: 65 pgs: 65 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:47:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:16 smithi167 ceph-mon[76323]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-17T01:47:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:16 smithi167 ceph-mon[76323]: osdmap e73: 6 total, 5 up, 6 in 2024-09-17T01:47:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:17.004 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:16 smithi167 podman[93868]: 2024-09-17 01:47:16.696833984 +0000 UTC m=+0.625213092 container remove 9810d2d739fc5f2dde8d46e1d9da9c1245c5f3201d2b2da0f8df51e7f3f8ccc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:475e68c989240ebfb6ca26a687a713828159881ccf6edcf69b7320f1853af3e3, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-c2ddf97, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:47:17.390 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.023812633 +0000 UTC m=+0.015785502 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:47:17.390 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.148124271 +0000 UTC m=+0.140097182 container create 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:47:17.390 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.392749086 +0000 UTC m=+0.384721965 container init 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T01:47:17.712 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.396105135 +0000 UTC m=+0.388078003 container start 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:47:17.712 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.475803341 +0000 UTC m=+0.467776221 container attach 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-17T01:47:17.712 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:17 smithi167 podman[93955]: 2024-09-17 01:47:17.583822936 +0000 UTC m=+0.575795809 container died 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:47:17.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:17 smithi082 ceph-mon[92957]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T01:47:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:17 smithi167 ceph-mon[76323]: osdmap e74: 6 total, 5 up, 6 in 2024-09-17T01:47:18.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[93978]: 2024-09-17 01:47:18.221671673 +0000 UTC m=+0.631915772 container remove 5f38dee05f9804437baacc7b566fd80d59b55d9cb0cacb24c5b96bc563358971 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:47:18.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-17T01:47:18.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 systemd[1]: Stopped Ceph osd.5 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:47:18.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 systemd[1]: ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.5.service: Consumed 50.247s CPU time. 2024-09-17T01:47:18.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 systemd[1]: Starting Ceph osd.5 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:47:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:18 smithi082 ceph-mon[92957]: pgmap v166: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-17T01:47:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:18 smithi082 ceph-mon[92957]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-17T01:47:18.980 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:18 smithi167 ceph-mon[76323]: pgmap v166: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-17T01:47:18.980 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:18 smithi167 ceph-mon[76323]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-17T01:47:18.981 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[94078]: 2024-09-17 01:47:18.556767517 +0000 UTC m=+0.015730025 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:47:18.981 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[94078]: 2024-09-17 01:47:18.68108127 +0000 UTC m=+0.140043768 container create c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:47:18.981 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[94078]: 2024-09-17 01:47:18.900204971 +0000 UTC m=+0.359167472 container init c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-17T01:47:18.981 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[94078]: 2024-09-17 01:47:18.903386711 +0000 UTC m=+0.362349207 container start c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:47:18.981 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:18 smithi167 podman[94078]: 2024-09-17 01:47:18.983566707 +0000 UTC m=+0.442529210 container attach c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:47:19.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:47:19.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 bash[94078]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:47:19.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:47:19.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 bash[94078]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-17T01:47:20.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:19 smithi082 ceph-mon[92957]: pgmap v167: 65 pgs: 6 active+undersized, 10 peering, 3 stale+active+clean, 6 active+undersized+degraded, 40 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17/312 objects degraded (5.449%) 2024-09-17T01:47:20.090 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:19 smithi082 ceph-mon[92957]: Health check failed: Degraded data redundancy: 17/312 objects degraded (5.449%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:20.164 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-mon[76323]: pgmap v167: 65 pgs: 6 active+undersized, 10 peering, 3 stale+active+clean, 6 active+undersized+degraded, 40 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 17/312 objects degraded (5.449%) 2024-09-17T01:47:20.164 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-mon[76323]: Health check failed: Degraded data redundancy: 17/312 objects degraded (5.449%), 6 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:20.164 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:47:20.164 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 bash[94078]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:47:20.164 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:47:20.164 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:19 smithi167 bash[94078]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-17T01:47:20.476 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:47:20.476 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 bash[94078]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 bash[94078]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 bash[94078]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 bash[94078]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate[94093]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 bash[94078]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-17T01:47:20.477 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 podman[94078]: 2024-09-17 01:47:20.195355159 +0000 UTC m=+1.654317660 container died c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:47:21.041 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 podman[94241]: 2024-09-17 01:47:20.762677619 +0000 UTC m=+0.557251498 container remove c443c0c1acaac8c8f0095153c06c9c1b98f3f05a072af08bea0231c220671ba5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:47:21.041 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 podman[94302]: 2024-09-17 01:47:20.96349293 +0000 UTC m=+0.106342661 container create 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:47:21.041 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:20 smithi167 podman[94302]: 2024-09-17 01:47:20.873256272 +0000 UTC m=+0.016106027 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:47:21.405 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:21 smithi167 podman[94302]: 2024-09-17 01:47:21.227263538 +0000 UTC m=+0.370113282 container init 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:47:21.405 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:21 smithi167 podman[94302]: 2024-09-17 01:47:21.230608907 +0000 UTC m=+0.373458642 container start 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T01:47:21.753 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:21 smithi167 bash[94302]: 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 2024-09-17T01:47:21.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:21 smithi167 systemd[1]: Started Ceph osd.5 for 5047e42a-7494-11ef-bceb-c7b262605968. 2024-09-17T01:47:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:22.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:22 smithi082 ceph-mon[92957]: pgmap v168: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:22.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:22.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:22.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:22.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:22 smithi167 ceph-mon[76323]: pgmap v168: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:23.414 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:23 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:47:23.122+0000 7fa811efc640 -1 Falling back to public interface 2024-09-17T01:47:23.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:23 smithi082 ceph-mon[92957]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-17T01:47:23.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:23 smithi167 ceph-mon[76323]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-17T01:47:24.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:24 smithi167 ceph-mon[76323]: pgmap v169: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:24.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:24.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:24 smithi082 ceph-mon[92957]: pgmap v169: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:26.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:25 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:26.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:25 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:26.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:25 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:26.124 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:25 smithi167 ceph-mon[76323]: pgmap v170: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:26.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:25 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:26.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:25 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:26.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:25 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:26.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:25 smithi082 ceph-mon[92957]: pgmap v170: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:28.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: pgmap v171: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:28.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:28.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-17T01:47:28.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:47:28.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:28.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-17T01:47:29.004 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:47:28.815+0000 7fa811efc640 -1 osd.5 72 log_to_monitors true 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: pgmap v171: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 49/312 objects degraded (15.705%) 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-17T01:47:29.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-17T01:47:29.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all osd 2024-09-17T01:47:29.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:47:29.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T01:47:29.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:29.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:29.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:29 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} : dispatch 2024-09-17T01:47:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all osd 2024-09-17T01:47:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-17T01:47:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: osdmap e75: 6 total, 5 up, 6 in 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:active} 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:30.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:30.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:29 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} : dispatch 2024-09-17T01:47:30.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 -- 172.21.15.82:0/2341285088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0101a60 msgr2=0x7fb5e0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/2341285088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0101a60 0x7fb5e0101ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009880 tx=0x7fb5c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 -- 172.21.15.82:0/2341285088 shutdown_connections 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/2341285088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0101a60 0x7fb5e0101ee0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/2341285088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0100860 0x7fb5e0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 -- 172.21.15.82:0/2341285088 >> 172.21.15.82:0/2341285088 conn(0x7fb5e00fc010 msgr2=0x7fb5e00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 -- 172.21.15.82:0/2341285088 shutdown_connections 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.636+0000 7fb5e6e22640 1 -- 172.21.15.82:0/2341285088 wait complete. 2024-09-17T01:47:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 Processor -- start 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 -- start start 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0101a60 0x7fb5e019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0109680 con 0x7fb5e0100860 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e6e22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e0109500 con 0x7fb5e0101a60 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5dffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0101a60 0x7fb5e019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49362/0 (socket says 172.21.15.82:49362) 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 -- 172.21.15.82:0/1626624554 learned_addr learned my addr 172.21.15.82:0/1626624554 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 -- 172.21.15.82:0/1626624554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0101a60 msgr2=0x7fb5e019c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0101a60 0x7fb5e019c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.637+0000 7fb5e4bbe640 1 -- 172.21.15.82:0/1626624554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e019c7c0 con 0x7fb5e0100860 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5e4bbe640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d8d0 tx=0x7fb5d800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5d8017020 con 0x7fb5e0100860 2024-09-17T01:47:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5d8010460 con 0x7fb5e0100860 2024-09-17T01:47:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e019cab0 con 0x7fb5e0100860 2024-09-17T01:47:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5d800f5b0 con 0x7fb5e0100860 2024-09-17T01:47:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.638+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e019d010 con 0x7fb5e0100860 2024-09-17T01:47:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.639+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e0100c60 con 0x7fb5e0100860 2024-09-17T01:47:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.640+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb5d801a020 con 0x7fb5e0100860 2024-09-17T01:47:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.640+0000 7fb5ddffb640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 0x7fb5cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.640+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5984+0+0 (secure 0 0 0) 0x7fb5d809de00 con 0x7fb5e0100860 2024-09-17T01:47:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.640+0000 7fb5dffff640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 0x7fb5cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.641+0000 7fb5dffff640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 0x7fb5cc07d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c80058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.645+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb5d8021030 con 0x7fb5e0100860 2024-09-17T01:47:30.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.834+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb5e0062630 con 0x7fb5cc07af30 2024-09-17T01:47:30.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.835+0000 7fb5ddffb640 1 -- 172.21.15.82:0/1626624554 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb5e0062630 con 0x7fb5cc07af30 2024-09-17T01:47:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 msgr2=0x7fb5cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 0x7fb5cc07d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8000c00 tx=0x7fb5c80058d0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 msgr2=0x7fb5e006ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800d8d0 tx=0x7fb5d800dd90 comp rx=0 tx=0).stop 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 shutdown_connections 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb5cc07af30 0x7fb5cc07d3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5e0101a60 0x7fb5e019c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 --2- 172.21.15.82:0/1626624554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5e0100860 0x7fb5e006ace0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 >> 172.21.15.82:0/1626624554 conn(0x7fb5e00fc010 msgr2=0x7fb5e0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 shutdown_connections 2024-09-17T01:47:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.838+0000 7fb5e6e22640 1 -- 172.21.15.82:0/1626624554 wait complete. 2024-09-17T01:47:30.845 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:47:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.920+0000 7f40039da640 1 -- 172.21.15.82:0/3766617608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 msgr2=0x7f3ffc104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.920+0000 7f40039da640 1 --2- 172.21.15.82:0/3766617608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc104880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009880 tx=0x7f3ff402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 -- 172.21.15.82:0/3766617608 shutdown_connections 2024-09-17T01:47:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 --2- 172.21.15.82:0/3766617608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 0x7f3ffc1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 --2- 172.21.15.82:0/3766617608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc104880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 -- 172.21.15.82:0/3766617608 >> 172.21.15.82:0/3766617608 conn(0x7f3ffc0fbff0 msgr2=0x7f3ffc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 -- 172.21.15.82:0/3766617608 shutdown_connections 2024-09-17T01:47:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 -- 172.21.15.82:0/3766617608 wait complete. 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: Upgrade: Scaling down filesystem cephfs 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: pgmap v173: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 49/312 objects degraded (15.705%) 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: osdmap e76: 6 total, 5 up, 6 in 2024-09-17T01:47:30.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: stopping daemon mds.cephfs.smithi167.vbekqg 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:boot 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.82:6828/2234505694,v1:172.21.15.82:6829/2234505694] up:boot 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:stopping} 2 up:standby 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:30.921 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:30.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:30 smithi082 ceph-mon[92957]: from='osd.5 ' entity='osd.5' 2024-09-17T01:47:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 Processor -- start 2024-09-17T01:47:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.921+0000 7f40039da640 1 -- start start 2024-09-17T01:47:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f40039da640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f40039da640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 0x7f3ffc197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f40039da640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc10a7d0 con 0x7f3ffc102490 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f40039da640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc10a650 con 0x7f3ffc104dc0 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49386/0 (socket says 172.21.15.82:49386) 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 -- 172.21.15.82:0/1599216973 learned_addr learned my addr 172.21.15.82:0/1599216973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4000f75640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 0x7f3ffc197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 -- 172.21.15.82:0/1599216973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 msgr2=0x7f3ffc197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 0x7f3ffc197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 -- 172.21.15.82:0/1599216973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc1980b0 con 0x7f3ffc102490 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f4001776640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4006010 tx=0x7f3ff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.922+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ff403f070 con 0x7f3ffc102490 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.923+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ff4004ac0 con 0x7f3ffc102490 2024-09-17T01:47:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.923+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc19ca90 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.923+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ff4035030 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.923+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc19d020 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.924+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc102870 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.924+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3ff4042070 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.925+0000 7f3ffa7fc640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 0x7f3fe407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.925+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5984+0+0 (secure 0 0 0) 0x7f3ff40bea60 con 0x7f3ffc102490 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.925+0000 7f4000f75640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 0x7f3fe407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.925+0000 7f4000f75640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 0x7f3fe407d440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc1989a0 tx=0x7f3ff000b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:30.929+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3ff408a190 con 0x7f3ffc102490 2024-09-17T01:47:31.004 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:47:30.551+0000 7fa805c74640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: Upgrade: Scaling down filesystem cephfs 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: pgmap v173: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 49/312 objects degraded (15.705%) 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: osdmap e76: 6 total, 5 up, 6 in 2024-09-17T01:47:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]} : dispatch 2024-09-17T01:47:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: stopping daemon mds.cephfs.smithi167.vbekqg 2024-09-17T01:47:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-17T01:47:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-17T01:47:31.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:boot 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.82:6828/2234505694,v1:172.21.15.82:6829/2234505694] up:boot 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: fsmap cephfs:2 {0=cephfs.smithi082.haarnz=up:active,1=cephfs.smithi167.vbekqg=up:stopping} 2 up:standby 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:31.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:30 smithi167 ceph-mon[76323]: from='osd.5 ' entity='osd.5' 2024-09-17T01:47:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.121+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ffc105740 con 0x7f3fe407af80 2024-09-17T01:47:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.122+0000 7f3ffa7fc640 1 -- 172.21.15.82:0/1599216973 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3ffc105740 con 0x7f3fe407af80 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 msgr2=0x7f3fe407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 0x7f3fe407d440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc1989a0 tx=0x7f3ff000b390 comp rx=0 tx=0).stop 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 msgr2=0x7f3ffc1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4006010 tx=0x7f3ff40046c0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 shutdown_connections 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3fe407af80 0x7f3fe407d440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ffc104dc0 0x7f3ffc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 --2- 172.21.15.82:0/1599216973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ffc102490 0x7f3ffc1974f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 >> 172.21.15.82:0/1599216973 conn(0x7f3ffc0fbff0 msgr2=0x7f3ffc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 shutdown_connections 2024-09-17T01:47:31.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.125+0000 7f40039da640 1 -- 172.21.15.82:0/1599216973 wait complete. 2024-09-17T01:47:31.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 -- 172.21.15.82:0/1872419022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800102450 msgr2=0x7fc800104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 --2- 172.21.15.82:0/1872419022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800102450 0x7fc800104840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009880 tx=0x7fc7f402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 -- 172.21.15.82:0/1872419022 shutdown_connections 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 --2- 172.21.15.82:0/1872419022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800104d80 0x7fc800107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 --2- 172.21.15.82:0/1872419022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800102450 0x7fc800104840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 -- 172.21.15.82:0/1872419022 >> 172.21.15.82:0/1872419022 conn(0x7fc8000fc010 msgr2=0x7fc8000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 -- 172.21.15.82:0/1872419022 shutdown_connections 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.206+0000 7fc806bb6640 1 -- 172.21.15.82:0/1872419022 wait complete. 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 Processor -- start 2024-09-17T01:47:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 -- start start 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800102450 0x7fc8001974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc80010a770 con 0x7fc800104d80 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc806bb6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc80010a5f0 con 0x7fc800102450 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49398/0 (socket says 172.21.15.82:49398) 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 -- 172.21.15.82:0/3965040349 learned_addr learned my addr 172.21.15.82:0/3965040349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc804952640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800102450 0x7fc8001974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 -- 172.21.15.82:0/3965040349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800102450 msgr2=0x7fc8001974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800102450 0x7fc8001974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.207+0000 7fc7fffff640 1 -- 172.21.15.82:0/3965040349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc800198080 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc7fffff640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d6c0 tx=0x7fc7ec00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7ec017070 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7ec0054e0 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80019cac0 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7ec004b70 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.208+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80019d050 con 0x7fc800104d80 2024-09-17T01:47:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.209+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc800102830 con 0x7fc800104d80 2024-09-17T01:47:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.210+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc7ec009820 con 0x7fc800104d80 2024-09-17T01:47:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.210+0000 7fc7fdffb640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 0x7fc7f007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.210+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5984+0+0 (secure 0 0 0) 0x7fc7ec09d9e0 con 0x7fc800104d80 2024-09-17T01:47:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.210+0000 7fc804952640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 0x7fc7f007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.211+0000 7fc804952640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 0x7fc7f007d440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f40058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.215+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc7ec069110 con 0x7fc800104d80 2024-09-17T01:47:31.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.397+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc800105700 con 0x7fc7f007af80 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.407+0000 7fc7fdffb640 1 -- 172.21.15.82:0/3965040349 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fc800105700 con 0x7fc7f007af80 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (12m) 104s ago 14m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (5m) 104s ago 14m 8762k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (5m) 7s ago 13m 8749k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (3m) 104s ago 14m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (3m) 7s ago 13m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:47:31.405 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (12m) 104s ago 13m 81.1M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (8m) 104s ago 8m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (8m) 104s ago 8m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (8m) 7s ago 8m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (8m) 7s ago 8m 26.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (5m) 104s ago 15m 586M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (4m) 7s ago 13m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (3m) 104s ago 15m 113M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (3m) 7s ago 13m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (14m) 104s ago 14m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (13m) 7s ago 13m 16.5M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 104s ago 11m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 104s ago 11m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:47:31.406 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (110s) 104s ago 11m 80.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:47:31.407 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (75s) 7s ago 10m 165M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:47:31.407 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (43s) 7s ago 10m 154M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:47:31.407 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (10s) 7s ago 9m 81.4M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:47:31.407 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 104s ago 13m 69.2M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 msgr2=0x7fc7f007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 0x7fc7f007d440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4000c00 tx=0x7fc7f40058d0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 msgr2=0x7fc800197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00d6c0 tx=0x7fc7ec00db80 comp rx=0 tx=0).stop 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 shutdown_connections 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc7f007af80 0x7fc7f007d440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc800104d80 0x7fc800197a00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 --2- 172.21.15.82:0/3965040349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc800102450 0x7fc8001974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 >> 172.21.15.82:0/3965040349 conn(0x7fc8000fc010 msgr2=0x7fc8000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 shutdown_connections 2024-09-17T01:47:31.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.409+0000 7fc806bb6640 1 -- 172.21.15.82:0/3965040349 wait complete. 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 -- 172.21.15.82:0/3775707774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c100860 msgr2=0x7ff35c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 --2- 172.21.15.82:0/3775707774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c100860 0x7ff35c100c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff350009880 tx=0x7ff35002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 -- 172.21.15.82:0/3775707774 shutdown_connections 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 --2- 172.21.15.82:0/3775707774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c101a60 0x7ff35c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 --2- 172.21.15.82:0/3775707774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c100860 0x7ff35c100c60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 -- 172.21.15.82:0/3775707774 >> 172.21.15.82:0/3775707774 conn(0x7ff35c0fc010 msgr2=0x7ff35c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 -- 172.21.15.82:0/3775707774 shutdown_connections 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.490+0000 7ff362dff640 1 -- 172.21.15.82:0/3775707774 wait complete. 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 Processor -- start 2024-09-17T01:47:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 -- start start 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c100860 0x7ff35c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c109680 con 0x7ff35c101a60 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff362dff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c109500 con 0x7ff35c100860 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49404/0 (socket says 172.21.15.82:49404) 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 -- 172.21.15.82:0/1237704468 learned_addr learned my addr 172.21.15.82:0/1237704468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff360b9b640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c100860 0x7ff35c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 -- 172.21.15.82:0/1237704468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c100860 msgr2=0x7ff35c104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c100860 0x7ff35c104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.491+0000 7ff35bfff640 1 -- 172.21.15.82:0/1237704468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c103380 con 0x7ff35c101a60 2024-09-17T01:47:31.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff35bfff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d8d0 tx=0x7ff34800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff35c101a60 2024-09-17T01:47:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c103670 con 0x7ff35c101a60 2024-09-17T01:47:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff348010460 con 0x7ff35c101a60 2024-09-17T01:47:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff34800f5f0 con 0x7ff35c101a60 2024-09-17T01:47:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.492+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c103c00 con 0x7ff35c101a60 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.493+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c100c60 con 0x7ff35c101a60 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.494+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff348009a30 con 0x7ff35c101a60 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.494+0000 7ff359ffb640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 0x7ff34c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.494+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5984+0+0 (secure 0 0 0) 0x7ff34809dd80 con 0x7ff35c101a60 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.494+0000 7ff360b9b640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 0x7ff34c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.495+0000 7ff360b9b640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 0x7ff34c07d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff350009230 tx=0x7ff3500058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.499+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff348069430 con 0x7ff35c101a60 2024-09-17T01:47:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.758+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff35c19f6e0 con 0x7ff35c101a60 2024-09-17T01:47:31.757 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:31.757 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:31.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:31.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:47:31.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852] boot 2024-09-17T01:47:31.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:47:31.758 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-17T01:47:31.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.759+0000 7ff359ffb640 1 -- 172.21.15.82:0/1237704468 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+731 (secure 0 0 0) 0x7ff34806e2e0 con 0x7ff35c101a60 2024-09-17T01:47:31.759 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:47:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:47:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:47:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:47:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:47:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:47:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:47:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-17T01:47:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 10 2024-09-17T01:47:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:47:31.761 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:47:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 msgr2=0x7ff34c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 0x7ff34c07d3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff350009230 tx=0x7ff3500058d0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 msgr2=0x7ff35c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d8d0 tx=0x7ff34800dd90 comp rx=0 tx=0).stop 2024-09-17T01:47:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 shutdown_connections 2024-09-17T01:47:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34c07af30 0x7ff34c07d3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff35c101a60 0x7ff35c102e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 --2- 172.21.15.82:0/1237704468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff35c100860 0x7ff35c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 >> 172.21.15.82:0/1237704468 conn(0x7ff35c0fc010 msgr2=0x7ff35c06a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 shutdown_connections 2024-09-17T01:47:31.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.761+0000 7ff362dff640 1 -- 172.21.15.82:0/1237704468 wait complete. 2024-09-17T01:47:31.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.842+0000 7f080fe7a640 1 -- 172.21.15.82:0/1992169145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808102b60 msgr2=0x7f0808102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.842+0000 7f080fe7a640 1 --2- 172.21.15.82:0/1992169145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808102b60 0x7f0808102fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009880 tx=0x7f07f802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.842+0000 7f080fe7a640 1 -- 172.21.15.82:0/1992169145 shutdown_connections 2024-09-17T01:47:31.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.842+0000 7f080fe7a640 1 --2- 172.21.15.82:0/1992169145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808102b60 0x7f0808102fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.842+0000 7f080fe7a640 1 --2- 172.21.15.82:0/1992169145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808101960 0x7f0808101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- 172.21.15.82:0/1992169145 >> 172.21.15.82:0/1992169145 conn(0x7f08080fd110 msgr2=0x7f08080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- 172.21.15.82:0/1992169145 shutdown_connections 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- 172.21.15.82:0/1992169145 wait complete. 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 Processor -- start 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- start start 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808102b60 0x7f0808197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f080810a820 con 0x7f0808101960 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080fe7a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f080810a6a0 con 0x7f0808102b60 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.843+0000 7f080dc16640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49422/0 (socket says 172.21.15.82:49422) 2024-09-17T01:47:31.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080d415640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808102b60 0x7f0808197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 -- 172.21.15.82:0/254854017 learned_addr learned my addr 172.21.15.82:0/254854017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 -- 172.21.15.82:0/254854017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808102b60 msgr2=0x7f0808197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808102b60 0x7f0808197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 -- 172.21.15.82:0/254854017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08081980e0 con 0x7f0808101960 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080dc16640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f080400b3d0 tx=0x7f080400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0804015020 con 0x7f0808101960 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080819cb20 con 0x7f0808101960 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0804011af0 con 0x7f0808101960 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0804010da0 con 0x7f0808101960 2024-09-17T01:47:31.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.844+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f080819d080 con 0x7f0808101960 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.845+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0808101d60 con 0x7f0808101960 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.846+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0804018020 con 0x7f0808101960 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.846+0000 7f07feffd640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 0x7f07f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.846+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5984+0+0 (secure 0 0 0) 0x7f080409d950 con 0x7f0808101960 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.846+0000 7f080d415640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 0x7f07f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:31.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.847+0000 7f080d415640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 0x7f07f407d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07f8000c00 tx=0x7f07f80058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:31.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:31.851+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f080401f020 con 0x7f0808101960 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: osd.5 [v2:172.21.15.167:6816/2974773852,v1:172.21.15.167:6817/2974773852] boot 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: osdmap e77: 6 total, 6 up, 6 in 2024-09-17T01:47:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-17T01:47:32.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.061+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f080819da80 con 0x7f0808101960 2024-09-17T01:47:32.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.061+0000 7f07feffd640 1 -- 172.21.15.82:0/254854017 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2027 (secure 0 0 0) 0x7f0804069000 con 0x7f0808101960 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:e16 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:47:29:923030+0000 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 16 2024-09-17T01:47:32.060 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:47:29.923023+0000 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:47:32.061 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=14576,1=24301} 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 14576 members: 14576 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:14576} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.82:6826/981106576,v1:172.21.15.82:6827/981106576] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:47:32.062 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{1:24301} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{-1:34227} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:47:32.063 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{-1:34294} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/2234505694,v1:172.21.15.82:6829/2234505694] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 msgr2=0x7f07f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 0x7f07f407d3f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07f8000c00 tx=0x7f07f80058d0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 msgr2=0x7f0808197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f080400b3d0 tx=0x7f080400b890 comp rx=0 tx=0).stop 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 shutdown_connections 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f07f407af30 0x7f07f407d3f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0808102b60 0x7f0808197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 --2- 172.21.15.82:0/254854017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0808101960 0x7f0808197520 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 >> 172.21.15.82:0/254854017 conn(0x7f08080fd110 msgr2=0x7f08080ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 shutdown_connections 2024-09-17T01:47:32.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.065+0000 7f080fe7a640 1 -- 172.21.15.82:0/254854017 wait complete. 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 -- 172.21.15.82:0/2171006661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70101a60 msgr2=0x7faf70101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 --2- 172.21.15.82:0/2171006661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70101a60 0x7faf70101ee0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf64009880 tx=0x7faf6402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 -- 172.21.15.82:0/2171006661 shutdown_connections 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 --2- 172.21.15.82:0/2171006661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70101a60 0x7faf70101ee0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 --2- 172.21.15.82:0/2171006661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70100860 0x7faf70100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 -- 172.21.15.82:0/2171006661 >> 172.21.15.82:0/2171006661 conn(0x7faf700fc010 msgr2=0x7faf700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 -- 172.21.15.82:0/2171006661 shutdown_connections 2024-09-17T01:47:32.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.150+0000 7faf757e0640 1 -- 172.21.15.82:0/2171006661 wait complete. 2024-09-17T01:47:32.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 Processor -- start 2024-09-17T01:47:32.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 -- start start 2024-09-17T01:47:32.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 0x7faf70196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf70109680 con 0x7faf70100860 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.151+0000 7faf757e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faf70109500 con 0x7faf70101a60 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49450/0 (socket says 172.21.15.82:49450) 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 -- 172.21.15.82:0/4282069022 learned_addr learned my addr 172.21.15.82:0/4282069022 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6e7fc640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 0x7faf70196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 -- 172.21.15.82:0/4282069022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 msgr2=0x7faf70196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 0x7faf70196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 -- 172.21.15.82:0/4282069022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70196f80 con 0x7faf70100860 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6e7fc640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 0x7faf70196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf6effd640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf60009fd0 tx=0x7faf60007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf6001c070 con 0x7faf70100860 2024-09-17T01:47:32.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf70069d00 con 0x7faf70100860 2024-09-17T01:47:32.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf6000ee20 con 0x7faf70100860 2024-09-17T01:47:32.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf60017640 con 0x7faf70100860 2024-09-17T01:47:32.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.152+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7006a290 con 0x7faf70100860 2024-09-17T01:47:32.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.153+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf70100c60 con 0x7faf70100860 2024-09-17T01:47:32.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.154+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7faf6001f070 con 0x7faf70100860 2024-09-17T01:47:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.154+0000 7faf57fff640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 0x7faf5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.155+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5984+0+0 (secure 0 0 0) 0x7faf60014070 con 0x7faf70100860 2024-09-17T01:47:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.155+0000 7faf6e7fc640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 0x7faf5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.155+0000 7faf6e7fc640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 0x7faf5807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf70197870 tx=0x7faf64005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.159+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7faf6006ad00 con 0x7faf70100860 2024-09-17T01:47:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.351+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf7006a5a0 con 0x7faf5807af30 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.353+0000 7faf57fff640 1 -- 172.21.15.82:0/4282069022 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7faf7006a5a0 con 0x7faf5807af30 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:47:32.351 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "osd" 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading osd daemons", 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:47:32.352 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:47:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 msgr2=0x7faf5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 0x7faf5807d3f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf70197870 tx=0x7faf64005a20 comp rx=0 tx=0).stop 2024-09-17T01:47:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 msgr2=0x7faf701963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7faf60009fd0 tx=0x7faf60007590 comp rx=0 tx=0).stop 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 shutdown_connections 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7faf5807af30 0x7faf5807d3f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faf70101a60 0x7faf70196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 --2- 172.21.15.82:0/4282069022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70100860 0x7faf701963c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.355+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 >> 172.21.15.82:0/4282069022 conn(0x7faf700fc010 msgr2=0x7faf70104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.356+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 shutdown_connections 2024-09-17T01:47:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.356+0000 7faf757e0640 1 -- 172.21.15.82:0/4282069022 wait complete. 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 -- 172.21.15.82:0/2650303814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 msgr2=0x7f40541025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 --2- 172.21.15.82:0/2650303814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f40541025f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4044009880 tx=0x7f404402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 -- 172.21.15.82:0/2650303814 shutdown_connections 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 --2- 172.21.15.82:0/2650303814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 0x7f4054104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 --2- 172.21.15.82:0/2650303814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f40541025f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.436+0000 7f4059b87640 1 -- 172.21.15.82:0/2650303814 >> 172.21.15.82:0/2650303814 conn(0x7f40540fc010 msgr2=0x7f40540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.437+0000 7f4059b87640 1 -- 172.21.15.82:0/2650303814 shutdown_connections 2024-09-17T01:47:32.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.437+0000 7f4059b87640 1 -- 172.21.15.82:0/2650303814 wait complete. 2024-09-17T01:47:32.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.437+0000 7f4059b87640 1 Processor -- start 2024-09-17T01:47:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.437+0000 7f4059b87640 1 -- start start 2024-09-17T01:47:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4059b87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4059b87640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 0x7f405419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4059b87640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4054110d90 con 0x7f40541001e0 2024-09-17T01:47:32.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4059b87640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4054110c10 con 0x7f4054102b30 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49482/0 (socket says 172.21.15.82:49482) 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 -- 172.21.15.82:0/1629002681 learned_addr learned my addr 172.21.15.82:0/1629002681 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4052ffd640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 0x7f405419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 -- 172.21.15.82:0/1629002681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 msgr2=0x7f405419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 0x7f405419e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 -- 172.21.15.82:0/1629002681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405419e6b0 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f40537fe640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4044006010 tx=0x7f40440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f404403f070 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40541a3090 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4044004ac0 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.438+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4044035030 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.439+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40541a3620 con 0x7f40541001e0 2024-09-17T01:47:32.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.439+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40541005e0 con 0x7f40541001e0 2024-09-17T01:47:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.440+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4044042070 con 0x7f40541001e0 2024-09-17T01:47:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.441+0000 7f4050ff9640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 0x7f403c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:47:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.441+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5984+0+0 (secure 0 0 0) 0x7f40440bebc0 con 0x7f40541001e0 2024-09-17T01:47:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.441+0000 7f4052ffd640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 0x7f403c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:47:32.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.441+0000 7f4052ffd640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 0x7f403c07d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4048005fd0 tx=0x7f4048005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:47:32.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.445+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f404408a270 con 0x7f40541001e0 2024-09-17T01:47:32.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.703+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f40541a3f10 con 0x7f40541001e0 2024-09-17T01:47:32.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.703+0000 7f4050ff9640 1 -- 172.21.15.82:0/1629002681 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1154 (secure 0 0 0) 0x7f404408f120 con 0x7f40541001e0 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/312 objects degraded (15.705%), 14 pgs degraded 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-17T01:47:32.702 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-17T01:47:32.703 INFO:teuthology.orchestra.run.smithi082.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 msgr2=0x7f403c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 0x7f403c07d3f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4048005fd0 tx=0x7f4048005850 comp rx=0 tx=0).stop 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 msgr2=0x7f405419daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4044006010 tx=0x7f40440046c0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 shutdown_connections 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f403c07af30 0x7f403c07d3f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4054102b30 0x7f405419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 --2- 172.21.15.82:0/1629002681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40541001e0 0x7f405419daf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:47:32.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 >> 172.21.15.82:0/1629002681 conn(0x7f40540fc010 msgr2=0x7f40540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:47:32.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 shutdown_connections 2024-09-17T01:47:32.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:47:32.705+0000 7f4059b87640 1 -- 172.21.15.82:0/1629002681 wait complete. 2024-09-17T01:47:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: pgmap v175: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s; 49/312 objects degraded (15.705%) 2024-09-17T01:47:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1237704468' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:32.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/254854017' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:47:32.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:32 smithi082 ceph-mon[92957]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: pgmap v175: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 245 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s; 49/312 objects degraded (15.705%) 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1237704468' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/254854017' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:47:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:32 smithi167 ceph-mon[76323]: osdmap e78: 6 total, 6 up, 6 in 2024-09-17T01:47:33.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:33 smithi082 ceph-mon[92957]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:33.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:33 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1629002681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:47:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:33 smithi167 ceph-mon[76323]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:47:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:33 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1629002681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:47:34.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:34 smithi082 ceph-mon[92957]: pgmap v178: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 245 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 414 B/s wr, 3 op/s; 44/312 objects degraded (14.103%) 2024-09-17T01:47:34.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:34 smithi082 ceph-mon[92957]: Health check update: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:34 smithi167 ceph-mon[76323]: pgmap v178: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 245 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 414 B/s wr, 3 op/s; 44/312 objects degraded (14.103%) 2024-09-17T01:47:35.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:34 smithi167 ceph-mon[76323]: Health check update: Degraded data redundancy: 44/312 objects degraded (14.103%), 12 pgs degraded (PG_DEGRADED) 2024-09-17T01:47:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:36 smithi082 ceph-mon[92957]: pgmap v179: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 511 B/s wr, 2 op/s; 25/312 objects degraded (8.013%); 14 B/s, 0 objects/s recovering 2024-09-17T01:47:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:36 smithi167 ceph-mon[76323]: pgmap v179: 65 pgs: 3 active+undersized, 6 active+undersized+degraded, 56 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 511 B/s wr, 2 op/s; 25/312 objects degraded (8.013%); 14 B/s, 0 objects/s recovering 2024-09-17T01:47:37.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:37 smithi082 ceph-mon[92957]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/312 objects degraded (8.013%), 6 pgs degraded) 2024-09-17T01:47:38.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:37 smithi167 ceph-mon[76323]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/312 objects degraded (8.013%), 6 pgs degraded) 2024-09-17T01:47:38.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:38 smithi082 ceph-mon[92957]: pgmap v180: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 386 B/s rd, 515 B/s wr, 1 op/s; 46 B/s, 0 objects/s recovering 2024-09-17T01:47:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:38 smithi167 ceph-mon[76323]: pgmap v180: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 386 B/s rd, 515 B/s wr, 1 op/s; 46 B/s, 0 objects/s recovering 2024-09-17T01:47:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: pgmap v181: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 46 B/s, 0 objects/s recovering 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: pgmap v181: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s; 46 B/s, 0 objects/s recovering 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:41 smithi082 ceph-mon[92957]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:41 smithi167 ceph-mon[76323]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:42 smithi082 ceph-mon[92957]: pgmap v182: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 37 B/s, 0 objects/s recovering 2024-09-17T01:47:43.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:42 smithi167 ceph-mon[76323]: pgmap v182: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 307 B/s wr, 0 op/s; 37 B/s, 0 objects/s recovering 2024-09-17T01:47:44.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:44 smithi082 ceph-mon[92957]: pgmap v183: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 279 B/s wr, 0 op/s; 33 B/s, 0 objects/s recovering 2024-09-17T01:47:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:44 smithi167 ceph-mon[76323]: pgmap v183: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 279 B/s wr, 0 op/s; 33 B/s, 0 objects/s recovering 2024-09-17T01:47:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:46 smithi082 ceph-mon[92957]: pgmap v184: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 30 B/s, 0 objects/s recovering 2024-09-17T01:47:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:46 smithi167 ceph-mon[76323]: pgmap v184: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 30 B/s, 0 objects/s recovering 2024-09-17T01:47:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:47:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:48.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:48 smithi082 ceph-mon[92957]: pgmap v185: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 23 B/s, 0 objects/s recovering 2024-09-17T01:47:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:48 smithi167 ceph-mon[76323]: pgmap v185: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s; 23 B/s, 0 objects/s recovering 2024-09-17T01:47:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: pgmap v186: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:50.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: pgmap v186: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:51.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:51.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:47:52.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:51 smithi167 ceph-mon[76323]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:51 smithi082 ceph-mon[92957]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-17T01:47:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:52 smithi167 ceph-mon[76323]: pgmap v187: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:53.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:52 smithi082 ceph-mon[92957]: pgmap v187: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:54 smithi167 ceph-mon[76323]: pgmap v188: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-17T01:47:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:54 smithi082 ceph-mon[92957]: pgmap v188: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-17T01:47:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:55 smithi167 ceph-mon[76323]: daemon mds.cephfs.smithi167.vbekqg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T01:47:56.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:55 smithi082 ceph-mon[92957]: daemon mds.cephfs.smithi167.vbekqg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-17T01:47:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:56 smithi167 ceph-mon[76323]: pgmap v189: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:56 smithi167 ceph-mon[76323]: mds.1 [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] down:stopped 2024-09-17T01:47:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:56 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 2 up:standby 2024-09-17T01:47:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:56 smithi082 ceph-mon[92957]: pgmap v189: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-17T01:47:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:56 smithi082 ceph-mon[92957]: mds.1 [v2:172.21.15.167:6824/1713530120,v1:172.21.15.167:6825/1713530120] down:stopped 2024-09-17T01:47:57.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:56 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 2 up:standby 2024-09-17T01:47:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:57 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6824/1046955956,v1:172.21.15.167:6825/1046955956] up:boot 2024-09-17T01:47:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:57 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 3 up:standby 2024-09-17T01:47:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:47:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:57 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6824/1046955956,v1:172.21.15.167:6825/1046955956] up:boot 2024-09-17T01:47:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:57 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi082.haarnz=up:active} 3 up:standby 2024-09-17T01:47:58.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:47:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:47:58 smithi167 ceph-mon[76323]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-17T01:47:59.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:47:58 smithi082 ceph-mon[92957]: pgmap v190: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-17T01:48:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:00 smithi167 ceph-mon[76323]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:00 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:00 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:00 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:00 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:01.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:00 smithi082 ceph-mon[92957]: pgmap v191: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:01.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:00 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:01.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:00 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:01.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:00 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:01.097 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:00 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.haarnz"]} : dispatch 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: Upgrade: It appears safe to stop mds.cephfs.smithi082.haarnz 2024-09-17T01:48:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.haarnz"]} : dispatch 2024-09-17T01:48:02.126 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: Upgrade: It appears safe to stop mds.cephfs.smithi082.haarnz 2024-09-17T01:48:02.127 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:02.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 -- 172.21.15.82:0/1435768936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878102f30 msgr2=0x7fe878103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 --2- 172.21.15.82:0/1435768936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878102f30 0x7fe878103330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe874009880 tx=0x7fe87402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 -- 172.21.15.82:0/1435768936 shutdown_connections 2024-09-17T01:48:02.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 --2- 172.21.15.82:0/1435768936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 0x7fe8780ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 --2- 172.21.15.82:0/1435768936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878102f30 0x7fe878103330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 -- 172.21.15.82:0/1435768936 >> 172.21.15.82:0/1435768936 conn(0x7fe8780fb760 msgr2=0x7fe8780fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:02.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 -- 172.21.15.82:0/1435768936 shutdown_connections 2024-09-17T01:48:02.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.792+0000 7fe87fb47640 1 -- 172.21.15.82:0/1435768936 wait complete. 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 Processor -- start 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 -- start start 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 0x7fe8781025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe87810a7c0 con 0x7fe878100c80 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87fb47640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe87810a640 con 0x7fe878103900 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87d0e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87d0e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54350/0 (socket says 172.21.15.82:54350) 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87d0e2640 1 -- 172.21.15.82:0/418035155 learned_addr learned my addr 172.21.15.82:0/418035155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:02.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.793+0000 7fe87d8e3640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 0x7fe8781025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87d0e2640 1 -- 172.21.15.82:0/418035155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 msgr2=0x7fe8781025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87d0e2640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 0x7fe8781025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87d0e2640 1 -- 172.21.15.82:0/418035155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe878101640 con 0x7fe878100c80 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87d0e2640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d6c0 tx=0x7fe86800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe868017070 con 0x7fe878100c80 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8680054e0 con 0x7fe878100c80 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe868004b70 con 0x7fe878100c80 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe878101930 con 0x7fe878100c80 2024-09-17T01:48:02.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.794+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87819f930 con 0x7fe878100c80 2024-09-17T01:48:02.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.795+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe878103330 con 0x7fe878100c80 2024-09-17T01:48:02.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.796+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe868009820 con 0x7fe878100c80 2024-09-17T01:48:02.796 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:02 smithi082 ceph-mon[92957]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:02.796 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:02.796 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:02.796 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:02.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.797+0000 7fe86effd640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 0x7fe86407d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:02.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.797+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5984+0+0 (secure 0 0 0) 0x7fe86809d970 con 0x7fe878100c80 2024-09-17T01:48:02.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.797+0000 7fe87d8e3640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 0x7fe86407d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:02.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.798+0000 7fe87d8e3640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 0x7fe86407d490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe874006010 tx=0x7fe8740058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:02.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.802+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe86809fe20 con 0x7fe878100c80 2024-09-17T01:48:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.997+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe878107350 con 0x7fe86407afd0 2024-09-17T01:48:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:02.998+0000 7fe86effd640 1 -- 172.21.15.82:0/418035155 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fe878107350 con 0x7fe86407afd0 2024-09-17T01:48:02.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 msgr2=0x7fe86407d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 0x7fe86407d490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe874006010 tx=0x7fe8740058d0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 msgr2=0x7fe878101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe86800d6c0 tx=0x7fe86800db80 comp rx=0 tx=0).stop 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 shutdown_connections 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe86407afd0 0x7fe86407d490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe878100c80 0x7fe878101100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 --2- 172.21.15.82:0/418035155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe878103900 0x7fe8781025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 >> 172.21.15.82:0/418035155 conn(0x7fe8780fb760 msgr2=0x7fe8780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.000+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 shutdown_connections 2024-09-17T01:48:03.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.001+0000 7fe87fb47640 1 -- 172.21.15.82:0/418035155 wait complete. 2024-09-17T01:48:03.008 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 -- 172.21.15.82:0/2483181985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 msgr2=0x7f2088100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 --2- 172.21.15.82:0/2483181985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088100c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2084009880 tx=0x7f208402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 -- 172.21.15.82:0/2483181985 shutdown_connections 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 --2- 172.21.15.82:0/2483181985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 0x7f2088101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 --2- 172.21.15.82:0/2483181985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088100c60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.082+0000 7f20901e8640 1 -- 172.21.15.82:0/2483181985 >> 172.21.15.82:0/2483181985 conn(0x7f20880fc010 msgr2=0x7f20880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 -- 172.21.15.82:0/2483181985 shutdown_connections 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 -- 172.21.15.82:0/2483181985 wait complete. 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 Processor -- start 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 -- start start 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 0x7f2088102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20881096a0 con 0x7f2088100860 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.083+0000 7f20901e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2088109520 con 0x7f2088101a60 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54356/0 (socket says 172.21.15.82:54356) 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 -- 172.21.15.82:0/1096821552 learned_addr learned my addr 172.21.15.82:0/1096821552 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208d783640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 0x7f2088102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 -- 172.21.15.82:0/1096821552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 msgr2=0x7f2088102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 0x7f2088102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 -- 172.21.15.82:0/1096821552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2088103380 con 0x7f2088100860 2024-09-17T01:48:03.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f208df84640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2084006010 tx=0x7f20840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f208403f070 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20840044d0 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2084035030 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2088103610 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.084+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2088103b40 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.086+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2088100c60 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.086+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2084042070 con 0x7f2088100860 2024-09-17T01:48:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.087+0000 7f207effd640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 0x7f207407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.087+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5984+0+0 (secure 0 0 0) 0x7f20840bec30 con 0x7f2088100860 2024-09-17T01:48:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.087+0000 7f208d783640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 0x7f207407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.087+0000 7f208d783640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 0x7f207407d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2078005fd0 tx=0x7f2078005e20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.091+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f208408a2e0 con 0x7f2088100860 2024-09-17T01:48:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:02 smithi167 ceph-mon[76323]: pgmap v192: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.haarnz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.290+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f208806a460 con 0x7f207407af30 2024-09-17T01:48:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.291+0000 7f207effd640 1 -- 172.21.15.82:0/1096821552 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f208806a460 con 0x7f207407af30 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 msgr2=0x7f207407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 0x7f207407d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2078005fd0 tx=0x7f2078005e20 comp rx=0 tx=0).stop 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 msgr2=0x7f2088104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2084006010 tx=0x7f20840048f0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 shutdown_connections 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f207407af30 0x7f207407d3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2088101a60 0x7f2088102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 --2- 172.21.15.82:0/1096821552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2088100860 0x7f2088104780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.293+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 >> 172.21.15.82:0/1096821552 conn(0x7f20880fc010 msgr2=0x7f2088069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.294+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 shutdown_connections 2024-09-17T01:48:03.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.294+0000 7f20901e8640 1 -- 172.21.15.82:0/1096821552 wait complete. 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- 172.21.15.82:0/683529908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 msgr2=0x7f9058107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 --2- 172.21.15.82:0/683529908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058107110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f904c0098b0 tx=0x7f904c02a4d0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- 172.21.15.82:0/683529908 shutdown_connections 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 --2- 172.21.15.82:0/683529908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058107110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 --2- 172.21.15.82:0/683529908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 0x7f90581047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- 172.21.15.82:0/683529908 >> 172.21.15.82:0/683529908 conn(0x7f90580fc010 msgr2=0x7f90580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- 172.21.15.82:0/683529908 shutdown_connections 2024-09-17T01:48:03.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- 172.21.15.82:0/683529908 wait complete. 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 Processor -- start 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.376+0000 7f905fb54640 1 -- start start 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 0x7f9058197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f905810a7b0 con 0x7f9058104d20 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f905810a630 con 0x7f90581023f0 2024-09-17T01:48:03.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54374/0 (socket says 172.21.15.82:54374) 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 -- 172.21.15.82:0/1687507502 learned_addr learned my addr 172.21.15.82:0/1687507502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d8f0640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 0x7f9058197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 -- 172.21.15.82:0/1687507502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 msgr2=0x7f9058197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 0x7f9058197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 -- 172.21.15.82:0/1687507502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90581980f0 con 0x7f9058104d20 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905d0ef640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f904c009230 tx=0x7f904c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f904c03f070 con 0x7f9058104d20 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905819cad0 con 0x7f9058104d20 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f904c0044d0 con 0x7f9058104d20 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905819d060 con 0x7f9058104d20 2024-09-17T01:48:03.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.377+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f904c049060 con 0x7f9058104d20 2024-09-17T01:48:03.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.378+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90581027d0 con 0x7f9058104d20 2024-09-17T01:48:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.379+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f904c042070 con 0x7f9058104d20 2024-09-17T01:48:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.380+0000 7f9056ffd640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 0x7f904007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.380+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5984+0+0 (secure 0 0 0) 0x7f904c0bece0 con 0x7f9058104d20 2024-09-17T01:48:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.380+0000 7f905d8f0640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 0x7f904007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.380+0000 7f905d8f0640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 0x7f904007d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90500058c0 tx=0x7f905000a250 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.384+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f904c0c3070 con 0x7f9058104d20 2024-09-17T01:48:03.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.574+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9058105780 con 0x7f904007af30 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.583+0000 7f9056ffd640 1 -- 172.21.15.82:0/1687507502 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f9058105780 con 0x7f904007af30 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (13m) 2m ago 14m 24.3M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (6m) 2m ago 14m 8762k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (5m) 39s ago 13m 8749k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (3m) 2m ago 14m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:48:03.582 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (3m) 39s ago 13m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (12m) 2m ago 14m 81.1M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (9m) 2m ago 9m 149M - 19.1.1-330-gc2ddf972 ebb0615149de 477d8a8847f7 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (9m) 2m ago 9m 96.0M - 19.1.1-330-gc2ddf972 ebb0615149de 707e25fa7369 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (9m) 39s ago 9m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (9m) 39s ago 9m 26.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (5m) 2m ago 15m 586M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (4m) 39s ago 13m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (4m) 2m ago 16m 113M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (4m) 39s ago 13m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (14m) 2m ago 14m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (13m) 39s ago 13m 16.5M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (3m) 2m ago 12m 150M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:48:03.583 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (2m) 2m ago 12m 153M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:48:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 2m ago 11m 80.1M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:48:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (107s) 39s ago 11m 165M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:48:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (75s) 39s ago 10m 154M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:48:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (42s) 39s ago 10m 81.4M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:48:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (4m) 2m ago 14m 69.2M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 msgr2=0x7f904007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 0x7f904007d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90500058c0 tx=0x7f905000a250 comp rx=0 tx=0).stop 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 msgr2=0x7f9058197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f904c009230 tx=0x7f904c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 shutdown_connections 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f904007af30 0x7f904007d3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9058104d20 0x7f9058197a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 --2- 172.21.15.82:0/1687507502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90581023f0 0x7f9058197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 >> 172.21.15.82:0/1687507502 conn(0x7f90580fc010 msgr2=0x7f90580fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 shutdown_connections 2024-09-17T01:48:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.585+0000 7f905fb54640 1 -- 172.21.15.82:0/1687507502 wait complete. 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 -- 172.21.15.82:0/732840986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7341011d0 msgr2=0x7fa734101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 --2- 172.21.15.82:0/732840986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7341011d0 0x7fa734101650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009880 tx=0x7fa71c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 -- 172.21.15.82:0/732840986 shutdown_connections 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 --2- 172.21.15.82:0/732840986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7341011d0 0x7fa734101650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 --2- 172.21.15.82:0/732840986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7340fffd0 0x7fa7341003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 -- 172.21.15.82:0/732840986 >> 172.21.15.82:0/732840986 conn(0x7fa7340fb760 msgr2=0x7fa7340fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 -- 172.21.15.82:0/732840986 shutdown_connections 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.679+0000 7fa73a05a640 1 -- 172.21.15.82:0/732840986 wait complete. 2024-09-17T01:48:03.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 Processor -- start 2024-09-17T01:48:03.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 -- start start 2024-09-17T01:48:03.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 0x7fa7341025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa734108580 con 0x7fa7340fffd0 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa73a05a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa734108400 con 0x7fa7341011d0 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54398/0 (socket says 172.21.15.82:54398) 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 -- 172.21.15.82:0/1692652235 learned_addr learned my addr 172.21.15.82:0/1692652235 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa72bfff640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 0x7fa7341025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 -- 172.21.15.82:0/1692652235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 msgr2=0x7fa7341025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 0x7fa7341025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa7337fe640 1 -- 172.21.15.82:0/1692652235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa734102af0 con 0x7fa7340fffd0 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.680+0000 7fa72bfff640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 0x7fa7341025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:48:03.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa7337fe640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa72400daf0 tx=0x7fa72400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa72401b070 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa734102de0 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa72400ac90 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa724016800 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.681+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa734103370 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.682+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7341003d0 con 0x7fa7340fffd0 2024-09-17T01:48:03.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.683+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa72401e070 con 0x7fa7340fffd0 2024-09-17T01:48:03.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.684+0000 7fa7317fa640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 0x7fa72007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:03.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.684+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5984+0+0 (secure 0 0 0) 0x7fa72409de10 con 0x7fa7340fffd0 2024-09-17T01:48:03.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.684+0000 7fa72bfff640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 0x7fa72007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:03.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.685+0000 7fa72bfff640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 0x7fa72007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0096c0 tx=0x7fa71c009650 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:03.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.689+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa724069540 con 0x7fa7340fffd0 2024-09-17T01:48:03.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:03 smithi082 ceph-mon[92957]: Upgrade: Updating mds.cephfs.smithi082.haarnz 2024-09-17T01:48:03.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:03 smithi082 ceph-mon[92957]: Deploying daemon mds.cephfs.smithi082.haarnz on smithi082 2024-09-17T01:48:03.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.966+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa734062df0 con 0x7fa7340fffd0 2024-09-17T01:48:03.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.967+0000 7fa7317fa640 1 -- 172.21.15.82:0/1692652235 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+731 (secure 0 0 0) 0x7fa72406e3f0 con 0x7fa7340fffd0 2024-09-17T01:48:03.966 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4 2024-09-17T01:48:03.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:03.968 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:48:03.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 4, 2024-09-17T01:48:03.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 10 2024-09-17T01:48:03.968 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:48:03.968 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 msgr2=0x7fa72007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 0x7fa72007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0096c0 tx=0x7fa71c009650 comp rx=0 tx=0).stop 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 msgr2=0x7fa734103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa72400daf0 tx=0x7fa72400a250 comp rx=0 tx=0).stop 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 shutdown_connections 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa72007af80 0x7fa72007d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7341011d0 0x7fa7341025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 --2- 172.21.15.82:0/1692652235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7340fffd0 0x7fa734103ef0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:03.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 >> 172.21.15.82:0/1692652235 conn(0x7fa7340fb760 msgr2=0x7fa734104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:03.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 shutdown_connections 2024-09-17T01:48:03.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:03.970+0000 7fa73a05a640 1 -- 172.21.15.82:0/1692652235 wait complete. 2024-09-17T01:48:04.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.051+0000 7f7e582d1640 1 -- 172.21.15.82:0/121460170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 msgr2=0x7f7e50100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.051+0000 7f7e582d1640 1 --2- 172.21.15.82:0/121460170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e50100c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009880 tx=0x7f7e4802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- 172.21.15.82:0/121460170 shutdown_connections 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 --2- 172.21.15.82:0/121460170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 0x7f7e50101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 --2- 172.21.15.82:0/121460170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e50100c60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- 172.21.15.82:0/121460170 >> 172.21.15.82:0/121460170 conn(0x7f7e500fc010 msgr2=0x7f7e500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- 172.21.15.82:0/121460170 shutdown_connections 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- 172.21.15.82:0/121460170 wait complete. 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 Processor -- start 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- start start 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 0x7f7e5019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50109680 con 0x7f7e50100860 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.052+0000 7f7e582d1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50109500 con 0x7f7e50101a60 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54416/0 (socket says 172.21.15.82:54416) 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 -- 172.21.15.82:0/1648775914 learned_addr learned my addr 172.21.15.82:0/1648775914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5586c640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 0x7f7e5019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 -- 172.21.15.82:0/1648775914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 msgr2=0x7f7e5019e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 0x7f7e5019e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 -- 172.21.15.82:0/1648775914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5019eb40 con 0x7f7e50100860 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e5606d640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006010 tx=0x7f7e480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e4803f070 con 0x7f7e50100860 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5019ed10 con 0x7f7e50100860 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e48004a50 con 0x7f7e50100860 2024-09-17T01:48:04.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e48035030 con 0x7f7e50100860 2024-09-17T01:48:04.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.053+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5019f1c0 con 0x7f7e50100860 2024-09-17T01:48:04.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.054+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e50100c60 con 0x7f7e50100860 2024-09-17T01:48:04.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.055+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7e48042070 con 0x7f7e50100860 2024-09-17T01:48:04.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.055+0000 7f7e4f7fe640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 0x7f7e3807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.055+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5984+0+0 (secure 0 0 0) 0x7f7e480beb40 con 0x7f7e50100860 2024-09-17T01:48:04.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.055+0000 7f7e5586c640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 0x7f7e3807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.056+0000 7f7e5586c640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 0x7f7e3807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e5006a510 tx=0x7f7e4400b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.060+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7e48004c00 con 0x7f7e50100860 2024-09-17T01:48:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:03 smithi167 ceph-mon[76323]: Upgrade: Updating mds.cephfs.smithi082.haarnz 2024-09-17T01:48:04.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:03 smithi167 ceph-mon[76323]: Deploying daemon mds.cephfs.smithi082.haarnz on smithi082 2024-09-17T01:48:04.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.289+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7e5019faa0 con 0x7f7e50100860 2024-09-17T01:48:04.289 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[92953]: 2024-09-17T01:48:04.064+0000 7f2ca023d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.290+0000 7f7e4f7fe640 1 -- 172.21.15.82:0/1648775914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+1835 (secure 0 0 0) 0x7f7e4808a160 con 0x7f7e50100860 2024-09-17T01:48:04.289 INFO:teuthology.orchestra.run.smithi082.stdout:e20 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:48:04:071505+0000 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 20 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:48:04.071489+0000 2024-09-17T01:48:04.290 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 79 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34227} 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:48:04.291 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{0:34227} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-09-17T01:48:04.292 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:04.293 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{-1:34259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.167:6824/1046955956,v1:172.21.15.167:6825/1046955956] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:04.293 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{-1:34294} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/2234505694,v1:172.21.15.82:6829/2234505694] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:04.293 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 20 2024-09-17T01:48:04.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 msgr2=0x7f7e3807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 0x7f7e3807d3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7e5006a510 tx=0x7f7e4400b390 comp rx=0 tx=0).stop 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 msgr2=0x7f7e5006a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e48006010 tx=0x7f7e480045e0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 shutdown_connections 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7e3807af30 0x7f7e3807d3f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e50101a60 0x7f7e5019e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 --2- 172.21.15.82:0/1648775914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e50100860 0x7f7e5006a790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 >> 172.21.15.82:0/1648775914 conn(0x7f7e500fc010 msgr2=0x7f7e500fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 shutdown_connections 2024-09-17T01:48:04.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.292+0000 7f7e582d1640 1 -- 172.21.15.82:0/1648775914 wait complete. 2024-09-17T01:48:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 -- 172.21.15.82:0/3318739372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8101960 msgr2=0x7f50d8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 --2- 172.21.15.82:0/3318739372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8101960 0x7f50d8101d60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009880 tx=0x7f50d002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 -- 172.21.15.82:0/3318739372 shutdown_connections 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 --2- 172.21.15.82:0/3318739372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8102b60 0x7f50d8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 --2- 172.21.15.82:0/3318739372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8101960 0x7f50d8101d60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 -- 172.21.15.82:0/3318739372 >> 172.21.15.82:0/3318739372 conn(0x7f50d80fd0f0 msgr2=0x7f50d80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 -- 172.21.15.82:0/3318739372 shutdown_connections 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 -- 172.21.15.82:0/3318739372 wait complete. 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.375+0000 7f50df52d640 1 Processor -- start 2024-09-17T01:48:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50df52d640 1 -- start start 2024-09-17T01:48:04.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50df52d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 0x7f50d8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50df52d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50df52d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50d810a7a0 con 0x7f50d8102b60 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50df52d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50d810a620 con 0x7f50d8101960 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54438/0 (socket says 172.21.15.82:54438) 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 -- 172.21.15.82:0/942704407 learned_addr learned my addr 172.21.15.82:0/942704407 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dd2c9640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 0x7f50d8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 -- 172.21.15.82:0/942704407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 msgr2=0x7f50d8197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 0x7f50d8197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 -- 172.21.15.82:0/942704407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d81980c0 con 0x7f50d8102b60 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dd2c9640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 0x7f50d8197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.376+0000 7f50dcac8640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00eb10 tx=0x7f50cc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.377+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50cc00cce0 con 0x7f50d8102b60 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.377+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50cc005020 con 0x7f50d8102b60 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.377+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d819cb00 con 0x7f50d8102b60 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.377+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50cc010660 con 0x7f50d8102b60 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.377+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d819d090 con 0x7f50d8102b60 2024-09-17T01:48:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.378+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d8101d60 con 0x7f50d8102b60 2024-09-17T01:48:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.378+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f50cc0051d0 con 0x7f50d8102b60 2024-09-17T01:48:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.379+0000 7f50d67fc640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 0x7f50c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.379+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f50cc09e800 con 0x7f50d8102b60 2024-09-17T01:48:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.379+0000 7f50dd2c9640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 0x7f50c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.379+0000 7f50dd2c9640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 0x7f50c007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009230 tx=0x7f50d00058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.383+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f50cc069e50 con 0x7f50d8102b60 2024-09-17T01:48:04.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.576+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f50d8062630 con 0x7f50c007af30 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.578+0000 7f50d67fc640 1 -- 172.21.15.82:0/942704407 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f50d8062630 con 0x7f50c007af30 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:48:04.577 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout: "osd" 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "12/23 daemons upgraded", 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:48:04.578 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:48:04.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 msgr2=0x7f50c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 0x7f50c007d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009230 tx=0x7f50d00058d0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 msgr2=0x7f50d8197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00eb10 tx=0x7f50cc00c2d0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 shutdown_connections 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50c007af30 0x7f50c007d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d8102b60 0x7f50d8197a40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 --2- 172.21.15.82:0/942704407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50d8101960 0x7f50d8197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 >> 172.21.15.82:0/942704407 conn(0x7f50d80fd0f0 msgr2=0x7f50d8106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 shutdown_connections 2024-09-17T01:48:04.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.580+0000 7f50df52d640 1 -- 172.21.15.82:0/942704407 wait complete. 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 -- 172.21.15.82:0/2989929305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58101a60 msgr2=0x7f6a58101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 --2- 172.21.15.82:0/2989929305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58101a60 0x7f6a58101ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009880 tx=0x7f6a4402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 -- 172.21.15.82:0/2989929305 shutdown_connections 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 --2- 172.21.15.82:0/2989929305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58101a60 0x7f6a58101ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 --2- 172.21.15.82:0/2989929305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58100860 0x7f6a58100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 -- 172.21.15.82:0/2989929305 >> 172.21.15.82:0/2989929305 conn(0x7f6a580fc010 msgr2=0x7f6a580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 -- 172.21.15.82:0/2989929305 shutdown_connections 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.663+0000 7f6a5f042640 1 -- 172.21.15.82:0/2989929305 wait complete. 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 Processor -- start 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 -- start start 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 0x7f6a58197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5806aa60 con 0x7f6a58100860 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5f042640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5806a8e0 con 0x7f6a58101a60 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54464/0 (socket says 172.21.15.82:54464) 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 -- 172.21.15.82:0/3913736308 learned_addr learned my addr 172.21.15.82:0/3913736308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a57fff640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 0x7f6a58197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 -- 172.21.15.82:0/3913736308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 msgr2=0x7f6a58197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 0x7f6a58197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 -- 172.21.15.82:0/3913736308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a58198090 con 0x7f6a58100860 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a57fff640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 0x7f6a58197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.664+0000 7f6a5cdde640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e940 tx=0x7f6a4c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.665+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a4c00cac0 con 0x7f6a58100860 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.665+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5819cad0 con 0x7f6a58100860 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.665+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a4c00cc60 con 0x7f6a58100860 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.665+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6a4c003e30 con 0x7f6a58100860 2024-09-17T01:48:04.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.665+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5819d030 con 0x7f6a58100860 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.666+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58100c60 con 0x7f6a58100860 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.666+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6a4c004000 con 0x7f6a58100860 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.667+0000 7f6a55ffb640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 0x7f6a4807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.667+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6070+0+0 (secure 0 0 0) 0x7f6a4c09e550 con 0x7f6a58100860 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.667+0000 7f6a57fff640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 0x7f6a4807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:04.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.668+0000 7f6a57fff640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 0x7f6a4807d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a440058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:04.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.672+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6a4c069ba0 con 0x7f6a58100860 2024-09-17T01:48:04.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.924+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6a58062df0 con 0x7f6a58100860 2024-09-17T01:48:04.923 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1692652235' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: Standby daemon mds.cephfs.smithi167.ypfdyj assigned to filesystem cephfs as rank 0 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:replay} 2 up:standby 2024-09-17T01:48:04.924 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:04 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1648775914' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.924+0000 7f6a55ffb640 1 -- 172.21.15.82:0/3913736308 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f6a4c06ea50 con 0x7f6a58100860 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs is degraded 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:48:04.925 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:48:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 msgr2=0x7f6a4807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 0x7f6a4807d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a440058d0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 msgr2=0x7f6a581974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e940 tx=0x7f6a4c00ee00 comp rx=0 tx=0).stop 2024-09-17T01:48:04.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 shutdown_connections 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6a4807af30 0x7f6a4807d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a58101a60 0x7f6a58197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 --2- 172.21.15.82:0/3913736308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a58100860 0x7f6a581974d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 >> 172.21.15.82:0/3913736308 conn(0x7f6a580fc010 msgr2=0x7f6a58104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 shutdown_connections 2024-09-17T01:48:04.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:04.928+0000 7f6a5f042640 1 -- 172.21.15.82:0/3913736308 wait complete. 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: pgmap v193: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1692652235' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: osdmap e79: 6 total, 6 up, 6 in 2024-09-17T01:48:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: Standby daemon mds.cephfs.smithi167.ypfdyj assigned to filesystem cephfs as rank 0 2024-09-17T01:48:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:48:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:48:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:replay} 2 up:standby 2024-09-17T01:48:05.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:04 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1648775914' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:48:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:05 smithi082 ceph-mon[92957]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:06.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:05 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3913736308' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:48:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:05 smithi167 ceph-mon[76323]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:05 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3913736308' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:48:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:06 smithi082 ceph-mon[92957]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 0 op/s 2024-09-17T01:48:07.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:48:07.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:06 smithi167 ceph-mon[76323]: pgmap v195: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 0 op/s 2024-09-17T01:48:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:48:08.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:07 smithi082 ceph-mon[92957]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-17T01:48:08.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:07 smithi167 ceph-mon[76323]: pgmap v196: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-17T01:48:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:10 smithi082 ceph-mon[92957]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-17T01:48:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:10 smithi167 ceph-mon[76323]: pgmap v197: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-17T01:48:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:12 smithi082 ceph-mon[92957]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:48:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:12 smithi167 ceph-mon[76323]: pgmap v198: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:48:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:13 smithi082 ceph-mon[92957]: reconnect by client.24333 192.168.0.1:0/2452546215 after 0.000999981 2024-09-17T01:48:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:13 smithi082 ceph-mon[92957]: reconnect by client.14622 192.168.0.1:0/2424388004 after 0.000999981 2024-09-17T01:48:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:13 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:reconnect 2024-09-17T01:48:13.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:13 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:reconnect} 2 up:standby 2024-09-17T01:48:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:13 smithi167 ceph-mon[76323]: reconnect by client.24333 192.168.0.1:0/2452546215 after 0.000999981 2024-09-17T01:48:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:13 smithi167 ceph-mon[76323]: reconnect by client.14622 192.168.0.1:0/2424388004 after 0.000999981 2024-09-17T01:48:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:13 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:reconnect 2024-09-17T01:48:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:13 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:reconnect} 2 up:standby 2024-09-17T01:48:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:14 smithi082 ceph-mon[92957]: pgmap v199: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-17T01:48:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:14 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:rejoin 2024-09-17T01:48:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:14 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:rejoin} 2 up:standby 2024-09-17T01:48:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:14 smithi082 ceph-mon[92957]: daemon mds.cephfs.smithi167.ypfdyj is now active in filesystem cephfs as rank 0 2024-09-17T01:48:14.993 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:14 smithi167 ceph-mon[76323]: pgmap v199: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-09-17T01:48:14.993 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:14 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:rejoin 2024-09-17T01:48:14.993 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:14 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.ypfdyj=up:rejoin} 2 up:standby 2024-09-17T01:48:14.993 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:14 smithi167 ceph-mon[76323]: daemon mds.cephfs.smithi167.ypfdyj is now active in filesystem cephfs as rank 0 2024-09-17T01:48:15.678 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:15 smithi082 ceph-mon[92957]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:48:15.678 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:15 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:active 2024-09-17T01:48:15.678 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:15 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:15 smithi167 ceph-mon[76323]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:48:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:15 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] up:active 2024-09-17T01:48:16.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:15 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:16 smithi082 ceph-mon[92957]: pgmap v200: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T01:48:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:16 smithi167 ceph-mon[76323]: pgmap v200: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-17T01:48:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:17.897 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:17 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] up:boot 2024-09-17T01:48:17.897 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:17 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:17.897 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:17 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:48:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:17 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] up:boot 2024-09-17T01:48:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:17 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:18.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:17 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:48:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:18 smithi082 ceph-mon[92957]: pgmap v201: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T01:48:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:18 smithi167 ceph-mon[76323]: pgmap v201: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T01:48:20.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:20 smithi082 ceph-mon[92957]: pgmap v202: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:48:20.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:20.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:21.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:20 smithi167 ceph-mon[76323]: pgmap v202: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:48:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:22.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:22.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:22.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:22 smithi082 ceph-mon[92957]: pgmap v203: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-17T01:48:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:22 smithi167 ceph-mon[76323]: pgmap v203: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-17T01:48:24.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: pgmap v204: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:48:24.878 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:24.879 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:24.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:24.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:24.880 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:24 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.pwukvc"]} : dispatch 2024-09-17T01:48:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: pgmap v204: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:48:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:25.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:24 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi082.pwukvc"]} : dispatch 2024-09-17T01:48:25.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:25 smithi082 ceph-mon[92957]: Upgrade: It appears safe to stop mds.cephfs.smithi082.pwukvc 2024-09-17T01:48:26.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:25 smithi167 ceph-mon[76323]: Upgrade: It appears safe to stop mds.cephfs.smithi082.pwukvc 2024-09-17T01:48:26.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:26 smithi082 ceph-mon[92957]: pgmap v205: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:48:26.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:26 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:26.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:26 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:26.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:26 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:26 smithi167 ceph-mon[76323]: pgmap v205: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:48:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:26 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:26 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi082.pwukvc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:26 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:27.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:27 smithi082 ceph-mon[92957]: Upgrade: Updating mds.cephfs.smithi082.pwukvc 2024-09-17T01:48:27.653 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:27 smithi082 ceph-mon[92957]: Deploying daemon mds.cephfs.smithi082.pwukvc on smithi082 2024-09-17T01:48:28.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:27 smithi167 ceph-mon[76323]: Upgrade: Updating mds.cephfs.smithi082.pwukvc 2024-09-17T01:48:28.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:27 smithi167 ceph-mon[76323]: Deploying daemon mds.cephfs.smithi082.pwukvc on smithi082 2024-09-17T01:48:28.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:28 smithi082 ceph-mon[92957]: pgmap v206: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-17T01:48:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:28 smithi167 ceph-mon[76323]: pgmap v206: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-17T01:48:29.869 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:29 smithi082 ceph-mon[92957]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T01:48:29.870 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:29 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:30.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:29 smithi167 ceph-mon[76323]: osdmap e80: 6 total, 6 up, 6 in 2024-09-17T01:48:30.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:29 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:30.815 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:30 smithi082 ceph-mon[92957]: pgmap v208: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s wr, 2 op/s 2024-09-17T01:48:31.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:30 smithi167 ceph-mon[76323]: pgmap v208: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s wr, 2 op/s 2024-09-17T01:48:32.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:32.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:32.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:32.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:32.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: pgmap v209: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:32.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] up:boot 2024-09-17T01:48:32.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:32.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: pgmap v209: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] up:boot 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:32.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:48:34.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:34 smithi082 ceph-mon[92957]: pgmap v210: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:35.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:34 smithi167 ceph-mon[76323]: pgmap v210: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 -- 172.21.15.82:0/690559242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 msgr2=0x7fd3dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/690559242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc101d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009880 tx=0x7fd3cc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 -- 172.21.15.82:0/690559242 shutdown_connections 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/690559242 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 0x7fd3dc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/690559242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc101d60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 -- 172.21.15.82:0/690559242 >> 172.21.15.82:0/690559242 conn(0x7fd3dc0fd0f0 msgr2=0x7fd3dc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 -- 172.21.15.82:0/690559242 shutdown_connections 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.015+0000 7fd3e1d99640 1 -- 172.21.15.82:0/690559242 wait complete. 2024-09-17T01:48:35.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 Processor -- start 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 -- start start 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 0x7fd3dc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc10a780 con 0x7fd3dc101960 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.016+0000 7fd3e1d99640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc10a600 con 0x7fd3dc102b60 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52946/0 (socket says 172.21.15.82:52946) 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 -- 172.21.15.82:0/3797054556 learned_addr learned my addr 172.21.15.82:0/3797054556 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3daffd640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 0x7fd3dc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 -- 172.21.15.82:0/3797054556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 msgr2=0x7fd3dc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 0x7fd3dc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 -- 172.21.15.82:0/3797054556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc074b20 con 0x7fd3dc101960 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3db7fe640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc006010 tx=0x7fd3cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc03f070 con 0x7fd3dc101960 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc074db0 con 0x7fd3dc101960 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3cc004a50 con 0x7fd3dc101960 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc035030 con 0x7fd3dc101960 2024-09-17T01:48:35.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.017+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc0752e0 con 0x7fd3dc101960 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.018+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc101d60 con 0x7fd3dc101960 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.019+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd3cc042070 con 0x7fd3dc101960 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.019+0000 7fd3d8ff9640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 0x7fd3c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.020+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7fd3cc0bea80 con 0x7fd3dc101960 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.020+0000 7fd3daffd640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 0x7fd3c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.020+0000 7fd3daffd640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 0x7fd3c407d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc075ca0 tx=0x7fd3d000b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.024+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd3cc004c00 con 0x7fd3dc101960 2024-09-17T01:48:35.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.234+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd3dc062630 con 0x7fd3c407af30 2024-09-17T01:48:35.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.236+0000 7fd3d8ff9640 1 -- 172.21.15.82:0/3797054556 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fd3dc062630 con 0x7fd3c407af30 2024-09-17T01:48:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 msgr2=0x7fd3c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 0x7fd3c407d3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc075ca0 tx=0x7fd3d000b390 comp rx=0 tx=0).stop 2024-09-17T01:48:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 msgr2=0x7fd3dc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc006010 tx=0x7fd3cc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 shutdown_connections 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd3c407af30 0x7fd3c407d3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3dc102b60 0x7fd3dc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 --2- 172.21.15.82:0/3797054556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3dc101960 0x7fd3dc075f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 >> 172.21.15.82:0/3797054556 conn(0x7fd3dc0fd0f0 msgr2=0x7fd3dc105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 shutdown_connections 2024-09-17T01:48:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.238+0000 7fd3e1d99640 1 -- 172.21.15.82:0/3797054556 wait complete. 2024-09-17T01:48:35.245 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.321+0000 7f138fdfb640 1 -- 172.21.15.82:0/2035190900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388101a60 msgr2=0x7f1388101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.321+0000 7f138fdfb640 1 --2- 172.21.15.82:0/2035190900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388101a60 0x7f1388101ee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f137c009880 tx=0x7f137c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 -- 172.21.15.82:0/2035190900 shutdown_connections 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 --2- 172.21.15.82:0/2035190900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388101a60 0x7f1388101ee0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 --2- 172.21.15.82:0/2035190900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388100860 0x7f1388100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 -- 172.21.15.82:0/2035190900 >> 172.21.15.82:0/2035190900 conn(0x7f13880fc010 msgr2=0x7f13880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 -- 172.21.15.82:0/2035190900 shutdown_connections 2024-09-17T01:48:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 -- 172.21.15.82:0/2035190900 wait complete. 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 Processor -- start 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.322+0000 7f138fdfb640 1 -- start start 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138fdfb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138fdfb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 0x7f138819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138fdfb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1388109680 con 0x7f1388100860 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138fdfb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1388109500 con 0x7f1388101a60 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52964/0 (socket says 172.21.15.82:52964) 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 -- 172.21.15.82:0/3126915912 learned_addr learned my addr 172.21.15.82:0/3126915912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138d396640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 0x7f138819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 -- 172.21.15.82:0/3126915912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 msgr2=0x7f138819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 0x7f138819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 -- 172.21.15.82:0/3126915912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138819c760 con 0x7f1388100860 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138d396640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 0x7f138819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138db97640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f137800cc60 tx=0x7f137800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f137800ae50 con 0x7f1388100860 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1378003e30 con 0x7f1388100860 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138819ca50 con 0x7f1388100860 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.323+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f137800f680 con 0x7f1388100860 2024-09-17T01:48:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.324+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138819cfe0 con 0x7f1388100860 2024-09-17T01:48:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.325+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1388100c60 con 0x7f1388100860 2024-09-17T01:48:35.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.325+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1378003fe0 con 0x7f1388100860 2024-09-17T01:48:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.326+0000 7f1386ffd640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 0x7f137007d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.326+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7f137809e3a0 con 0x7f1388100860 2024-09-17T01:48:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.326+0000 7f138d396640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 0x7f137007d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.326+0000 7f138d396640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 0x7f137007d5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f138806a510 tx=0x7f137c005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.330+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1378014070 con 0x7f1388100860 2024-09-17T01:48:35.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.524+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1388062630 con 0x7f137007b0e0 2024-09-17T01:48:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.525+0000 7f1386ffd640 1 -- 172.21.15.82:0/3126915912 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1388062630 con 0x7f137007b0e0 2024-09-17T01:48:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 msgr2=0x7f137007d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 0x7f137007d5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f138806a510 tx=0x7f137c005a20 comp rx=0 tx=0).stop 2024-09-17T01:48:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 msgr2=0x7f138806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f137800cc60 tx=0x7f137800a620 comp rx=0 tx=0).stop 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 shutdown_connections 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f137007b0e0 0x7f137007d5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1388101a60 0x7f138819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 --2- 172.21.15.82:0/3126915912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1388100860 0x7f138806a790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 >> 172.21.15.82:0/3126915912 conn(0x7f13880fc010 msgr2=0x7f1388104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 shutdown_connections 2024-09-17T01:48:35.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.527+0000 7f138fdfb640 1 -- 172.21.15.82:0/3126915912 wait complete. 2024-09-17T01:48:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.618+0000 7fcab4605640 1 -- 172.21.15.82:0/3402767050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 msgr2=0x7fcaac101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.618+0000 7fcab4605640 1 --2- 172.21.15.82:0/3402767050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac101d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009880 tx=0x7fcaa802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 -- 172.21.15.82:0/3402767050 shutdown_connections 2024-09-17T01:48:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 --2- 172.21.15.82:0/3402767050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 0x7fcaac102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 --2- 172.21.15.82:0/3402767050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac101d70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 -- 172.21.15.82:0/3402767050 >> 172.21.15.82:0/3402767050 conn(0x7fcaac0fd140 msgr2=0x7fcaac0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 -- 172.21.15.82:0/3402767050 shutdown_connections 2024-09-17T01:48:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.619+0000 7fcab4605640 1 -- 172.21.15.82:0/3402767050 wait complete. 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 Processor -- start 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 -- start start 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 0x7fcaac1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac10a790 con 0x7fcaac101970 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab4605640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac10a610 con 0x7fcaac102b70 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab23a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab23a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52974/0 (socket says 172.21.15.82:52974) 2024-09-17T01:48:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab23a1640 1 -- 172.21.15.82:0/3990527553 learned_addr learned my addr 172.21.15.82:0/3990527553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.620+0000 7fcab1ba0640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 0x7fcaac1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcab23a1640 1 -- 172.21.15.82:0/3990527553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 msgr2=0x7fcaac1979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcab23a1640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 0x7fcaac1979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcab23a1640 1 -- 172.21.15.82:0/3990527553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac198050 con 0x7fcaac101970 2024-09-17T01:48:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcab23a1640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009230 tx=0x7fcaa80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcaa803f070 con 0x7fcaac101970 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcaa80044d0 con 0x7fcaac101970 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.621+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcaa8035030 con 0x7fcaac101970 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.622+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaac19ca30 con 0x7fcaac101970 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.622+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaac19cfc0 con 0x7fcaac101970 2024-09-17T01:48:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.623+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac101d70 con 0x7fcaac101970 2024-09-17T01:48:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.624+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcaa8042070 con 0x7fcaac101970 2024-09-17T01:48:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.625+0000 7fcaa37fe640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 0x7fca9807d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.625+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7fcaa80bea40 con 0x7fcaac101970 2024-09-17T01:48:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.625+0000 7fcab1ba0640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 0x7fca9807d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.626+0000 7fcab1ba0640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 0x7fca9807d4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaac198940 tx=0x7fca9c00a2d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.633+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcaa808a1b0 con 0x7fcaac101970 2024-09-17T01:48:35.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.872+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcaac107110 con 0x7fca9807afe0 2024-09-17T01:48:35.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.882+0000 7fcaa37fe640 1 -- 172.21.15.82:0/3990527553 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fcaac107110 con 0x7fca9807afe0 2024-09-17T01:48:35.880 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:48:35.880 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (13m) 0s ago 15m 25.1M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:48:35.880 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (6m) 0s ago 15m 8984k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:48:35.880 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (6m) 71s ago 14m 8749k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (4m) 0s ago 15m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (4m) 71s ago 14m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (13m) 0s ago 14m 78.4M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (20s) 0s ago 9m 81.1M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (5s) 0s ago 9m 80.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (9m) 71s ago 9m 29.8M - 19.1.1-330-gc2ddf972 ebb0615149de 49ff2ec154a8 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (9m) 71s ago 9m 26.6M - 19.1.1-330-gc2ddf972 ebb0615149de 12e40d1a89aa 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (6m) 0s ago 16m 591M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (5m) 71s ago 14m 523M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (4m) 0s ago 16m 117M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (4m) 71s ago 14m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (15m) 0s ago 15m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:48:35.881 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (14m) 71s ago 14m 16.5M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 0s ago 13m 159M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (3m) 0s ago 12m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (2m) 0s ago 12m 154M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (2m) 71s ago 11m 165M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (107s) 71s ago 11m 154M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (75s) 71s ago 10m 81.4M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:48:35.882 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 0s ago 14m 69.3M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 msgr2=0x7fca9807d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 0x7fca9807d4a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaac198940 tx=0x7fca9c00a2d0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 msgr2=0x7fcaac197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009230 tx=0x7fcaa80048f0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 shutdown_connections 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fca9807afe0 0x7fca9807d4a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcaac102b70 0x7fcaac1979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 --2- 172.21.15.82:0/3990527553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcaac101970 0x7fcaac197490 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.884+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 >> 172.21.15.82:0/3990527553 conn(0x7fcaac0fd140 msgr2=0x7fcaac0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.885+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 shutdown_connections 2024-09-17T01:48:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.885+0000 7fcab4605640 1 -- 172.21.15.82:0/3990527553 wait complete. 2024-09-17T01:48:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 -- 172.21.15.82:0/2331166372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 msgr2=0x7fcbdc103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 --2- 172.21.15.82:0/2331166372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc103080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009880 tx=0x7fcbd002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 -- 172.21.15.82:0/2331166372 shutdown_connections 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 --2- 172.21.15.82:0/2331166372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc103080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 --2- 172.21.15.82:0/2331166372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 0x7fcbdc100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 -- 172.21.15.82:0/2331166372 >> 172.21.15.82:0/2331166372 conn(0x7fcbdc0fb770 msgr2=0x7fcbdc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 -- 172.21.15.82:0/2331166372 shutdown_connections 2024-09-17T01:48:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.967+0000 7fcbe1897640 1 -- 172.21.15.82:0/2331166372 wait complete. 2024-09-17T01:48:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 Processor -- start 2024-09-17T01:48:35.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 -- start start 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 0x7fcbdc197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10a820 con 0x7fcbdc102c00 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbe1897640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc10a6a0 con 0x7fcbdc0ffc20 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbda7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbda7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52996/0 (socket says 172.21.15.82:52996) 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.968+0000 7fcbda7fc640 1 -- 172.21.15.82:0/105728057 learned_addr learned my addr 172.21.15.82:0/105728057 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 0x7fcbdc197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbda7fc640 1 -- 172.21.15.82:0/105728057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 msgr2=0x7fcbdc197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbda7fc640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 0x7fcbdc197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbda7fc640 1 -- 172.21.15.82:0/105728057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc1980d0 con 0x7fcbdc102c00 2024-09-17T01:48:35.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbda7fc640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0006010 tx=0x7fcbd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd003f070 con 0x7fcbdc102c00 2024-09-17T01:48:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc19cab0 con 0x7fcbdc102c00 2024-09-17T01:48:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbd00044d0 con 0x7fcbdc102c00 2024-09-17T01:48:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbd0035030 con 0x7fcbdc102c00 2024-09-17T01:48:35.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.969+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc19d0c0 con 0x7fcbdc102c00 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.971+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc100000 con 0x7fcbdc102c00 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.971+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcbd0042070 con 0x7fcbdc102c00 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.971+0000 7fcbe0895640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 0x7fcbc407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.972+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7fcbd00beb80 con 0x7fcbdc102c00 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.972+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 0x7fcbc407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:35.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.972+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 0x7fcbc407d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc069fb0 tx=0x7fcbcc009110 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:35.976+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcbd008a250 con 0x7fcbdc102c00 2024-09-17T01:48:36.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.240+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcbdc062df0 con 0x7fcbdc102c00 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.240+0000 7fcbe0895640 1 -- 172.21.15.82:0/105728057 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fcbd008c770 con 0x7fcbdc102c00 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:48:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.1.1-330-gc2ddf972 (c2ddf9721ef254645201cdbabd9c8f49c30a586f) squid (stable)": 2, 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 12 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:48:36.240 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 msgr2=0x7fcbc407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 0x7fcbc407d440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc069fb0 tx=0x7fcbcc009110 comp rx=0 tx=0).stop 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 msgr2=0x7fcbdc197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0006010 tx=0x7fcbd00048f0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 shutdown_connections 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcbc407af80 0x7fcbc407d440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc102c00 0x7fcbdc197a50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 --2- 172.21.15.82:0/105728057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbdc0ffc20 0x7fcbdc197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 >> 172.21.15.82:0/105728057 conn(0x7fcbdc0fb770 msgr2=0x7fcbdc1060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 shutdown_connections 2024-09-17T01:48:36.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.243+0000 7fcbe1897640 1 -- 172.21.15.82:0/105728057 wait complete. 2024-09-17T01:48:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 -- 172.21.15.82:0/4156099450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 msgr2=0x7f6664100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 --2- 172.21.15.82:0/4156099450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f6664100c60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6654009880 tx=0x7f665402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 -- 172.21.15.82:0/4156099450 shutdown_connections 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 --2- 172.21.15.82:0/4156099450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 0x7f6664101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 --2- 172.21.15.82:0/4156099450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f6664100c60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 -- 172.21.15.82:0/4156099450 >> 172.21.15.82:0/4156099450 conn(0x7f66640fc010 msgr2=0x7f66640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 -- 172.21.15.82:0/4156099450 shutdown_connections 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.327+0000 7f666a8d2640 1 -- 172.21.15.82:0/4156099450 wait complete. 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 Processor -- start 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 -- start start 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 0x7f6664197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6664109680 con 0x7f6664100860 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f666a8d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6664109500 con 0x7f6664101a60 2024-09-17T01:48:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f6663fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f6663fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53010/0 (socket says 172.21.15.82:53010) 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f6663fff640 1 -- 172.21.15.82:0/2081833153 learned_addr learned my addr 172.21.15.82:0/2081833153 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.328+0000 7f665bfff640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 0x7f6664197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6663fff640 1 -- 172.21.15.82:0/2081833153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 msgr2=0x7f6664197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6663fff640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 0x7f6664197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6663fff640 1 -- 172.21.15.82:0/2081833153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66641980b0 con 0x7f6664100860 2024-09-17T01:48:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6663fff640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6654006010 tx=0x7f66540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f665403f070 con 0x7f6664100860 2024-09-17T01:48:36.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666419ca90 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6654004a50 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6654035030 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.329+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666419d020 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.330+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6664100c60 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.331+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6654042070 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.331+0000 7f6661ffb640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 0x7f665007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.331+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7f66540bea00 con 0x7f6664100860 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.331+0000 7f665bfff640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 0x7f665007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.332+0000 7f665bfff640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 0x7f665007d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66641989a0 tx=0x7f664c00b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.336+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f665408a0d0 con 0x7f6664100860 2024-09-17T01:48:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.559+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f666419d850 con 0x7f6664100860 2024-09-17T01:48:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.559+0000 7f6661ffb640 1 -- 172.21.15.82:0/2081833153 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+2020 (secure 0 0 0) 0x7f665408ef80 con 0x7f6664100860 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:e26 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:48:31:635075+0000 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 23 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:48:36.558 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:48:14.620977+0000 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 79 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-09-17T01:48:36.559 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34227} 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34227 members: 34227 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{0:34227} state up:active seq 14 join_fscid=1 addr [v2:172.21.15.167:6826/3290052476,v1:172.21.15.167:6827/3290052476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:36.560 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{-1:34259} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.167:6824/1046955956,v1:172.21.15.167:6825/1046955956] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{-1:34358} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:36.561 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{-1:34362} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.561+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 msgr2=0x7f665007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.561+0000 7f666a8d2640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 0x7f665007d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f66641989a0 tx=0x7f664c00b390 comp rx=0 tx=0).stop 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.561+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 msgr2=0x7f66641974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.561+0000 7f666a8d2640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6654006010 tx=0x7f66540045e0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.561+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 shutdown_connections 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f665007af80 0x7f665007d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6664101a60 0x7f6664197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 --2- 172.21.15.82:0/2081833153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6664100860 0x7f66641974f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 >> 172.21.15.82:0/2081833153 conn(0x7f66640fc010 msgr2=0x7f6664069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 shutdown_connections 2024-09-17T01:48:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.562+0000 7f666a8d2640 1 -- 172.21.15.82:0/2081833153 wait complete. 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.652+0000 7f1183b94640 1 -- 172.21.15.82:0/2786940572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101960 msgr2=0x7f117c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.652+0000 7f1183b94640 1 --2- 172.21.15.82:0/2786940572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101960 0x7f117c101d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1178009880 tx=0x7f117802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 -- 172.21.15.82:0/2786940572 shutdown_connections 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 --2- 172.21.15.82:0/2786940572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c102b60 0x7f117c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 --2- 172.21.15.82:0/2786940572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c101960 0x7f117c101d60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 -- 172.21.15.82:0/2786940572 >> 172.21.15.82:0/2786940572 conn(0x7f117c0fd0f0 msgr2=0x7f117c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 -- 172.21.15.82:0/2786940572 shutdown_connections 2024-09-17T01:48:36.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 -- 172.21.15.82:0/2786940572 wait complete. 2024-09-17T01:48:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.653+0000 7f1183b94640 1 Processor -- start 2024-09-17T01:48:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1183b94640 1 -- start start 2024-09-17T01:48:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1183b94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c101960 0x7f117c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1183b94640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1183b94640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f117c10a7a0 con 0x7f117c102b60 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1183b94640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f117c10a620 con 0x7f117c101960 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53026/0 (socket says 172.21.15.82:53026) 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 -- 172.21.15.82:0/3291687968 learned_addr learned my addr 172.21.15.82:0/3291687968 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f1181930640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c101960 0x7f117c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 -- 172.21.15.82:0/3291687968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c101960 msgr2=0x7f117c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c101960 0x7f117c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.654+0000 7f118112f640 1 -- 172.21.15.82:0/3291687968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c1980c0 con 0x7f117c102b60 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f118112f640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f116c00e970 tx=0x7f116c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f116c00cac0 con 0x7f117c102b60 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c19cb00 con 0x7f117c102b60 2024-09-17T01:48:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f116c0054e0 con 0x7f117c102b60 2024-09-17T01:48:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f116c010430 con 0x7f117c102b60 2024-09-17T01:48:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.655+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c19d090 con 0x7f117c102b60 2024-09-17T01:48:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.656+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c101d60 con 0x7f117c102b60 2024-09-17T01:48:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.657+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f116c004f00 con 0x7f117c102b60 2024-09-17T01:48:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.658+0000 7f1172ffd640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 0x7f116807d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.658+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7f116c09e710 con 0x7f117c102b60 2024-09-17T01:48:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.659+0000 7f1181930640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 0x7f116807d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.659+0000 7f1181930640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 0x7f116807d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1178000c00 tx=0x7f1178005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.663+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f116c069d40 con 0x7f117c102b60 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: pgmap v211: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/105728057' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:36.824 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:36 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2081833153' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:48:36.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.868+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f117c062630 con 0x7f116807afd0 2024-09-17T01:48:36.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.869+0000 7f1172ffd640 1 -- 172.21.15.82:0/3291687968 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f117c062630 con 0x7f116807afd0 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "osd" 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "14/23 daemons upgraded", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:48:36.868 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:48:36.869 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:48:36.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.871+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 msgr2=0x7f116807d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.871+0000 7f1183b94640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 0x7f116807d490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1178000c00 tx=0x7f1178005a20 comp rx=0 tx=0).stop 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.871+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 msgr2=0x7f117c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.871+0000 7f1183b94640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f116c00e970 tx=0x7f116c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 shutdown_connections 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f116807afd0 0x7f116807d490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f117c102b60 0x7f117c197a40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 --2- 172.21.15.82:0/3291687968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f117c101960 0x7f117c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 >> 172.21.15.82:0/3291687968 conn(0x7f117c0fd0f0 msgr2=0x7f117c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 shutdown_connections 2024-09-17T01:48:36.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.872+0000 7f1183b94640 1 -- 172.21.15.82:0/3291687968 wait complete. 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 -- 172.21.15.82:0/1147818027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 msgr2=0x7fc354102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/1147818027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc354102fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009880 tx=0x7fc33c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 -- 172.21.15.82:0/1147818027 shutdown_connections 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/1147818027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc354102fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/1147818027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 0x7fc354101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 -- 172.21.15.82:0/1147818027 >> 172.21.15.82:0/1147818027 conn(0x7fc3540fd0f0 msgr2=0x7fc3540ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 -- 172.21.15.82:0/1147818027 shutdown_connections 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.954+0000 7fc35a6d7640 1 -- 172.21.15.82:0/1147818027 wait complete. 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 Processor -- start 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 -- start start 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 0x7fc3541974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc35410a7a0 con 0x7fc354102b60 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc35a6d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc35410a620 con 0x7fc354101960 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53042/0 (socket says 172.21.15.82:53042) 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 -- 172.21.15.82:0/2769680880 learned_addr learned my addr 172.21.15.82:0/2769680880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc353fff640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 0x7fc3541974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 -- 172.21.15.82:0/2769680880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 msgr2=0x7fc3541974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 0x7fc3541974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.955+0000 7fc34bfff640 1 -- 172.21.15.82:0/2769680880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc354198060 con 0x7fc354102b60 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc34bfff640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006010 tx=0x7fc33c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c03f070 con 0x7fc354102b60 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35419ca40 con 0x7fc354102b60 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc33c0049d0 con 0x7fc354102b60 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c035030 con 0x7fc354102b60 2024-09-17T01:48:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.956+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35419cfd0 con 0x7fc354102b60 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.957+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc354101d60 con 0x7fc354102b60 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.958+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc33c042070 con 0x7fc354102b60 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.958+0000 7fc351ffb640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 0x7fc34007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.958+0000 7fc353fff640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 0x7fc34007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.958+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6070+0+0 (secure 0 0 0) 0x7fc33c0bec40 con 0x7fc354102b60 2024-09-17T01:48:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.959+0000 7fc353fff640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 0x7fc34007d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3541029c0 tx=0x7fc344005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:48:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:36.963+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc33c08a290 con 0x7fc354102b60 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: pgmap v211: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/105728057' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:37.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:37.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:36 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2081833153' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:48:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.220+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc354062df0 con 0x7fc354102b60 2024-09-17T01:48:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.221+0000 7fc351ffb640 1 -- 172.21.15.82:0/2769680880 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fc33c08f140 con 0x7fc354102b60 2024-09-17T01:48:37.219 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:48:37.219 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:48:37.219 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 msgr2=0x7fc34007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 0x7fc34007d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3541029c0 tx=0x7fc344005f90 comp rx=0 tx=0).stop 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 msgr2=0x7fc3541979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006010 tx=0x7fc33c004570 comp rx=0 tx=0).stop 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 shutdown_connections 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc34007af30 0x7fc34007d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc354102b60 0x7fc3541979e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 --2- 172.21.15.82:0/2769680880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc354101960 0x7fc3541974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:48:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 >> 172.21.15.82:0/2769680880 conn(0x7fc3540fd0f0 msgr2=0x7fc354106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:48:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 shutdown_connections 2024-09-17T01:48:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:48:37.223+0000 7fc35a6d7640 1 -- 172.21.15.82:0/2769680880 wait complete. 2024-09-17T01:48:37.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:37 smithi167 ceph-mon[76323]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:37.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:37 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2769680880' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:48:37.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:37 smithi082 ceph-mon[92957]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:37.910 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:37 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2769680880' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:48:38.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:38 smithi082 ceph-mon[92957]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:38.890 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:38 smithi082 ceph-mon[92957]: pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:38 smithi167 ceph-mon[76323]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:48:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:38 smithi167 ceph-mon[76323]: pgmap v212: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:40 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi167.vbekqg"]} : dispatch 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: pgmap v213: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:40 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi167.vbekqg"]} : dispatch 2024-09-17T01:48:41.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:41 smithi167 ceph-mon[76323]: Upgrade: It appears safe to stop mds.cephfs.smithi167.vbekqg 2024-09-17T01:48:41.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:41.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:41.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:41 smithi082 ceph-mon[92957]: Upgrade: It appears safe to stop mds.cephfs.smithi167.vbekqg 2024-09-17T01:48:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.vbekqg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:42.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:42 smithi167 ceph-mon[76323]: Upgrade: Updating mds.cephfs.smithi167.vbekqg 2024-09-17T01:48:42.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:42 smithi167 ceph-mon[76323]: Deploying daemon mds.cephfs.smithi167.vbekqg on smithi167 2024-09-17T01:48:42.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:42 smithi167 ceph-mon[76323]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:42 smithi082 ceph-mon[92957]: Upgrade: Updating mds.cephfs.smithi167.vbekqg 2024-09-17T01:48:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:42 smithi082 ceph-mon[92957]: Deploying daemon mds.cephfs.smithi167.vbekqg on smithi167 2024-09-17T01:48:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:42 smithi082 ceph-mon[92957]: pgmap v214: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:44.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:44 smithi082 ceph-mon[92957]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:44.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:44 smithi082 ceph-mon[92957]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T01:48:44.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:44 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:44 smithi167 ceph-mon[76323]: pgmap v215: 65 pgs: 65 active+clean; 245 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:45.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:44 smithi167 ceph-mon[76323]: osdmap e81: 6 total, 6 up, 6 in 2024-09-17T01:48:45.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:44 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 2 up:standby 2024-09-17T01:48:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:46 smithi082 ceph-mon[92957]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:46 smithi167 ceph-mon[76323]: pgmap v217: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:48:48.001 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:47 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:48:48.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:47 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:48:48.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:48 smithi167 ceph-mon[76323]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:49.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:48 smithi082 ceph-mon[92957]: pgmap v218: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:50.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:50.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:50.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:50.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:50.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:boot 2024-09-17T01:48:50.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:50.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:50 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: pgmap v219: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:boot 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.ypfdyj=up:active} 3 up:standby 2024-09-17T01:48:50.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:50 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:48:52.945 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:52 smithi167 ceph-mon[76323]: pgmap v220: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:52.945 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:52.945 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:52.945 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:52.946 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:52 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:53.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:52 smithi082 ceph-mon[92957]: pgmap v220: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:53.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:53.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:53.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:53.215 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:52 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:54 smithi167 ceph-mon[76323]: pgmap v221: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:54 smithi082 ceph-mon[92957]: pgmap v221: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.677 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi167.ypfdyj"]} : dispatch 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: Upgrade: It appears safe to stop mds.cephfs.smithi167.ypfdyj 2024-09-17T01:48:56.678 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:56 smithi167 ceph-mon[76323]: pgmap v222: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi167.ypfdyj"]} : dispatch 2024-09-17T01:48:56.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: Upgrade: It appears safe to stop mds.cephfs.smithi167.ypfdyj 2024-09-17T01:48:56.716 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:56 smithi082 ceph-mon[92957]: pgmap v222: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:57 smithi082 ceph-mon[92957]: Upgrade: Updating mds.cephfs.smithi167.ypfdyj 2024-09-17T01:48:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:57 smithi082 ceph-mon[92957]: Deploying daemon mds.cephfs.smithi167.ypfdyj on smithi167 2024-09-17T01:48:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:57 smithi167 ceph-mon[76323]: Upgrade: Updating mds.cephfs.smithi167.ypfdyj 2024-09-17T01:48:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:48:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi167.ypfdyj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-17T01:48:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:48:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:57 smithi167 ceph-mon[76323]: Deploying daemon mds.cephfs.smithi167.ypfdyj on smithi167 2024-09-17T01:48:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[92953]: 2024-09-17T01:48:58.580+0000 7f2ca023d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: pgmap v223: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:48:58.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T01:48:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: Standby daemon mds.cephfs.smithi167.vbekqg assigned to filesystem cephfs as rank 0 2024-09-17T01:48:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:48:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:48:58.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:48:58 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:replay} 2 up:standby 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: pgmap v223: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: osdmap e82: 6 total, 6 up, 6 in 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: Standby daemon mds.cephfs.smithi167.vbekqg assigned to filesystem cephfs as rank 0 2024-09-17T01:48:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-17T01:48:59.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-17T01:48:59.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:48:58 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:replay} 2 up:standby 2024-09-17T01:49:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:00 smithi167 ceph-mon[76323]: pgmap v225: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-09-17T01:49:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:00 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:00 smithi082 ceph-mon[92957]: pgmap v225: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-09-17T01:49:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:00 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:02.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:02.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:02 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:02.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:02 smithi082 ceph-mon[92957]: pgmap v226: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-17T01:49:02.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:02.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:02 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:02.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:02 smithi167 ceph-mon[76323]: pgmap v226: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-17T01:49:04.870 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:04 smithi167 ceph-mon[76323]: pgmap v227: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-17T01:49:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:04 smithi082 ceph-mon[92957]: pgmap v227: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-09-17T01:49:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:06 smithi082 ceph-mon[92957]: pgmap v228: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-17T01:49:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:06 smithi167 ceph-mon[76323]: pgmap v228: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-17T01:49:07.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/2176424687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 msgr2=0x7f4fdc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/2176424687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc101d60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009880 tx=0x7f4fcc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/2176424687 shutdown_connections 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/2176424687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 0x7f4fdc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/2176424687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc101d60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/2176424687 >> 172.21.15.82:0/2176424687 conn(0x7f4fdc0fd0f0 msgr2=0x7f4fdc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/2176424687 shutdown_connections 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.319+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/2176424687 wait complete. 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 Processor -- start 2024-09-17T01:49:07.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 -- start start 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 0x7f4fdc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10a780 con 0x7f4fdc101960 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.320+0000 7f4fe0bb9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc10a600 con 0x7f4fdc102b60 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43964/0 (socket says 172.21.15.82:43964) 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fd9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 0x7f4fdc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 -- 172.21.15.82:0/687683132 learned_addr learned my addr 172.21.15.82:0/687683132 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 -- 172.21.15.82:0/687683132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 msgr2=0x7f4fdc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 0x7f4fdc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 -- 172.21.15.82:0/687683132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc074b20 con 0x7f4fdc101960 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fda59c640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fcc03f070 con 0x7f4fdc101960 2024-09-17T01:49:07.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fcc004a50 con 0x7f4fdc101960 2024-09-17T01:49:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc074db0 con 0x7f4fdc101960 2024-09-17T01:49:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fcc035030 con 0x7f4fdc101960 2024-09-17T01:49:07.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.321+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc0752e0 con 0x7f4fdc101960 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.323+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc101d60 con 0x7f4fdc101960 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.323+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4fcc042070 con 0x7f4fdc101960 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.324+0000 7f4fcb7fe640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.324+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f4fcc0beaf0 con 0x7f4fdc101960 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.324+0000 7f4fd9d9b640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.324+0000 7f4fd9d9b640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 0x7f4fc407d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc075ca0 tx=0x7f4fd000b410 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.329+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4fcc004c00 con 0x7f4fdc101960 2024-09-17T01:49:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.520+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4fdc062630 con 0x7f4fc407af30 2024-09-17T01:49:07.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.521+0000 7f4fcb7fe640 1 -- 172.21.15.82:0/687683132 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4fdc062630 con 0x7f4fc407af30 2024-09-17T01:49:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 msgr2=0x7f4fc407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 0x7f4fc407d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc075ca0 tx=0x7f4fd000b410 comp rx=0 tx=0).stop 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 msgr2=0x7f4fdc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc006010 tx=0x7f4fcc0045e0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 shutdown_connections 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4fc407af30 0x7f4fc407d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102b60 0x7f4fdc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 --2- 172.21.15.82:0/687683132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc101960 0x7f4fdc075f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 >> 172.21.15.82:0/687683132 conn(0x7f4fdc0fd0f0 msgr2=0x7f4fdc105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 shutdown_connections 2024-09-17T01:49:07.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.523+0000 7f4fe0bb9640 1 -- 172.21.15.82:0/687683132 wait complete. 2024-09-17T01:49:07.530 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:49:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 -- 172.21.15.82:0/3003277752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c101a60 msgr2=0x7fb61c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 --2- 172.21.15.82:0/3003277752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c101a60 0x7fb61c101ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb610009880 tx=0x7fb61002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 -- 172.21.15.82:0/3003277752 shutdown_connections 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 --2- 172.21.15.82:0/3003277752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c101a60 0x7fb61c101ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 --2- 172.21.15.82:0/3003277752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100860 0x7fb61c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 -- 172.21.15.82:0/3003277752 >> 172.21.15.82:0/3003277752 conn(0x7fb61c0fc010 msgr2=0x7fb61c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 -- 172.21.15.82:0/3003277752 shutdown_connections 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 -- 172.21.15.82:0/3003277752 wait complete. 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.606+0000 7fb6220c5640 1 Processor -- start 2024-09-17T01:49:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb6220c5640 1 -- start start 2024-09-17T01:49:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb6220c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb6220c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c101a60 0x7fb61c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb6220c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c109720 con 0x7fb61c100860 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb6220c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1095a0 con 0x7fb61c101a60 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43976/0 (socket says 172.21.15.82:43976) 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 -- 172.21.15.82:0/374347481 learned_addr learned my addr 172.21.15.82:0/374347481 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61affd640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c101a60 0x7fb61c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 -- 172.21.15.82:0/374347481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c101a60 msgr2=0x7fb61c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c101a60 0x7fb61c102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 -- 172.21.15.82:0/374347481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c103380 con 0x7fb61c100860 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.607+0000 7fb61b7fe640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b3d0 tx=0x7fb60c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.608+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb60c015020 con 0x7fb61c100860 2024-09-17T01:49:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.608+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb60c011af0 con 0x7fb61c100860 2024-09-17T01:49:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.608+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c103670 con 0x7fb61c100860 2024-09-17T01:49:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.608+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb60c010da0 con 0x7fb61c100860 2024-09-17T01:49:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.608+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c103c80 con 0x7fb61c100860 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.609+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c100c60 con 0x7fb61c100860 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.610+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fb60c018020 con 0x7fb61c100860 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.610+0000 7fb618ff9640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 0x7fb60407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.610+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fb60c09d9e0 con 0x7fb61c100860 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.610+0000 7fb61affd640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 0x7fb60407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.611+0000 7fb61affd640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 0x7fb60407d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb61c104500 tx=0x7fb610005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.615+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fb60c01f020 con 0x7fb61c100860 2024-09-17T01:49:07.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.815+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb61c19f6c0 con 0x7fb60407af30 2024-09-17T01:49:07.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.816+0000 7fb618ff9640 1 -- 172.21.15.82:0/374347481 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fb61c19f6c0 con 0x7fb60407af30 2024-09-17T01:49:07.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 msgr2=0x7fb60407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 0x7fb60407d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb61c104500 tx=0x7fb610005a20 comp rx=0 tx=0).stop 2024-09-17T01:49:07.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 msgr2=0x7fb61c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b3d0 tx=0x7fb60c00b890 comp rx=0 tx=0).stop 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 shutdown_connections 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fb60407af30 0x7fb60407d3f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c101a60 0x7fb61c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 --2- 172.21.15.82:0/374347481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100860 0x7fb61c104780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 >> 172.21.15.82:0/374347481 conn(0x7fb61c0fc010 msgr2=0x7fb61c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 shutdown_connections 2024-09-17T01:49:07.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.818+0000 7fb6220c5640 1 -- 172.21.15.82:0/374347481 wait complete. 2024-09-17T01:49:07.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 -- 172.21.15.82:0/2694760860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 msgr2=0x7f52b8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 --2- 172.21.15.82:0/2694760860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b8100c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009880 tx=0x7f52b402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 -- 172.21.15.82:0/2694760860 shutdown_connections 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 --2- 172.21.15.82:0/2694760860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 0x7f52b8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 --2- 172.21.15.82:0/2694760860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b8100c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 -- 172.21.15.82:0/2694760860 >> 172.21.15.82:0/2694760860 conn(0x7f52b80fc010 msgr2=0x7f52b80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 -- 172.21.15.82:0/2694760860 shutdown_connections 2024-09-17T01:49:07.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.900+0000 7f52c064f640 1 -- 172.21.15.82:0/2694760860 wait complete. 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] up:boot 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:replay} 3 up:standby 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:07.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 Processor -- start 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 -- start start 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 0x7f52b8197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81096c0 con 0x7f52b8100880 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52c064f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8109540 con 0x7f52b8101a80 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52be3eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52be3eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44000/0 (socket says 172.21.15.82:44000) 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52be3eb640 1 -- 172.21.15.82:0/602133633 learned_addr learned my addr 172.21.15.82:0/602133633 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.901+0000 7f52bdbea640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 0x7f52b8197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52be3eb640 1 -- 172.21.15.82:0/602133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 msgr2=0x7f52b8197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52be3eb640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 0x7f52b8197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52be3eb640 1 -- 172.21.15.82:0/602133633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b8198160 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52be3eb640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006010 tx=0x7f52b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52b403f070 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52b40035f0 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b819cb40 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52b4035030 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.902+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b819d0d0 con 0x7f52b8100880 2024-09-17T01:49:07.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.903+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b8100c80 con 0x7f52b8100880 2024-09-17T01:49:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.904+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f52b4042070 con 0x7f52b8100880 2024-09-17T01:49:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.905+0000 7f52af7fe640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 0x7f52a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.905+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f52b40bea50 con 0x7f52b8100880 2024-09-17T01:49:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.905+0000 7f52bdbea640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 0x7f52a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:07.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.905+0000 7f52bdbea640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 0x7f52a407d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52b8198a50 tx=0x7f52a8005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:07.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:07.909+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f52b408a050 con 0x7f52b8100880 2024-09-17T01:49:07.984 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] up:boot 2024-09-17T01:49:07.984 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:replay} 3 up:standby 2024-09-17T01:49:07.984 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "mds metadata", "who": "cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:07.984 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:07.985 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:07.985 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.106+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f52b806a910 con 0x7f52a407af30 2024-09-17T01:49:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.115+0000 7f52af7fe640 1 -- 172.21.15.82:0/602133633 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f52b806a910 con 0x7f52a407af30 2024-09-17T01:49:08.114 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (14m) 32s ago 15m 25.1M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (7m) 32s ago 15m 8984k - 19.1.1-330-gc2ddf972 ebb0615149de eb79bcde50a0 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (6m) 16s ago 15m 8988k - 19.1.1-330-gc2ddf972 ebb0615149de de920343a3f3 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 32s ago 15m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (4m) 16s ago 14m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (14m) 32s ago 15m 78.4M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (52s) 32s ago 10m 81.1M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (37s) 32s ago 10m 80.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (19s) 16s ago 10m 80.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 starting - - - - 2024-09-17T01:49:08.115 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (6m) 32s ago 16m 591M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (5m) 16s ago 14m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (5m) 32s ago 17m 117M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (5m) 16s ago 14m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (15m) 32s ago 15m 14.9M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (14m) 16s ago 14m 16.3M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (4m) 32s ago 13m 159M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 32s ago 13m 166M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 32s ago 12m 154M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (2m) 16s ago 12m 175M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (2m) 16s ago 11m 157M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (107s) 16s ago 11m 160M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:49:08.116 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (5m) 32s ago 15m 69.3M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:49:08.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 msgr2=0x7f52a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 0x7f52a407d3f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52b8198a50 tx=0x7f52a8005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 msgr2=0x7f52b81975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006010 tx=0x7f52b40045e0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 shutdown_connections 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f52a407af30 0x7f52a407d3f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52b8101a80 0x7f52b8197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 --2- 172.21.15.82:0/602133633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b8100880 0x7f52b81975a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 >> 172.21.15.82:0/602133633 conn(0x7f52b80fc010 msgr2=0x7f52b806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 shutdown_connections 2024-09-17T01:49:08.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.118+0000 7f52c064f640 1 -- 172.21.15.82:0/602133633 wait complete. 2024-09-17T01:49:08.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 -- 172.21.15.82:0/524587590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 msgr2=0x7fa2c4101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/524587590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4101d20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009880 tx=0x7fa2b802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 -- 172.21.15.82:0/524587590 shutdown_connections 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/524587590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4101d20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/524587590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 -- 172.21.15.82:0/524587590 >> 172.21.15.82:0/524587590 conn(0x7fa2c40fbe30 msgr2=0x7fa2c40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 -- 172.21.15.82:0/524587590 shutdown_connections 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.199+0000 7fa2c8da2640 1 -- 172.21.15.82:0/524587590 wait complete. 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 Processor -- start 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 -- start start 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c41094e0 con 0x7fa2c41018a0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c8da2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4109360 con 0x7fa2c41006a0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44028/0 (socket says 172.21.15.82:44028) 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c2ffd640 1 -- 172.21.15.82:0/3018100950 learned_addr learned my addr 172.21.15.82:0/3018100950 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.200+0000 7fa2c37fe640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c2ffd640 1 -- 172.21.15.82:0/3018100950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 msgr2=0x7fa2c4197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c2ffd640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c2ffd640 1 -- 172.21.15.82:0/3018100950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c4197ee0 con 0x7fa2c41018a0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c37fe640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c2ffd640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009230 tx=0x7fa2b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2b803f070 con 0x7fa2c41018a0 2024-09-17T01:49:08.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c419c8c0 con 0x7fa2c41018a0 2024-09-17T01:49:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa2b8004b80 con 0x7fa2c41018a0 2024-09-17T01:49:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.201+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c419ce50 con 0x7fa2c41018a0 2024-09-17T01:49:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.202+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa2b8035030 con 0x7fa2c41018a0 2024-09-17T01:49:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.202+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b0005290 con 0x7fa2c41018a0 2024-09-17T01:49:08.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.204+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa2b8042070 con 0x7fa2c41018a0 2024-09-17T01:49:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.204+0000 7fa2c0ff9640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 0x7fa2ac07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.205+0000 7fa2c37fe640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 0x7fa2ac07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.205+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fa2b80beff0 con 0x7fa2c41018a0 2024-09-17T01:49:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.205+0000 7fa2c37fe640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 0x7fa2ac07d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40058c0 tx=0x7fa2b4005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.208+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa2b808a670 con 0x7fa2c41018a0 2024-09-17T01:49:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.453+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa2b0005850 con 0x7fa2c41018a0 2024-09-17T01:49:08.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.453+0000 7fa2c0ff9640 1 -- 172.21.15.82:0/3018100950 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa2b808f520 con 0x7fa2c41018a0 2024-09-17T01:49:08.451 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:49:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:49:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:49:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:49:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:49:08.453 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 msgr2=0x7fa2ac07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 0x7fa2ac07d400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40058c0 tx=0x7fa2b4005850 comp rx=0 tx=0).stop 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 msgr2=0x7fa2c4197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009230 tx=0x7fa2b80046c0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 shutdown_connections 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa2ac07af40 0x7fa2ac07d400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2c41018a0 0x7fa2c4197860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 --2- 172.21.15.82:0/3018100950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c41006a0 0x7fa2c4197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 >> 172.21.15.82:0/3018100950 conn(0x7fa2c40fbe30 msgr2=0x7fa2c406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 shutdown_connections 2024-09-17T01:49:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.456+0000 7fa2c8da2640 1 -- 172.21.15.82:0/3018100950 wait complete. 2024-09-17T01:49:08.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 -- 172.21.15.82:0/3683075334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 msgr2=0x7f1900104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 --2- 172.21.15.82:0/3683075334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f1900104840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009880 tx=0x7f18fc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 -- 172.21.15.82:0/3683075334 shutdown_connections 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 --2- 172.21.15.82:0/3683075334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900104d80 0x7f1900107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 --2- 172.21.15.82:0/3683075334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900102450 0x7f1900104840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 -- 172.21.15.82:0/3683075334 >> 172.21.15.82:0/3683075334 conn(0x7f19000fc010 msgr2=0x7f19000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 -- 172.21.15.82:0/3683075334 shutdown_connections 2024-09-17T01:49:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.536+0000 7f19074e6640 1 -- 172.21.15.82:0/3683075334 wait complete. 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 Processor -- start 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 -- start start 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900102450 0x7f19001974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f190010a750 con 0x7f1900104d80 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f19074e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f190010a5d0 con 0x7f1900102450 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f1904a81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f1904a81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44058/0 (socket says 172.21.15.82:44058) 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f1904a81640 1 -- 172.21.15.82:0/596529589 learned_addr learned my addr 172.21.15.82:0/596529589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.537+0000 7f1905282640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900102450 0x7f19001974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f1904a81640 1 -- 172.21.15.82:0/596529589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900102450 msgr2=0x7f19001974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f1904a81640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900102450 0x7f19001974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f1904a81640 1 -- 172.21.15.82:0/596529589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900198060 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f1904a81640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f000dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f0017070 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190019caa0 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18f0004020 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f0003b30 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.538+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190019d030 con 0x7f1900104d80 2024-09-17T01:49:08.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.539+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900102830 con 0x7f1900104d80 2024-09-17T01:49:08.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.540+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f18f00041d0 con 0x7f1900104d80 2024-09-17T01:49:08.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.540+0000 7f18f67fc640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.540+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f18f009de80 con 0x7f1900104d80 2024-09-17T01:49:08.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.541+0000 7f1905282640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.541+0000 7f1905282640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18fc000c00 tx=0x7f18fc0058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.545+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f18f0020030 con 0x7f1900104d80 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: pgmap v229: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: reconnect by client.14622 192.168.0.1:0/2424388004 after 0 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: reconnect by client.24333 192.168.0.1:0/2452546215 after 0 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:reconnect 2024-09-17T01:49:08.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:reconnect} 3 up:standby 2024-09-17T01:49:08.715 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:08 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3018100950' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:08.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.762+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f190019d970 con 0x7f1900104d80 2024-09-17T01:49:08.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.762+0000 7f18f67fc640 1 -- 172.21.15.82:0/596529589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) ==== 76+0+2008 (secure 0 0 0) 0x7f18f0069480 con 0x7f1900104d80 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout:e33 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:49:08:694013+0000 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:49:08.761 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 33 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:49:07.698197+0000 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:49:08.762 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 1 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:in 0 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34311} 2024-09-17T01:49:08.763 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 1 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:49:08.764 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 0 members: 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{0:34311} state up:rejoin seq 7 join_fscid=1 addr [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{-1:34315} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{-1:34358} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:08.765 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{-1:34362} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 msgr2=0x7f18ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f18fc000c00 tx=0x7f18fc0058d0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 msgr2=0x7f19001979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f000dd60 comp rx=0 tx=0).stop 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 shutdown_connections 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f18ec07af30 0x7f18ec07d3f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1900104d80 0x7f19001979e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 --2- 172.21.15.82:0/596529589 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900102450 0x7f19001974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 >> 172.21.15.82:0/596529589 conn(0x7f19000fc010 msgr2=0x7f19000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 shutdown_connections 2024-09-17T01:49:08.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.764+0000 7f19074e6640 1 -- 172.21.15.82:0/596529589 wait complete. 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 -- 172.21.15.82:0/1330567108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 msgr2=0x7f00041003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 --2- 172.21.15.82:0/1330567108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f00041003e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efff4009880 tx=0x7efff402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 -- 172.21.15.82:0/1330567108 shutdown_connections 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 --2- 172.21.15.82:0/1330567108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 0x7f0004101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 --2- 172.21.15.82:0/1330567108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f00041003e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 -- 172.21.15.82:0/1330567108 >> 172.21.15.82:0/1330567108 conn(0x7f00040fb770 msgr2=0x7f00040fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:08.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 -- 172.21.15.82:0/1330567108 shutdown_connections 2024-09-17T01:49:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.847+0000 7f000a0b3640 1 -- 172.21.15.82:0/1330567108 wait complete. 2024-09-17T01:49:08.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 Processor -- start 2024-09-17T01:49:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 -- start start 2024-09-17T01:49:08.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 0x7f0004197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0004108e20 con 0x7f00040fffe0 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f000a0b3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0004108ca0 con 0x7f00041011e0 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.848+0000 7f00037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44068/0 (socket says 172.21.15.82:44068) 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 -- 172.21.15.82:0/2309914177 learned_addr learned my addr 172.21.15.82:0/2309914177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f0002ffd640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 0x7f0004197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 -- 172.21.15.82:0/2309914177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 msgr2=0x7f0004197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 0x7f0004197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 -- 172.21.15.82:0/2309914177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0004198110 con 0x7f00040fffe0 2024-09-17T01:49:08.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f00037fe640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff4006010 tx=0x7efff40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff403f070 con 0x7f00040fffe0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efff40049d0 con 0x7f00040fffe0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000419caf0 con 0x7f00040fffe0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efff4035030 con 0x7f00040fffe0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.849+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000419d080 con 0x7f00040fffe0 2024-09-17T01:49:08.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.850+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00041003e0 con 0x7f00040fffe0 2024-09-17T01:49:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.851+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7efff4042070 con 0x7f00040fffe0 2024-09-17T01:49:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.851+0000 7f0000ff9640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 0x7effec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.851+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7efff40beb50 con 0x7f00040fffe0 2024-09-17T01:49:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.851+0000 7f0002ffd640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 0x7effec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:08.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.852+0000 7f0002ffd640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 0x7effec07d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0004198a00 tx=0x7efff8005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:08.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:08.856+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7efff408a150 con 0x7f00040fffe0 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: pgmap v229: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: reconnect by client.14622 192.168.0.1:0/2424388004 after 0 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: reconnect by client.24333 192.168.0.1:0/2452546215 after 0 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:reconnect 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:reconnect} 3 up:standby 2024-09-17T01:49:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:08 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3018100950' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.048+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0004105620 con 0x7effec07af30 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.050+0000 7f0000ff9640 1 -- 172.21.15.82:0/2309914177 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0004105620 con 0x7effec07af30 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: "osd" 2024-09-17T01:49:09.048 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:49:09.049 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "15/23 daemons upgraded", 2024-09-17T01:49:09.049 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading mds daemons", 2024-09-17T01:49:09.049 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:49:09.049 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 msgr2=0x7effec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 0x7effec07d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0004198a00 tx=0x7efff8005f90 comp rx=0 tx=0).stop 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 msgr2=0x7f0004197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efff4006010 tx=0x7efff40045e0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 shutdown_connections 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7effec07af30 0x7effec07d3f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00041011e0 0x7f0004197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 --2- 172.21.15.82:0/2309914177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00040fffe0 0x7f0004197550 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 >> 172.21.15.82:0/2309914177 conn(0x7f00040fb770 msgr2=0x7f00040fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 shutdown_connections 2024-09-17T01:49:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.053+0000 7f000a0b3640 1 -- 172.21.15.82:0/2309914177 wait complete. 2024-09-17T01:49:09.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- 172.21.15.82:0/3766920436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884100860 msgr2=0x7f9884100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3766920436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884100860 0x7f9884100c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9878009880 tx=0x7f987802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- 172.21.15.82:0/3766920436 shutdown_connections 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3766920436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884101a60 0x7f9884101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3766920436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884100860 0x7f9884100c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- 172.21.15.82:0/3766920436 >> 172.21.15.82:0/3766920436 conn(0x7f98840fc010 msgr2=0x7f98840fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- 172.21.15.82:0/3766920436 shutdown_connections 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- 172.21.15.82:0/3766920436 wait complete. 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 Processor -- start 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.136+0000 7f988ae3f640 1 -- start start 2024-09-17T01:49:09.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f988ae3f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884100860 0x7f98841952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f988ae3f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f988ae3f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9884108590 con 0x7f9884101a60 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f988ae3f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9884108410 con 0x7f9884100860 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44080/0 (socket says 172.21.15.82:44080) 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 -- 172.21.15.82:0/3660200676 learned_addr learned my addr 172.21.15.82:0/3660200676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9888bdb640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884100860 0x7f98841952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 -- 172.21.15.82:0/3660200676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884100860 msgr2=0x7f98841952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884100860 0x7f98841952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 -- 172.21.15.82:0/3660200676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9884195e60 con 0x7f9884101a60 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9883fff640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f987000d6f0 tx=0x7f987000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.137+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9870017070 con 0x7f9884101a60 2024-09-17T01:49:09.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.138+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988419a8a0 con 0x7f9884101a60 2024-09-17T01:49:09.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.138+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f987000de00 con 0x7f9884101a60 2024-09-17T01:49:09.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.138+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9870004bb0 con 0x7f9884101a60 2024-09-17T01:49:09.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.138+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988419ae30 con 0x7f9884101a60 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.139+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9884100c60 con 0x7f9884101a60 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.139+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9870004e60 con 0x7f9884101a60 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.140+0000 7f9881ffb640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 0x7f987407f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.140+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f987009db80 con 0x7f9884101a60 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.140+0000 7f9888bdb640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 0x7f987407f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:09.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.140+0000 7f9888bdb640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 0x7f987407f610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9878009230 tx=0x7f98780058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:09.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.144+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9870069180 con 0x7f9884101a60 2024-09-17T01:49:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.388+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9884062df0 con 0x7f9884101a60 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.389+0000 7f9881ffb640 1 -- 172.21.15.82:0/3660200676 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f987006e030 con 0x7f9884101a60 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs is degraded 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:49:09.387 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 msgr2=0x7f987407f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 0x7f987407f610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9878009230 tx=0x7f98780058d0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 msgr2=0x7f98841957e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f987000d6f0 tx=0x7f987000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 shutdown_connections 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f987407d150 0x7f987407f610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9884101a60 0x7f98841957e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 --2- 172.21.15.82:0/3660200676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9884100860 0x7f98841952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 >> 172.21.15.82:0/3660200676 conn(0x7f98840fc010 msgr2=0x7f9884104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 shutdown_connections 2024-09-17T01:49:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:09.392+0000 7f988ae3f640 1 -- 172.21.15.82:0/3660200676 wait complete. 2024-09-17T01:49:09.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:09.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:09.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:rejoin 2024-09-17T01:49:09.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:rejoin} 3 up:standby 2024-09-17T01:49:09.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/596529589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:49:09.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: daemon mds.cephfs.smithi167.vbekqg is now active in filesystem cephfs as rank 0 2024-09-17T01:49:09.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:09 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3660200676' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:rejoin 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: fsmap cephfs:1/1 {0=cephfs.smithi167.vbekqg=up:rejoin} 3 up:standby 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/596529589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: daemon mds.cephfs.smithi167.vbekqg is now active in filesystem cephfs as rank 0 2024-09-17T01:49:10.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:09 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3660200676' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:49:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:10 smithi082 ceph-mon[92957]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:10.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:10 smithi082 ceph-mon[92957]: pgmap v230: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:49:10.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:10 smithi082 ceph-mon[92957]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:49:10.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:10 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:active 2024-09-17T01:49:10.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:10 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.vbekqg=up:active} 3 up:standby 2024-09-17T01:49:11.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:10 smithi167 ceph-mon[76323]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:11.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:10 smithi167 ceph-mon[76323]: pgmap v230: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-09-17T01:49:11.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:10 smithi167 ceph-mon[76323]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T01:49:11.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:10 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] up:active 2024-09-17T01:49:11.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:10 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.vbekqg=up:active} 3 up:standby 2024-09-17T01:49:12.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:12 smithi082 ceph-mon[92957]: pgmap v231: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T01:49:13.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:12 smithi167 ceph-mon[76323]: pgmap v231: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-17T01:49:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:14 smithi082 ceph-mon[92957]: pgmap v232: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:49:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:14 smithi167 ceph-mon[76323]: pgmap v232: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-17T01:49:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:15.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:15 smithi082 ceph-mon[92957]: pgmap v233: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:49:16.234 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:15 smithi167 ceph-mon[76323]: pgmap v233: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-17T01:49:17.423 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:17 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:17.423 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:17 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:17 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:17.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:17 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: pgmap v234: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-17T01:49:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.haarnz"}]': finished 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.pwukvc"}]': finished 2024-09-17T01:49:18.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:49:18.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.vbekqg"}]': finished 2024-09-17T01:49:18.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:18.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.ypfdyj"}]': finished 2024-09-17T01:49:18.466 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} : dispatch 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: pgmap v234: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:49:18.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.haarnz"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.haarnz"}]': finished 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.pwukvc"} : dispatch 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi082.pwukvc"}]': finished 2024-09-17T01:49:18.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.vbekqg"} : dispatch 2024-09-17T01:49:18.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.vbekqg"}]': finished 2024-09-17T01:49:18.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.ypfdyj"} : dispatch 2024-09-17T01:49:18.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi167.ypfdyj"}]': finished 2024-09-17T01:49:18.506 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} : dispatch 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all mds 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: daemon mds.cephfs.smithi167.ypfdyj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:49:19.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:49:19.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: fsmap cephfs:1 {0=cephfs.smithi167.vbekqg=up:active} 3 up:standby 2024-09-17T01:49:19.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi167.vbekqg=up:active,1=cephfs.smithi167.ypfdyj=up:starting} 2 up:standby 2024-09-17T01:49:19.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:19.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-17T01:49:19.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:19 smithi082 ceph-mon[92957]: daemon mds.cephfs.smithi167.ypfdyj is now active in filesystem cephfs as rank 1 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all mds 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: daemon mds.cephfs.smithi167.ypfdyj assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-17T01:49:19.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: fsmap cephfs:1 {0=cephfs.smithi167.vbekqg=up:active} 3 up:standby 2024-09-17T01:49:19.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: fsmap cephfs:2 {0=cephfs.smithi167.vbekqg=up:active,1=cephfs.smithi167.ypfdyj=up:starting} 2 up:standby 2024-09-17T01:49:19.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:19.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-17T01:49:19.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:19 smithi167 ceph-mon[76323]: daemon mds.cephfs.smithi167.ypfdyj is now active in filesystem cephfs as rank 1 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: mds.? [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] up:active 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: fsmap cephfs:2 {0=cephfs.smithi167.vbekqg=up:active,1=cephfs.smithi167.ypfdyj=up:active} 2 up:standby-replay 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.357 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: pgmap v235: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: mds.? [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] up:active 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: fsmap cephfs:2 {0=cephfs.smithi167.vbekqg=up:active,1=cephfs.smithi167.ypfdyj=up:active} 2 up:standby-replay 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:20.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:20.505 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:21.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:21 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all rgw 2024-09-17T01:49:21.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:21 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:49:21.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:21 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all rgw 2024-09-17T01:49:21.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:21 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all rbd-mirror 2024-09-17T01:49:22.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:22 smithi082 ceph-mon[92957]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-17T01:49:22.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:22 smithi167 ceph-mon[76323]: pgmap v236: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 4.3 KiB/s wr, 11 op/s 2024-09-17T01:49:23.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:23 smithi082 ceph-mon[92957]: Upgrade: Updating ceph-exporter.smithi082 (1/2) 2024-09-17T01:49:23.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:23 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:23.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:23 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T01:49:23.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:23 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:23.465 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:23 smithi082 ceph-mon[92957]: Deploying daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:49:23.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:23 smithi167 ceph-mon[76323]: Upgrade: Updating ceph-exporter.smithi082 (1/2) 2024-09-17T01:49:23.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:23 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:23.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:23 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi082", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T01:49:23.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:23 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:23.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:23 smithi167 ceph-mon[76323]: Deploying daemon ceph-exporter.smithi082 on smithi082 2024-09-17T01:49:24.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:24 smithi082 ceph-mon[92957]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:49:24.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:24 smithi167 ceph-mon[76323]: pgmap v237: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.7 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-17T01:49:26.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:26 smithi167 ceph-mon[76323]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-17T01:49:26.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:26 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:26.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:26 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:26 smithi082 ceph-mon[92957]: pgmap v238: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.3 MiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-17T01:49:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:26 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:26 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:28.621 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: Upgrade: Updating ceph-exporter.smithi167 (2/2) 2024-09-17T01:49:28.621 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:28.622 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T01:49:28.622 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:28.622 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:49:28.622 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:28 smithi167 ceph-mon[76323]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: Upgrade: Updating ceph-exporter.smithi167 (2/2) 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi167", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: Deploying daemon ceph-exporter.smithi167 on smithi167 2024-09-17T01:49:28.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:28 smithi082 ceph-mon[92957]: pgmap v239: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-09-17T01:49:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:30 smithi082 ceph-mon[92957]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T01:49:31.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:30 smithi167 ceph-mon[76323]: pgmap v240: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-17T01:49:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:32.117 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:32.117 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:32.117 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:32.117 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:33.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:32 smithi167 ceph-mon[76323]: pgmap v241: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T01:49:33.045 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:32 smithi082 ceph-mon[92957]: pgmap v241: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 14 op/s 2024-09-17T01:49:34.140 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.140 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.140 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.140 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.140 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:33 smithi167 ceph-mon[76323]: pgmap v242: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2024-09-17T01:49:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:33 smithi082 ceph-mon[92957]: pgmap v242: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 8 op/s 2024-09-17T01:49:36.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:35 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:35 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:35 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.074 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:35 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.075 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:35 smithi082 ceph-mon[92957]: pgmap v243: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2024-09-17T01:49:36.126 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:35 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.127 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:35 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.127 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:35 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.127 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:35 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:36.127 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:35 smithi167 ceph-mon[76323]: pgmap v243: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 8 op/s 2024-09-17T01:49:38.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:38.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:38.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:37 smithi082 ceph-mon[92957]: pgmap v244: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5 op/s 2024-09-17T01:49:38.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:37 smithi167 ceph-mon[76323]: pgmap v244: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5 op/s 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.480+0000 7ff35c7c6640 1 -- 172.21.15.82:0/976160012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 msgr2=0x7ff354107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.480+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/976160012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff354107170 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff344009880 tx=0x7ff34402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 -- 172.21.15.82:0/976160012 shutdown_connections 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/976160012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff354107170 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/976160012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff354104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 -- 172.21.15.82:0/976160012 >> 172.21.15.82:0/976160012 conn(0x7ff3540fc010 msgr2=0x7ff3540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:39.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 -- 172.21.15.82:0/976160012 shutdown_connections 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 -- 172.21.15.82:0/976160012 wait complete. 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 Processor -- start 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.481+0000 7ff35c7c6640 1 -- start start 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35c7c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff3541974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35c7c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35c7c6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff35410a740 con 0x7ff354104d80 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35c7c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff35410a5c0 con 0x7ff354102450 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60432/0 (socket says 172.21.15.82:60432) 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 -- 172.21.15.82:0/4015701782 learned_addr learned my addr 172.21.15.82:0/4015701782 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35a562640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff3541974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 -- 172.21.15.82:0/4015701782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 msgr2=0x7ff3541974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff3541974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 -- 172.21.15.82:0/4015701782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff354198060 con 0x7ff354104d80 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35a562640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff3541974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff359d61640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff344009230 tx=0x7ff3440045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff34403f070 con 0x7ff354104d80 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35419caa0 con 0x7ff354104d80 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.482+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff344004a50 con 0x7ff354104d80 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.483+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff344035030 con 0x7ff354104d80 2024-09-17T01:49:39.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.483+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35419d030 con 0x7ff354104d80 2024-09-17T01:49:39.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.484+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff354102830 con 0x7ff354104d80 2024-09-17T01:49:39.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.484+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff344042070 con 0x7ff354104d80 2024-09-17T01:49:39.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.485+0000 7ff34b7fe640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 0x7ff34007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.485+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7ff3440bec40 con 0x7ff354104d80 2024-09-17T01:49:39.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.485+0000 7ff35a562640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 0x7ff34007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.486+0000 7ff35a562640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 0x7ff34007d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3500058c0 tx=0x7ff350005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:39.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.490+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff34408a240 con 0x7ff354104d80 2024-09-17T01:49:39.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.690+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff354105700 con 0x7ff34007af40 2024-09-17T01:49:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.691+0000 7ff34b7fe640 1 -- 172.21.15.82:0/4015701782 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7ff354105700 con 0x7ff34007af40 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 msgr2=0x7ff34007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 0x7ff34007d400 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3500058c0 tx=0x7ff350005850 comp rx=0 tx=0).stop 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 msgr2=0x7ff3541979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff344009230 tx=0x7ff3440045c0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 shutdown_connections 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff34007af40 0x7ff34007d400 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff354104d80 0x7ff3541979e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 --2- 172.21.15.82:0/4015701782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff354102450 0x7ff3541974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.693+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 >> 172.21.15.82:0/4015701782 conn(0x7ff3540fc010 msgr2=0x7ff3540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.694+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 shutdown_connections 2024-09-17T01:49:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.694+0000 7ff35c7c6640 1 -- 172.21.15.82:0/4015701782 wait complete. 2024-09-17T01:49:39.701 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 -- 172.21.15.82:0/647138470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 msgr2=0x7f231c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 --2- 172.21.15.82:0/647138470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c101d60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2310009880 tx=0x7f231002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 -- 172.21.15.82:0/647138470 shutdown_connections 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 --2- 172.21.15.82:0/647138470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 0x7f231c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 --2- 172.21.15.82:0/647138470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c101d60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 -- 172.21.15.82:0/647138470 >> 172.21.15.82:0/647138470 conn(0x7f231c0fd0f0 msgr2=0x7f231c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 -- 172.21.15.82:0/647138470 shutdown_connections 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.777+0000 7f2322eff640 1 -- 172.21.15.82:0/647138470 wait complete. 2024-09-17T01:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 Processor -- start 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.777 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi082"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi082"}]': finished 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi167"} : dispatch 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi167"}]': finished 2024-09-17T01:49:39.778 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.779 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.779 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.779 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.779 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:39.779 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:39 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 -- start start 2024-09-17T01:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 0x7f231c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f231c10a780 con 0x7f231c101960 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2322eff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f231c10a600 con 0x7f231c102b60 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2320c9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2320c9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60440/0 (socket says 172.21.15.82:60440) 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f2320c9b640 1 -- 172.21.15.82:0/3426350781 learned_addr learned my addr 172.21.15.82:0/3426350781 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.778+0000 7f231bfff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 0x7f231c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2320c9b640 1 -- 172.21.15.82:0/3426350781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 msgr2=0x7f231c199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2320c9b640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 0x7f231c199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2320c9b640 1 -- 172.21.15.82:0/3426350781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c19a220 con 0x7f231c101960 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2320c9b640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2310006010 tx=0x7f23100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f231003f070 con 0x7f231c101960 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c19ec30 con 0x7f231c101960 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23100044d0 con 0x7f231c101960 2024-09-17T01:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2310035030 con 0x7f231c101960 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.779+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c19f130 con 0x7f231c101960 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.781+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c101d60 con 0x7f231c101960 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.781+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2310042070 con 0x7f231c101960 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.781+0000 7f2319ffb640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 0x7f230c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.782+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f23100beb50 con 0x7f231c101960 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.782+0000 7f231bfff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 0x7f230c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:39.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.782+0000 7f231bfff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 0x7f230c07d440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f231c19aba0 tx=0x7f230800a2d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.786+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f231008a1d0 con 0x7f231c101960 2024-09-17T01:49:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.984+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f231c075d80 con 0x7f230c07af80 2024-09-17T01:49:39.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.986+0000 7f2319ffb640 1 -- 172.21.15.82:0/3426350781 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f231c075d80 con 0x7f230c07af80 2024-09-17T01:49:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 msgr2=0x7f230c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 0x7f230c07d440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f231c19aba0 tx=0x7f230800a2d0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 msgr2=0x7f231c1996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2310006010 tx=0x7f23100048f0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 shutdown_connections 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f230c07af80 0x7f230c07d440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f231c102b60 0x7f231c199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 --2- 172.21.15.82:0/3426350781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f231c101960 0x7f231c1996f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 >> 172.21.15.82:0/3426350781 conn(0x7f231c0fd0f0 msgr2=0x7f231c074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 shutdown_connections 2024-09-17T01:49:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:39.988+0000 7f2322eff640 1 -- 172.21.15.82:0/3426350781 wait complete. 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:40.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all ceph-exporter 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi082"} : dispatch 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi082"}]': finished 2024-09-17T01:49:40.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi167"} : dispatch 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi167"}]': finished 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:39 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 -- 172.21.15.82:0/846948183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8100860 msgr2=0x7f55d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 --2- 172.21.15.82:0/846948183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8100860 0x7f55d8100c60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009880 tx=0x7f55c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 -- 172.21.15.82:0/846948183 shutdown_connections 2024-09-17T01:49:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 --2- 172.21.15.82:0/846948183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8101a60 0x7f55d8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 --2- 172.21.15.82:0/846948183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8100860 0x7f55d8100c60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.070+0000 7f55dca78640 1 -- 172.21.15.82:0/846948183 >> 172.21.15.82:0/846948183 conn(0x7f55d80fc010 msgr2=0x7f55d80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.071+0000 7f55dca78640 1 -- 172.21.15.82:0/846948183 shutdown_connections 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.071+0000 7f55dca78640 1 -- 172.21.15.82:0/846948183 wait complete. 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.071+0000 7f55dca78640 1 Processor -- start 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.071+0000 7f55dca78640 1 -- start start 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.071+0000 7f55dca78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8100860 0x7f55d8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55dca78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55dca78640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f55d81096a0 con 0x7f55d8101a60 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55dca78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8109520 con 0x7f55d8100860 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60452/0 (socket says 172.21.15.82:60452) 2024-09-17T01:49:40.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 -- 172.21.15.82:0/1337091770 learned_addr learned my addr 172.21.15.82:0/1337091770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55d659c640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8100860 0x7f55d8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 -- 172.21.15.82:0/1337091770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8100860 msgr2=0x7f55d8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8100860 0x7f55d8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 -- 172.21.15.82:0/1337091770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d81980e0 con 0x7f55d8101a60 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cffff640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55c000e970 tx=0x7f55c000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55c000cac0 con 0x7f55d8101a60 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d819cb20 con 0x7f55d8101a60 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55c00054e0 con 0x7f55d8101a60 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f55c0010430 con 0x7f55d8101a60 2024-09-17T01:49:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.072+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d819d0b0 con 0x7f55d8101a60 2024-09-17T01:49:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.073+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d8100c60 con 0x7f55d8101a60 2024-09-17T01:49:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.074+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f55c0004ec0 con 0x7f55d8101a60 2024-09-17T01:49:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.075+0000 7f55cf7fe640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.075+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f55c009e720 con 0x7f55d8101a60 2024-09-17T01:49:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.075+0000 7f55d659c640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.075+0000 7f55d659c640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 0x7f55c407d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009230 tx=0x7f55c80058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.079+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f55c0069d20 con 0x7f55d8101a60 2024-09-17T01:49:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.279+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f55d806a420 con 0x7f55c407af30 2024-09-17T01:49:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.289+0000 7f55cf7fe640 1 -- 172.21.15.82:0/1337091770 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f55d806a420 con 0x7f55c407af30 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (14m) 5s ago 16m 24.7M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (14s) 5s ago 16m 74.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 01a86954347f 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (9s) 7s ago 15m 74.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 04be388af4a1 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (5m) 5s ago 16m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (5m) 7s ago 15m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (14m) 5s ago 16m 78.2M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (84s) 5s ago 10m 154M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (69s) 5s ago 10m 82.9M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (51s) 7s ago 10m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:49:40.287 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (34s) 7s ago 10m 84.3M - 19.3.0-4989-gce1b342b 8e039cb7fe1e cb24609f3962 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (7m) 5s ago 17m 593M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (6m) 7s ago 15m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 5s ago 17m 118M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (5m) 7s ago 15m 105M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (16m) 5s ago 16m 15.3M - 1.5.0 0da6a335fe13 d7cae30ea102 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (15m) 7s ago 15m 16.4M - 1.5.0 0da6a335fe13 23f9884d43df 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 5s ago 14m 161M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (4m) 5s ago 13m 168M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (3m) 5s ago 13m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (3m) 7s ago 12m 178M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (2m) 7s ago 12m 159M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (2m) 7s ago 11m 161M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:49:40.288 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 5s ago 15m 69.4M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:49:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 msgr2=0x7f55c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 0x7f55c407d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009230 tx=0x7f55c80058d0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 msgr2=0x7f55d8197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55c000e970 tx=0x7f55c000ed70 comp rx=0 tx=0).stop 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 shutdown_connections 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f55c407af30 0x7f55c407d3f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55d8101a60 0x7f55d8197a60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 --2- 172.21.15.82:0/1337091770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55d8100860 0x7f55d8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 >> 172.21.15.82:0/1337091770 conn(0x7f55d80fc010 msgr2=0x7f55d8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 shutdown_connections 2024-09-17T01:49:40.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.291+0000 7f55dca78640 1 -- 172.21.15.82:0/1337091770 wait complete. 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- 172.21.15.82:0/2941045424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8100860 msgr2=0x7f7ac8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/2941045424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8100860 0x7f7ac8100c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009880 tx=0x7f7abc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- 172.21.15.82:0/2941045424 shutdown_connections 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/2941045424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8101a60 0x7f7ac8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/2941045424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8100860 0x7f7ac8100c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- 172.21.15.82:0/2941045424 >> 172.21.15.82:0/2941045424 conn(0x7f7ac80fc010 msgr2=0x7f7ac80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- 172.21.15.82:0/2941045424 shutdown_connections 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- 172.21.15.82:0/2941045424 wait complete. 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 Processor -- start 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.373+0000 7f7acf0bc640 1 -- start start 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7acf0bc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8100860 0x7f7ac81974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7acf0bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7acf0bc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8109690 con 0x7f7ac8101a60 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7acf0bc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac8109510 con 0x7f7ac8100860 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60468/0 (socket says 172.21.15.82:60468) 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 -- 172.21.15.82:0/267327883 learned_addr learned my addr 172.21.15.82:0/267327883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7acce58640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8100860 0x7f7ac81974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 -- 172.21.15.82:0/267327883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8100860 msgr2=0x7f7ac81974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8100860 0x7f7ac81974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 -- 172.21.15.82:0/267327883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac8198090 con 0x7f7ac8101a60 2024-09-17T01:49:40.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.374+0000 7f7ac7fff640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e970 tx=0x7f7ab400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.375+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ab400cac0 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.375+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ab40054e0 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.375+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac819cad0 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.375+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ab4004e10 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.375+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac819d060 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.376+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac8100c60 con 0x7f7ac8101a60 2024-09-17T01:49:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.376+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7ab4005020 con 0x7f7ac8101a60 2024-09-17T01:49:40.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.377+0000 7f7ac5ffb640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 0x7f7ab807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.377+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f7ab409e6b0 con 0x7f7ac8101a60 2024-09-17T01:49:40.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.377+0000 7f7acce58640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 0x7f7ab807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.378+0000 7f7acce58640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 0x7f7ab807d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000c00 tx=0x7f7abc005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.382+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7ab4069d30 con 0x7f7ac8101a60 2024-09-17T01:49:40.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.663+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7ac819d8f0 con 0x7f7ac8101a60 2024-09-17T01:49:40.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.663+0000 7f7ac5ffb640 1 -- 172.21.15.82:0/267327883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7ab406ebe0 con 0x7f7ac8101a60 2024-09-17T01:49:40.661 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:49:40.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:49:40.663 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:49:40.663 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:49:40.663 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:49:40.663 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.665+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 msgr2=0x7f7ab807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.665+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 0x7f7ab807d3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7abc000c00 tx=0x7f7abc005a20 comp rx=0 tx=0).stop 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.665+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 msgr2=0x7f7ac8197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.665+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e970 tx=0x7f7ab400ee30 comp rx=0 tx=0).stop 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.665+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 shutdown_connections 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7ab807af30 0x7f7ab807d3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac8101a60 0x7f7ac8197a10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 --2- 172.21.15.82:0/267327883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ac8100860 0x7f7ac81974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 >> 172.21.15.82:0/267327883 conn(0x7f7ac80fc010 msgr2=0x7f7ac8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 shutdown_connections 2024-09-17T01:49:40.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.666+0000 7f7acf0bc640 1 -- 172.21.15.82:0/267327883 wait complete. 2024-09-17T01:49:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- 172.21.15.82:0/449547238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18100860 msgr2=0x7f2c18100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 --2- 172.21.15.82:0/449547238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18100860 0x7f2c18100c60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009880 tx=0x7f2c1402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- 172.21.15.82:0/449547238 shutdown_connections 2024-09-17T01:49:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 --2- 172.21.15.82:0/449547238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18101a60 0x7f2c18101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 --2- 172.21.15.82:0/449547238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18100860 0x7f2c18100c60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- 172.21.15.82:0/449547238 >> 172.21.15.82:0/449547238 conn(0x7f2c180fc010 msgr2=0x7f2c180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- 172.21.15.82:0/449547238 shutdown_connections 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- 172.21.15.82:0/449547238 wait complete. 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 Processor -- start 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.753+0000 7f2c1f417640 1 -- start start 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1f417640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18100860 0x7f2c1806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1f417640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1f417640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c181096a0 con 0x7f2c18101a60 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1f417640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c18109520 con 0x7f2c18100860 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60484/0 (socket says 172.21.15.82:60484) 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 -- 172.21.15.82:0/117733788 learned_addr learned my addr 172.21.15.82:0/117733788 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:40.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1d1b3640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18100860 0x7f2c1806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 -- 172.21.15.82:0/117733788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18100860 msgr2=0x7f2c1806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:40.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18100860 0x7f2c1806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:40.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 -- 172.21.15.82:0/117733788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1819c7f0 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.754+0000 7f2c1c9b2640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800d6f0 tx=0x7f2c0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.755+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c08017070 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.755+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1819cae0 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.755+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c0800de00 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.755+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c08004bb0 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.755+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1819d070 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.757+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2c08009a30 con 0x7f2c18101a60 2024-09-17T01:49:40.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.757+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c18100c60 con 0x7f2c18101a60 2024-09-17T01:49:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.757+0000 7f2c0e7fc640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.757+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f2c0809dcb0 con 0x7f2c18101a60 2024-09-17T01:49:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.758+0000 7f2c1d1b3640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:40.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.758+0000 7f2c1d1b3640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 0x7f2c0407d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009230 tx=0x7f2c140058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.766+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2c08069180 con 0x7f2c18101a60 2024-09-17T01:49:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:49:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all nfs 2024-09-17T01:49:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:49:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: pgmap v245: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 3 op/s 2024-09-17T01:49:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:40.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:40 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/267327883' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:40.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:40.999+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2c18062fb0 con 0x7f2c18101a60 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.000+0000 7f2c0e7fc640 1 -- 172.21.15.82:0/117733788 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2044 (secure 0 0 0) 0x7f2c0806e030 con 0x7f2c18101a60 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:e37 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:49:19:946718+0000 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:40.998 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 37 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:49:19.946714+0000 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:49:40.999 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34311,1=34315} 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:49:41.000 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34311 members: 34311,34315 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{0:34311} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:34358} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:34315} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{1:34362} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:41.001 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:49:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-09-17T01:49:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 msgr2=0x7f2c0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 0x7f2c0407d3f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009230 tx=0x7f2c140058d0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 msgr2=0x7f2c1819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800d6f0 tx=0x7f2c0800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 shutdown_connections 2024-09-17T01:49:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c18101a60 0x7f2c1819c230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 --2- 172.21.15.82:0/117733788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c18100860 0x7f2c1806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 >> 172.21.15.82:0/117733788 conn(0x7f2c180fc010 msgr2=0x7f2c18104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 shutdown_connections 2024-09-17T01:49:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.002+0000 7f2c1f417640 1 -- 172.21.15.82:0/117733788 wait complete. 2024-09-17T01:49:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all iscsi 2024-09-17T01:49:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all nfs 2024-09-17T01:49:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: Upgrade: Setting container_image for all nvmeof 2024-09-17T01:49:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: pgmap v245: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 3 op/s 2024-09-17T01:49:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:41.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:40 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/267327883' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 -- 172.21.15.82:0/99023336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 msgr2=0x7f4a18102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 --2- 172.21.15.82:0/99023336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a18102fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009880 tx=0x7f4a0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 -- 172.21.15.82:0/99023336 shutdown_connections 2024-09-17T01:49:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 --2- 172.21.15.82:0/99023336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a18102fe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 --2- 172.21.15.82:0/99023336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 0x7f4a18101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 -- 172.21.15.82:0/99023336 >> 172.21.15.82:0/99023336 conn(0x7f4a180fd0f0 msgr2=0x7f4a180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 -- 172.21.15.82:0/99023336 shutdown_connections 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.089+0000 7f4a20323640 1 -- 172.21.15.82:0/99023336 wait complete. 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 Processor -- start 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 -- start start 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 0x7f4a18197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1810a780 con 0x7f4a18102b60 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a20323640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1810a600 con 0x7f4a18101960 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60502/0 (socket says 172.21.15.82:60502) 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 -- 172.21.15.82:0/4037780025 learned_addr learned my addr 172.21.15.82:0/4037780025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:41.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1e0bf640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 0x7f4a18197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 -- 172.21.15.82:0/4037780025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 msgr2=0x7f4a18197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 0x7f4a18197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 -- 172.21.15.82:0/4037780025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18198040 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.090+0000 7f4a1d8be640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.091+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c03f070 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.091+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1819ca20 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.091+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a0c004ac0 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.091+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1819cfb0 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.091+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a0c035030 con 0x7f4a18102b60 2024-09-17T01:49:41.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.092+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a18101d60 con 0x7f4a18102b60 2024-09-17T01:49:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.092+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4a0c042070 con 0x7f4a18102b60 2024-09-17T01:49:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.093+0000 7f4a0b7fe640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 0x7f4a0407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.093+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f4a0c0beb10 con 0x7f4a18102b60 2024-09-17T01:49:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.093+0000 7f4a1e0bf640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 0x7f4a0407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.093+0000 7f4a1e0bf640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 0x7f4a0407d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a181029c0 tx=0x7f4a1400b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.097+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4a0c08a190 con 0x7f4a18102b60 2024-09-17T01:49:41.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.296+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4a18062630 con 0x7f4a0407af80 2024-09-17T01:49:41.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.297+0000 7f4a0b7fe640 1 -- 172.21.15.82:0/4037780025 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f4a18062630 con 0x7f4a0407af80 2024-09-17T01:49:41.295 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:49:41.295 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:49:41.295 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph-exporter", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:49:41.296 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 msgr2=0x7f4a0407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 0x7f4a0407d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4a181029c0 tx=0x7f4a1400b390 comp rx=0 tx=0).stop 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 msgr2=0x7f4a181979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c0046c0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 shutdown_connections 2024-09-17T01:49:41.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f4a0407af80 0x7f4a0407d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a18102b60 0x7f4a181979c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 --2- 172.21.15.82:0/4037780025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a18101960 0x7f4a18197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 >> 172.21.15.82:0/4037780025 conn(0x7f4a180fd0f0 msgr2=0x7f4a18106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 shutdown_connections 2024-09-17T01:49:41.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.300+0000 7f4a20323640 1 -- 172.21.15.82:0/4037780025 wait complete. 2024-09-17T01:49:41.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 -- 172.21.15.82:0/626499602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c104d20 msgr2=0x7fd96c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 --2- 172.21.15.82:0/626499602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c104d20 0x7fd96c107110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd9600098b0 tx=0x7fd96002a4d0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 -- 172.21.15.82:0/626499602 shutdown_connections 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 --2- 172.21.15.82:0/626499602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c104d20 0x7fd96c107110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 --2- 172.21.15.82:0/626499602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c1023f0 0x7fd96c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 -- 172.21.15.82:0/626499602 >> 172.21.15.82:0/626499602 conn(0x7fd96c0fc010 msgr2=0x7fd96c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 -- 172.21.15.82:0/626499602 shutdown_connections 2024-09-17T01:49:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.390+0000 7fd970ed6640 1 -- 172.21.15.82:0/626499602 wait complete. 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 Processor -- start 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 -- start start 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c104d20 0x7fd96c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c10a7b0 con 0x7fd96c1023f0 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd970ed6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c10a630 con 0x7fd96c104d20 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd96a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd96a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60512/0 (socket says 172.21.15.82:60512) 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.391+0000 7fd96a59c640 1 -- 172.21.15.82:0/2342127599 learned_addr learned my addr 172.21.15.82:0/2342127599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd969d9b640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c104d20 0x7fd96c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd96a59c640 1 -- 172.21.15.82:0/2342127599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c104d20 msgr2=0x7fd96c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd96a59c640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c104d20 0x7fd96c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd96a59c640 1 -- 172.21.15.82:0/2342127599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c1980f0 con 0x7fd96c1023f0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd96a59c640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00e970 tx=0x7fd95c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd95c00cac0 con 0x7fd96c1023f0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c19cb30 con 0x7fd96c1023f0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd95c0054e0 con 0x7fd96c1023f0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd95c010430 con 0x7fd96c1023f0 2024-09-17T01:49:41.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.392+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c19d090 con 0x7fd96c1023f0 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.393+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c1027d0 con 0x7fd96c1023f0 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.394+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd95c004ec0 con 0x7fd96c1023f0 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.395+0000 7fd95b7fe640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 0x7fd95407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.395+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fd95c09e720 con 0x7fd96c1023f0 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.395+0000 7fd969d9b640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 0x7fd95407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:49:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.395+0000 7fd969d9b640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 0x7fd95407d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd960009880 tx=0x7fd9600058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:49:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.401+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd95c069d20 con 0x7fd96c1023f0 2024-09-17T01:49:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.676+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd96c19da30 con 0x7fd96c1023f0 2024-09-17T01:49:41.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.677+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2342127599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fd95c06ebd0 con 0x7fd96c1023f0 2024-09-17T01:49:41.675 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:49:41.675 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:49:41.675 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:49:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.679+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 msgr2=0x7fd95407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.679+0000 7fd970ed6640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 0x7fd95407d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd960009880 tx=0x7fd9600058d0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 msgr2=0x7fd96c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00e970 tx=0x7fd95c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 shutdown_connections 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd95407af30 0x7fd95407d3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96c104d20 0x7fd96c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 --2- 172.21.15.82:0/2342127599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96c1023f0 0x7fd96c197530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 >> 172.21.15.82:0/2342127599 conn(0x7fd96c0fc010 msgr2=0x7fd96c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 shutdown_connections 2024-09-17T01:49:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:49:41.680+0000 7fd970ed6640 1 -- 172.21.15.82:0/2342127599 wait complete. 2024-09-17T01:49:41.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:41 smithi082 ceph-mon[92957]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:41.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:41 smithi082 ceph-mon[92957]: Upgrade: Updating node-exporter.smithi082 (1/2) 2024-09-17T01:49:41.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:41 smithi082 ceph-mon[92957]: Deploying daemon node-exporter.smithi082 on smithi082 2024-09-17T01:49:41.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:41 smithi082 ceph-mon[92957]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:41.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:41 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/117733788' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:49:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:41 smithi167 ceph-mon[76323]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:41 smithi167 ceph-mon[76323]: Upgrade: Updating node-exporter.smithi082 (1/2) 2024-09-17T01:49:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:41 smithi167 ceph-mon[76323]: Deploying daemon node-exporter.smithi082 on smithi082 2024-09-17T01:49:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:41 smithi167 ceph-mon[76323]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:41 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/117733788' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:49:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:42 smithi082 ceph-mon[92957]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:42 smithi082 ceph-mon[92957]: pgmap v246: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 4 op/s 2024-09-17T01:49:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:42 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2342127599' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:49:43.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:42 smithi167 ceph-mon[76323]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:49:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:42 smithi167 ceph-mon[76323]: pgmap v246: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 4 op/s 2024-09-17T01:49:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:42 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2342127599' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:49:44.864 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:44 smithi082 ceph-mon[92957]: pgmap v247: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:44 smithi167 ceph-mon[76323]: pgmap v247: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:46.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:46.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:46 smithi167 ceph-mon[76323]: pgmap v248: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:49:46.423 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:46.423 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:46.423 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:46 smithi082 ceph-mon[92957]: pgmap v248: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:49:47.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:47 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:47.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:47 smithi167 ceph-mon[76323]: Upgrade: Updating node-exporter.smithi167 (2/2) 2024-09-17T01:49:47.428 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:47 smithi167 ceph-mon[76323]: Deploying daemon node-exporter.smithi167 on smithi167 2024-09-17T01:49:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:47 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:49:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:47 smithi082 ceph-mon[92957]: Upgrade: Updating node-exporter.smithi167 (2/2) 2024-09-17T01:49:47.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:47 smithi082 ceph-mon[92957]: Deploying daemon node-exporter.smithi167 on smithi167 2024-09-17T01:49:48.295 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:48 smithi167 ceph-mon[76323]: pgmap v249: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:48.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:48 smithi082 ceph-mon[92957]: pgmap v249: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:50.842 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:50 smithi167 ceph-mon[76323]: pgmap v250: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:50 smithi082 ceph-mon[92957]: pgmap v250: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:51 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:52.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:51 smithi082 ceph-mon[92957]: pgmap v251: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:49:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:51 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:52.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:51 smithi167 ceph-mon[76323]: pgmap v251: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:49:54.014 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:53 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.014 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:53 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.014 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:53 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.014 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:53 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.014 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:53 smithi167 ceph-mon[76323]: pgmap v252: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:53 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:53 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:53 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:53 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:54.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:53 smithi082 ceph-mon[92957]: pgmap v252: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:49:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:56 smithi082 ceph-mon[92957]: pgmap v253: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:49:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.624 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:56 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.697 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.698 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.698 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:56 smithi167 ceph-mon[76323]: pgmap v253: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:49:56.698 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:56.698 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:56 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:57.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:57.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:57 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:58.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:57 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:58.873 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:58 smithi082 ceph-mon[92957]: pgmap v254: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:58 smithi167 ceph-mon[76323]: pgmap v254: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:49:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:59.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:49:59.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:49:59 smithi082 ceph-mon[92957]: pgmap v255: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:50:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:00.256 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:49:59 smithi167 ceph-mon[76323]: pgmap v255: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:00 smithi082 ceph-mon[92957]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:00 smithi082 ceph-mon[92957]: Upgrade: Updating prometheus.smithi082 2024-09-17T01:50:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:00 smithi082 ceph-mon[92957]: Deploying daemon prometheus.smithi082 on smithi082 2024-09-17T01:50:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:00 smithi167 ceph-mon[76323]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:00 smithi167 ceph-mon[76323]: Upgrade: Updating prometheus.smithi082 2024-09-17T01:50:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:00 smithi167 ceph-mon[76323]: Deploying daemon prometheus.smithi082 on smithi082 2024-09-17T01:50:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:01 smithi082 ceph-mon[92957]: pgmap v256: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:01 smithi167 ceph-mon[76323]: pgmap v256: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:04 smithi082 ceph-mon[92957]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:04 smithi167 ceph-mon[76323]: pgmap v257: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:06.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:06 smithi082 ceph-mon[92957]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:06 smithi167 ceph-mon[76323]: pgmap v258: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:08.788 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:08 smithi082 ceph-mon[92957]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:08 smithi167 ceph-mon[76323]: pgmap v259: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:10.817 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:10 smithi082 ceph-mon[92957]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:10 smithi167 ceph-mon[76323]: pgmap v260: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.768+0000 7f54e8b33640 1 -- 172.21.15.82:0/2049727523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4102450 msgr2=0x7f54e4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.768+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2049727523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4102450 0x7f54e4104840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009880 tx=0x7f54d402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 -- 172.21.15.82:0/2049727523 shutdown_connections 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2049727523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4104d80 0x7f54e4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2049727523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4102450 0x7f54e4104840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 -- 172.21.15.82:0/2049727523 >> 172.21.15.82:0/2049727523 conn(0x7f54e40fc010 msgr2=0x7f54e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:11.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 -- 172.21.15.82:0/2049727523 shutdown_connections 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 -- 172.21.15.82:0/2049727523 wait complete. 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.769+0000 7f54e8b33640 1 Processor -- start 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e8b33640 1 -- start start 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e8b33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4102450 0x7f54e4197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e8b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e8b33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410a770 con 0x7f54e4104d80 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e8b33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410a5f0 con 0x7f54e4102450 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37836/0 (socket says 172.21.15.82:37836) 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 -- 172.21.15.82:0/2398275031 learned_addr learned my addr 172.21.15.82:0/2398275031 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54e259c640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4102450 0x7f54e4197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:11.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 -- 172.21.15.82:0/2398275031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4102450 msgr2=0x7f54e4197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4102450 0x7f54e4197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.770+0000 7f54d9d9b640 1 -- 172.21.15.82:0/2398275031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e4198030 con 0x7f54e4104d80 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54d9d9b640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e970 tx=0x7f54cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54cc00cac0 con 0x7f54e4104d80 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e419ca70 con 0x7f54e4104d80 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e419d000 con 0x7f54e4104d80 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54cc0054e0 con 0x7f54e4104d80 2024-09-17T01:50:11.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.771+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54cc004bf0 con 0x7f54e4104d80 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.772+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c40052c0 con 0x7f54e4104d80 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.773+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f54cc00cc60 con 0x7f54e4104d80 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.773+0000 7f54dbfff640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 0x7f54d007d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.774+0000 7f54e259c640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 0x7f54d007d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.774+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f54cc09e160 con 0x7f54e4104d80 2024-09-17T01:50:11.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.774+0000 7f54e259c640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 0x7f54d007d5f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000c00 tx=0x7f54d40058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:11.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.778+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f54cc069760 con 0x7f54e4104d80 2024-09-17T01:50:11.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.979+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f54c4000bf0 con 0x7f54d007b130 2024-09-17T01:50:11.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.980+0000 7f54dbfff640 1 -- 172.21.15.82:0/2398275031 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7f54c4000bf0 con 0x7f54d007b130 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 msgr2=0x7f54d007d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 0x7f54d007d5f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000c00 tx=0x7f54d40058d0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 msgr2=0x7f54e41979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00e970 tx=0x7f54cc00ee30 comp rx=0 tx=0).stop 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 shutdown_connections 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f54d007b130 0x7f54d007d5f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54e4104d80 0x7f54e41979b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 --2- 172.21.15.82:0/2398275031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54e4102450 0x7f54e4197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 >> 172.21.15.82:0/2398275031 conn(0x7f54e40fc010 msgr2=0x7f54e40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 shutdown_connections 2024-09-17T01:50:11.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:11.982+0000 7f54e8b33640 1 -- 172.21.15.82:0/2398275031 wait complete. 2024-09-17T01:50:11.990 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:50:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.067+0000 7f8615b4c640 1 -- 172.21.15.82:0/1988109305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 msgr2=0x7f8610101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.067+0000 7f8615b4c640 1 --2- 172.21.15.82:0/1988109305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610101ee0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009880 tx=0x7f85f802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.067+0000 7f8615b4c640 1 -- 172.21.15.82:0/1988109305 shutdown_connections 2024-09-17T01:50:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 --2- 172.21.15.82:0/1988109305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610101ee0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 --2- 172.21.15.82:0/1988109305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 0x7f8610100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 -- 172.21.15.82:0/1988109305 >> 172.21.15.82:0/1988109305 conn(0x7f86100fc010 msgr2=0x7f86100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 -- 172.21.15.82:0/1988109305 shutdown_connections 2024-09-17T01:50:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 -- 172.21.15.82:0/1988109305 wait complete. 2024-09-17T01:50:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 Processor -- start 2024-09-17T01:50:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.068+0000 7f8615b4c640 1 -- start start 2024-09-17T01:50:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f8615b4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 0x7f86101963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f8615b4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f8615b4c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86101096a0 con 0x7f8610101a60 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f8615b4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8610109520 con 0x7f8610100860 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37846/0 (socket says 172.21.15.82:37846) 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 -- 172.21.15.82:0/3070550832 learned_addr learned my addr 172.21.15.82:0/3070550832 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860f7fe640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 0x7f86101963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 -- 172.21.15.82:0/3070550832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 msgr2=0x7f86101963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 0x7f86101963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 -- 172.21.15.82:0/3070550832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8610196f90 con 0x7f8610101a60 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860effd640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006010 tx=0x7f85f8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85f803f070 con 0x7f8610101a60 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861019b970 con 0x7f8610101a60 2024-09-17T01:50:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85f80049d0 con 0x7f8610101a60 2024-09-17T01:50:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.069+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85f8035030 con 0x7f8610101a60 2024-09-17T01:50:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.070+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861019bf00 con 0x7f8610101a60 2024-09-17T01:50:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.070+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8610100c60 con 0x7f8610101a60 2024-09-17T01:50:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.071+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f85f8042070 con 0x7f8610101a60 2024-09-17T01:50:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.072+0000 7f860cff9640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 0x7f85fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.072+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f85f80beb90 con 0x7f8610101a60 2024-09-17T01:50:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.072+0000 7f860f7fe640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 0x7f85fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.072+0000 7f860f7fe640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 0x7f85fc07d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86101018c0 tx=0x7f8600009500 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.076+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f85f808a190 con 0x7f8610101a60 2024-09-17T01:50:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.271+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f86100626f0 con 0x7f85fc07af30 2024-09-17T01:50:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.272+0000 7f860cff9640 1 -- 172.21.15.82:0/3070550832 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7f86100626f0 con 0x7f85fc07af30 2024-09-17T01:50:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 msgr2=0x7f85fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 0x7f85fc07d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86101018c0 tx=0x7f8600009500 comp rx=0 tx=0).stop 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 msgr2=0x7f8610196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006010 tx=0x7f85f8004570 comp rx=0 tx=0).stop 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 shutdown_connections 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f85fc07af30 0x7f85fc07d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8610101a60 0x7f8610196910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 --2- 172.21.15.82:0/3070550832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8610100860 0x7f86101963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.274+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 >> 172.21.15.82:0/3070550832 conn(0x7f86100fc010 msgr2=0x7f8610104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.275+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 shutdown_connections 2024-09-17T01:50:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.275+0000 7f8615b4c640 1 -- 172.21.15.82:0/3070550832 wait complete. 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 -- 172.21.15.82:0/3007418956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 msgr2=0x7f50f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3007418956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f8100c60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009880 tx=0x7f50e802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 -- 172.21.15.82:0/3007418956 shutdown_connections 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3007418956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 0x7f50f8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3007418956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f8100c60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 -- 172.21.15.82:0/3007418956 >> 172.21.15.82:0/3007418956 conn(0x7f50f80fc010 msgr2=0x7f50f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 -- 172.21.15.82:0/3007418956 shutdown_connections 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.356+0000 7f50fdfae640 1 -- 172.21.15.82:0/3007418956 wait complete. 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 Processor -- start 2024-09-17T01:50:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 -- start start 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 0x7f50f81979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50f81096a0 con 0x7f50f8100860 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50fdfae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f50f8109520 con 0x7f50f8101a60 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37862/0 (socket says 172.21.15.82:37862) 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50f77fe640 1 -- 172.21.15.82:0/3629673693 learned_addr learned my addr 172.21.15.82:0/3629673693 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.357+0000 7f50f6ffd640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 0x7f50f81979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f77fe640 1 -- 172.21.15.82:0/3629673693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 msgr2=0x7f50f81979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f77fe640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 0x7f50f81979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f77fe640 1 -- 172.21.15.82:0/3629673693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8198070 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f77fe640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006010 tx=0x7f50e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50e803f070 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f819ca50 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50e80049d0 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50e8035030 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.358+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f819cfe0 con 0x7f50f8100860 2024-09-17T01:50:12.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.359+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f8100c60 con 0x7f50f8100860 2024-09-17T01:50:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.360+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f50e8042070 con 0x7f50f8100860 2024-09-17T01:50:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.360+0000 7f50f4ff9640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 0x7f50e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.360+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f50e80beac0 con 0x7f50f8100860 2024-09-17T01:50:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.360+0000 7f50f6ffd640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 0x7f50e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.361+0000 7f50f6ffd640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 0x7f50e007d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50f8198960 tx=0x7f50ec005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.365+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f50e808a0c0 con 0x7f50f8100860 2024-09-17T01:50:12.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.551+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f50f806a8f0 con 0x7f50e007af30 2024-09-17T01:50:12.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.561+0000 7f50f4ff9640 1 -- 172.21.15.82:0/3629673693 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f50f806a8f0 con 0x7f50e007af30 2024-09-17T01:50:12.559 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:50:12.559 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (15m) 17s ago 16m 24.7M - 0.25.0 c8568f914cd2 fa71c1e289f7 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (46s) 17s ago 16m 75.4M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 01a86954347f 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (42s) 19s ago 16m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 04be388af4a1 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 17s ago 16m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (6m) 19s ago 16m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (15m) 17s ago 16m 79.6M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (117s) 17s ago 11m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (102s) 17s ago 11m 83.6M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (83s) 19s ago 11m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (66s) 19s ago 11m 85.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e cb24609f3962 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (7m) 17s ago 18m 594M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (6m) 19s ago 15m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (6m) 17s ago 18m 119M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:50:12.560 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (6m) 19s ago 15m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (28s) 17s ago 16m 7239k - 1.7.0 72c9c2088986 708402080be5 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (22s) 19s ago 15m 3460k - 1.7.0 72c9c2088986 2f85a91a5a1a 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (5m) 17s ago 14m 161M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 17s ago 14m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (4m) 17s ago 13m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (3m) 19s ago 13m 178M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (3m) 19s ago 12m 159M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (2m) 19s ago 12m 162M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:50:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (6m) 17s ago 16m 69.4M - 2.43.0 a07b618ecd1d 5a9a7fcd6b44 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 msgr2=0x7f50e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 0x7f50e007d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50f8198960 tx=0x7f50ec005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 msgr2=0x7f50f81974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f50e8006010 tx=0x7f50e80045e0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 shutdown_connections 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f50e007af30 0x7f50e007d3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f50f8101a60 0x7f50f81979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 --2- 172.21.15.82:0/3629673693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f8100860 0x7f50f81974b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 >> 172.21.15.82:0/3629673693 conn(0x7f50f80fc010 msgr2=0x7f50f806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 shutdown_connections 2024-09-17T01:50:12.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.564+0000 7f50fdfae640 1 -- 172.21.15.82:0/3629673693 wait complete. 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.645+0000 7fe04f34b640 1 -- 172.21.15.82:0/479962437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048102410 msgr2=0x7fe048104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.645+0000 7fe04f34b640 1 --2- 172.21.15.82:0/479962437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048102410 0x7fe048104800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe0440098b0 tx=0x7fe04402a4d0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 -- 172.21.15.82:0/479962437 shutdown_connections 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 --2- 172.21.15.82:0/479962437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048104d40 0x7fe048107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 --2- 172.21.15.82:0/479962437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048102410 0x7fe048104800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 -- 172.21.15.82:0/479962437 >> 172.21.15.82:0/479962437 conn(0x7fe0480fc010 msgr2=0x7fe0480fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 -- 172.21.15.82:0/479962437 shutdown_connections 2024-09-17T01:50:12.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 -- 172.21.15.82:0/479962437 wait complete. 2024-09-17T01:50:12.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.646+0000 7fe04f34b640 1 Processor -- start 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04f34b640 1 -- start start 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04f34b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048102410 0x7fe048101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04f34b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04f34b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe04810a800 con 0x7fe048104d40 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04f34b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe04810a680 con 0x7fe048102410 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37876/0 (socket says 172.21.15.82:37876) 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04d0e7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048102410 0x7fe048101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 -- 172.21.15.82:0/2352123845 learned_addr learned my addr 172.21.15.82:0/2352123845 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 -- 172.21.15.82:0/2352123845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048102410 msgr2=0x7fe048101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048102410 0x7fe048101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.647+0000 7fe04c8e6640 1 -- 172.21.15.82:0/2352123845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048100900 con 0x7fe048104d40 2024-09-17T01:50:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.648+0000 7fe04c8e6640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c8f0 tx=0x7fe03800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.650+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe0380079b0 con 0x7fe048104d40 2024-09-17T01:50:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.650+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe038007b50 con 0x7fe048104d40 2024-09-17T01:50:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.650+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe048100bf0 con 0x7fe048104d40 2024-09-17T01:50:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.650+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe038018630 con 0x7fe048104d40 2024-09-17T01:50:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.650+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe048101180 con 0x7fe048104d40 2024-09-17T01:50:12.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.651+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0481027f0 con 0x7fe048104d40 2024-09-17T01:50:12.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.652+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe03800f9a0 con 0x7fe048104d40 2024-09-17T01:50:12.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.652+0000 7fe03e7fc640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 0x7fe03407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:12.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.652+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fe03809e0c0 con 0x7fe048104d40 2024-09-17T01:50:12.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.652+0000 7fe04d0e7640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 0x7fe03407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:12.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.653+0000 7fe04d0e7640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 0x7fe03407d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe044006010 tx=0x7fe0440058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:12.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.657+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe038014030 con 0x7fe048104d40 2024-09-17T01:50:12.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.914+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe04819f660 con 0x7fe048104d40 2024-09-17T01:50:12.913 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:12 smithi082 ceph-mon[92957]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:12.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.915+0000 7fe03e7fc640 1 -- 172.21.15.82:0/2352123845 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe038069740 con 0x7fe048104d40 2024-09-17T01:50:12.913 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:12.914 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:50:12.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:50:12.915 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:50:12.915 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:50:12.916 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:12 smithi167 ceph-mon[76323]: pgmap v261: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:12.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 msgr2=0x7fe03407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 0x7fe03407d440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe044006010 tx=0x7fe0440058d0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 msgr2=0x7fe0481003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c8f0 tx=0x7fe03800cdb0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 shutdown_connections 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe03407af80 0x7fe03407d440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe048104d40 0x7fe0481003c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 --2- 172.21.15.82:0/2352123845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe048102410 0x7fe048101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 >> 172.21.15.82:0/2352123845 conn(0x7fe0480fc010 msgr2=0x7fe0480fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 shutdown_connections 2024-09-17T01:50:12.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:12.918+0000 7fe04f34b640 1 -- 172.21.15.82:0/2352123845 wait complete. 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.012+0000 7f556f1a0640 1 -- 172.21.15.82:0/2590935855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 msgr2=0x7f5568102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.012+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2590935855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f5568102fe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5554009880 tx=0x7f555402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 -- 172.21.15.82:0/2590935855 shutdown_connections 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2590935855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f5568102fe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2590935855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 0x7f5568101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 -- 172.21.15.82:0/2590935855 >> 172.21.15.82:0/2590935855 conn(0x7f55680fd110 msgr2=0x7f55680ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 -- 172.21.15.82:0/2590935855 shutdown_connections 2024-09-17T01:50:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 -- 172.21.15.82:0/2590935855 wait complete. 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 Processor -- start 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.013+0000 7f556f1a0640 1 -- start start 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f556f1a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 0x7f5568075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f556f1a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f556f1a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f556810a7a0 con 0x7f5568102b60 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f556f1a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f556810a620 con 0x7f5568101960 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37898/0 (socket says 172.21.15.82:37898) 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 -- 172.21.15.82:0/2639595063 learned_addr learned my addr 172.21.15.82:0/2639595063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f556cf3c640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 0x7f5568075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 -- 172.21.15.82:0/2639595063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 msgr2=0x7f5568075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 0x7f5568075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 -- 172.21.15.82:0/2639595063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5568074b20 con 0x7f5568102b60 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.014+0000 7f5567fff640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5554006010 tx=0x7f5554004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.015+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f555403f070 con 0x7f5568102b60 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.015+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5568074db0 con 0x7f5568102b60 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.015+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55540049d0 con 0x7f5568102b60 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.015+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5554035030 con 0x7f5568102b60 2024-09-17T01:50:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.015+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55680752e0 con 0x7f5568102b60 2024-09-17T01:50:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.016+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5568101d60 con 0x7f5568102b60 2024-09-17T01:50:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.017+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5554042070 con 0x7f5568102b60 2024-09-17T01:50:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.018+0000 7f5565ffb640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 0x7f555807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.018+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f55540bf0c0 con 0x7f5568102b60 2024-09-17T01:50:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.018+0000 7f556cf3c640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 0x7f555807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.019+0000 7f556cf3c640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 0x7f555807d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55681029c0 tx=0x7f555c005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.023+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f555408a7e0 con 0x7f5568102b60 2024-09-17T01:50:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.272+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f556802d7c0 con 0x7f5568102b60 2024-09-17T01:50:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.272+0000 7f5565ffb640 1 -- 172.21.15.82:0/2639595063 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2044 (secure 0 0 0) 0x7f555408f690 con 0x7f5568102b60 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:e37 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:49:19:946718+0000 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:50:13.271 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 37 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:49:19.946714+0000 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:50:13.272 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34311,1=34315} 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:50:13.273 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34311 members: 34311,34315 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{0:34311} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:34358} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:34315} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{1:34362} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:13.274 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 msgr2=0x7f555807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 0x7f555807d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55681029c0 tx=0x7f555c005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 msgr2=0x7f55680745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5554006010 tx=0x7f5554004570 comp rx=0 tx=0).stop 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 shutdown_connections 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f555807af80 0x7f555807d440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5568102b60 0x7f55680745e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 --2- 172.21.15.82:0/2639595063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5568101960 0x7f5568075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 >> 172.21.15.82:0/2639595063 conn(0x7f55680fd110 msgr2=0x7f5568106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 shutdown_connections 2024-09-17T01:50:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.276+0000 7f556f1a0640 1 -- 172.21.15.82:0/2639595063 wait complete. 2024-09-17T01:50:13.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 -- 172.21.15.82:0/634219484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c101df0 msgr2=0x7f935c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 --2- 172.21.15.82:0/634219484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c101df0 0x7f935c1021f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f934c009880 tx=0x7f934c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 -- 172.21.15.82:0/634219484 shutdown_connections 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 --2- 172.21.15.82:0/634219484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c100b30 0x7f935c100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 --2- 172.21.15.82:0/634219484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c101df0 0x7f935c1021f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 -- 172.21.15.82:0/634219484 >> 172.21.15.82:0/634219484 conn(0x7f935c0fb770 msgr2=0x7f935c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 -- 172.21.15.82:0/634219484 shutdown_connections 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.366+0000 7f93628d6640 1 -- 172.21.15.82:0/634219484 wait complete. 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 Processor -- start 2024-09-17T01:50:13.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 -- start start 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c101df0 0x7f935c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f935c109680 con 0x7f935c100b30 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f93628d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f935c109500 con 0x7f935c101df0 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37916/0 (socket says 172.21.15.82:37916) 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935bfff640 1 -- 172.21.15.82:0/2183036937 learned_addr learned my addr 172.21.15.82:0/2183036937 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935b7fe640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c101df0 0x7f935c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935bfff640 1 -- 172.21.15.82:0/2183036937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c101df0 msgr2=0x7f935c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.367+0000 7f935bfff640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c101df0 0x7f935c197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f935bfff640 1 -- 172.21.15.82:0/2183036937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c198100 con 0x7f935c100b30 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f935bfff640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f934c006010 tx=0x7f934c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f934c03f070 con 0x7f935c100b30 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c19cae0 con 0x7f935c100b30 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f934c004a50 con 0x7f935c100b30 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f934c035030 con 0x7f935c100b30 2024-09-17T01:50:13.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.368+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c19d070 con 0x7f935c100b30 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.369+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935c100fb0 con 0x7f935c100b30 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.370+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f934c042070 con 0x7f935c100b30 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.370+0000 7f93597fa640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 0x7f934407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.370+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f934c0bead0 con 0x7f935c100b30 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.370+0000 7f935b7fe640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 0x7f934407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.371+0000 7f935b7fe640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 0x7f934407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f935c1989f0 tx=0x7f935000b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.375+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f934c004c00 con 0x7f935c100b30 2024-09-17T01:50:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.570+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f935c100180 con 0x7f934407af30 2024-09-17T01:50:13.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.572+0000 7f93597fa640 1 -- 172.21.15.82:0/2183036937 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+463 (secure 0 0 0) 0x7f935c100180 con 0x7f934407af30 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph-exporter", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:50:13.570 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:50:13.571 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:50:13.571 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-17T01:50:13.571 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:50:13.571 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 msgr2=0x7f934407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 0x7f934407d3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f935c1989f0 tx=0x7f935000b390 comp rx=0 tx=0).stop 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 msgr2=0x7f935c197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f934c006010 tx=0x7f934c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 shutdown_connections 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f934407af30 0x7f934407d3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f935c101df0 0x7f935c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 --2- 172.21.15.82:0/2183036937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f935c100b30 0x7f935c197540 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 >> 172.21.15.82:0/2183036937 conn(0x7f935c0fb770 msgr2=0x7f935c0ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 shutdown_connections 2024-09-17T01:50:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.574+0000 7f93628d6640 1 -- 172.21.15.82:0/2183036937 wait complete. 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 -- 172.21.15.82:0/3003815128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 msgr2=0x7f7cc4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3003815128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4101d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009880 tx=0x7f7cb402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 -- 172.21.15.82:0/3003815128 shutdown_connections 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3003815128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 0x7f7cc4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3003815128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4101d70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 -- 172.21.15.82:0/3003815128 >> 172.21.15.82:0/3003815128 conn(0x7f7cc40fd140 msgr2=0x7f7cc40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.655+0000 7f7cc896a640 1 -- 172.21.15.82:0/3003815128 shutdown_connections 2024-09-17T01:50:13.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.656+0000 7f7cc896a640 1 -- 172.21.15.82:0/3003815128 wait complete. 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.656+0000 7f7cc896a640 1 Processor -- start 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.656+0000 7f7cc896a640 1 -- start start 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc896a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc896a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 0x7f7cc40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc896a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc410a7b0 con 0x7f7cc4101970 2024-09-17T01:50:13.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc896a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc410a630 con 0x7f7cc4102b70 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37934/0 (socket says 172.21.15.82:37934) 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 -- 172.21.15.82:0/3732097802 learned_addr learned my addr 172.21.15.82:0/3732097802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cbbfff640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 0x7f7cc40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 -- 172.21.15.82:0/3732097802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 msgr2=0x7f7cc40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 0x7f7cc40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 -- 172.21.15.82:0/3732097802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc4074b20 con 0x7f7cc4101970 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc259c640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4006010 tx=0x7f7cb40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb403f070 con 0x7f7cc4101970 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc4074db0 con 0x7f7cc4101970 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cb40049d0 con 0x7f7cc4101970 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.657+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cb4035030 con 0x7f7cc4101970 2024-09-17T01:50:13.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.658+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc40752e0 con 0x7f7cc4101970 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.659+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc4101d70 con 0x7f7cc4101970 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.659+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7cb4042070 con 0x7f7cc4101970 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.660+0000 7f7cbb7fe640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 0x7f7cb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.660+0000 7f7cbbfff640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 0x7f7cb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.660+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f7cb40beaf0 con 0x7f7cc4101970 2024-09-17T01:50:13.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.660+0000 7f7cbbfff640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 0x7f7cb007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4075ca0 tx=0x7f7cac005f90 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:13.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.664+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7cb408a0f0 con 0x7f7cc4101970 2024-09-17T01:50:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:13 smithi082 ceph-mon[92957]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:13 smithi082 ceph-mon[92957]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:13 smithi082 ceph-mon[92957]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:13 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2352123845' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:13.874 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:13 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2639595063' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:50:13.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.921+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7cc4062df0 con 0x7f7cc4101970 2024-09-17T01:50:13.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.922+0000 7f7cbb7fe640 1 -- 172.21.15.82:0/3732097802 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f7cb408efa0 con 0x7f7cc4101970 2024-09-17T01:50:13.920 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:13.920 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:13.920 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 msgr2=0x7f7cb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 0x7f7cb007d3f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4075ca0 tx=0x7f7cac005f90 comp rx=0 tx=0).stop 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 msgr2=0x7f7cc4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4006010 tx=0x7f7cb40045e0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 shutdown_connections 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7cb007af30 0x7f7cb007d3f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cc4102b70 0x7f7cc40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 --2- 172.21.15.82:0/3732097802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cc4101970 0x7f7cc4075f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:13.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 >> 172.21.15.82:0/3732097802 conn(0x7f7cc40fd140 msgr2=0x7f7cc4105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:13.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 shutdown_connections 2024-09-17T01:50:13.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:13.924+0000 7f7cc896a640 1 -- 172.21.15.82:0/3732097802 wait complete. 2024-09-17T01:50:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:13 smithi167 ceph-mon[76323]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:13 smithi167 ceph-mon[76323]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:13 smithi167 ceph-mon[76323]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:13 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2352123845' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:14.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:13 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2639595063' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3732097802' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:14.954 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:14 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: pgmap v262: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3732097802' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:14 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:16 smithi082 ceph-mon[92957]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:16.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:16 smithi167 ceph-mon[76323]: pgmap v263: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:18 smithi082 ceph-mon[92957]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:18.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:18 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:18 smithi167 ceph-mon[76323]: pgmap v264: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:18 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:20.440 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:20.440 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:20 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:20.440 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:20 smithi082 ceph-mon[92957]: pgmap v265: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:20 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:20.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:20 smithi167 ceph-mon[76323]: pgmap v265: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-17T01:50:22.899 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:22.900 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:22 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: pgmap v266: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:50:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:22 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:23.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:23 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:50:23.941 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:23 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-17T01:50:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:24 smithi082 ceph-mon[92957]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:24 smithi082 ceph-mon[92957]: Upgrade: Updating alertmanager.smithi082 2024-09-17T01:50:24.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:24 smithi082 ceph-mon[92957]: Deploying daemon alertmanager.smithi082 on smithi082 2024-09-17T01:50:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:24 smithi167 ceph-mon[76323]: pgmap v267: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:24 smithi167 ceph-mon[76323]: Upgrade: Updating alertmanager.smithi082 2024-09-17T01:50:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:24 smithi167 ceph-mon[76323]: Deploying daemon alertmanager.smithi082 on smithi082 2024-09-17T01:50:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:26 smithi082 ceph-mon[92957]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:27.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:26 smithi167 ceph-mon[76323]: pgmap v268: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:28.932 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:28 smithi082 ceph-mon[92957]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:28 smithi167 ceph-mon[76323]: pgmap v269: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:30.945 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:30 smithi082 ceph-mon[92957]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:30 smithi167 ceph-mon[76323]: pgmap v270: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:32.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:32.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:32 smithi082 ceph-mon[92957]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:32 smithi167 ceph-mon[76323]: pgmap v271: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:33.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:33.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:33.937 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:33 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:34.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:33 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:34.871 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:34 smithi082 ceph-mon[92957]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:35.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:34 smithi167 ceph-mon[76323]: pgmap v272: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:36 smithi082 ceph-mon[92957]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:36.983 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:36 smithi167 ceph-mon[76323]: pgmap v273: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:38.107 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.107 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:37 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.108 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:37 smithi082 ceph-mon[92957]: pgmap v274: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:37 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:37 smithi167 ceph-mon[76323]: pgmap v274: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:40 smithi082 ceph-mon[92957]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:41.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:40 smithi167 ceph-mon[76323]: pgmap v275: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:41.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:41.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:41 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-17T01:50:42.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:41 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:42.762 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:42 smithi167 ceph-mon[76323]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:42.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:42 smithi082 ceph-mon[92957]: pgmap v276: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:44.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:43 smithi167 ceph-mon[76323]: Upgrade: Updating grafana.smithi082 2024-09-17T01:50:44.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:43 smithi167 ceph-mon[76323]: Deploying daemon grafana.smithi082 on smithi082 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 -- 172.21.15.82:0/924046086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c100880 msgr2=0x7fc28c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 --2- 172.21.15.82:0/924046086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c100880 0x7fc28c100c80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009880 tx=0x7fc27c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 -- 172.21.15.82:0/924046086 shutdown_connections 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 --2- 172.21.15.82:0/924046086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c101a80 0x7fc28c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 --2- 172.21.15.82:0/924046086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c100880 0x7fc28c100c80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 -- 172.21.15.82:0/924046086 >> 172.21.15.82:0/924046086 conn(0x7fc28c0fc010 msgr2=0x7fc28c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 -- 172.21.15.82:0/924046086 shutdown_connections 2024-09-17T01:50:44.025 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:43 smithi082 ceph-mon[92957]: Upgrade: Updating grafana.smithi082 2024-09-17T01:50:44.025 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:43 smithi082 ceph-mon[92957]: Deploying daemon grafana.smithi082 on smithi082 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.025+0000 7fc290edd640 1 -- 172.21.15.82:0/924046086 wait complete. 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 Processor -- start 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 -- start start 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 0x7fc28c1087c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10a7d0 con 0x7fc28c101a80 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc290edd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c10a650 con 0x7fc28c100880 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc289d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc289d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55982/0 (socket says 172.21.15.82:55982) 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc289d9b640 1 -- 172.21.15.82:0/2723596424 learned_addr learned my addr 172.21.15.82:0/2723596424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.026+0000 7fc28a59c640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 0x7fc28c1087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc289d9b640 1 -- 172.21.15.82:0/2723596424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 msgr2=0x7fc28c1087c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc289d9b640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 0x7fc28c1087c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc289d9b640 1 -- 172.21.15.82:0/2723596424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1073c0 con 0x7fc28c101a80 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc28a59c640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 0x7fc28c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc289d9b640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc28000e970 tx=0x7fc28000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc28000cac0 con 0x7fc28c101a80 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1076b0 con 0x7fc28c101a80 2024-09-17T01:50:44.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2800054e0 con 0x7fc28c101a80 2024-09-17T01:50:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc280010430 con 0x7fc28c101a80 2024-09-17T01:50:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.027+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c107c40 con 0x7fc28c101a80 2024-09-17T01:50:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.028+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c100c80 con 0x7fc28c101a80 2024-09-17T01:50:44.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.029+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc280004e80 con 0x7fc28c101a80 2024-09-17T01:50:44.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.030+0000 7fc27b7fe640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 0x7fc27407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.030+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fc28009e670 con 0x7fc28c101a80 2024-09-17T01:50:44.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.030+0000 7fc28a59c640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 0x7fc27407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.030+0000 7fc28a59c640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 0x7fc27407d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006010 tx=0x7fc27c005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.036+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc280069c70 con 0x7fc28c101a80 2024-09-17T01:50:44.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.349+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc28c062630 con 0x7fc27407af40 2024-09-17T01:50:44.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.351+0000 7fc27b7fe640 1 -- 172.21.15.82:0/2723596424 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+460 (secure 0 0 0) 0x7fc28c062630 con 0x7fc27407af40 2024-09-17T01:50:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 msgr2=0x7fc27407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 0x7fc27407d400 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006010 tx=0x7fc27c005a20 comp rx=0 tx=0).stop 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 msgr2=0x7fc28c106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc28000e970 tx=0x7fc28000ed70 comp rx=0 tx=0).stop 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 shutdown_connections 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc27407af40 0x7fc27407d400 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc28c101a80 0x7fc28c106e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 --2- 172.21.15.82:0/2723596424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc28c100880 0x7fc28c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 >> 172.21.15.82:0/2723596424 conn(0x7fc28c0fc010 msgr2=0x7fc28c104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 shutdown_connections 2024-09-17T01:50:44.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.354+0000 7fc290edd640 1 -- 172.21.15.82:0/2723596424 wait complete. 2024-09-17T01:50:44.364 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:50:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 -- 172.21.15.82:0/1160413202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138102490 msgr2=0x7fc138104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 --2- 172.21.15.82:0/1160413202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138102490 0x7fc138104880 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc128009880 tx=0x7fc12802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 -- 172.21.15.82:0/1160413202 shutdown_connections 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 --2- 172.21.15.82:0/1160413202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138104dc0 0x7fc1381071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 --2- 172.21.15.82:0/1160413202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138102490 0x7fc138104880 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 -- 172.21.15.82:0/1160413202 >> 172.21.15.82:0/1160413202 conn(0x7fc1380fc010 msgr2=0x7fc1380fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 -- 172.21.15.82:0/1160413202 shutdown_connections 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.465+0000 7fc13db89640 1 -- 172.21.15.82:0/1160413202 wait complete. 2024-09-17T01:50:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 Processor -- start 2024-09-17T01:50:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 -- start start 2024-09-17T01:50:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138102490 0x7fc138197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc13810a7d0 con 0x7fc138104dc0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc13db89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc13810a650 con 0x7fc138102490 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc136ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc136ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56000/0 (socket says 172.21.15.82:56000) 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc136ffd640 1 -- 172.21.15.82:0/2770870175 learned_addr learned my addr 172.21.15.82:0/2770870175 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.466+0000 7fc1377fe640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138102490 0x7fc138197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc136ffd640 1 -- 172.21.15.82:0/2770870175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138102490 msgr2=0x7fc138197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc136ffd640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138102490 0x7fc138197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc136ffd640 1 -- 172.21.15.82:0/2770870175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1381980e0 con 0x7fc138104dc0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc136ffd640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d6c0 tx=0x7fc12c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc12c017070 con 0x7fc138104dc0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc12c0054e0 con 0x7fc138104dc0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13819cb20 con 0x7fc138104dc0 2024-09-17T01:50:44.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.467+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc12c004b70 con 0x7fc138104dc0 2024-09-17T01:50:44.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.468+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13819d0b0 con 0x7fc138104dc0 2024-09-17T01:50:44.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.469+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc138102870 con 0x7fc138104dc0 2024-09-17T01:50:44.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.469+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc12c009820 con 0x7fc138104dc0 2024-09-17T01:50:44.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.470+0000 7fc134ff9640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 0x7fc12007d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.470+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fc12c09db30 con 0x7fc138104dc0 2024-09-17T01:50:44.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.470+0000 7fc1377fe640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 0x7fc12007d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.471+0000 7fc1377fe640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 0x7fc12007d490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.476+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc12c069110 con 0x7fc138104dc0 2024-09-17T01:50:44.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.812+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc138105740 con 0x7fc12007afd0 2024-09-17T01:50:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.814+0000 7fc134ff9640 1 -- 172.21.15.82:0/2770870175 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+460 (secure 0 0 0) 0x7fc138105740 con 0x7fc12007afd0 2024-09-17T01:50:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.817+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 msgr2=0x7fc12007d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.817+0000 7fc13db89640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 0x7fc12007d490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280058d0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 msgr2=0x7fc138197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d6c0 tx=0x7fc12c00db80 comp rx=0 tx=0).stop 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 shutdown_connections 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc12007afd0 0x7fc12007d490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc138104dc0 0x7fc138197a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 --2- 172.21.15.82:0/2770870175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc138102490 0x7fc138197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 >> 172.21.15.82:0/2770870175 conn(0x7fc1380fc010 msgr2=0x7fc1380fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 shutdown_connections 2024-09-17T01:50:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.818+0000 7fc13db89640 1 -- 172.21.15.82:0/2770870175 wait complete. 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.916+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/1964638903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94101980 msgr2=0x7f1c94101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/1964638903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94101980 0x7f1c94101d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009880 tx=0x7f1c9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/1964638903 shutdown_connections 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/1964638903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94102b80 0x7f1c94103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/1964638903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94101980 0x7f1c94101d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/1964638903 >> 172.21.15.82:0/1964638903 conn(0x7f1c940fd110 msgr2=0x7f1c940ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/1964638903 shutdown_connections 2024-09-17T01:50:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/1964638903 wait complete. 2024-09-17T01:50:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 Processor -- start 2024-09-17T01:50:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- start start 2024-09-17T01:50:44.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 0x7f1c941974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9410a7a0 con 0x7f1c94102b80 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.917+0000 7f1c9b6a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9410a620 con 0x7f1c94101980 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56010/0 (socket says 172.21.15.82:56010) 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 -- 172.21.15.82:0/3837555404 learned_addr learned my addr 172.21.15.82:0/3837555404 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c99441640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 0x7f1c941974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 -- 172.21.15.82:0/3837555404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 msgr2=0x7f1c941974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 0x7f1c941974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 -- 172.21.15.82:0/3837555404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c94197ff0 con 0x7f1c94102b80 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c99441640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 0x7f1c941974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.918+0000 7f1c98c40640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c8a0 tx=0x7f1c8400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.919+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c840079b0 con 0x7f1c94102b80 2024-09-17T01:50:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.919+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c84007b50 con 0x7f1c94102b80 2024-09-17T01:50:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.919+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c84018700 con 0x7f1c94102b80 2024-09-17T01:50:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.919+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9419ca60 con 0x7f1c94102b80 2024-09-17T01:50:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.919+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9419cfc0 con 0x7f1c94102b80 2024-09-17T01:50:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.920+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c94101d80 con 0x7f1c94102b80 2024-09-17T01:50:44.920 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:44 smithi082 ceph-mon[92957]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.921+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1c84007d00 con 0x7f1c94102b80 2024-09-17T01:50:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.922+0000 7f1c8a7fc640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 0x7f1c8007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.922+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f1c8409e200 con 0x7f1c94102b80 2024-09-17T01:50:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.922+0000 7f1c99441640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 0x7f1c8007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.922+0000 7f1c99441640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 0x7f1c8007d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c90000c00 tx=0x7f1c90005a20 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:44.927+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1c84014030 con 0x7f1c94102b80 2024-09-17T01:50:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:44 smithi167 ceph-mon[76323]: pgmap v277: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:45.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.171+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1c9419d220 con 0x7f1c8007af80 2024-09-17T01:50:45.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.183+0000 7f1c8a7fc640 1 -- 172.21.15.82:0/3837555404 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1c9419d220 con 0x7f1c8007af80 2024-09-17T01:50:45.182 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:50:45.182 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (13s) 8s ago 17m 17.5M - 0.27.0 11f11916f8cd 38f5f5c5f7ba 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (79s) 8s ago 17m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 01a86954347f 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (74s) 52s ago 16m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 04be388af4a1 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (6m) 8s ago 17m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (6m) 52s ago 16m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (15m) 8s ago 17m 80.7M - 9.4.12 2bacad6d85d8 0b77ce4229dd 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (2m) 8s ago 11m 154M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (2m) 8s ago 11m 85.9M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (116s) 52s ago 11m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:50:45.183 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (98s) 52s ago 11m 85.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e cb24609f3962 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (8m) 8s ago 18m 596M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (7m) 52s ago 16m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 8s ago 18m 124M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (6m) 52s ago 16m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (60s) 8s ago 17m 7558k - 1.7.0 72c9c2088986 708402080be5 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (54s) 52s ago 16m 3460k - 1.7.0 72c9c2088986 2f85a91a5a1a 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 8s ago 15m 161M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (5m) 8s ago 14m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:50:45.184 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 8s ago 14m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:50:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (4m) 52s ago 13m 178M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:50:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (3m) 52s ago 13m 159M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:50:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (3m) 52s ago 12m 162M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:50:45.185 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (31s) 8s ago 16m 44.0M - 2.51.0 1d3b7f56885b 6bb627e40f7b 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 msgr2=0x7f1c8007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 0x7f1c8007d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c90000c00 tx=0x7f1c90005a20 comp rx=0 tx=0).stop 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 msgr2=0x7f1c94197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400c8a0 tx=0x7f1c8400cd60 comp rx=0 tx=0).stop 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 shutdown_connections 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f1c8007af80 0x7f1c8007d440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c94102b80 0x7f1c94197a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 --2- 172.21.15.82:0/3837555404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c94101980 0x7f1c941974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 >> 172.21.15.82:0/3837555404 conn(0x7f1c940fd110 msgr2=0x7f1c940ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 shutdown_connections 2024-09-17T01:50:45.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.186+0000 7f1c9b6a5640 1 -- 172.21.15.82:0/3837555404 wait complete. 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 -- 172.21.15.82:0/2141560760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00104d80 msgr2=0x7f3b00107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 --2- 172.21.15.82:0/2141560760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00104d80 0x7f3b00107170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009880 tx=0x7f3af002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 -- 172.21.15.82:0/2141560760 shutdown_connections 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 --2- 172.21.15.82:0/2141560760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00104d80 0x7f3b00107170 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 --2- 172.21.15.82:0/2141560760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b00102450 0x7f3b00104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.304+0000 7f3b0731b640 1 -- 172.21.15.82:0/2141560760 >> 172.21.15.82:0/2141560760 conn(0x7f3b000fc010 msgr2=0x7f3b000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.305+0000 7f3b0731b640 1 -- 172.21.15.82:0/2141560760 shutdown_connections 2024-09-17T01:50:45.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.305+0000 7f3b0731b640 1 -- 172.21.15.82:0/2141560760 wait complete. 2024-09-17T01:50:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 Processor -- start 2024-09-17T01:50:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 -- start start 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b00197bb0 0x7f3b0019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0010a720 con 0x7f3b00102450 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b0731b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0010a5a0 con 0x7f3b00197bb0 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b050b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b050b7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56032/0 (socket says 172.21.15.82:56032) 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.306+0000 7f3b050b7640 1 -- 172.21.15.82:0/3229787512 learned_addr learned my addr 172.21.15.82:0/3229787512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.307+0000 7f3b050b7640 1 -- 172.21.15.82:0/3229787512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b00197bb0 msgr2=0x7f3b0019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.307+0000 7f3b050b7640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b00197bb0 0x7f3b0019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.307+0000 7f3b050b7640 1 -- 172.21.15.82:0/3229787512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001980e0 con 0x7f3b00102450 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.307+0000 7f3b050b7640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00d8d0 tx=0x7f3afc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.307+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3afc017070 con 0x7f3b00102450 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.308+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0019d0f0 con 0x7f3b00102450 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.308+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3afc010460 con 0x7f3b00102450 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.308+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0019d5f0 con 0x7f3b00102450 2024-09-17T01:50:45.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.308+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3afc020060 con 0x7f3b00102450 2024-09-17T01:50:45.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.309+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b00105160 con 0x7f3b00102450 2024-09-17T01:50:45.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.310+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3afc009a30 con 0x7f3b00102450 2024-09-17T01:50:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.311+0000 7f3af67fc640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 0x7f3aec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.311+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f3afc09e0b0 con 0x7f3b00102450 2024-09-17T01:50:45.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.311+0000 7f3b048b6640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 0x7f3aec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.312+0000 7f3b048b6640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 0x7f3aec07d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3b00198b20 tx=0x7f3af0000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.318+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3afc069620 con 0x7f3b00102450 2024-09-17T01:50:45.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.672+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3b0019df50 con 0x7f3b00102450 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.673+0000 7f3af67fc640 1 -- 172.21.15.82:0/3229787512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3afc06e4d0 con 0x7f3b00102450 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:50:45.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:50:45.673 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 msgr2=0x7f3aec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 0x7f3aec07d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3b00198b20 tx=0x7f3af0000bc0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 msgr2=0x7f3b00197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00d8d0 tx=0x7f3afc00dd90 comp rx=0 tx=0).stop 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 shutdown_connections 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3aec07af30 0x7f3aec07d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b00197bb0 0x7f3b0019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 --2- 172.21.15.82:0/3229787512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b00102450 0x7f3b00197670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 >> 172.21.15.82:0/3229787512 conn(0x7f3b000fc010 msgr2=0x7f3b000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 shutdown_connections 2024-09-17T01:50:45.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.675+0000 7f3b0731b640 1 -- 172.21.15.82:0/3229787512 wait complete. 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.757+0000 7f3be16e6640 1 -- 172.21.15.82:0/688164764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 msgr2=0x7f3bdc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 --2- 172.21.15.82:0/688164764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc101ee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009880 tx=0x7f3bc402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 -- 172.21.15.82:0/688164764 shutdown_connections 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 --2- 172.21.15.82:0/688164764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc101ee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 --2- 172.21.15.82:0/688164764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 0x7f3bdc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 -- 172.21.15.82:0/688164764 >> 172.21.15.82:0/688164764 conn(0x7f3bdc0fc010 msgr2=0x7f3bdc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 -- 172.21.15.82:0/688164764 shutdown_connections 2024-09-17T01:50:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 -- 172.21.15.82:0/688164764 wait complete. 2024-09-17T01:50:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 Processor -- start 2024-09-17T01:50:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.758+0000 7f3be16e6640 1 -- start start 2024-09-17T01:50:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3be16e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 0x7f3bdc104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3be16e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3be16e6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc1096a0 con 0x7f3bdc101a60 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3be16e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc109520 con 0x7f3bdc100860 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56064/0 (socket says 172.21.15.82:56064) 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 -- 172.21.15.82:0/1009067533 learned_addr learned my addr 172.21.15.82:0/1009067533 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bdaffd640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 0x7f3bdc104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 -- 172.21.15.82:0/1009067533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 msgr2=0x7f3bdc104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 0x7f3bdc104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 -- 172.21.15.82:0/1009067533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc103380 con 0x7f3bdc101a60 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bda7fc640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.759+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc403f070 con 0x7f3bdc101a60 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.760+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc103610 con 0x7f3bdc101a60 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.760+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3bc4004ac0 con 0x7f3bdc101a60 2024-09-17T01:50:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.760+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc4035030 con 0x7f3bdc101a60 2024-09-17T01:50:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.760+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc103b40 con 0x7f3bdc101a60 2024-09-17T01:50:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc100c60 con 0x7f3bdc101a60 2024-09-17T01:50:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3bc4042070 con 0x7f3bdc101a60 2024-09-17T01:50:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3bd3fff640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 0x7f3bc807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f3bc40bebc0 con 0x7f3bdc101a60 2024-09-17T01:50:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3bdaffd640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 0x7f3bc807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.762+0000 7f3bdaffd640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 0x7f3bc807d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4005fd0 tx=0x7f3bd400b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:45.766+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3bc408a1c0 con 0x7f3bdc101a60 2024-09-17T01:50:45.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:45 smithi082 ceph-mon[92957]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:45.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:45 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3229787512' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:46.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:45 smithi167 ceph-mon[76323]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:46.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:45 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3229787512' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:50:46.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.014+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3bdc19fba0 con 0x7f3bdc101a60 2024-09-17T01:50:46.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.014+0000 7f3bd3fff640 1 -- 172.21.15.82:0/1009067533 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2044 (secure 0 0 0) 0x7f3bc408f070 con 0x7f3bdc101a60 2024-09-17T01:50:46.012 INFO:teuthology.orchestra.run.smithi082.stdout:e37 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:49:19:946718+0000 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 37 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:49:19.946714+0000 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:50:46.013 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34311,1=34315} 2024-09-17T01:50:46.014 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34311 members: 34311,34315 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{0:34311} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:34358} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:34315} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{1:34362} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:50:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-09-17T01:50:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.016+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 msgr2=0x7f3bc807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.016+0000 7f3be16e6640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 0x7f3bc807d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4005fd0 tx=0x7f3bd400b390 comp rx=0 tx=0).stop 2024-09-17T01:50:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.016+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 msgr2=0x7f3bdc102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.016+0000 7f3be16e6640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4006010 tx=0x7f3bc40046c0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 shutdown_connections 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f3bc807af30 0x7f3bc807d3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bdc101a60 0x7f3bdc102e40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 --2- 172.21.15.82:0/1009067533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bdc100860 0x7f3bdc104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 >> 172.21.15.82:0/1009067533 conn(0x7f3bdc0fc010 msgr2=0x7f3bdc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 shutdown_connections 2024-09-17T01:50:46.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.017+0000 7f3be16e6640 1 -- 172.21.15.82:0/1009067533 wait complete. 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.099+0000 7f5461443640 1 -- 172.21.15.82:0/2734834219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 msgr2=0x7f545c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.099+0000 7f5461443640 1 --2- 172.21.15.82:0/2734834219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c100c60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f544c009c20 tx=0x7f544c02a970 comp rx=0 tx=0).stop 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 -- 172.21.15.82:0/2734834219 shutdown_connections 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 --2- 172.21.15.82:0/2734834219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 0x7f545c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 --2- 172.21.15.82:0/2734834219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c100c60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 -- 172.21.15.82:0/2734834219 >> 172.21.15.82:0/2734834219 conn(0x7f545c0fc010 msgr2=0x7f545c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 -- 172.21.15.82:0/2734834219 shutdown_connections 2024-09-17T01:50:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 -- 172.21.15.82:0/2734834219 wait complete. 2024-09-17T01:50:46.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 Processor -- start 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.100+0000 7f5461443640 1 -- start start 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f5461443640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f5461443640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 0x7f545c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f5461443640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f545c06a570 con 0x7f545c100860 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f5461443640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f545c06a3f0 con 0x7f545c101a60 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56088/0 (socket says 172.21.15.82:56088) 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 -- 172.21.15.82:0/1948898813 learned_addr learned my addr 172.21.15.82:0/1948898813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545a7fc640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 0x7f545c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 -- 172.21.15.82:0/1948898813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 msgr2=0x7f545c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 0x7f545c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 -- 172.21.15.82:0/1948898813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c1980a0 con 0x7f545c100860 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f545affd640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c02f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.101+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f544c047070 con 0x7f545c100860 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.102+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19ca80 con 0x7f545c100860 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.102+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f544c003e30 con 0x7f545c100860 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.102+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f544c034070 con 0x7f545c100860 2024-09-17T01:50:46.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.102+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c19d010 con 0x7f545c100860 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.103+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c100c60 con 0x7f545c100860 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.103+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f544c04a070 con 0x7f545c100860 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.104+0000 7f5443fff640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 0x7f544407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.104+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f544c0bed00 con 0x7f545c100860 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.104+0000 7f545a7fc640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 0x7f544407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.104+0000 7f545a7fc640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 0x7f544407d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f545c198990 tx=0x7f545000a250 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.109+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f544c0c2030 con 0x7f545c100860 2024-09-17T01:50:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.305+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f545c062630 con 0x7f544407af80 2024-09-17T01:50:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.306+0000 7f5443fff640 1 -- 172.21.15.82:0/1948898813 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+460 (secure 0 0 0) 0x7f545c062630 con 0x7f544407af80 2024-09-17T01:50:46.304 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:50:46.304 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": true, 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [ 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "mon", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph-exporter", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "mds", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "osd", 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: "crash" 2024-09-17T01:50:46.305 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-09-17T01:50:46.306 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": "18/23 daemons upgraded", 2024-09-17T01:50:46.306 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "Currently upgrading grafana daemons", 2024-09-17T01:50:46.306 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:50:46.306 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 msgr2=0x7f544407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 0x7f544407d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f545c198990 tx=0x7f545000a250 comp rx=0 tx=0).stop 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 msgr2=0x7f545c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c02f730 comp rx=0 tx=0).stop 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 shutdown_connections 2024-09-17T01:50:46.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f544407af80 0x7f544407d440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f545c101a60 0x7f545c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 --2- 172.21.15.82:0/1948898813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f545c100860 0x7f545c1974e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 >> 172.21.15.82:0/1948898813 conn(0x7f545c0fc010 msgr2=0x7f545c104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 shutdown_connections 2024-09-17T01:50:46.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.308+0000 7f5461443640 1 -- 172.21.15.82:0/1948898813 wait complete. 2024-09-17T01:50:46.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 -- 172.21.15.82:0/210520348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 msgr2=0x7fbd94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 --2- 172.21.15.82:0/210520348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd94100c60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009880 tx=0x7fbd8402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 -- 172.21.15.82:0/210520348 shutdown_connections 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 --2- 172.21.15.82:0/210520348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 0x7fbd94101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 --2- 172.21.15.82:0/210520348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd94100c60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 -- 172.21.15.82:0/210520348 >> 172.21.15.82:0/210520348 conn(0x7fbd940fc010 msgr2=0x7fbd940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 -- 172.21.15.82:0/210520348 shutdown_connections 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 -- 172.21.15.82:0/210520348 wait complete. 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.390+0000 7fbd9a006640 1 Processor -- start 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd9a006640 1 -- start start 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd9a006640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd9a006640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 0x7fbd9419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd9a006640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94109680 con 0x7fbd94100860 2024-09-17T01:50:46.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd9a006640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94109500 con 0x7fbd94101a60 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56106/0 (socket says 172.21.15.82:56106) 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 -- 172.21.15.82:0/1242754422 learned_addr learned my addr 172.21.15.82:0/1242754422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd92ffd640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 0x7fbd9419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 -- 172.21.15.82:0/1242754422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 msgr2=0x7fbd9419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 0x7fbd9419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 -- 172.21.15.82:0/1242754422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9419c7c0 con 0x7fbd94100860 2024-09-17T01:50:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.391+0000 7fbd937fe640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009230 tx=0x7fbd840045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.392+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd8403f070 con 0x7fbd94100860 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.392+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9419ca50 con 0x7fbd94100860 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.392+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd84004a50 con 0x7fbd94100860 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.392+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd84035030 con 0x7fbd94100860 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.392+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9419cf80 con 0x7fbd94100860 2024-09-17T01:50:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.393+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd94100c60 con 0x7fbd94100860 2024-09-17T01:50:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.393+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbd84042070 con 0x7fbd94100860 2024-09-17T01:50:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.394+0000 7fbd90ff9640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 0x7fbd8007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:50:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.394+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fbd840bec10 con 0x7fbd94100860 2024-09-17T01:50:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.394+0000 7fbd92ffd640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 0x7fbd8007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:50:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.395+0000 7fbd92ffd640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 0x7fbd8007d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005d00 tx=0x7fbd7c005c50 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:50:46.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.398+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbd8408a180 con 0x7fbd94100860 2024-09-17T01:50:46.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.653+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbd9419d990 con 0x7fbd94100860 2024-09-17T01:50:46.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.654+0000 7fbd90ff9640 1 -- 172.21.15.82:0/1242754422 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fbd8408f030 con 0x7fbd94100860 2024-09-17T01:50:46.652 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:46.652 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:50:46.652 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 msgr2=0x7fbd8007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 0x7fbd8007d400 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005d00 tx=0x7fbd7c005c50 comp rx=0 tx=0).stop 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 msgr2=0x7fbd9406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd84009230 tx=0x7fbd840045c0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 shutdown_connections 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbd8007af40 0x7fbd8007d400 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd94101a60 0x7fbd9419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 --2- 172.21.15.82:0/1242754422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd94100860 0x7fbd9406a790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:50:46.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 >> 172.21.15.82:0/1242754422 conn(0x7fbd940fc010 msgr2=0x7fbd940fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:50:46.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 shutdown_connections 2024-09-17T01:50:46.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:50:46.656+0000 7fbd9a006640 1 -- 172.21.15.82:0/1242754422 wait complete. 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1009067533' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:46 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1242754422' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: pgmap v278: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1009067533' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:50:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:46 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1242754422' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:50:47.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:47 smithi082 ceph-mon[92957]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:48.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:47 smithi167 ceph-mon[76323]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:50:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:48 smithi167 ceph-mon[76323]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:48 smithi082 ceph-mon[92957]: pgmap v279: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:50.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:50 smithi082 ceph-mon[92957]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:50 smithi167 ceph-mon[76323]: pgmap v280: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:52.898 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:52 smithi082 ceph-mon[92957]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:52 smithi167 ceph-mon[76323]: pgmap v281: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:50:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:54 smithi167 ceph-mon[76323]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:54 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:54 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:54 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:55.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:54 smithi082 ceph-mon[92957]: pgmap v282: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:50:55.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:54 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:55.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:54 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:50:55.037 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:54 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:50:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:56 smithi167 ceph-mon[76323]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:57.030 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:56 smithi082 ceph-mon[92957]: pgmap v283: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:50:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:58 smithi167 ceph-mon[76323]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:50:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:58 smithi082 ceph-mon[92957]: pgmap v284: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:00.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:59 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.015 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:50:59 smithi082 ceph-mon[92957]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:59 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:00.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:50:59 smithi167 ceph-mon[76323]: pgmap v285: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:01.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:01.753 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:02.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:02 smithi082 ceph-mon[92957]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:02.754 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:02 smithi167 ceph-mon[76323]: pgmap v286: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:04 smithi082 ceph-mon[92957]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:04 smithi167 ceph-mon[76323]: pgmap v287: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-17T01:51:06.965 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.966 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-17T01:51:06.967 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-17T01:51:06.968 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:51:06.969 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:06.970 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: pgmap v288: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:07.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.005 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.006 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-17T01:51:07.007 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.008 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:51:07.009 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:07 smithi082 ceph-mon[92957]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:51:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:07 smithi082 ceph-mon[92957]: Upgrade: Finalizing container_image settings 2024-09-17T01:51:07.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:07 smithi082 ceph-mon[92957]: Upgrade: Complete! 2024-09-17T01:51:08.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:07 smithi167 ceph-mon[76323]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-17T01:51:08.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:07 smithi167 ceph-mon[76323]: Upgrade: Finalizing container_image settings 2024-09-17T01:51:08.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:07 smithi167 ceph-mon[76323]: Upgrade: Complete! 2024-09-17T01:51:08.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:08 smithi082 ceph-mon[92957]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:09.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:08 smithi167 ceph-mon[76323]: pgmap v289: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:10 smithi082 ceph-mon[92957]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:11.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:10 smithi167 ceph-mon[76323]: pgmap v290: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:12 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:12.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:12 smithi167 ceph-mon[76323]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:12 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:51:12.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:12 smithi082 ceph-mon[92957]: pgmap v291: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:14 smithi082 ceph-mon[92957]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:14 smithi167 ceph-mon[76323]: pgmap v292: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 -- 172.21.15.82:0/2569027557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240ffc40 msgr2=0x7f3724100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 --2- 172.21.15.82:0/2569027557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240ffc40 0x7f3724100040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3714009880 tx=0x7f371402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 -- 172.21.15.82:0/2569027557 shutdown_connections 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 --2- 172.21.15.82:0/2569027557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3724102c20 0x7f37241030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 --2- 172.21.15.82:0/2569027557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37240ffc40 0x7f3724100040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 -- 172.21.15.82:0/2569027557 >> 172.21.15.82:0/2569027557 conn(0x7f37240fb790 msgr2=0x7f37240fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 -- 172.21.15.82:0/2569027557 shutdown_connections 2024-09-17T01:51:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.744+0000 7f3729cfc640 1 -- 172.21.15.82:0/2569027557 wait complete. 2024-09-17T01:51:16.744 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:16 smithi082 ceph-mon[92957]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:16.744 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:16.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 Processor -- start 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 -- start start 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37240ffc40 0x7f3724102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f372410a7d0 con 0x7f3724102c20 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.745+0000 7f3729cfc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f372410a650 con 0x7f37240ffc40 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39750/0 (socket says 172.21.15.82:39750) 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 -- 172.21.15.82:0/861725407 learned_addr learned my addr 172.21.15.82:0/861725407 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f37237fe640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37240ffc40 0x7f3724102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 -- 172.21.15.82:0/861725407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37240ffc40 msgr2=0x7f3724102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37240ffc40 0x7f3724102510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 -- 172.21.15.82:0/861725407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3724101110 con 0x7f3724102c20 2024-09-17T01:51:16.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3722ffd640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f371800d6f0 tx=0x7f371800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3718017070 con 0x7f3724102c20 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f371800de00 con 0x7f3724102c20 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3724101400 con 0x7f3724102c20 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3718004bb0 con 0x7f3724102c20 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.746+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3724101990 con 0x7f3724102c20 2024-09-17T01:51:16.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.747+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3724100040 con 0x7f3724102c20 2024-09-17T01:51:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.748+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3718009a30 con 0x7f3724102c20 2024-09-17T01:51:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.749+0000 7f3720ff9640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 0x7f370c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.749+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f371809dac0 con 0x7f3724102c20 2024-09-17T01:51:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.749+0000 7f37237fe640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 0x7f370c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:16.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.749+0000 7f37237fe640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 0x7f370c07d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3714009230 tx=0x7f37140058d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.753+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3718069140 con 0x7f3724102c20 2024-09-17T01:51:16.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.945+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3724107250 con 0x7f370c07af80 2024-09-17T01:51:16.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.947+0000 7f3720ff9640 1 -- 172.21.15.82:0/861725407 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f3724107250 con 0x7f370c07af80 2024-09-17T01:51:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 msgr2=0x7f370c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 0x7f370c07d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3714009230 tx=0x7f37140058d0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 msgr2=0x7f3724100bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f371800d6f0 tx=0x7f371800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 shutdown_connections 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f370c07af80 0x7f370c07d440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3724102c20 0x7f3724100bd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 --2- 172.21.15.82:0/861725407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37240ffc40 0x7f3724102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 >> 172.21.15.82:0/861725407 conn(0x7f37240fb790 msgr2=0x7f37240fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 shutdown_connections 2024-09-17T01:51:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:16.949+0000 7f3729cfc640 1 -- 172.21.15.82:0/861725407 wait complete. 2024-09-17T01:51:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:16 smithi167 ceph-mon[76323]: pgmap v293: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:17.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch ps' 2024-09-17T01:51:18.062 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- 172.21.15.82:0/2967106586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 msgr2=0x7f5694100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 --2- 172.21.15.82:0/2967106586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f5694100c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5680009880 tx=0x7f568002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- 172.21.15.82:0/2967106586 shutdown_connections 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 --2- 172.21.15.82:0/2967106586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f5694100c50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 --2- 172.21.15.82:0/2967106586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 0x7f5694106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- 172.21.15.82:0/2967106586 >> 172.21.15.82:0/2967106586 conn(0x7f56940fc550 msgr2=0x7f56940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- 172.21.15.82:0/2967106586 shutdown_connections 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- 172.21.15.82:0/2967106586 wait complete. 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 Processor -- start 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.533+0000 7f569aa85640 1 -- start start 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f569aa85640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f569aa85640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 0x7f5694198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f569aa85640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f569410dcc0 con 0x7f56941007f0 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f569aa85640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f569410db40 con 0x7f56941067f0 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57466/0 (socket says 172.21.15.82:57466) 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 -- 172.21.15.82:0/2985698967 learned_addr learned my addr 172.21.15.82:0/2985698967 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5693fff640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 0x7f5694198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 -- 172.21.15.82:0/2985698967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 msgr2=0x7f5694198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:18.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 0x7f5694198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 -- 172.21.15.82:0/2985698967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5694199330 con 0x7f56941007f0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5698821640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f568800d6f0 tx=0x7f568800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5688017070 con 0x7f56941007f0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f568800de00 con 0x7f56941007f0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.534+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5688004bb0 con 0x7f56941007f0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.535+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5694199620 con 0x7f56941007f0 2024-09-17T01:51:18.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.535+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941969a0 con 0x7f56941007f0 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.536+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694101f30 con 0x7f56941007f0 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.536+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5688004e60 con 0x7f56941007f0 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.537+0000 7f5691ffb640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 0x7f5684081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.537+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f568809dc50 con 0x7f56941007f0 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.537+0000 7f5693fff640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 0x7f5684081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:18.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.537+0000 7f5693fff640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 0x7f5684081800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f569406a7f0 tx=0x7f5680031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:18.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.541+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5694199620 con 0x7f56941007f0 2024-09-17T01:51:18.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:18 smithi082 ceph-mon[92957]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:18.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:18 smithi082 ceph-mon[92957]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:18.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.725+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5694062630 con 0x7f568407f340 2024-09-17T01:51:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.735+0000 7f5691ffb640 1 -- 172.21.15.82:0/2985698967 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f5694062630 con 0x7f568407f340 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (46s) 19s ago 17m 17.5M - 0.27.0 11f11916f8cd 38f5f5c5f7ba 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (113s) 19s ago 18m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 01a86954347f 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (108s) 85s ago 17m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 04be388af4a1 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (7m) 19s ago 18m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (7m) 85s ago 17m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (24s) 19s ago 17m 46.4M - 10.4.0 c8b91775d855 54ff5e3fbc3e 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (3m) 19s ago 12m 154M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (2m) 19s ago 12m 87.1M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (2m) 85s ago 12m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:51:18.733 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (2m) 85s ago 12m 85.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e cb24609f3962 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (9m) 19s ago 19m 603M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (7m) 85s ago 17m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (7m) 19s ago 19m 122M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (7m) 85s ago 16m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (94s) 19s ago 17m 12.1M - 1.7.0 72c9c2088986 708402080be5 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (88s) 85s ago 17m 3460k - 1.7.0 72c9c2088986 2f85a91a5a1a 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (6m) 19s ago 15m 161M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (6m) 19s ago 15m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (5m) 19s ago 14m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (5m) 85s ago 14m 178M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (4m) 85s ago 13m 159M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (3m) 85s ago 13m 162M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:51:18.734 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (65s) 19s ago 17m 44.1M - 2.51.0 1d3b7f56885b 6bb627e40f7b 2024-09-17T01:51:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 msgr2=0x7f5684081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 0x7f5684081800 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f569406a7f0 tx=0x7f5680031400 comp rx=0 tx=0).stop 2024-09-17T01:51:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 msgr2=0x7f56941987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f568800d6f0 tx=0x7f568800dbb0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 shutdown_connections 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f568407f340 0x7f5684081800 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56941067f0 0x7f5694198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 --2- 172.21.15.82:0/2985698967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56941007f0 0x7f56941987f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 >> 172.21.15.82:0/2985698967 conn(0x7f56940fc550 msgr2=0x7f56940fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 shutdown_connections 2024-09-17T01:51:18.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:18.737+0000 7f569aa85640 1 -- 172.21.15.82:0/2985698967 wait complete. 2024-09-17T01:51:19.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:18 smithi167 ceph-mon[76323]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:18 smithi167 ceph-mon[76323]: pgmap v294: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:19.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch upgrade status' 2024-09-17T01:51:19.630 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:19.923 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:19 smithi082 ceph-mon[92957]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:20.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:19 smithi167 ceph-mon[76323]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:20.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/632638427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc106800 msgr2=0x7fd2bc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:20.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/632638427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc106800 0x7fd2bc106be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009880 tx=0x7fd2ac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/632638427 shutdown_connections 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/632638427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc100800 0x7fd2bc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/632638427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc106800 0x7fd2bc106be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/632638427 >> 172.21.15.82:0/632638427 conn(0x7fd2bc0fc520 msgr2=0x7fd2bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/632638427 shutdown_connections 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.133+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/632638427 wait complete. 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 Processor -- start 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 -- start start 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc106800 0x7fd2bc19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc10dcd0 con 0x7fd2bc100800 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2c0dcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc10db50 con 0x7fd2bc106800 2024-09-17T01:51:20.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2ba59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2ba59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57484/0 (socket says 172.21.15.82:57484) 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.134+0000 7fd2ba59c640 1 -- 172.21.15.82:0/2941481595 learned_addr learned my addr 172.21.15.82:0/2941481595 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2b9d9b640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc106800 0x7fd2bc19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ba59c640 1 -- 172.21.15.82:0/2941481595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc106800 msgr2=0x7fd2bc19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ba59c640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc106800 0x7fd2bc19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ba59c640 1 -- 172.21.15.82:0/2941481595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc197780 con 0x7fd2bc100800 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ba59c640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac031460 tx=0x7fd2ac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac03f070 con 0x7fd2bc100800 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2ac0035f0 con 0x7fd2bc100800 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc197a10 con 0x7fd2bc100800 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2ac035030 con 0x7fd2bc100800 2024-09-17T01:51:20.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.135+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc197f40 con 0x7fd2bc100800 2024-09-17T01:51:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.136+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc101f40 con 0x7fd2bc100800 2024-09-17T01:51:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.137+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fd2ac042070 con 0x7fd2bc100800 2024-09-17T01:51:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.137+0000 7fd2ab7fe640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 0x7fd2a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:20.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.137+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fd2ac0be920 con 0x7fd2bc100800 2024-09-17T01:51:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.137+0000 7fd2b9d9b640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 0x7fd2a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:20.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.138+0000 7fd2b9d9b640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 0x7fd2a407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06b290 tx=0x7fd2b000b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:20.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.142+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fd2ac089f20 con 0x7fd2bc100800 2024-09-17T01:51:20.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.335+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd2bc1981f0 con 0x7fd2a407af30 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.337+0000 7fd2ab7fe640 1 -- 172.21.15.82:0/2941481595 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fd2bc1981f0 con 0x7fd2a407af30 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "target_image": null, 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "in_progress": false, 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "which": "", 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "services_complete": [], 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "progress": null, 2024-09-17T01:51:20.335 INFO:teuthology.orchestra.run.smithi082.stdout: "message": "", 2024-09-17T01:51:20.336 INFO:teuthology.orchestra.run.smithi082.stdout: "is_paused": false 2024-09-17T01:51:20.336 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:51:20.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 msgr2=0x7fd2a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:20.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 0x7fd2a407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06b290 tx=0x7fd2b000b390 comp rx=0 tx=0).stop 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 msgr2=0x7fd2bc19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac031460 tx=0x7fd2ac0045e0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 shutdown_connections 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fd2a407af30 0x7fd2a407d3f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc106800 0x7fd2bc19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 --2- 172.21.15.82:0/2941481595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2bc100800 0x7fd2bc19d600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 >> 172.21.15.82:0/2941481595 conn(0x7fd2bc0fc520 msgr2=0x7fd2bc1045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 shutdown_connections 2024-09-17T01:51:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:20.340+0000 7fd2c0dcf640 1 -- 172.21.15.82:0/2941481595 wait complete. 2024-09-17T01:51:20.953 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:20 smithi082 ceph-mon[92957]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:20.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph health detail' 2024-09-17T01:51:21.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:20 smithi167 ceph-mon[76323]: pgmap v295: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:21.248 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 -- 172.21.15.82:0/1267521212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4106800 msgr2=0x7f29c4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 --2- 172.21.15.82:0/1267521212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4106800 0x7f29c4106be0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009880 tx=0x7f29c002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 -- 172.21.15.82:0/1267521212 shutdown_connections 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 --2- 172.21.15.82:0/1267521212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4100800 0x7f29c4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 --2- 172.21.15.82:0/1267521212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4106800 0x7f29c4106be0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 -- 172.21.15.82:0/1267521212 >> 172.21.15.82:0/1267521212 conn(0x7f29c40fc520 msgr2=0x7f29c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 -- 172.21.15.82:0/1267521212 shutdown_connections 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.690+0000 7f29cb59c640 1 -- 172.21.15.82:0/1267521212 wait complete. 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 Processor -- start 2024-09-17T01:51:21.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 -- start start 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4106800 0x7f29c4196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29c410dcd0 con 0x7f29c4100800 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29cb59c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29c410db50 con 0x7f29c4106800 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57488/0 (socket says 172.21.15.82:57488) 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 -- 172.21.15.82:0/57324286 learned_addr learned my addr 172.21.15.82:0/57324286 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c8b37640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4106800 0x7f29c4196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 -- 172.21.15.82:0/57324286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4106800 msgr2=0x7f29c4196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4106800 0x7f29c4196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.691+0000 7f29c9338640 1 -- 172.21.15.82:0/57324286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c4197080 con 0x7f29c4100800 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29c9338640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29c0031460 tx=0x7f29c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:21.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29c003f070 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c4197310 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29c00035f0 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29c0035030 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.692+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c41a3e40 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.693+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c4101f40 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.694+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f29c0042070 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.694+0000 7f29ba7fc640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.694+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f29c00be970 con 0x7f29c4100800 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.694+0000 7f29c8b37640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.695+0000 7f29c8b37640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 0x7f29b007d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f29c4198760 tx=0x7f29b400b390 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.699+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f29c00c0e20 con 0x7f29c4100800 2024-09-17T01:51:21.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.944+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f29c41087e0 con 0x7f29c4100800 2024-09-17T01:51:21.942 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:21 smithi082 ceph-mon[92957]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:21.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.944+0000 7f29ba7fc640 1 -- 172.21.15.82:0/57324286 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f29c0089f70 con 0x7f29c4100800 2024-09-17T01:51:21.943 INFO:teuthology.orchestra.run.smithi082.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-17T01:51:21.943 INFO:teuthology.orchestra.run.smithi082.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-17T01:51:21.943 INFO:teuthology.orchestra.run.smithi082.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-17T01:51:21.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 msgr2=0x7f29b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 0x7f29b007d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f29c4198760 tx=0x7f29b400b390 comp rx=0 tx=0).stop 2024-09-17T01:51:21.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 msgr2=0x7f29c4196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:21.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29c0031460 tx=0x7f29c00045e0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 shutdown_connections 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f29b007af30 0x7f29b007d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29c4106800 0x7f29c4196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 --2- 172.21.15.82:0/57324286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29c4100800 0x7f29c4196600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 >> 172.21.15.82:0/57324286 conn(0x7f29c40fc520 msgr2=0x7f29c40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 shutdown_connections 2024-09-17T01:51:21.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:21.946+0000 7f29cb59c640 1 -- 172.21.15.82:0/57324286 wait complete. 2024-09-17T01:51:22.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:21 smithi167 ceph-mon[76323]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:51:22.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions' 2024-09-17T01:51:22.810 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:22.931 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:22 smithi082 ceph-mon[92957]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:22.931 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:22 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/57324286' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:51:23.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:22 smithi167 ceph-mon[76323]: pgmap v296: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:22 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/57324286' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-17T01:51:23.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 -- 172.21.15.82:0/751054935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 msgr2=0x7fc454100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 --2- 172.21.15.82:0/751054935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc454100c50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc444009c20 tx=0x7fc44402a970 comp rx=0 tx=0).stop 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 -- 172.21.15.82:0/751054935 shutdown_connections 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 --2- 172.21.15.82:0/751054935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc454100c50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 --2- 172.21.15.82:0/751054935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 0x7fc454106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 -- 172.21.15.82:0/751054935 >> 172.21.15.82:0/751054935 conn(0x7fc4540fc550 msgr2=0x7fc4540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 -- 172.21.15.82:0/751054935 shutdown_connections 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 -- 172.21.15.82:0/751054935 wait complete. 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.303+0000 7fc45adaa640 1 Processor -- start 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 -- start start 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 0x7fc454198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc45410dca0 con 0x7fc4541007f0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc45410db20 con 0x7fc4541067f0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57510/0 (socket says 172.21.15.82:57510) 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 -- 172.21.15.82:0/3863735081 learned_addr learned my addr 172.21.15.82:0/3863735081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc453fff640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 0x7fc454198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 -- 172.21.15.82:0/3863735081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 msgr2=0x7fc454198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 0x7fc454198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 -- 172.21.15.82:0/3863735081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc454199260 con 0x7fc4541007f0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc458b46640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00c8a0 tx=0x7fc44c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc44c0079b0 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc454199550 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc44c007b50 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.304+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc44c018700 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.305+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541a1b50 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.306+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc454101f30 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.306+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc44c007d00 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.307+0000 7fc451ffb640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 0x7fc44007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.307+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fc44c09e2f0 con 0x7fc4541007f0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.307+0000 7fc453fff640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 0x7fc44007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:51:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.307+0000 7fc453fff640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 0x7fc44007d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc444009430 tx=0x7fc4440093a0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:51:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.311+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc44c014030 con 0x7fc4541007f0 2024-09-17T01:51:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.561+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc4541a1eb0 con 0x7fc4541007f0 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.562+0000 7fc451ffb640 1 -- 172.21.15.82:0/3863735081 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fc44c0698f0 con 0x7fc4541007f0 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:51:23.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:51:23.561 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 msgr2=0x7fc44007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 0x7fc44007d3f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc444009430 tx=0x7fc4440093a0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 msgr2=0x7fc4541987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:51:23.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00c8a0 tx=0x7fc44c00cd60 comp rx=0 tx=0).stop 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 shutdown_connections 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc44007af30 0x7fc44007d3f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4541067f0 0x7fc454198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 --2- 172.21.15.82:0/3863735081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4541007f0 0x7fc4541987b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 >> 172.21.15.82:0/3863735081 conn(0x7fc4540fc550 msgr2=0x7fc4540fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 shutdown_connections 2024-09-17T01:51:23.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:51:23.564+0000 7fc45adaa640 1 -- 172.21.15.82:0/3863735081 wait complete. 2024-09-17T01:51:23.842 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:23 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3863735081' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:24.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:23 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3863735081' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:51:24.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-17T01:51:24.413 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:24.854 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:24 smithi082 ceph-mon[92957]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:24.962 INFO:teuthology.orchestra.run.smithi082.stdout:wait for servicemap items w/ changing names to refresh 2024-09-17T01:51:25.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:24 smithi167 ceph-mon[76323]: pgmap v297: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:25.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'sleep 60' 2024-09-17T01:51:25.793 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:51:26.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:26 smithi082 ceph-mon[92957]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:26 smithi167 ceph-mon[76323]: pgmap v298: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:28.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:28 smithi082 ceph-mon[92957]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:29.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:28 smithi167 ceph-mon[76323]: pgmap v299: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:30.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:30 smithi082 ceph-mon[92957]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:31.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:30 smithi167 ceph-mon[76323]: pgmap v300: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:31.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:32.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:32 smithi082 ceph-mon[92957]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:33.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:32 smithi167 ceph-mon[76323]: pgmap v301: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:34.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:34 smithi082 ceph-mon[92957]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:35.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:34 smithi167 ceph-mon[76323]: pgmap v302: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:36 smithi082 ceph-mon[92957]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:36 smithi167 ceph-mon[76323]: pgmap v303: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:38.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:38 smithi082 ceph-mon[92957]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:38 smithi167 ceph-mon[76323]: pgmap v304: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:40.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:40 smithi082 ceph-mon[92957]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:40 smithi167 ceph-mon[76323]: pgmap v305: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:42 smithi167 ceph-mon[76323]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:42 smithi082 ceph-mon[92957]: pgmap v306: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:45.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:44 smithi167 ceph-mon[76323]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:44 smithi082 ceph-mon[92957]: pgmap v307: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:46 smithi167 ceph-mon[76323]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:46 smithi082 ceph-mon[92957]: pgmap v308: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:51:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:48 smithi167 ceph-mon[76323]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:48 smithi082 ceph-mon[92957]: pgmap v309: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:50 smithi167 ceph-mon[76323]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:51.016 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:50 smithi082 ceph-mon[92957]: pgmap v310: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:52 smithi167 ceph-mon[76323]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:53.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:52 smithi082 ceph-mon[92957]: pgmap v311: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:51:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:54 smithi167 ceph-mon[76323]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:54 smithi082 ceph-mon[92957]: pgmap v312: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:51:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:56 smithi167 ceph-mon[76323]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:56 smithi082 ceph-mon[92957]: pgmap v313: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:51:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:51:58 smithi167 ceph-mon[76323]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:51:59.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:51:58 smithi082 ceph-mon[92957]: pgmap v314: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:00 smithi167 ceph-mon[76323]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:00 smithi082 ceph-mon[92957]: pgmap v315: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:02.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:02 smithi167 ceph-mon[76323]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:02 smithi082 ceph-mon[92957]: pgmap v316: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:04 smithi082 ceph-mon[92957]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:04 smithi167 ceph-mon[76323]: pgmap v317: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:06 smithi082 ceph-mon[92957]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:06 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:52:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:06 smithi167 ceph-mon[76323]: pgmap v318: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:06 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:52:08.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:52:08.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:52:08.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:52:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:52:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:52:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:52:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:08 smithi082 ceph-mon[92957]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:08 smithi167 ceph-mon[76323]: pgmap v319: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:10 smithi082 ceph-mon[92957]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:11.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:10 smithi167 ceph-mon[76323]: pgmap v320: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:13.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:12 smithi167 ceph-mon[76323]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:12 smithi082 ceph-mon[92957]: pgmap v321: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:14 smithi082 ceph-mon[92957]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:14 smithi167 ceph-mon[76323]: pgmap v322: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:16 smithi082 ceph-mon[92957]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:16 smithi167 ceph-mon[76323]: pgmap v323: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:18 smithi082 ceph-mon[92957]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:19.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:18 smithi167 ceph-mon[76323]: pgmap v324: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:20 smithi082 ceph-mon[92957]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:20 smithi167 ceph-mon[76323]: pgmap v325: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:23.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:22 smithi082 ceph-mon[92957]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:23.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:22 smithi167 ceph-mon[76323]: pgmap v326: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:24.848 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:24 smithi082 ceph-mon[92957]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:24 smithi167 ceph-mon[76323]: pgmap v327: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:26.826 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:26 smithi082 ceph-mon[92957]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:26.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph orch ps' 2024-09-17T01:52:27.114 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:27.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:26 smithi167 ceph-mon[76323]: pgmap v328: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3656508948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 msgr2=0x7f32c0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:27.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3656508948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0106bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009880 tx=0x7f32b802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3656508948 shutdown_connections 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3656508948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3656508948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0106bd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3656508948 >> 172.21.15.82:0/3656508948 conn(0x7f32c00fc550 msgr2=0x7f32c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3656508948 shutdown_connections 2024-09-17T01:52:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.545+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3656508948 wait complete. 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 Processor -- start 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 -- start start 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32c010dd20 con 0x7f32c01067f0 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32c4f4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32c010dba0 con 0x7f32c01007f0 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44578/0 (socket says 172.21.15.82:44578) 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.546+0000 7f32bdd9b640 1 -- 172.21.15.82:0/3212090151 learned_addr learned my addr 172.21.15.82:0/3212090151 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32be59c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32bdd9b640 1 -- 172.21.15.82:0/3212090151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 msgr2=0x7f32c0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32bdd9b640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32bdd9b640 1 -- 172.21.15.82:0/3212090151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c01994b0 con 0x7f32c01067f0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32be59c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32bdd9b640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b420 tx=0x7f32a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32a8011630 con 0x7f32c01067f0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c01997a0 con 0x7f32c01067f0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32a8016070 con 0x7f32c01067f0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32a8010d40 con 0x7f32c01067f0 2024-09-17T01:52:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.547+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c01a1da0 con 0x7f32c01067f0 2024-09-17T01:52:27.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.548+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c0101f30 con 0x7f32c01067f0 2024-09-17T01:52:27.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.549+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f32a801b460 con 0x7f32c01067f0 2024-09-17T01:52:27.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.550+0000 7f32b77fe640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 0x7f32ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.550+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f32a809d7b0 con 0x7f32c01067f0 2024-09-17T01:52:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.550+0000 7f32be59c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 0x7f32ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.550+0000 7f32be59c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 0x7f32ac07d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80095f0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:27.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.554+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f32c01997a0 con 0x7f32c01067f0 2024-09-17T01:52:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.743+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 --> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f32c0062630 con 0x7f32ac07af30 2024-09-17T01:52:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.752+0000 7f32b77fe640 1 -- 172.21.15.82:0/3212090151 <== mgr.24519 v2:172.21.15.82:6800/3638015872 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f32c0062630 con 0x7f32ac07af30 2024-09-17T01:52:27.772 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T01:52:27.772 INFO:teuthology.orchestra.run.smithi082.stdout:alertmanager.smithi082 smithi082 *:9093,9094 running (115s) 88s ago 18m 17.5M - 0.27.0 11f11916f8cd 38f5f5c5f7ba 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi082 smithi082 running (3m) 88s ago 19m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 01a86954347f 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-exporter.smithi167 smithi167 running (2m) 2m ago 18m 75.5M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 04be388af4a1 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi082 smithi082 running (8m) 88s ago 19m 6891k - 19.3.0-4989-gce1b342b 8e039cb7fe1e 843f0927fe94 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:crash.smithi167 smithi167 running (8m) 2m ago 18m 6903k - 19.3.0-4989-gce1b342b 8e039cb7fe1e bad263331eef 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:grafana.smithi082 smithi082 *:3000 running (93s) 88s ago 18m 46.4M - 10.4.0 c8b91775d855 54ff5e3fbc3e 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.haarnz smithi082 running (4m) 88s ago 13m 154M - 19.3.0-4989-gce1b342b 8e039cb7fe1e ceefc898520a 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi082.pwukvc smithi082 running (3m) 88s ago 13m 87.1M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 8b056b7cde8e 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.vbekqg smithi167 running (3m) 2m ago 13m 153M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 4c0dda808ea9 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mds.cephfs.smithi167.ypfdyj smithi167 running (3m) 2m ago 13m 85.0M - 19.3.0-4989-gce1b342b 8e039cb7fe1e cb24609f3962 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi082.oppacm smithi082 *:8443,9283,8765 running (10m) 88s ago 20m 603M - 19.3.0-4989-gce1b342b 8e039cb7fe1e b475cb98a663 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.smithi167.ysmbcy smithi167 *:8443,9283,8765 running (9m) 2m ago 18m 524M - 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ee42e012c83 2024-09-17T01:52:27.773 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi082 smithi082 running (8m) 88s ago 20m 122M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3f018a9faf44 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:mon.smithi167 smithi167 running (8m) 2m ago 18m 106M 2048M 19.3.0-4989-gce1b342b 8e039cb7fe1e ae72af1edf12 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi082 smithi082 *:9100 running (2m) 88s ago 19m 12.1M - 1.7.0 72c9c2088986 708402080be5 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:node-exporter.smithi167 smithi167 *:9100 running (2m) 2m ago 18m 3460k - 1.7.0 72c9c2088986 2f85a91a5a1a 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 88s ago 16m 161M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e cb7e40179579 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi082 running (7m) 88s ago 16m 169M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3cbea6819dca 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi082 running (6m) 88s ago 15m 156M 1216M 19.3.0-4989-gce1b342b 8e039cb7fe1e 6a499b30949e 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi167 running (6m) 2m ago 15m 178M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 3ca40366e9b9 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi167 running (5m) 2m ago 15m 159M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e ea8d8c7c12c5 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi167 running (5m) 2m ago 14m 162M 2240M 19.3.0-4989-gce1b342b 8e039cb7fe1e 2480e639d020 2024-09-17T01:52:27.774 INFO:teuthology.orchestra.run.smithi082.stdout:prometheus.smithi082 smithi082 *:9095 running (2m) 88s ago 18m 44.1M - 2.51.0 1d3b7f56885b 6bb627e40f7b 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 msgr2=0x7f32ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 0x7f32ac07d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80095f0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 msgr2=0x7f32c0198eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32a800b420 tx=0x7f32a800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 shutdown_connections 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f32ac07af30 0x7f32ac07d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32c01067f0 0x7f32c0198eb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 --2- 172.21.15.82:0/3212090151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32c01007f0 0x7f32c0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 >> 172.21.15.82:0/3212090151 conn(0x7f32c00fc550 msgr2=0x7f32c00fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 shutdown_connections 2024-09-17T01:52:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:27.755+0000 7f32c4f4c640 1 -- 172.21.15.82:0/3212090151 wait complete. 2024-09-17T01:52:28.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions' 2024-09-17T01:52:28.713 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:29.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:28 smithi082 ceph-mon[92957]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:29.111 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:28 smithi082 ceph-mon[92957]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:29.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 -- 172.21.15.82:0/2213724048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 msgr2=0x7f1570101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 --2- 172.21.15.82:0/2213724048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f1570101d60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f156c009880 tx=0x7f156c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 -- 172.21.15.82:0/2213724048 shutdown_connections 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 --2- 172.21.15.82:0/2213724048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f1570101d60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 --2- 172.21.15.82:0/2213724048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570107900 0x7f1570107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 -- 172.21.15.82:0/2213724048 >> 172.21.15.82:0/2213724048 conn(0x7f15700fd600 msgr2=0x7f15700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 -- 172.21.15.82:0/2213724048 shutdown_connections 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.192+0000 7f15777d9640 1 -- 172.21.15.82:0/2213724048 wait complete. 2024-09-17T01:52:29.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 Processor -- start 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 -- start start 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570107900 0x7f157019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f157010edd0 con 0x7f1570101900 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f15777d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f157010ec50 con 0x7f1570107900 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44592/0 (socket says 172.21.15.82:44592) 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 -- 172.21.15.82:0/1740162382 learned_addr learned my addr 172.21.15.82:0/1740162382 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 -- 172.21.15.82:0/1740162382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570107900 msgr2=0x7f157019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570107900 0x7f157019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.193+0000 7f1575575640 1 -- 172.21.15.82:0/1740162382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1570197800 con 0x7f1570101900 2024-09-17T01:52:29.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f1575575640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f156000c8f0 tx=0x7f156000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15600079b0 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15600054e0 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1570197af0 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1560004dd0 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.194+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1570198080 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.195+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1570103040 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.195+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f1560005020 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.196+0000 7f15667fc640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 0x7f155c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.196+0000 7f1574d74640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 0x7f155c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.196+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f156009dfd0 con 0x7f1570101900 2024-09-17T01:52:29.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.197+0000 7f1574d74640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 0x7f155c07d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f156c0096c0 tx=0x7f156c000bc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:29.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.201+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f1560014030 con 0x7f1570101900 2024-09-17T01:52:29.222 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:28 smithi167 ceph-mon[76323]: pgmap v329: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:29.223 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:28 smithi167 ceph-mon[76323]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T01:52:29.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.445+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1570109e70 con 0x7f1570101900 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.446+0000 7f15667fc640 1 -- 172.21.15.82:0/1740162382 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f15600695d0 con 0x7f1570101900 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": { 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:52:29.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": { 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 2 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": { 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 6 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 4 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "overall": { 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)": 14 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-09-17T01:52:29.445 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-09-17T01:52:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 msgr2=0x7f155c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 0x7f155c07d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f156c0096c0 tx=0x7f156c000bc0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 msgr2=0x7f157019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:29.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f156000c8f0 tx=0x7f156000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 shutdown_connections 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f155c07aed0 0x7f155c07d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570107900 0x7f157019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 --2- 172.21.15.82:0/1740162382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570101900 0x7f157019d680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 >> 172.21.15.82:0/1740162382 conn(0x7f15700fd600 msgr2=0x7f15700fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 shutdown_connections 2024-09-17T01:52:29.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:29.448+0000 7f15777d9640 1 -- 172.21.15.82:0/1740162382 wait complete. 2024-09-17T01:52:30.107 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:29 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1740162382' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:30.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-17T01:52:30.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:29 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1740162382' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:30.383 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 -- 172.21.15.82:0/995856958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 msgr2=0x7fbfb8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/995856958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb8106d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009880 tx=0x7fbfac02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 -- 172.21.15.82:0/995856958 shutdown_connections 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/995856958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb8100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/995856958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb8106d80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 -- 172.21.15.82:0/995856958 >> 172.21.15.82:0/995856958 conn(0x7fbfb80fbc90 msgr2=0x7fbfb80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 -- 172.21.15.82:0/995856958 shutdown_connections 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.817+0000 7fbfbed1e640 1 -- 172.21.15.82:0/995856958 wait complete. 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 Processor -- start 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 -- start start 2024-09-17T01:52:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb810efa0 con 0x7fbfb81069a0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbed1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb810ee20 con 0x7fbfb80ffdc0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44620/0 (socket says 172.21.15.82:44620) 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 -- 172.21.15.82:0/2804210269 learned_addr learned my addr 172.21.15.82:0/2804210269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbcaba640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 -- 172.21.15.82:0/2804210269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 msgr2=0x7fbfb819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 -- 172.21.15.82:0/2804210269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8197930 con 0x7fbfb81069a0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfbcaba640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.818+0000 7fbfb7fff640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400b420 tx=0x7fbfa400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.819+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfa4011630 con 0x7fbfb81069a0 2024-09-17T01:52:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.819+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbfa4016070 con 0x7fbfb81069a0 2024-09-17T01:52:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.819+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb8197c20 con 0x7fbfb81069a0 2024-09-17T01:52:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.819+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfa4010d40 con 0x7fbfb81069a0 2024-09-17T01:52:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.819+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb81981b0 con 0x7fbfb81069a0 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.820+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb81030e0 con 0x7fbfb81069a0 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.820+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fbfa401b480 con 0x7fbfb81069a0 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.821+0000 7fbfb5ffb640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 0x7fbfa807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.821+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fbfa409d740 con 0x7fbfb81069a0 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.821+0000 7fbfbcaba640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 0x7fbfa807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.821+0000 7fbfbcaba640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 0x7fbfa807d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000c00 tx=0x7fbfac031420 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:30.826+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fbfa4068d40 con 0x7fbfb81069a0 2024-09-17T01:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.070+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbfb8198e60 con 0x7fbfb81069a0 2024-09-17T01:52:31.069 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:30 smithi082 ceph-mon[92957]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.071+0000 7fbfb5ffb640 1 -- 172.21.15.82:0/2804210269 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbfa406dbf0 con 0x7fbfb81069a0 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 msgr2=0x7fbfa807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 0x7fbfa807d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000c00 tx=0x7fbfac031420 comp rx=0 tx=0).stop 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 msgr2=0x7fbfb819dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400b420 tx=0x7fbfa400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 shutdown_connections 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fbfa807af30 0x7fbfa807d3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfb81069a0 0x7fbfb819dcb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 --2- 172.21.15.82:0/2804210269 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb80ffdc0 0x7fbfb819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 >> 172.21.15.82:0/2804210269 conn(0x7fbfb80fbc90 msgr2=0x7fbfb80fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 shutdown_connections 2024-09-17T01:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:31.074+0000 7fbfbed1e640 1 -- 172.21.15.82:0/2804210269 wait complete. 2024-09-17T01:52:31.080 INFO:teuthology.orchestra.run.smithi082.stdout:true 2024-09-17T01:52:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:30 smithi167 ceph-mon[76323]: pgmap v330: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:31.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -e sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-17T01:52:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:31 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2804210269' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:31 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2804210269' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 -- 172.21.15.82:0/546237832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 msgr2=0x7f9574106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 --2- 172.21.15.82:0/546237832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574106bd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f956c009880 tx=0x7f956c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 -- 172.21.15.82:0/546237832 shutdown_connections 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 --2- 172.21.15.82:0/546237832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 0x7f9574100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 --2- 172.21.15.82:0/546237832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574106bd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 -- 172.21.15.82:0/546237832 >> 172.21.15.82:0/546237832 conn(0x7f95740fc550 msgr2=0x7f95740fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 -- 172.21.15.82:0/546237832 shutdown_connections 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 -- 172.21.15.82:0/546237832 wait complete. 2024-09-17T01:52:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.666+0000 7f9578c9f640 1 Processor -- start 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 -- start start 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 0x7f9574107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f957410dca0 con 0x7f95741067f0 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f957410db20 con 0x7f95741007f0 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44638/0 (socket says 172.21.15.82:44638) 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 -- 172.21.15.82:0/998584025 learned_addr learned my addr 172.21.15.82:0/998584025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f957259c640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 0x7f9574107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 -- 172.21.15.82:0/998584025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 msgr2=0x7f9574107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 0x7f9574107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 -- 172.21.15.82:0/998584025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741081a0 con 0x7f95741067f0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9571d9b640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f956800db80 tx=0x7f956800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9568017070 con 0x7f95741067f0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9568003e30 con 0x7f95741067f0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.667+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9574108490 con 0x7f95741067f0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.668+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9568010460 con 0x7f95741067f0 2024-09-17T01:52:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.668+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741a3dd0 con 0x7f95741067f0 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.669+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9574101f30 con 0x7f95741067f0 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.669+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f956800dc70 con 0x7f95741067f0 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.670+0000 7f95637fe640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 0x7f955c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.670+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f956809e4b0 con 0x7f95741067f0 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.670+0000 7f957259c640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 0x7f955c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.670+0000 7f957259c640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 0x7f955c07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f956c031460 tx=0x7f956c009560 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.674+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9568069ab0 con 0x7f95741067f0 2024-09-17T01:52:32.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.924+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f95741a40b0 con 0x7f95741067f0 2024-09-17T01:52:32.922 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:32 smithi082 ceph-mon[92957]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:32.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.924+0000 7f95637fe640 1 -- 172.21.15.82:0/998584025 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f956806e960 con 0x7f95741067f0 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 msgr2=0x7f955c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 0x7f955c07d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f956c031460 tx=0x7f956c009560 comp rx=0 tx=0).stop 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 msgr2=0x7f9574107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f956800db80 tx=0x7f956800b630 comp rx=0 tx=0).stop 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 shutdown_connections 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f955c07af30 0x7f955c07d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95741067f0 0x7f9574107c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 --2- 172.21.15.82:0/998584025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95741007f0 0x7f9574107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 >> 172.21.15.82:0/998584025 conn(0x7f95740fc550 msgr2=0x7f9574069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 shutdown_connections 2024-09-17T01:52:32.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:32.927+0000 7f9578c9f640 1 -- 172.21.15.82:0/998584025 wait complete. 2024-09-17T01:52:32.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)" 2024-09-17T01:52:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:32 smithi167 ceph-mon[76323]: pgmap v331: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:33.541 DEBUG:teuthology.parallel:result is None 2024-09-17T01:52:33.541 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T01:52:33.554 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T01:52:33.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-17T01:52:33.803 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:34.064 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:33 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/998584025' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:34.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:33 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/998584025' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-17T01:52:34.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 -- 172.21.15.82:0/113575845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 msgr2=0x7f2ad0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:34.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/113575845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad0107ce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009c20 tx=0x7f2ac002a970 comp rx=0 tx=0).stop 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 -- 172.21.15.82:0/113575845 shutdown_connections 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/113575845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 0x7f2ad0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/113575845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad0107ce0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 -- 172.21.15.82:0/113575845 >> 172.21.15.82:0/113575845 conn(0x7f2ad00fd600 msgr2=0x7f2ad00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 -- 172.21.15.82:0/113575845 shutdown_connections 2024-09-17T01:52:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.257+0000 7f2ad61b0640 1 -- 172.21.15.82:0/113575845 wait complete. 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 Processor -- start 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 -- start start 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 0x7f2ad019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010ee30 con 0x7f2ad0107900 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2ad61b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad010ecb0 con 0x7f2ad0101900 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2aceffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44652/0 (socket says 172.21.15.82:44652) 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.258+0000 7f2aceffd640 1 -- 172.21.15.82:0/3003781874 learned_addr learned my addr 172.21.15.82:0/3003781874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:34.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2acf7fe640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 0x7f2ad019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2aceffd640 1 -- 172.21.15.82:0/3003781874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 msgr2=0x7f2ad019d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2aceffd640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 0x7f2ad019d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2aceffd640 1 -- 172.21.15.82:0/3003781874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad0197940 con 0x7f2ad0107900 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2aceffd640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b420 tx=0x7f2ac400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4011630 con 0x7f2ad0107900 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4016070 con 0x7f2ad0107900 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad0197c30 con 0x7f2ad0107900 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ac4010d40 con 0x7f2ad0107900 2024-09-17T01:52:34.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.259+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01981c0 con 0x7f2ad0107900 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.260+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0103040 con 0x7f2ad0107900 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.261+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2ac401b460 con 0x7f2ad0107900 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.261+0000 7f2accff9640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 0x7f2ab807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.262+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f2ac409d6c0 con 0x7f2ad0107900 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.262+0000 7f2acf7fe640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 0x7f2ab807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.262+0000 7f2acf7fe640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 0x7f2ab807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009430 tx=0x7f2ac003c040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:34.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.266+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2ac4068cc0 con 0x7f2ad0107900 2024-09-17T01:52:34.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.476+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2ad0101de0 con 0x7f2ad0107900 2024-09-17T01:52:34.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.476+0000 7f2accff9640 1 -- 172.21.15.82:0/3003781874 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2044 (secure 0 0 0) 0x7f2ac406db70 con 0x7f2ad0107900 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:e37 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:btime 2024-09-17T01:49:19:946718+0000 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 37 2024-09-17T01:52:34.475 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-09-17T01:38:43.948337+0000 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-09-17T01:49:19.946714+0000 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 60 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 82 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-17T01:52:34.476 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 2 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=34311,1=34315} 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data enabled 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 1 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 34311 members: 34311,34315 2024-09-17T01:52:34.477 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.vbekqg{0:34311} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.167:6824/3730623711,v1:172.21.15.167:6825/3730623711] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.haarnz{0:34358} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6826/2712253415,v1:172.21.15.82:6827/2712253415] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi167.ypfdyj{1:34315} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.167:6826/124451305,v1:172.21.15.167:6827/124451305] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.cephfs.smithi082.pwukvc{1:34362} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.82:6828/226559431,v1:172.21.15.82:6829/226559431] compat {c=[1],r=[1],i=[1fff]}] 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 msgr2=0x7f2ab807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 0x7f2ab807d3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009430 tx=0x7f2ac003c040 comp rx=0 tx=0).stop 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 msgr2=0x7f2ad019dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400b420 tx=0x7f2ac400b8e0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 shutdown_connections 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2ab807af30 0x7f2ab807d3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0107900 0x7f2ad019dcc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 --2- 172.21.15.82:0/3003781874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad0101900 0x7f2ad019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 >> 172.21.15.82:0/3003781874 conn(0x7f2ad00fd600 msgr2=0x7f2ad00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 shutdown_connections 2024-09-17T01:52:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:34.479+0000 7f2ad61b0640 1 -- 172.21.15.82:0/3003781874 wait complete. 2024-09-17T01:52:35.104 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:34 smithi082 ceph-mon[92957]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:35.104 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:34 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3003781874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:52:35.130 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-17T01:52:35.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-17T01:52:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:34 smithi167 ceph-mon[76323]: pgmap v332: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:34 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3003781874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-17T01:52:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/710096717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 msgr2=0x7f6eb0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/710096717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb0107ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009880 tx=0x7f6ea002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/710096717 shutdown_connections 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/710096717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 0x7f6eb0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/710096717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb0107ce0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:35.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/710096717 >> 172.21.15.82:0/710096717 conn(0x7f6eb00fd600 msgr2=0x7f6eb00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/710096717 shutdown_connections 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.855+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/710096717 wait complete. 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.856+0000 7f6eb4c6d640 1 Processor -- start 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.856+0000 7f6eb4c6d640 1 -- start start 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 0x7f6eb019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010edb0 con 0x7f6eb0107900 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010ec30 con 0x7f6eb0101900 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44672/0 (socket says 172.21.15.82:44672) 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 -- 172.21.15.82:0/273180722 learned_addr learned my addr 172.21.15.82:0/273180722 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eae59c640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 0x7f6eb019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 -- 172.21.15.82:0/273180722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 msgr2=0x7f6eb019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 0x7f6eb019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 -- 172.21.15.82:0/273180722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb01977c0 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea7fff640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800d8d0 tx=0x7f6e9800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e98017070 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb0197ab0 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e98010460 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e9800f5f0 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.857+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb0198040 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.859+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb0103040 con 0x7f6eb0107900 2024-09-17T01:52:35.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.859+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6e98009a30 con 0x7f6eb0107900 2024-09-17T01:52:35.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.860+0000 7f6ea77fe640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:35.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.860+0000 7f6eae59c640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:35.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.860+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f6e9809dea0 con 0x7f6eb0107900 2024-09-17T01:52:35.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.860+0000 7f6eae59c640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00096c0 tx=0x7f6ea0031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:35.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:35.865+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6e980694a0 con 0x7f6eb0107900 2024-09-17T01:52:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.074+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eb0104b10 con 0x7f6eb0107900 2024-09-17T01:52:36.072 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:35 smithi082 ceph-mon[92957]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.075+0000 7f6ea77fe640 1 -- 172.21.15.82:0/273180722 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5354 (secure 0 0 0) 0x7f6e9806e350 con 0x7f6eb0107900 2024-09-17T01:52:36.073 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:36.073 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"btime":"2024-09-17T01:49:19:946718+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:19.946714+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34311,"mds_1":34315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34315":{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":1,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34358":{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34362":{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34311,"qdb_cluster":[34311,34315]},"id":1}]} 2024-09-17T01:52:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 37 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 msgr2=0x7f6e9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00096c0 tx=0x7f6ea0031400 comp rx=0 tx=0).stop 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 msgr2=0x7f6eb019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800d8d0 tx=0x7f6e9800dd90 comp rx=0 tx=0).stop 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 shutdown_connections 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6e9c07af30 0x7f6e9c07d3f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:36.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb0107900 0x7f6eb019db80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:36.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 --2- 172.21.15.82:0/273180722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb0101900 0x7f6eb019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:36.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 >> 172.21.15.82:0/273180722 conn(0x7f6eb00fd600 msgr2=0x7f6eb00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:36.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 shutdown_connections 2024-09-17T01:52:36.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:36.077+0000 7f6eb4c6d640 1 -- 172.21.15.82:0/273180722 wait complete. 2024-09-17T01:52:36.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:35 smithi167 ceph-mon[76323]: pgmap v333: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:36.707 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 2, 'flags': 50} 2024-09-17T01:52:36.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 15 2024-09-17T01:52:36.958 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:36 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/273180722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-17T01:52:37.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:36 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/273180722' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 -- 172.21.15.82:0/3018281575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 msgr2=0x7fe01810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 --2- 172.21.15.82:0/3018281575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01810b8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe000009880 tx=0x7fe00002a530 comp rx=0 tx=0).stop 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 -- 172.21.15.82:0/3018281575 shutdown_connections 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 --2- 172.21.15.82:0/3018281575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01810b8d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 --2- 172.21.15.82:0/3018281575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 0x7fe018102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 -- 172.21.15.82:0/3018281575 >> 172.21.15.82:0/3018281575 conn(0x7fe0180fc520 msgr2=0x7fe0180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:37.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 -- 172.21.15.82:0/3018281575 shutdown_connections 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 -- 172.21.15.82:0/3018281575 wait complete. 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.405+0000 7fe01dd61640 1 Processor -- start 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe01dd61640 1 -- start start 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe01dd61640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 0x7fe01819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe01dd61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe01dd61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810edf0 con 0x7fe0181033e0 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe01dd61640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe01810ec70 con 0x7fe018102ac0 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35502/0 (socket says 172.21.15.82:35502) 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 -- 172.21.15.82:0/251531899 learned_addr learned my addr 172.21.15.82:0/251531899 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe0177fe640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 0x7fe01819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:37.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 -- 172.21.15.82:0/251531899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 msgr2=0x7fe01819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 0x7fe01819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.406+0000 7fe00effd640 1 -- 172.21.15.82:0/251531899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe018197820 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe00effd640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe000031460 tx=0x7fe0000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe00003f070 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe018197ab0 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe000004ac0 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe000035030 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.407+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe018197fe0 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.408+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01806aa90 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.408+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe000042070 con 0x7fe0181033e0 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.409+0000 7fe0157fa640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 0x7fe00407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:37.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.409+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fe0000be9d0 con 0x7fe0181033e0 2024-09-17T01:52:37.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.409+0000 7fe0177fe640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 0x7fe00407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:37.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.409+0000 7fe0177fe640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 0x7fe00407d400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0080058c0 tx=0x7fe00800a250 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:37.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.413+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe000089fd0 con 0x7fe0181033e0 2024-09-17T01:52:37.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.623+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) -- 0x7fe018198d50 con 0x7fe0181033e0 2024-09-17T01:52:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.624+0000 7fe0157fa640 1 -- 172.21.15.82:0/251531899 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v37) ==== 107+0+3644 (secure 0 0 0) 0x7fe00008ee80 con 0x7fe0181033e0 2024-09-17T01:52:37.622 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:37.622 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":15,"btime":"2024-09-17T01:47:29:159385+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:47:28.161619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14576,"mds_1":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14576":{"gid":14576,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/981106576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":981106576},{"type":"v1","addr":"172.21.15.82:6827","nonce":981106576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24301":{"gid":24301,"name":"cephfs.smithi167.vbekqg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6825/1713530120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1713530120},{"type":"v1","addr":"172.21.15.167:6825","nonce":1713530120}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14576,"qdb_cluster":[24301,14576]},"id":1}]} 2024-09-17T01:52:37.622 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 15 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 msgr2=0x7fe00407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 0x7fe00407d400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0080058c0 tx=0x7fe00800a250 comp rx=0 tx=0).stop 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 msgr2=0x7fe01819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe000031460 tx=0x7fe0000046c0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 shutdown_connections 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe00407af40 0x7fe00407d400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0181033e0 0x7fe01819dbe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 --2- 172.21.15.82:0/251531899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe018102ac0 0x7fe01819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 >> 172.21.15.82:0/251531899 conn(0x7fe0180fc520 msgr2=0x7fe018108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 shutdown_connections 2024-09-17T01:52:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:37.626+0000 7fe01dd61640 1 -- 172.21.15.82:0/251531899 wait complete. 2024-09-17T01:52:38.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:37 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/251531899' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-17T01:52:38.176 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:37 smithi082 ceph-mon[92957]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:38.205 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 15 2024-09-17T01:52:38.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-17T01:52:38.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:37 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/251531899' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-17T01:52:38.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:37 smithi167 ceph-mon[76323]: pgmap v334: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:38.455 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:38.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 -- 172.21.15.82:0/4034181421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100250 msgr2=0x7fa264100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 --2- 172.21.15.82:0/4034181421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100250 0x7fa264100630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa254009880 tx=0x7fa25402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 -- 172.21.15.82:0/4034181421 shutdown_connections 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 --2- 172.21.15.82:0/4034181421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100c00 0x7fa264104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 --2- 172.21.15.82:0/4034181421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100250 0x7fa264100630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 -- 172.21.15.82:0/4034181421 >> 172.21.15.82:0/4034181421 conn(0x7fa2640fbc90 msgr2=0x7fa2640fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 -- 172.21.15.82:0/4034181421 shutdown_connections 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.929+0000 7fa268ed2640 1 -- 172.21.15.82:0/4034181421 wait complete. 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.930+0000 7fa268ed2640 1 Processor -- start 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.930+0000 7fa268ed2640 1 -- start start 2024-09-17T01:52:38.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100250 0x7fa26419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa26410cca0 con 0x7fa264100c00 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa26410cb20 con 0x7fa264100250 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35524/0 (socket says 172.21.15.82:35524) 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 -- 172.21.15.82:0/2306058468 learned_addr learned my addr 172.21.15.82:0/2306058468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa26259c640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100250 0x7fa26419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 -- 172.21.15.82:0/2306058468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100250 msgr2=0x7fa26419b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100250 0x7fa26419b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 -- 172.21.15.82:0/2306058468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2641956b0 con 0x7fa264100c00 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa261d9b640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa25800b420 tx=0x7fa25800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa258011630 con 0x7fa264100c00 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2641959a0 con 0x7fa264100c00 2024-09-17T01:52:38.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa258016070 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa258010d40 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.931+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa264195f00 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.932+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa264101730 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.933+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fa25801b460 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.933+0000 7fa2537fe640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 0x7fa24c07e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.934+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fa25809d740 con 0x7fa264100c00 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.934+0000 7fa26259c640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 0x7fa24c07e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.934+0000 7fa26259c640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 0x7fa24c07e510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2540096c0 tx=0x7fa254031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:38.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:38.938+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fa258068d40 con 0x7fa264100c00 2024-09-17T01:52:39.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.147+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7fa264196c10 con 0x7fa264100c00 2024-09-17T01:52:39.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.148+0000 7fa2537fe640 1 -- 172.21.15.82:0/2306058468 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v37) ==== 107+0+5336 (secure 0 0 0) 0x7fa264196c10 con 0x7fa264100c00 2024-09-17T01:52:39.146 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:39.146 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"btime":"2024-09-17T01:47:29:923030+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:47:29.923023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14576,"mds_1":24301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14576":{"gid":14576,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/981106576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":981106576},{"type":"v1","addr":"172.21.15.82:6827","nonce":981106576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24301":{"gid":24301,"name":"cephfs.smithi167.vbekqg","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.167:6825/1713530120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1713530120},{"type":"v1","addr":"172.21.15.167:6825","nonce":1713530120}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14576,"qdb_cluster":[14576]},"id":1}]} 2024-09-17T01:52:39.146 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2024-09-17T01:52:39.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 msgr2=0x7fa24c07e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:39.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 0x7fa24c07e510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2540096c0 tx=0x7fa254031400 comp rx=0 tx=0).stop 2024-09-17T01:52:39.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 msgr2=0x7fa26419bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:39.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa25800b420 tx=0x7fa25800b8e0 comp rx=0 tx=0).stop 2024-09-17T01:52:39.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 shutdown_connections 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fa24c07c050 0x7fa24c07e510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa264100c00 0x7fa26419bb20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 --2- 172.21.15.82:0/2306058468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa264100250 0x7fa26419b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 >> 172.21.15.82:0/2306058468 conn(0x7fa2640fbc90 msgr2=0x7fa2640fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 shutdown_connections 2024-09-17T01:52:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:39.150+0000 7fa268ed2640 1 -- 172.21.15.82:0/2306058468 wait complete. 2024-09-17T01:52:39.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:39 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2306058468' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-17T01:52:39.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:39 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2306058468' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-17T01:52:39.787 DEBUG:tasks.fs:max_mds reduced in epoch 16 2024-09-17T01:52:39.788 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 16 2024-09-17T01:52:39.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-17T01:52:40.051 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:40.444 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:40 smithi082 ceph-mon[92957]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:40.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:40 smithi167 ceph-mon[76323]: pgmap v335: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:40.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 -- 172.21.15.82:0/1286182664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 msgr2=0x7f3774107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 --2- 172.21.15.82:0/1286182664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f3774107ce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3768009880 tx=0x7f376802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 -- 172.21.15.82:0/1286182664 shutdown_connections 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 --2- 172.21.15.82:0/1286182664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 0x7f3774101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 --2- 172.21.15.82:0/1286182664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f3774107ce0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 -- 172.21.15.82:0/1286182664 >> 172.21.15.82:0/1286182664 conn(0x7f37740fd600 msgr2=0x7f37740ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 -- 172.21.15.82:0/1286182664 shutdown_connections 2024-09-17T01:52:40.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.526+0000 7f377bb13640 1 -- 172.21.15.82:0/1286182664 wait complete. 2024-09-17T01:52:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 Processor -- start 2024-09-17T01:52:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 -- start start 2024-09-17T01:52:40.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 0x7f377419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f377410edd0 con 0x7f3774107900 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f377bb13640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f377410ec50 con 0x7f3774101900 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f37790ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f37790ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35538/0 (socket says 172.21.15.82:35538) 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f37790ae640 1 -- 172.21.15.82:0/1931245645 learned_addr learned my addr 172.21.15.82:0/1931245645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.527+0000 7f37798af640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 0x7f377419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f37790ae640 1 -- 172.21.15.82:0/1931245645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 msgr2=0x7f377419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f37790ae640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 0x7f377419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f37790ae640 1 -- 172.21.15.82:0/1931245645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3774197840 con 0x7f3774107900 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f37790ae640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f377000d6f0 tx=0x7f377000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3770017070 con 0x7f3774107900 2024-09-17T01:52:40.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3774197b30 con 0x7f3774107900 2024-09-17T01:52:40.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f377000de00 con 0x7f3774107900 2024-09-17T01:52:40.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3770004bb0 con 0x7f3774107900 2024-09-17T01:52:40.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.528+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37741980c0 con 0x7f3774107900 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.529+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3774103040 con 0x7f3774107900 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.530+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3770004e60 con 0x7f3774107900 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.530+0000 7f3766ffd640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 0x7f376007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.530+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f377009dba0 con 0x7f3774107900 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.530+0000 7f37798af640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 0x7f376007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.531+0000 7f37798af640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 0x7f376007d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f37680096c0 tx=0x7f3768031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.535+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f37700691a0 con 0x7f3774107900 2024-09-17T01:52:40.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.746+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f3774109e70 con 0x7f3774107900 2024-09-17T01:52:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.747+0000 7f3766ffd640 1 -- 172.21.15.82:0/1931245645 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) ==== 107+0+4470 (secure 0 0 0) 0x7f377006e050 con 0x7f3774107900 2024-09-17T01:52:40.745 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:40.745 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"btime":"2024-09-17T01:47:55:725914+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:47:55.265187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14576},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14576":{"gid":14576,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/981106576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":981106576},{"type":"v1","addr":"172.21.15.82:6827","nonce":981106576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14576,"qdb_cluster":[14576]},"id":1}]} 2024-09-17T01:52:40.745 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 17 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 msgr2=0x7f376007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 0x7f376007d3f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f37680096c0 tx=0x7f3768031400 comp rx=0 tx=0).stop 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 msgr2=0x7f377419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f377000d6f0 tx=0x7f377000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 shutdown_connections 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f376007af30 0x7f376007d3f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3774107900 0x7f377419dc00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 --2- 172.21.15.82:0/1931245645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3774101900 0x7f377419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.749+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 >> 172.21.15.82:0/1931245645 conn(0x7f37740fd600 msgr2=0x7f37740fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:40.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.750+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 shutdown_connections 2024-09-17T01:52:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:40.750+0000 7f377bb13640 1 -- 172.21.15.82:0/1931245645 wait complete. 2024-09-17T01:52:41.407 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:41 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1931245645' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-17T01:52:41.437 DEBUG:tasks.fs:max_mds reduced in epoch 17 2024-09-17T01:52:41.437 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-09-17T01:52:41.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-17T01:52:41.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:41 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1931245645' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-17T01:52:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 -- 172.21.15.82:0/1682800739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8106800 msgr2=0x7fe6e8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 --2- 172.21.15.82:0/1682800739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8106800 0x7fe6e8106be0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009880 tx=0x7fe6e402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 -- 172.21.15.82:0/1682800739 shutdown_connections 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 --2- 172.21.15.82:0/1682800739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8100800 0x7fe6e8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 --2- 172.21.15.82:0/1682800739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8106800 0x7fe6e8106be0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 -- 172.21.15.82:0/1682800739 >> 172.21.15.82:0/1682800739 conn(0x7fe6e80fc520 msgr2=0x7fe6e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 -- 172.21.15.82:0/1682800739 shutdown_connections 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.276+0000 7fe6ef577640 1 -- 172.21.15.82:0/1682800739 wait complete. 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 Processor -- start 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 -- start start 2024-09-17T01:52:42.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8106800 0x7fe6e80fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e810dcd0 con 0x7fe6e8100800 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ef577640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e810db50 con 0x7fe6e8106800 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35566/0 (socket says 172.21.15.82:35566) 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 -- 172.21.15.82:0/2251643233 learned_addr learned my addr 172.21.15.82:0/2251643233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ecb12640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8106800 0x7fe6e80fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 -- 172.21.15.82:0/2251643233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8106800 msgr2=0x7fe6e80fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8106800 0x7fe6e80fd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.277+0000 7fe6ed313640 1 -- 172.21.15.82:0/2251643233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e80fd6f0 con 0x7fe6e8100800 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6ed313640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4031460 tx=0x7fe6e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:42.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6e403f070 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e80fd980 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6e4004cf0 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6e4035030 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.278+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81a3de0 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.279+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e8101f40 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.279+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe6e4042070 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.280+0000 7fe6de7fc640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 0x7fe6d407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.280+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fe6e40beac0 con 0x7fe6e8100800 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.280+0000 7fe6ecb12640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 0x7fe6d407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.280+0000 7fe6ecb12640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 0x7fe6d407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80fe700 tx=0x7fe6d8005c60 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.284+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe6e408a0c0 con 0x7fe6e8100800 2024-09-17T01:52:42.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:42 smithi082 ceph-mon[92957]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:42.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.495+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fe6e8109d80 con 0x7fe6e8100800 2024-09-17T01:52:42.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.496+0000 7fe6de7fc640 1 -- 172.21.15.82:0/2251643233 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) ==== 107+0+5320 (secure 0 0 0) 0x7fe6e408ef70 con 0x7fe6e8100800 2024-09-17T01:52:42.494 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:42.494 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"btime":"2024-09-17T01:47:56:732001+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:47:55.265187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14576},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14576":{"gid":14576,"name":"cephfs.smithi082.haarnz","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6827/981106576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":981106576},{"type":"v1","addr":"172.21.15.82:6827","nonce":981106576}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14576,"qdb_cluster":[14576]},"id":1}]} 2024-09-17T01:52:42.494 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2024-09-17T01:52:42.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 msgr2=0x7fe6d407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:42.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 0x7fe6d407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80fe700 tx=0x7fe6d8005c60 comp rx=0 tx=0).stop 2024-09-17T01:52:42.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 msgr2=0x7fe6e80fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:42.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4031460 tx=0x7fe6e40048f0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 shutdown_connections 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe6d407af30 0x7fe6d407d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e8106800 0x7fe6e80fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 --2- 172.21.15.82:0/2251643233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6e8100800 0x7fe6e80fcc70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 >> 172.21.15.82:0/2251643233 conn(0x7fe6e80fc520 msgr2=0x7fe6e806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 shutdown_connections 2024-09-17T01:52:42.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:42.498+0000 7fe6ef577640 1 -- 172.21.15.82:0/2251643233 wait complete. 2024-09-17T01:52:42.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:42 smithi167 ceph-mon[76323]: pgmap v336: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:43.116 DEBUG:tasks.fs:max_mds reduced in epoch 18 2024-09-17T01:52:43.116 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-09-17T01:52:43.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-17T01:52:43.366 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:43.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:43 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2251643233' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-17T01:52:43.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:43 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2251643233' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-17T01:52:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 -- 172.21.15.82:0/3551978986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 msgr2=0x7ff4b4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3551978986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4106be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009880 tx=0x7ff4a402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 -- 172.21.15.82:0/3551978986 shutdown_connections 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3551978986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 0x7ff4b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3551978986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4106be0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 -- 172.21.15.82:0/3551978986 >> 172.21.15.82:0/3551978986 conn(0x7ff4b40fc520 msgr2=0x7ff4b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 -- 172.21.15.82:0/3551978986 shutdown_connections 2024-09-17T01:52:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.816+0000 7ff4b898c640 1 -- 172.21.15.82:0/3551978986 wait complete. 2024-09-17T01:52:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 Processor -- start 2024-09-17T01:52:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 -- start start 2024-09-17T01:52:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 0x7ff4b4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b410dd30 con 0x7ff4b4106800 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.817+0000 7ff4b898c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b410dbb0 con 0x7ff4b4100800 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35592/0 (socket says 172.21.15.82:35592) 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 -- 172.21.15.82:0/3415495864 learned_addr learned my addr 172.21.15.82:0/3415495864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4b259c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 0x7ff4b4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 -- 172.21.15.82:0/3415495864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 msgr2=0x7ff4b4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 0x7ff4b4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 -- 172.21.15.82:0/3415495864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b41993c0 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4abfff640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00b420 tx=0x7ff49c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c011630 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b41996b0 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff49c016070 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c010d00 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.818+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b41a1cb0 con 0x7ff4b4106800 2024-09-17T01:52:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.819+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b4101f40 con 0x7ff4b4106800 2024-09-17T01:52:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.820+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff49c01b460 con 0x7ff4b4106800 2024-09-17T01:52:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.820+0000 7ff4ab7fe640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 0x7ff4a007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.821+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7ff49c09d750 con 0x7ff4b4106800 2024-09-17T01:52:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.821+0000 7ff4b259c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 0x7ff4a007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.821+0000 7ff4b259c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 0x7ff4a007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40096c0 tx=0x7ff4a4031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:43.825+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff4b41996b0 con 0x7ff4b4106800 2024-09-17T01:52:44.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.033+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7ff4b4108d70 con 0x7ff4b4106800 2024-09-17T01:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.034+0000 7ff4ab7fe640 1 -- 172.21.15.82:0/3415495864 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) ==== 107+0+4458 (secure 0 0 0) 0x7ff49c068d50 con 0x7ff4b4106800 2024-09-17T01:52:44.032 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:44.032 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"btime":"2024-09-17T01:48:04:066160+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:04.066155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:52:44.032 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 19 2024-09-17T01:52:44.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 msgr2=0x7ff4a007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 0x7ff4a007d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40096c0 tx=0x7ff4a4031400 comp rx=0 tx=0).stop 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 msgr2=0x7ff4b4198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00b420 tx=0x7ff49c00b8e0 comp rx=0 tx=0).stop 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 shutdown_connections 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff4a007af30 0x7ff4a007d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4b4106800 0x7ff4b4198dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 --2- 172.21.15.82:0/3415495864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4b4100800 0x7ff4b4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 >> 172.21.15.82:0/3415495864 conn(0x7ff4b40fc520 msgr2=0x7ff4b40fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:44.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 shutdown_connections 2024-09-17T01:52:44.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:44.036+0000 7ff4b898c640 1 -- 172.21.15.82:0/3415495864 wait complete. 2024-09-17T01:52:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:44 smithi167 ceph-mon[76323]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:44.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:44 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3415495864' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-17T01:52:44.518 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:44 smithi082 ceph-mon[92957]: pgmap v337: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:44.518 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:44 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3415495864' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-17T01:52:44.691 DEBUG:tasks.fs:max_mds reduced in epoch 19 2024-09-17T01:52:44.691 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-09-17T01:52:44.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-17T01:52:44.937 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:45.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 -- 172.21.15.82:0/3607194458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 msgr2=0x7f7838100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 --2- 172.21.15.82:0/3607194458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f7838100a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f782c009880 tx=0x7f782c02a490 comp rx=0 tx=0).stop 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 -- 172.21.15.82:0/3607194458 shutdown_connections 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 --2- 172.21.15.82:0/3607194458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 0x7f783810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 --2- 172.21.15.82:0/3607194458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f7838100a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 -- 172.21.15.82:0/3607194458 >> 172.21.15.82:0/3607194458 conn(0x7f78380fc520 msgr2=0x7f78380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 -- 172.21.15.82:0/3607194458 shutdown_connections 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.398+0000 7f783f37a640 1 -- 172.21.15.82:0/3607194458 wait complete. 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 Processor -- start 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 -- start start 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 0x7f783819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7838110f90 con 0x7f7838100650 2024-09-17T01:52:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783f37a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7838110e10 con 0x7f7838101000 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783d116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783d116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35616/0 (socket says 172.21.15.82:35616) 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.399+0000 7f783d116640 1 -- 172.21.15.82:0/217271737 learned_addr learned my addr 172.21.15.82:0/217271737 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783c915640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 0x7f783819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783d116640 1 -- 172.21.15.82:0/217271737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 msgr2=0x7f783819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783d116640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 0x7f783819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783d116640 1 -- 172.21.15.82:0/217271737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7838199980 con 0x7f7838100650 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783d116640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f782c031460 tx=0x7f782c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f782c03f070 con 0x7f7838100650 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7838199c10 con 0x7f7838100650 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f782c004cf0 con 0x7f7838100650 2024-09-17T01:52:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f782c035030 con 0x7f7838100650 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.400+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783819a1a0 con 0x7f7838100650 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.401+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783806aa90 con 0x7f7838100650 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.402+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f782c042070 con 0x7f7838100650 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.402+0000 7f78367fc640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 0x7f782007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.402+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f782c0bf1b0 con 0x7f7838100650 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.402+0000 7f783c915640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 0x7f782007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.403+0000 7f783c915640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 0x7f782007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7838102530 tx=0x7f7828008230 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.406+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f782c08a790 con 0x7f7838100650 2024-09-17T01:52:45.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.615+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7f783819aeb0 con 0x7f7838100650 2024-09-17T01:52:45.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.616+0000 7f78367fc640 1 -- 172.21.15.82:0/217271737 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) ==== 107+0+4469 (secure 0 0 0) 0x7f782c08f640 con 0x7f7838100650 2024-09-17T01:52:45.614 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:45.614 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":20,"btime":"2024-09-17T01:48:04:071505+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:04.071489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:52:45.614 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 20 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 msgr2=0x7f782007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 0x7f782007d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7838102530 tx=0x7f7828008230 comp rx=0 tx=0).stop 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 msgr2=0x7f783819f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f782c031460 tx=0x7f782c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 shutdown_connections 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f782007af30 0x7f782007d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7838101000 0x7f783819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 --2- 172.21.15.82:0/217271737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7838100650 0x7f783819f7c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:45.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 >> 172.21.15.82:0/217271737 conn(0x7f78380fc520 msgr2=0x7f78380fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:45.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 shutdown_connections 2024-09-17T01:52:45.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:45.618+0000 7f783f37a640 1 -- 172.21.15.82:0/217271737 wait complete. 2024-09-17T01:52:45.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:45 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/217271737' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-17T01:52:46.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:45 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/217271737' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-17T01:52:46.315 DEBUG:tasks.fs:max_mds reduced in epoch 20 2024-09-17T01:52:46.315 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-17T01:52:46.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-17T01:52:46.564 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:46 smithi082 ceph-mon[92957]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:46.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:47.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:46 smithi167 ceph-mon[76323]: pgmap v338: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:47.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:52:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 -- 172.21.15.82:0/3218390690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 msgr2=0x7fac08107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 --2- 172.21.15.82:0/3218390690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac08107ce0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fac00009880 tx=0x7fac0002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 -- 172.21.15.82:0/3218390690 shutdown_connections 2024-09-17T01:52:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 --2- 172.21.15.82:0/3218390690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac08101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 --2- 172.21.15.82:0/3218390690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac08107ce0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 -- 172.21.15.82:0/3218390690 >> 172.21.15.82:0/3218390690 conn(0x7fac080fd600 msgr2=0x7fac080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 -- 172.21.15.82:0/3218390690 shutdown_connections 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 -- 172.21.15.82:0/3218390690 wait complete. 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.007+0000 7fac0d083640 1 Processor -- start 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0d083640 1 -- start start 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0d083640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac0819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0d083640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0d083640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac0810edd0 con 0x7fac08107900 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0d083640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac0810ec50 con 0x7fac08101900 2024-09-17T01:52:47.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35636/0 (socket says 172.21.15.82:35636) 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 -- 172.21.15.82:0/2099612050 learned_addr learned my addr 172.21.15.82:0/2099612050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac06d9d640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac0819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 -- 172.21.15.82:0/2099612050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 msgr2=0x7fac0819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac0819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac0659c640 1 -- 172.21.15.82:0/2099612050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac081977c0 con 0x7fac08107900 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.008+0000 7fac06d9d640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac0819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fac0659c640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c8f0 tx=0x7fabf000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabf00079b0 con 0x7fac08107900 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fabf00054e0 con 0x7fac08107900 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac08197ab0 con 0x7fac08107900 2024-09-17T01:52:47.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fabf0004dd0 con 0x7fac08107900 2024-09-17T01:52:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.009+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac08198040 con 0x7fac08107900 2024-09-17T01:52:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.010+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac08103040 con 0x7fac08107900 2024-09-17T01:52:47.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.011+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fabf0005020 con 0x7fac08107900 2024-09-17T01:52:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.011+0000 7fabfffff640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 0x7fabf407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.011+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fabf009dfd0 con 0x7fac08107900 2024-09-17T01:52:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.011+0000 7fac06d9d640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 0x7fabf407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:47.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.012+0000 7fac06d9d640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 0x7fabf407d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac00031460 tx=0x7fac00009560 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:47.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.016+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fabf0014030 con 0x7fac08107900 2024-09-17T01:52:47.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.229+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7fac08109e70 con 0x7fac08107900 2024-09-17T01:52:47.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.230+0000 7fabfffff640 1 -- 172.21.15.82:0/2099612050 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) ==== 107+0+4473 (secure 0 0 0) 0x7fabf00880e0 con 0x7fac08107900 2024-09-17T01:52:47.228 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:47.228 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"btime":"2024-09-17T01:48:12:609543+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:11.694460+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":12,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:52:47.229 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-09-17T01:52:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 msgr2=0x7fabf407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 0x7fabf407d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fac00031460 tx=0x7fac00009560 comp rx=0 tx=0).stop 2024-09-17T01:52:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 msgr2=0x7fac0819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:47.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fabf000c8f0 tx=0x7fabf000cdb0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 shutdown_connections 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fabf407aed0 0x7fabf407d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac08107900 0x7fac0819db80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 --2- 172.21.15.82:0/2099612050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac08101900 0x7fac0819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.232+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 >> 172.21.15.82:0/2099612050 conn(0x7fac080fd600 msgr2=0x7fac080fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.233+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 shutdown_connections 2024-09-17T01:52:47.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:47.233+0000 7fac0d083640 1 -- 172.21.15.82:0/2099612050 wait complete. 2024-09-17T01:52:47.853 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:47 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2099612050' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-17T01:52:47.883 DEBUG:tasks.fs:max_mds reduced in epoch 21 2024-09-17T01:52:47.883 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-17T01:52:47.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-17T01:52:48.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:47 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2099612050' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-17T01:52:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:48.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 -- 172.21.15.82:0/3692501198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541067f0 msgr2=0x7f8954106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:48.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 --2- 172.21.15.82:0/3692501198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541067f0 0x7f8954106bd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8944009880 tx=0x7f894402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 -- 172.21.15.82:0/3692501198 shutdown_connections 2024-09-17T01:52:48.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 --2- 172.21.15.82:0/3692501198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541007f0 0x7f8954100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 --2- 172.21.15.82:0/3692501198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541067f0 0x7f8954106bd0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 -- 172.21.15.82:0/3692501198 >> 172.21.15.82:0/3692501198 conn(0x7f89540fc550 msgr2=0x7f89540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:48.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 -- 172.21.15.82:0/3692501198 shutdown_connections 2024-09-17T01:52:48.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.556+0000 7f8958b40640 1 -- 172.21.15.82:0/3692501198 wait complete. 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 Processor -- start 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 -- start start 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541067f0 0x7f8954196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f895410dcc0 con 0x7f89541007f0 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8958b40640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f895410db40 con 0x7f89541067f0 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47922/0 (socket says 172.21.15.82:47922) 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 -- 172.21.15.82:0/2380867097 learned_addr learned my addr 172.21.15.82:0/2380867097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f8951d9b640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541067f0 0x7f8954196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 -- 172.21.15.82:0/2380867097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541067f0 msgr2=0x7f8954196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:48.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541067f0 0x7f8954196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.557+0000 7f895259c640 1 -- 172.21.15.82:0/2380867097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8954197080 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f895259c640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8944031460 tx=0x7f89440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f894403f070 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8954197310 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89541a3e40 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89440035f0 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.558+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8944049060 con 0x7f89541007f0 2024-09-17T01:52:48.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.559+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8934005290 con 0x7f89541007f0 2024-09-17T01:52:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.560+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f8944042070 con 0x7f89541007f0 2024-09-17T01:52:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.560+0000 7f894b7fe640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 0x7f894007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:48.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.560+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f89440be6c0 con 0x7f89541007f0 2024-09-17T01:52:48.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.560+0000 7f8951d9b640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 0x7f894007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:48.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.561+0000 7f8951d9b640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 0x7f894007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f893c005fd0 tx=0x7f893c005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:48.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.565+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f8944089cc0 con 0x7f89541007f0 2024-09-17T01:52:48.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.774+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f8934005580 con 0x7f89541007f0 2024-09-17T01:52:48.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.775+0000 7f894b7fe640 1 -- 172.21.15.82:0/2380867097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) ==== 107+0+4470 (secure 0 0 0) 0x7f894408eb70 con 0x7f89541007f0 2024-09-17T01:52:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:48.773 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"btime":"2024-09-17T01:48:13:615750+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:12.619161+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:52:48.774 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-09-17T01:52:48.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 msgr2=0x7f894007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 0x7f894007d3f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f893c005fd0 tx=0x7f893c005850 comp rx=0 tx=0).stop 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 msgr2=0x7f8954196600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8944031460 tx=0x7f89440045e0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 shutdown_connections 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f894007af30 0x7f894007d3f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89541067f0 0x7f8954196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 --2- 172.21.15.82:0/2380867097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89541007f0 0x7f8954196600 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:48.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.777+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 >> 172.21.15.82:0/2380867097 conn(0x7f89540fc550 msgr2=0x7f89540fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.778+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 shutdown_connections 2024-09-17T01:52:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:48.778+0000 7f8958b40640 1 -- 172.21.15.82:0/2380867097 wait complete. 2024-09-17T01:52:48.850 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:48 smithi082 ceph-mon[92957]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:48 smithi167 ceph-mon[76323]: pgmap v339: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:49.517 DEBUG:tasks.fs:max_mds reduced in epoch 22 2024-09-17T01:52:49.517 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-17T01:52:49.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-17T01:52:49.772 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:49.892 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:49 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2380867097' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-17T01:52:50.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:49 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2380867097' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- 172.21.15.82:0/1109192877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814102b10 msgr2=0x7f3814102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 --2- 172.21.15.82:0/1109192877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814102b10 0x7f3814102ef0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38080098b0 tx=0x7f380802a560 comp rx=0 tx=0).stop 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- 172.21.15.82:0/1109192877 shutdown_connections 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 --2- 172.21.15.82:0/1109192877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814103430 0x7f381410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 --2- 172.21.15.82:0/1109192877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814102b10 0x7f3814102ef0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- 172.21.15.82:0/1109192877 >> 172.21.15.82:0/1109192877 conn(0x7f38140fc550 msgr2=0x7f38140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- 172.21.15.82:0/1109192877 shutdown_connections 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- 172.21.15.82:0/1109192877 wait complete. 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 Processor -- start 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.238+0000 7f381af0c640 1 -- start start 2024-09-17T01:52:50.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f381af0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 0x7f381419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f381af0c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f381af0c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f381410ede0 con 0x7f3814103430 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f381af0c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f381410ec60 con 0x7f3814102b10 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47942/0 (socket says 172.21.15.82:47942) 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 -- 172.21.15.82:0/3106153731 learned_addr learned my addr 172.21.15.82:0/3106153731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3818ca8640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 0x7f381419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 -- 172.21.15.82:0/3106153731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 msgr2=0x7f381419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 0x7f381419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 -- 172.21.15.82:0/3106153731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3814197870 con 0x7f3814103430 2024-09-17T01:52:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3818ca8640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 0x7f381419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3813fff640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f380000d6f0 tx=0x7f380000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3800017070 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f380000de00 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3814197b60 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.239+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3800004bb0 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.240+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141980f0 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.241+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381406a520 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.241+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f3800004e60 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.242+0000 7f3811ffb640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 0x7f380407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.242+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f380009dc50 con 0x7f3814103430 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.242+0000 7f3818ca8640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 0x7f380407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.242+0000 7f3818ca8640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 0x7f380407d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3808009230 tx=0x7f3808031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.246+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f3800069250 con 0x7f3814103430 2024-09-17T01:52:50.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.459+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f3814104f90 con 0x7f3814103430 2024-09-17T01:52:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.460+0000 7f3811ffb640 1 -- 172.21.15.82:0/3106153731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) ==== 107+0+4479 (secure 0 0 0) 0x7f380006e100 con 0x7f3814103430 2024-09-17T01:52:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 23 2024-09-17T01:52:50.459 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:50.459 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"btime":"2024-09-17T01:48:14:620985+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 msgr2=0x7f380407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 0x7f380407d3f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3808009230 tx=0x7f3808031400 comp rx=0 tx=0).stop 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 msgr2=0x7f381419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f380000d6f0 tx=0x7f380000dbb0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 shutdown_connections 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f380407af30 0x7f380407d3f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3814103430 0x7f381419dbf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 --2- 172.21.15.82:0/3106153731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3814102b10 0x7f381419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 >> 172.21.15.82:0/3106153731 conn(0x7f38140fc550 msgr2=0x7f3814107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 shutdown_connections 2024-09-17T01:52:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:50.463+0000 7f381af0c640 1 -- 172.21.15.82:0/3106153731 wait complete. 2024-09-17T01:52:50.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:50 smithi082 ceph-mon[92957]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:50.714 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:50 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3106153731' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-17T01:52:51.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:50 smithi167 ceph-mon[76323]: pgmap v340: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:50 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3106153731' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-17T01:52:51.088 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-09-17T01:52:51.088 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-17T01:52:51.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-17T01:52:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 -- 172.21.15.82:0/3185557763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201067f0 msgr2=0x7f6d20106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 --2- 172.21.15.82:0/3185557763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201067f0 0x7f6d20106bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009880 tx=0x7f6d1002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 -- 172.21.15.82:0/3185557763 shutdown_connections 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 --2- 172.21.15.82:0/3185557763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201007f0 0x7f6d20100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 --2- 172.21.15.82:0/3185557763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201067f0 0x7f6d20106bd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 -- 172.21.15.82:0/3185557763 >> 172.21.15.82:0/3185557763 conn(0x7f6d200fc550 msgr2=0x7f6d200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 -- 172.21.15.82:0/3185557763 shutdown_connections 2024-09-17T01:52:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 -- 172.21.15.82:0/3185557763 wait complete. 2024-09-17T01:52:51.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.812+0000 7f6d24988640 1 Processor -- start 2024-09-17T01:52:51.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d24988640 1 -- start start 2024-09-17T01:52:51.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d24988640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d24988640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 0x7f6d2019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d24988640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2010ee20 con 0x7f6d201007f0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d24988640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2010eca0 con 0x7f6d201067f0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47964/0 (socket says 172.21.15.82:47964) 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 -- 172.21.15.82:0/1322180627 learned_addr learned my addr 172.21.15.82:0/1322180627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1dd9b640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 0x7f6d2019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 -- 172.21.15.82:0/1322180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 msgr2=0x7f6d2019dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 0x7f6d2019dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 -- 172.21.15.82:0/1322180627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d20197930 con 0x7f6d201007f0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1dd9b640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 0x7f6d2019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.813+0000 7f6d1e59c640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d10031460 tx=0x7f6d100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.814+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d1003f070 con 0x7f6d201007f0 2024-09-17T01:52:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.814+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d10004cf0 con 0x7f6d201007f0 2024-09-17T01:52:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.814+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d20197bc0 con 0x7f6d201007f0 2024-09-17T01:52:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.814+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d10035030 con 0x7f6d201007f0 2024-09-17T01:52:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.814+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d201980f0 con 0x7f6d201007f0 2024-09-17T01:52:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.815+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d20101f30 con 0x7f6d201007f0 2024-09-17T01:52:51.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.815+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f6d10042070 con 0x7f6d201007f0 2024-09-17T01:52:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.816+0000 7f6d0f7fe640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.816+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f6d100beb00 con 0x7f6d201007f0 2024-09-17T01:52:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.816+0000 7f6d1dd9b640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.816+0000 7f6d1dd9b640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 0x7f6d0807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:51.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:51.820+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f6d1008a100 con 0x7f6d201007f0 2024-09-17T01:52:52.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.034+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f6d20108d60 con 0x7f6d201007f0 2024-09-17T01:52:52.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.034+0000 7f6d0f7fe640 1 -- 172.21.15.82:0/1322180627 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) ==== 107+0+5326 (secure 0 0 0) 0x7f6d1008efb0 con 0x7f6d201007f0 2024-09-17T01:52:52.033 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:52.033 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":24,"btime":"2024-09-17T01:48:16:632871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34294,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/2234505694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":2234505694},{"type":"v1","addr":"172.21.15.82:6829","nonce":2234505694}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:52.033 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 24 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 msgr2=0x7f6d0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 0x7f6d0807d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6d14006fd0 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 msgr2=0x7f6d2019d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6d10031460 tx=0x7f6d100048f0 comp rx=0 tx=0).stop 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 shutdown_connections 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d201067f0 0x7f6d2019dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:52.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 --2- 172.21.15.82:0/1322180627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d201007f0 0x7f6d2019d770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:52.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 >> 172.21.15.82:0/1322180627 conn(0x7f6d200fc550 msgr2=0x7f6d200fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:52.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 shutdown_connections 2024-09-17T01:52:52.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:52.038+0000 7f6d24988640 1 -- 172.21.15.82:0/1322180627 wait complete. 2024-09-17T01:52:52.635 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-09-17T01:52:52.635 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-17T01:52:52.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-17T01:52:52.891 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:52 smithi082 ceph-mon[92957]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:52.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:52 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1322180627' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-17T01:52:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:52 smithi167 ceph-mon[76323]: pgmap v341: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:52:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:52 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1322180627' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- 172.21.15.82:0/2522505662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a800ffdc0 msgr2=0x7f7a80100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 --2- 172.21.15.82:0/2522505662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100220 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009880 tx=0x7f7a7402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- 172.21.15.82:0/2522505662 shutdown_connections 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 --2- 172.21.15.82:0/2522505662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100220 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 --2- 172.21.15.82:0/2522505662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a801069a0 0x7f7a80106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- 172.21.15.82:0/2522505662 >> 172.21.15.82:0/2522505662 conn(0x7f7a800fbc90 msgr2=0x7f7a800fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- 172.21.15.82:0/2522505662 shutdown_connections 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- 172.21.15.82:0/2522505662 wait complete. 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 Processor -- start 2024-09-17T01:52:53.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.395+0000 7f7a852ea640 1 -- start start 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a852ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a852ea640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a852ea640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8010ef20 con 0x7f7a801069a0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a852ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8010eda0 con 0x7f7a800ffdc0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47982/0 (socket says 172.21.15.82:47982) 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 -- 172.21.15.82:0/970414135 learned_addr learned my addr 172.21.15.82:0/970414135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 -- 172.21.15.82:0/970414135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a800ffdc0 msgr2=0x7f7a80100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7effd640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 -- 172.21.15.82:0/970414135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a80101a20 con 0x7f7a801069a0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a7e7fc640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031460 tx=0x7f7a740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:53.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a7403f070 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a74004cf0 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a80101cb0 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.396+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a74035030 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.397+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a801a3e20 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.397+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a801030e0 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.398+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f7a74042070 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.399+0000 7f7a67fff640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 0x7f7a6807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.399+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f7a740bea90 con 0x7f7a801069a0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.399+0000 7f7a7effd640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 0x7f7a6807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.399+0000 7f7a7effd640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 0x7f7a6807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000ba40 tx=0x7f7a70005cc0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:53.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.403+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f7a7408a090 con 0x7f7a801069a0 2024-09-17T01:52:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.615+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f7a80109ee0 con 0x7f7a801069a0 2024-09-17T01:52:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.615+0000 7f7a67fff640 1 -- 172.21.15.82:0/970414135 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) ==== 107+0+4479 (secure 0 0 0) 0x7f7a80109ee0 con 0x7f7a801069a0 2024-09-17T01:52:53.614 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:53.614 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"btime":"2024-09-17T01:48:28:626076+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:53.614 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 msgr2=0x7f7a6807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 0x7f7a6807d3f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000ba40 tx=0x7f7a70005cc0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 msgr2=0x7f7a801014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031460 tx=0x7f7a740048f0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 shutdown_connections 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f7a6807af30 0x7f7a6807d3f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a801069a0 0x7f7a801014e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 --2- 172.21.15.82:0/970414135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7a800ffdc0 0x7f7a80100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 >> 172.21.15.82:0/970414135 conn(0x7f7a800fbc90 msgr2=0x7f7a800fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 shutdown_connections 2024-09-17T01:52:53.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:53.618+0000 7f7a852ea640 1 -- 172.21.15.82:0/970414135 wait complete. 2024-09-17T01:52:53.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:53 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/970414135' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-17T01:52:54.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:53 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/970414135' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-17T01:52:54.193 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-17T01:52:54.193 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-17T01:52:54.193 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-17T01:52:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:54.852 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:54 smithi082 ceph-mon[92957]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:54.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.893+0000 7f9cd1efa640 1 -- 172.21.15.82:0/2054923239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 msgr2=0x7f9ccc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/2054923239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc106be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc009880 tx=0x7f9cbc02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 -- 172.21.15.82:0/2054923239 shutdown_connections 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/2054923239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 0x7f9ccc101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/2054923239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc106be0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 -- 172.21.15.82:0/2054923239 >> 172.21.15.82:0/2054923239 conn(0x7f9ccc077270 msgr2=0x7f9ccc077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 -- 172.21.15.82:0/2054923239 shutdown_connections 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 -- 172.21.15.82:0/2054923239 wait complete. 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 Processor -- start 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.894+0000 7f9cd1efa640 1 -- start start 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 0x7f9ccc19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:54.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc10dce0 con 0x7f9ccc106800 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc10db60 con 0x7f9ccc1011e0 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47988/0 (socket says 172.21.15.82:47988) 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 -- 172.21.15.82:0/3391833665 learned_addr learned my addr 172.21.15.82:0/3391833665 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9ccb7fe640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 0x7f9ccc19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 -- 172.21.15.82:0/3391833665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 msgr2=0x7f9ccc19f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 0x7f9ccc19f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 -- 172.21.15.82:0/3391833665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc199a50 con 0x7f9ccc106800 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc2ffd640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d6f0 tx=0x7f9cb400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cb4017070 con 0x7f9ccc106800 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc199d40 con 0x7f9ccc106800 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9cb400de00 con 0x7f9ccc106800 2024-09-17T01:52:54.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9cb4004bb0 con 0x7f9ccc106800 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.895+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc19a2d0 con 0x7f9ccc106800 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.897+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc069f00 con 0x7f9ccc106800 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.897+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9cb4004e60 con 0x7f9ccc106800 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.898+0000 7f9cc97fa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 0x7f9cb807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.898+0000 7f9ccb7fe640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 0x7f9cb807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.898+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f9cb409dba0 con 0x7f9ccc106800 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.898+0000 7f9ccb7fe640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 0x7f9cb807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:54.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:54.902+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9cb40691a0 con 0x7f9ccc106800 2024-09-17T01:52:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:54 smithi167 ceph-mon[76323]: pgmap v342: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:52:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.113+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f9ccc19afb0 con 0x7f9ccc106800 2024-09-17T01:52:55.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.114+0000 7f9cc97fa640 1 -- 172.21.15.82:0/3391833665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) ==== 107+0+5323 (secure 0 0 0) 0x7f9cb406e050 con 0x7f9ccc106800 2024-09-17T01:52:55.112 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:55.113 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"btime":"2024-09-17T01:48:31:635075+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34259,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/1046955956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1046955956},{"type":"v1","addr":"172.21.15.167:6825","nonce":1046955956}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:55.113 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.116+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 msgr2=0x7f9cb807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.116+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 0x7f9cb807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc000c00 tx=0x7f9cbc031400 comp rx=0 tx=0).stop 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.116+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 msgr2=0x7f9ccc19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.116+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400d6f0 tx=0x7f9cb400dbb0 comp rx=0 tx=0).stop 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 shutdown_connections 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9cb807af30 0x7f9cb807d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ccc106800 0x7f9ccc19fdd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 --2- 172.21.15.82:0/3391833665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ccc1011e0 0x7f9ccc19f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 >> 172.21.15.82:0/3391833665 conn(0x7f9ccc077270 msgr2=0x7f9ccc0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 shutdown_connections 2024-09-17T01:52:55.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:55.117+0000 7f9cd1efa640 1 -- 172.21.15.82:0/3391833665 wait complete. 2024-09-17T01:52:55.730 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:55 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3391833665' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-17T01:52:55.761 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-17T01:52:55.762 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-17T01:52:55.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-17T01:52:56.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:55 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3391833665' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-17T01:52:56.012 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 -- 172.21.15.82:0/584688976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 msgr2=0x7f72d4104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 --2- 172.21.15.82:0/584688976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d4104c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009880 tx=0x7f72c802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 -- 172.21.15.82:0/584688976 shutdown_connections 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 --2- 172.21.15.82:0/584688976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d4104c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 --2- 172.21.15.82:0/584688976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d4100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 -- 172.21.15.82:0/584688976 >> 172.21.15.82:0/584688976 conn(0x7f72d40fbc90 msgr2=0x7f72d40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 -- 172.21.15.82:0/584688976 shutdown_connections 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.508+0000 7f72db63f640 1 -- 172.21.15.82:0/584688976 wait complete. 2024-09-17T01:52:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 Processor -- start 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 -- start start 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72d410d4b0 con 0x7f72d4100c00 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72db63f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72d410d330 con 0x7f72d4100250 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72d8bda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72d8bda640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48002/0 (socket says 172.21.15.82:48002) 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72d8bda640 1 -- 172.21.15.82:0/679329488 learned_addr learned my addr 172.21.15.82:0/679329488 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.509+0000 7f72d93db640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72d8bda640 1 -- 172.21.15.82:0/679329488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 msgr2=0x7f72d419c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72d8bda640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d419c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72d8bda640 1 -- 172.21.15.82:0/679329488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d4196720 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72d93db640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72d8bda640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031460 tx=0x7f72c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72c803f070 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d41969b0 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72c80035f0 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72c8035030 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.510+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d4196eb0 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.511+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d4101730 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.512+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f72c8042070 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.512+0000 7f72c67fc640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 0x7f72c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.512+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f72c80bea20 con 0x7f72d4100c00 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.512+0000 7f72d93db640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 0x7f72c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.512+0000 7f72d93db640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 0x7f72c007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72d0005d00 tx=0x7f72d0009550 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.517+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f72c808a020 con 0x7f72d4100c00 2024-09-17T01:52:56.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.731+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f72d4197c50 con 0x7f72d4100c00 2024-09-17T01:52:56.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.732+0000 7f72c67fc640 1 -- 172.21.15.82:0/679329488 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) ==== 107+0+4473 (secure 0 0 0) 0x7f72c808c020 con 0x7f72d4100c00 2024-09-17T01:52:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:56.730 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"btime":"2024-09-17T01:48:43:709139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:56.730 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-09-17T01:52:56.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 msgr2=0x7f72c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:56.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 0x7f72c007d3f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72d0005d00 tx=0x7f72d0009550 comp rx=0 tx=0).stop 2024-09-17T01:52:56.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 msgr2=0x7f72d419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:56.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031460 tx=0x7f72c80045e0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 shutdown_connections 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f72c007af30 0x7f72c007d3f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72d4100c00 0x7f72d419cb90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 --2- 172.21.15.82:0/679329488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72d4100250 0x7f72d419c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 >> 172.21.15.82:0/679329488 conn(0x7f72d40fbc90 msgr2=0x7f72d4103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 shutdown_connections 2024-09-17T01:52:56.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:56.734+0000 7f72db63f640 1 -- 172.21.15.82:0/679329488 wait complete. 2024-09-17T01:52:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:56 smithi167 ceph-mon[76323]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:57.080 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:56 smithi082 ceph-mon[92957]: pgmap v343: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:57.390 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-17T01:52:57.390 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-17T01:52:57.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-17T01:52:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:58.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:57 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/679329488' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-17T01:52:58.067 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:57 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/679329488' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-17T01:52:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 -- 172.21.15.82:0/3518687805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 msgr2=0x7ff460101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:58.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 --2- 172.21.15.82:0/3518687805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff460101d60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff454009880 tx=0x7ff45402a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 -- 172.21.15.82:0/3518687805 shutdown_connections 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 --2- 172.21.15.82:0/3518687805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff460101d60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 --2- 172.21.15.82:0/3518687805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 0x7ff460107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 -- 172.21.15.82:0/3518687805 >> 172.21.15.82:0/3518687805 conn(0x7ff4600fd600 msgr2=0x7ff4600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 -- 172.21.15.82:0/3518687805 shutdown_connections 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.264+0000 7ff465811640 1 -- 172.21.15.82:0/3518687805 wait complete. 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 Processor -- start 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 -- start start 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 0x7ff46019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff46010ee30 con 0x7ff460101900 2024-09-17T01:52:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff465811640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff46010ecb0 con 0x7ff460107900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff45effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff45effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55728/0 (socket says 172.21.15.82:55728) 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.265+0000 7ff45effd640 1 -- 172.21.15.82:0/3293156266 learned_addr learned my addr 172.21.15.82:0/3293156266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff45e7fc640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 0x7ff46019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff45effd640 1 -- 172.21.15.82:0/3293156266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 msgr2=0x7ff46019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff45effd640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 0x7ff46019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff45effd640 1 -- 172.21.15.82:0/3293156266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff460197840 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff45effd640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff45000ba50 tx=0x7ff45000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff450019070 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff45000ce20 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff460197b30 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4500075a0 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.266+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff460198090 con 0x7ff460101900 2024-09-17T01:52:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.267+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460103040 con 0x7ff460101900 2024-09-17T01:52:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.268+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7ff45001c070 con 0x7ff460101900 2024-09-17T01:52:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.268+0000 7ff46480f640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 0x7ff44807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:58.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.269+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7ff45009d8f0 con 0x7ff460101900 2024-09-17T01:52:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.269+0000 7ff45e7fc640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 0x7ff44807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.269+0000 7ff45e7fc640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 0x7ff44807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff460198b90 tx=0x7ff454031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.274+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7ff450068ef0 con 0x7ff460101900 2024-09-17T01:52:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.487+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7ff460198da0 con 0x7ff460101900 2024-09-17T01:52:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.488+0000 7ff46480f640 1 -- 172.21.15.82:0/3293156266 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) ==== 107+0+5323 (secure 0 0 0) 0x7ff460198da0 con 0x7ff460101900 2024-09-17T01:52:58.486 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:52:58.486 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"btime":"2024-09-17T01:48:49:723343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:14.620977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34227},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34227":{"gid":34227,"name":"cephfs.smithi167.ypfdyj","rank":0,"incarnation":20,"state":"up:active","state_seq":14,"addr":"172.21.15.167:6827/3290052476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":3290052476},{"type":"v1","addr":"172.21.15.167:6827","nonce":3290052476}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34227,"qdb_cluster":[34227]},"id":1}]} 2024-09-17T01:52:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 msgr2=0x7ff44807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 0x7ff44807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff460198b90 tx=0x7ff454031400 comp rx=0 tx=0).stop 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 msgr2=0x7ff46019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff45000ba50 tx=0x7ff45000bf10 comp rx=0 tx=0).stop 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 shutdown_connections 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7ff44807af30 0x7ff44807d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff460107900 0x7ff46019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 --2- 172.21.15.82:0/3293156266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff460101900 0x7ff46019d6c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 >> 172.21.15.82:0/3293156266 conn(0x7ff4600fd600 msgr2=0x7ff4600fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 shutdown_connections 2024-09-17T01:52:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:58.490+0000 7ff465811640 1 -- 172.21.15.82:0/3293156266 wait complete. 2024-09-17T01:52:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:58 smithi167 ceph-mon[76323]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:52:58 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3293156266' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-17T01:52:59.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:58 smithi082 ceph-mon[92957]: pgmap v344: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:52:59.128 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:52:58 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3293156266' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-17T01:52:59.156 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-17T01:52:59.156 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-17T01:52:59.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-17T01:52:59.404 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:52:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 -- 172.21.15.82:0/3350727207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558100800 msgr2=0x7f2558100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 --2- 172.21.15.82:0/3350727207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558100800 0x7f2558100c60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2540009880 tx=0x7f254002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:52:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 -- 172.21.15.82:0/3350727207 shutdown_connections 2024-09-17T01:52:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 --2- 172.21.15.82:0/3350727207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558100800 0x7f2558100c60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 --2- 172.21.15.82:0/3350727207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558106800 0x7f2558106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 -- 172.21.15.82:0/3350727207 >> 172.21.15.82:0/3350727207 conn(0x7f25580fc520 msgr2=0x7f25580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 -- 172.21.15.82:0/3350727207 shutdown_connections 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.880+0000 7f255f15a640 1 -- 172.21.15.82:0/3350727207 wait complete. 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 Processor -- start 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 -- start start 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 0x7f255819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f255810dcd0 con 0x7f2558106800 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255f15a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f255810db50 con 0x7f2558100800 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55732/0 (socket says 172.21.15.82:55732) 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 -- 172.21.15.82:0/3363137270 learned_addr learned my addr 172.21.15.82:0/3363137270 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:52:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255cef6640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 0x7f255819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 -- 172.21.15.82:0/3363137270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 msgr2=0x7f255819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 0x7f255819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 -- 172.21.15.82:0/3363137270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25581977f0 con 0x7f2558106800 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f255cef6640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 0x7f255819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.881+0000 7f2557fff640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2540031460 tx=0x7f2540004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.882+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f254003f070 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.882+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2558197a80 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.882+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25400035f0 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.882+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2540035030 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.882+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2558197fb0 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.883+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2558101f40 con 0x7f2558106800 2024-09-17T01:52:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.883+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2540042070 con 0x7f2558106800 2024-09-17T01:52:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.884+0000 7f2555ffb640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 0x7f254407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:52:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.884+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f25400bea10 con 0x7f2558106800 2024-09-17T01:52:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.884+0000 7f255cef6640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 0x7f254407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:52:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.885+0000 7f255cef6640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 0x7f254407d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2548005fd0 tx=0x7f2548009500 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:52:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:52:59.889+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2540089fb0 con 0x7f2558106800 2024-09-17T01:53:00.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.103+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f2558198d20 con 0x7f2558106800 2024-09-17T01:53:00.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.104+0000 7f2555ffb640 1 -- 172.21.15.82:0/3363137270 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) ==== 107+0+4452 (secure 0 0 0) 0x7f254008ee60 con 0x7f2558106800 2024-09-17T01:53:00.102 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:00.102 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"btime":"2024-09-17T01:48:58:582083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:58.582077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:53:00.102 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-09-17T01:53:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 msgr2=0x7f254407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 0x7f254407d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2548005fd0 tx=0x7f2548009500 comp rx=0 tx=0).stop 2024-09-17T01:53:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 msgr2=0x7f255819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2540031460 tx=0x7f2540004530 comp rx=0 tx=0).stop 2024-09-17T01:53:00.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 shutdown_connections 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f254407af30 0x7f254407d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2558106800 0x7f255819dbb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 --2- 172.21.15.82:0/3363137270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2558100800 0x7f255819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 >> 172.21.15.82:0/3363137270 conn(0x7f25580fc520 msgr2=0x7f255806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 shutdown_connections 2024-09-17T01:53:00.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:00.106+0000 7f255f15a640 1 -- 172.21.15.82:0/3363137270 wait complete. 2024-09-17T01:53:00.780 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-17T01:53:00.780 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-17T01:53:00.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-17T01:53:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:00 smithi167 ceph-mon[76323]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:00 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3363137270' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-17T01:53:01.031 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:01.145 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:00 smithi082 ceph-mon[92957]: pgmap v345: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:01.145 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:00 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3363137270' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-17T01:53:01.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 -- 172.21.15.82:0/2424143950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8102b20 msgr2=0x7f9dc8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:01.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 --2- 172.21.15.82:0/2424143950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8102b20 0x7f9dc8102f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9db80098b0 tx=0x7f9db802a560 comp rx=0 tx=0).stop 2024-09-17T01:53:01.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 -- 172.21.15.82:0/2424143950 shutdown_connections 2024-09-17T01:53:01.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 --2- 172.21.15.82:0/2424143950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8103440 0x7f9dc810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 --2- 172.21.15.82:0/2424143950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8102b20 0x7f9dc8102f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 -- 172.21.15.82:0/2424143950 >> 172.21.15.82:0/2424143950 conn(0x7f9dc80fc520 msgr2=0x7f9dc80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:01.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 -- 172.21.15.82:0/2424143950 shutdown_connections 2024-09-17T01:53:01.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.531+0000 7f9dce094640 1 -- 172.21.15.82:0/2424143950 wait complete. 2024-09-17T01:53:01.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 Processor -- start 2024-09-17T01:53:01.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 -- start start 2024-09-17T01:53:01.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8102b20 0x7f9dc819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:01.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:01.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc810edf0 con 0x7f9dc8103440 2024-09-17T01:53:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dce094640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc810ec70 con 0x7f9dc8102b20 2024-09-17T01:53:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.532+0000 7f9dc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55748/0 (socket says 172.21.15.82:55748) 2024-09-17T01:53:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc6ffd640 1 -- 172.21.15.82:0/113410087 learned_addr learned my addr 172.21.15.82:0/113410087 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc77fe640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8102b20 0x7f9dc819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc6ffd640 1 -- 172.21.15.82:0/113410087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8102b20 msgr2=0x7f9dc819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc6ffd640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8102b20 0x7f9dc819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc6ffd640 1 -- 172.21.15.82:0/113410087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc8197800 con 0x7f9dc8103440 2024-09-17T01:53:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc6ffd640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c8f0 tx=0x7f9dbc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc0079b0 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc8197af0 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dbc007b50 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dbc0185f0 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.533+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc8198080 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.534+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc806aa30 con 0x7f9dc8103440 2024-09-17T01:53:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.535+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f9dbc00f450 con 0x7f9dc8103440 2024-09-17T01:53:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.535+0000 7f9dc4ff9640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 0x7f9db007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.535+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f9dbc09e210 con 0x7f9dc8103440 2024-09-17T01:53:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.535+0000 7f9dc77fe640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 0x7f9db007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.536+0000 7f9dc77fe640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 0x7f9db007d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000c00 tx=0x7f9db8031420 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.540+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f9dbc014030 con 0x7f9dc8103440 2024-09-17T01:53:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.751+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f9dc8105ff0 con 0x7f9dc8103440 2024-09-17T01:53:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.752+0000 7f9dc4ff9640 1 -- 172.21.15.82:0/113410087 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) ==== 107+0+4463 (secure 0 0 0) 0x7f9dbc069810 con 0x7f9dc8103440 2024-09-17T01:53:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:01.753 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"btime":"2024-09-17T01:48:58:588103+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:58.588085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 msgr2=0x7f9db007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 0x7f9db007d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000c00 tx=0x7f9db8031420 comp rx=0 tx=0).stop 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 msgr2=0x7f9dc819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c8f0 tx=0x7f9dbc00cdb0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 shutdown_connections 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f9db007af30 0x7f9db007d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dc8103440 0x7f9dc819dbc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 --2- 172.21.15.82:0/113410087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dc8102b20 0x7f9dc819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 >> 172.21.15.82:0/113410087 conn(0x7f9dc80fc520 msgr2=0x7f9dc8103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 shutdown_connections 2024-09-17T01:53:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:01.754+0000 7f9dce094640 1 -- 172.21.15.82:0/113410087 wait complete. 2024-09-17T01:53:02.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:02.043 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:02.398 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-17T01:53:02.398 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-17T01:53:02.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-17T01:53:02.647 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:03.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:02 smithi167 ceph-mon[76323]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:03.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:02 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/113410087' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-17T01:53:03.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:02 smithi082 ceph-mon[92957]: pgmap v346: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:03.088 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:02 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/113410087' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-17T01:53:03.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 -- 172.21.15.82:0/1393833361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4888100570 msgr2=0x7f48881065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 --2- 172.21.15.82:0/1393833361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4888100570 0x7f48881065e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f487c009880 tx=0x7f487c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 -- 172.21.15.82:0/1393833361 shutdown_connections 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 --2- 172.21.15.82:0/1393833361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4888100570 0x7f48881065e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 --2- 172.21.15.82:0/1393833361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48880ffbc0 0x7f48880fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 -- 172.21.15.82:0/1393833361 >> 172.21.15.82:0/1393833361 conn(0x7f48880fb870 msgr2=0x7f48880fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 -- 172.21.15.82:0/1393833361 shutdown_connections 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.171+0000 7f488fa9b640 1 -- 172.21.15.82:0/1393833361 wait complete. 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 Processor -- start 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 -- start start 2024-09-17T01:53:03.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888100570 0x7f4888101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f488810ed90 con 0x7f48880ffbc0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488fa9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f488810ec10 con 0x7f4888100570 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55762/0 (socket says 172.21.15.82:55762) 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 -- 172.21.15.82:0/3919622360 learned_addr learned my addr 172.21.15.82:0/3919622360 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d036640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888100570 0x7f4888101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 -- 172.21.15.82:0/3919622360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888100570 msgr2=0x7f4888101910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888100570 0x7f4888101910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 -- 172.21.15.82:0/3919622360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4888101e50 con 0x7f48880ffbc0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.172+0000 7f488d837640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f488400c8a0 tx=0x7f488400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.173+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f48840079b0 con 0x7f48880ffbc0 2024-09-17T01:53:03.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.173+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4884007b50 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.173+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4888102140 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.173+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4884018700 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.173+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48881a3d20 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.174+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4888100e20 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.174+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f4884007d00 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.175+0000 7f487affd640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 0x7f487407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.175+0000 7f488d036640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 0x7f487407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.175+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f488409e310 con 0x7f48880ffbc0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.175+0000 7f488d036640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 0x7f487407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f487c009230 tx=0x7f487c031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:03.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.180+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f4884014030 con 0x7f48880ffbc0 2024-09-17T01:53:03.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.391+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f48880fffa0 con 0x7f48880ffbc0 2024-09-17T01:53:03.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.391+0000 7f487affd640 1 -- 172.21.15.82:0/3919622360 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) ==== 107+0+5310 (secure 0 0 0) 0x7f4884069910 con 0x7f48880ffbc0 2024-09-17T01:53:03.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:03.390 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"btime":"2024-09-17T01:49:06:624371+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:48:58.588085+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:53:03.390 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-09-17T01:53:03.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 msgr2=0x7f487407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 0x7f487407d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f487c009230 tx=0x7f487c031400 comp rx=0 tx=0).stop 2024-09-17T01:53:03.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 msgr2=0x7f48881013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:03.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f488400c8a0 tx=0x7f488400cd60 comp rx=0 tx=0).stop 2024-09-17T01:53:03.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 shutdown_connections 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f487407af30 0x7f487407d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4888100570 0x7f4888101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 --2- 172.21.15.82:0/3919622360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48880ffbc0 0x7f48881013d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 >> 172.21.15.82:0/3919622360 conn(0x7f48880fb870 msgr2=0x7f48880fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 shutdown_connections 2024-09-17T01:53:03.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:03.394+0000 7f488fa9b640 1 -- 172.21.15.82:0/3919622360 wait complete. 2024-09-17T01:53:04.001 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:03 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/3919622360' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-17T01:53:04.003 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-17T01:53:04.003 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-17T01:53:04.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-17T01:53:04.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:03 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/3919622360' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-17T01:53:04.253 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 -- 172.21.15.82:0/3294269824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 msgr2=0x7f2a6410b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/3294269824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6410b960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009880 tx=0x7f2a4c02a530 comp rx=0 tx=0).stop 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 -- 172.21.15.82:0/3294269824 shutdown_connections 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/3294269824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6410b960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/3294269824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a64102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.686+0000 7f2a68dbf640 1 -- 172.21.15.82:0/3294269824 >> 172.21.15.82:0/3294269824 conn(0x7f2a640fc550 msgr2=0x7f2a640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.687+0000 7f2a68dbf640 1 -- 172.21.15.82:0/3294269824 shutdown_connections 2024-09-17T01:53:04.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.687+0000 7f2a68dbf640 1 -- 172.21.15.82:0/3294269824 wait complete. 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.687+0000 7f2a68dbf640 1 Processor -- start 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.687+0000 7f2a68dbf640 1 -- start start 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a6419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6410edc0 con 0x7f2a64103470 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6410ec40 con 0x7f2a64102b50 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55780/0 (socket says 172.21.15.82:55780) 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 -- 172.21.15.82:0/2210933344 learned_addr learned my addr 172.21.15.82:0/2210933344 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a6259c640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a6419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 -- 172.21.15.82:0/2210933344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 msgr2=0x7f2a6419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a6419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 -- 172.21.15.82:0/2210933344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a64197790 con 0x7f2a64103470 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a6259c640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a6419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a59d9b640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004f90 tx=0x7f2a4c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a4c03f070 con 0x7f2a64103470 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a64197a20 con 0x7f2a64103470 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a4c004c70 con 0x7f2a64103470 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a4c035030 con 0x7f2a64103470 2024-09-17T01:53:04.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.688+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a64197f50 con 0x7f2a64103470 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.689+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6406a4e0 con 0x7f2a64103470 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.690+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f2a4c042070 con 0x7f2a64103470 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.691+0000 7f2a5bfff640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 0x7f2a5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.691+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f2a4c0bead0 con 0x7f2a64103470 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.691+0000 7f2a6259c640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 0x7f2a5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:04.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.691+0000 7f2a6259c640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 0x7f2a5007d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009b40 tx=0x7f2a54005e50 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.695+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f2a4c08a030 con 0x7f2a64103470 2024-09-17T01:53:04.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.907+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f2a64198cc0 con 0x7f2a64103470 2024-09-17T01:53:04.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.908+0000 7f2a5bfff640 1 -- 172.21.15.82:0/2210933344 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) ==== 107+0+5313 (secure 0 0 0) 0x7f2a4c08eee0 con 0x7f2a64103470 2024-09-17T01:53:04.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:04.906 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":32,"btime":"2024-09-17T01:49:07:688314+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:07.179855+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:53:04.906 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 32 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 msgr2=0x7f2a5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 0x7f2a5007d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009b40 tx=0x7f2a54005e50 comp rx=0 tx=0).stop 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 msgr2=0x7f2a6419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004f90 tx=0x7f2a4c0048f0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 shutdown_connections 2024-09-17T01:53:04.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f2a5007af30 0x7f2a5007d3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a64103470 0x7f2a6419db50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 --2- 172.21.15.82:0/2210933344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a64102b50 0x7f2a6419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:04.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 >> 172.21.15.82:0/2210933344 conn(0x7f2a640fc550 msgr2=0x7f2a64108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:04.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 shutdown_connections 2024-09-17T01:53:04.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:04.910+0000 7f2a68dbf640 1 -- 172.21.15.82:0/2210933344 wait complete. 2024-09-17T01:53:04.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:04 smithi082 ceph-mon[92957]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:05.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:04 smithi167 ceph-mon[76323]: pgmap v347: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:05.710 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-17T01:53:05.710 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-17T01:53:05.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-17T01:53:05.959 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:05.963 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:05 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2210933344' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-17T01:53:06.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:05 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2210933344' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-17T01:53:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 -- 172.21.15.82:0/3424463390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100330 msgr2=0x7fe4ec100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/3424463390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100330 0x7fe4ec100710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009880 tx=0x7fe4e802a4a0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 -- 172.21.15.82:0/3424463390 shutdown_connections 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/3424463390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/3424463390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100330 0x7fe4ec100710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 -- 172.21.15.82:0/3424463390 >> 172.21.15.82:0/3424463390 conn(0x7fe4ec077270 msgr2=0x7fe4ec077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 -- 172.21.15.82:0/3424463390 shutdown_connections 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.388+0000 7fe4f3c50640 1 -- 172.21.15.82:0/3424463390 wait complete. 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 Processor -- start 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 -- start start 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 0x7fe4ec101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec10d4f0 con 0x7fe4ec100ce0 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f3c50640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec10d370 con 0x7fe4ec100330 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f11eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f11eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55798/0 (socket says 172.21.15.82:55798) 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.389+0000 7fe4f11eb640 1 -- 172.21.15.82:0/2412965115 learned_addr learned my addr 172.21.15.82:0/2412965115 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f19ec640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 0x7fe4ec101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f11eb640 1 -- 172.21.15.82:0/2412965115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 msgr2=0x7fe4ec101cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f11eb640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 0x7fe4ec101cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f11eb640 1 -- 172.21.15.82:0/2412965115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec102740 con 0x7fe4ec100ce0 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f19ec640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 0x7fe4ec101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T01:53:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f11eb640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b3d0 tx=0x7fe4dc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc015020 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec102a30 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe4dc011af0 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc010d30 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.390+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec1a3f10 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.391+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec101700 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.392+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fe4dc018020 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.392+0000 7fe4e2ffd640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 0x7fe4d807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.392+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fe4dc09d900 con 0x7fe4ec100ce0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.392+0000 7fe4f19ec640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 0x7fe4d807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.393+0000 7fe4f19ec640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 0x7fe4d807d440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8006010 tx=0x7fe4e80095f0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.397+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fe4dc01f020 con 0x7fe4ec100ce0 2024-09-17T01:53:06.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.605+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7fe4ec100710 con 0x7fe4ec100ce0 2024-09-17T01:53:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.606+0000 7fe4e2ffd640 1 -- 172.21.15.82:0/2412965115 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) ==== 107+0+5310 (secure 0 0 0) 0x7fe4dc068f80 con 0x7fe4ec100ce0 2024-09-17T01:53:06.604 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:06.604 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"btime":"2024-09-17T01:49:08:694013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:07.698197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-17T01:53:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2024-09-17T01:53:06.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 msgr2=0x7fe4d807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 0x7fe4d807d440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8006010 tx=0x7fe4e80095f0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 msgr2=0x7fe4ec102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:06.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00b3d0 tx=0x7fe4dc00b890 comp rx=0 tx=0).stop 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 shutdown_connections 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fe4d807af80 0x7fe4d807d440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4ec100ce0 0x7fe4ec102200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 --2- 172.21.15.82:0/2412965115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4ec100330 0x7fe4ec101cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.608+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 >> 172.21.15.82:0/2412965115 conn(0x7fe4ec077270 msgr2=0x7fe4ec0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.609+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 shutdown_connections 2024-09-17T01:53:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:06.609+0000 7fe4f3c50640 1 -- 172.21.15.82:0/2412965115 wait complete. 2024-09-17T01:53:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:06 smithi082 ceph-mon[92957]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:07.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:06 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/2412965115' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-17T01:53:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:06 smithi167 ceph-mon[76323]: pgmap v348: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:06 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/2412965115' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-17T01:53:07.271 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-17T01:53:07.271 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-17T01:53:07.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-17T01:53:07.540 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:07.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:53:07.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:07.938 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:07 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 -- 172.21.15.82:0/1127829322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34681033d0 msgr2=0x7f346810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 --2- 172.21.15.82:0/1127829322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34681033d0 0x7f346810b8c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3454009880 tx=0x7f345402a530 comp rx=0 tx=0).stop 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 -- 172.21.15.82:0/1127829322 shutdown_connections 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 --2- 172.21.15.82:0/1127829322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34681033d0 0x7f346810b8c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 --2- 172.21.15.82:0/1127829322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3468102ab0 0x7f3468102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 -- 172.21.15.82:0/1127829322 >> 172.21.15.82:0/1127829322 conn(0x7f34680fc550 msgr2=0x7f34680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 -- 172.21.15.82:0/1127829322 shutdown_connections 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.030+0000 7f346ed91640 1 -- 172.21.15.82:0/1127829322 wait complete. 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 Processor -- start 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 -- start start 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34681033d0 0x7f3468100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f346810ede0 con 0x7f3468102ab0 2024-09-17T01:53:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346ed91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f346810ec60 con 0x7f34681033d0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36846/0 (socket says 172.21.15.82:36846) 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 -- 172.21.15.82:0/1400892420 learned_addr learned my addr 172.21.15.82:0/1400892420 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f3467fff640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34681033d0 0x7f3468100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 -- 172.21.15.82:0/1400892420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34681033d0 msgr2=0x7f3468100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34681033d0 0x7f3468100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.031+0000 7f346cb2d640 1 -- 172.21.15.82:0/1400892420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3468101190 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f346cb2d640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e970 tx=0x7f345c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f345c00cac0 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3468101480 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f345c0054e0 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f345c010430 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.032+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34681a3e90 con 0x7f3468102ab0 2024-09-17T01:53:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.033+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346806a580 con 0x7f3468102ab0 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.033+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f345c004e80 con 0x7f3468102ab0 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.034+0000 7f3465ffb640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 0x7f345807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.034+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f345c09e6b0 con 0x7f3468102ab0 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.034+0000 7f3467fff640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 0x7f345807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.034+0000 7f3467fff640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 0x7f345807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34681021a0 tx=0x7f3454031400 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.038+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f345c069c50 con 0x7f3468102ab0 2024-09-17T01:53:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.251+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f3468102e90 con 0x7f3468102ab0 2024-09-17T01:53:08.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.251+0000 7f3465ffb640 1 -- 172.21.15.82:0/1400892420 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) ==== 107+0+5319 (secure 0 0 0) 0x7f345c06eb00 con 0x7f3468102ab0 2024-09-17T01:53:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:08.251 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":34,"btime":"2024-09-17T01:49:09:701707+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:09.701700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34311,"qdb_cluster":[34311]},"id":1}]} 2024-09-17T01:53:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 34 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 msgr2=0x7f345807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 0x7f345807d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f34681021a0 tx=0x7f3454031400 comp rx=0 tx=0).stop 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 msgr2=0x7f3468100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e970 tx=0x7f345c00ed70 comp rx=0 tx=0).stop 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 shutdown_connections 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f345807af30 0x7f345807d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34681033d0 0x7f3468100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 --2- 172.21.15.82:0/1400892420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3468102ab0 0x7f3468100710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 >> 172.21.15.82:0/1400892420 conn(0x7f34680fc550 msgr2=0x7f3468108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 shutdown_connections 2024-09-17T01:53:08.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:08.254+0000 7f346ed91640 1 -- 172.21.15.82:0/1400892420 wait complete. 2024-09-17T01:53:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:53:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:08.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:07 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:08.809 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:08 smithi082 ceph-mon[92957]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:08.809 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:53:08.810 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:53:08.810 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:08.810 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:08 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/1400892420' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-17T01:53:09.095 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-17T01:53:09.095 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-17T01:53:09.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-17T01:53:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:08 smithi167 ceph-mon[76323]: pgmap v349: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:53:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:53:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:53:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:08 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/1400892420' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-17T01:53:09.343 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:09.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.812+0000 7fcdf8b28640 1 -- 172.21.15.82:0/2299857532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4107900 msgr2=0x7fcdf4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:09.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.812+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/2299857532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4107900 0x7fcdf4107ce0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009c20 tx=0x7fcde402a970 comp rx=0 tx=0).stop 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 -- 172.21.15.82:0/2299857532 shutdown_connections 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/2299857532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4101900 0x7fcdf4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/2299857532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4107900 0x7fcdf4107ce0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 -- 172.21.15.82:0/2299857532 >> 172.21.15.82:0/2299857532 conn(0x7fcdf40fd620 msgr2=0x7fcdf40ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 -- 172.21.15.82:0/2299857532 shutdown_connections 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 -- 172.21.15.82:0/2299857532 wait complete. 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 Processor -- start 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.813+0000 7fcdf8b28640 1 -- start start 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4107900 0x7fcdf419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf410edb0 con 0x7fcdf4101900 2024-09-17T01:53:09.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf410ec30 con 0x7fcdf4107900 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36864/0 (socket says 172.21.15.82:36864) 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 -- 172.21.15.82:0/4109168568 learned_addr learned my addr 172.21.15.82:0/4109168568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf1d9b640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4107900 0x7fcdf419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 -- 172.21.15.82:0/4109168568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4107900 msgr2=0x7fcdf419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4107900 0x7fcdf419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 -- 172.21.15.82:0/4109168568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf4197770 con 0x7fcdf4101900 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf259c640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005cc0 tx=0x7fcde402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcde4047070 con 0x7fcdf4101900 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf4197a00 con 0x7fcdf4101900 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcde402f7e0 con 0x7fcdf4101900 2024-09-17T01:53:09.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcde4034070 con 0x7fcdf4101900 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.814+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf4197f00 con 0x7fcdf4101900 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.815+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf4103040 con 0x7fcdf4101900 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.816+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fcde404a070 con 0x7fcdf4101900 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.817+0000 7fcdeb7fe640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 0x7fcde007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.817+0000 7fcdf1d9b640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 0x7fcde007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.817+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fcde40bee30 con 0x7fcdf4101900 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.817+0000 7fcdf1d9b640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 0x7fcde007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4198fc0 tx=0x7fcddc00a2d0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:09.821+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fcde403f070 con 0x7fcdf4101900 2024-09-17T01:53:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.032+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7fcdf4104b10 con 0x7fcdf4101900 2024-09-17T01:53:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.032+0000 7fcdeb7fe640 1 -- 172.21.15.82:0/4109168568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) ==== 107+0+5319 (secure 0 0 0) 0x7fcde408a430 con 0x7fcdf4101900 2024-09-17T01:53:10.031 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:10.032 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":35,"btime":"2024-09-17T01:49:18:964725+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:17.968321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34311},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34311,"qdb_cluster":[34311]},"id":1}]} 2024-09-17T01:53:10.032 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 35 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 msgr2=0x7fcde007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 0x7fcde007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4198fc0 tx=0x7fcddc00a2d0 comp rx=0 tx=0).stop 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 msgr2=0x7fcdf419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcde4005cc0 tx=0x7fcde402f5f0 comp rx=0 tx=0).stop 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 shutdown_connections 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fcde007af30 0x7fcde007d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdf4107900 0x7fcdf419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 --2- 172.21.15.82:0/4109168568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf4101900 0x7fcdf419d6a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 >> 172.21.15.82:0/4109168568 conn(0x7fcdf40fd620 msgr2=0x7fcdf40fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 shutdown_connections 2024-09-17T01:53:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:10.035+0000 7fcdf8b28640 1 -- 172.21.15.82:0/4109168568 wait complete. 2024-09-17T01:53:10.653 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-17T01:53:10.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-17T01:53:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:10 smithi082 ceph-mon[92957]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:10.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:10 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/4109168568' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-17T01:53:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:10 smithi167 ceph-mon[76323]: pgmap v350: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:10 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/4109168568' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-17T01:53:11.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.410+0000 7f0c4464d640 1 -- 172.21.15.82:0/1414422767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c100800 msgr2=0x7f0c3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.410+0000 7f0c4464d640 1 --2- 172.21.15.82:0/1414422767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c100800 0x7f0c3c100c60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009880 tx=0x7f0c2c02a4a0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- 172.21.15.82:0/1414422767 shutdown_connections 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 --2- 172.21.15.82:0/1414422767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c100800 0x7f0c3c100c60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 --2- 172.21.15.82:0/1414422767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c106800 0x7f0c3c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- 172.21.15.82:0/1414422767 >> 172.21.15.82:0/1414422767 conn(0x7f0c3c0fc520 msgr2=0x7f0c3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- 172.21.15.82:0/1414422767 shutdown_connections 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- 172.21.15.82:0/1414422767 wait complete. 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 Processor -- start 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- start start 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c100800 0x7f0c3c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c10dcd0 con 0x7f0c3c106800 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.411+0000 7f0c4464d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c10db50 con 0x7f0c3c100800 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36884/0 (socket says 172.21.15.82:36884) 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 -- 172.21.15.82:0/145631103 learned_addr learned my addr 172.21.15.82:0/145631103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 -- 172.21.15.82:0/145631103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c100800 msgr2=0x7f0c3c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c423e9640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c100800 0x7f0c3c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c100800 0x7f0c3c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 -- 172.21.15.82:0/145631103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c199320 con 0x7f0c3c106800 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c41be8640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c031460 tx=0x7f0c2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c03f070 con 0x7f0c3c106800 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c2c0035f0 con 0x7f0c3c106800 2024-09-17T01:53:11.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c1995b0 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c2c035030 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.412+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c1a1b60 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.413+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c101f40 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.414+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f0c2c042070 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.414+0000 7f0c337fe640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 0x7f0c2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.414+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f0c2c0bea20 con 0x7f0c3c106800 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.414+0000 7f0c423e9640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 0x7f0c2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.415+0000 7f0c423e9640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 0x7f0c2807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c38005fd0 tx=0x7f0c38005850 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:11.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.419+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f0c2c08a020 con 0x7f0c3c106800 2024-09-17T01:53:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.630+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7f0c3c108d70 con 0x7f0c3c106800 2024-09-17T01:53:11.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.630+0000 7f0c337fe640 1 -- 172.21.15.82:0/145631103 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) ==== 107+0+5336 (secure 0 0 0) 0x7f0c2c08c020 con 0x7f0c3c106800 2024-09-17T01:53:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-09-17T01:53:11.630 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"btime":"2024-09-17T01:49:18:969993+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34358,"name":"cephfs.smithi082.haarnz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6827/2712253415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":2712253415},{"type":"v1","addr":"172.21.15.82:6827","nonce":2712253415}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34362,"name":"cephfs.smithi082.pwukvc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6829/226559431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":226559431},{"type":"v1","addr":"172.21.15.82:6829","nonce":226559431}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-17T01:38:43.948337+0000","modified":"2024-09-17T01:49:18.969969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34311,"mds_1":34315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34311":{"gid":34311,"name":"cephfs.smithi167.vbekqg","rank":0,"incarnation":30,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6825/3730623711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":3730623711},{"type":"v1","addr":"172.21.15.167:6825","nonce":3730623711}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34315":{"gid":34315,"name":"cephfs.smithi167.ypfdyj","rank":1,"incarnation":36,"state":"up:starting","state_seq":1,"addr":"172.21.15.167:6827/124451305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":124451305},{"type":"v1","addr":"172.21.15.167:6827","nonce":124451305}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34311,"qdb_cluster":[34311]},"id":1}]} 2024-09-17T01:53:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 36 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 msgr2=0x7f0c2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 0x7f0c2807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c38005fd0 tx=0x7f0c38005850 comp rx=0 tx=0).stop 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 msgr2=0x7f0c3c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c031460 tx=0x7f0c2c0045e0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 shutdown_connections 2024-09-17T01:53:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f0c2807af30 0x7f0c2807d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c3c106800 0x7f0c3c198d20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 --2- 172.21.15.82:0/145631103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c3c100800 0x7f0c3c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 >> 172.21.15.82:0/145631103 conn(0x7f0c3c0fc520 msgr2=0x7f0c3c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 shutdown_connections 2024-09-17T01:53:11.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:11.633+0000 7f0c4464d640 1 -- 172.21.15.82:0/145631103 wait complete. 2024-09-17T01:53:11.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:11 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/145631103' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-17T01:53:12.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:11 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/145631103' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-17T01:53:12.277 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-17T01:53:12.278 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T01:53:12.290 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T01:53:12.290 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:53:12.290 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:53:12.309 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:53:12.309 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:53:12.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:53:12.655 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:13.053 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:12 smithi082 ceph-mon[92957]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 -- 172.21.15.82:0/2975354582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0107910 msgr2=0x7f5ea0107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/2975354582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0107910 0x7f5ea0107cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009880 tx=0x7f5e9002a4a0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 -- 172.21.15.82:0/2975354582 shutdown_connections 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/2975354582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea0101910 0x7f5ea0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/2975354582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0107910 0x7f5ea0107cf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 -- 172.21.15.82:0/2975354582 >> 172.21.15.82:0/2975354582 conn(0x7f5ea00fd610 msgr2=0x7f5ea00ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 -- 172.21.15.82:0/2975354582 shutdown_connections 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.134+0000 7f5ea60ca640 1 -- 172.21.15.82:0/2975354582 wait complete. 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 Processor -- start 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 -- start start 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea0107910 0x7f5ea0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea010ede0 con 0x7f5ea0101910 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5ea60ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea010ec60 con 0x7f5ea0107910 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36904/0 (socket says 172.21.15.82:36904) 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 -- 172.21.15.82:0/520761732 learned_addr learned my addr 172.21.15.82:0/520761732 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 -- 172.21.15.82:0/520761732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea0107910 msgr2=0x7f5ea0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:13.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea0107910 0x7f5ea0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 -- 172.21.15.82:0/520761732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea0074f70 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.135+0000 7f5e9f7fe640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e90031460 tx=0x7f5e900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.136+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e9003f070 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.136+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e90004cf0 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.136+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea0075200 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.136+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e90035030 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.136+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea01a3d90 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.137+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea0103050 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.137+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7f5e90042070 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.138+0000 7f5e9d7fa640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 0x7f5e8c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.138+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7f5e900beac0 con 0x7f5ea0101910 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.138+0000 7f5e97fff640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 0x7f5e8c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.138+0000 7f5e97fff640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 0x7f5e8c07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0075f80 tx=0x7f5e88005bf0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:13.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.142+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7f5e9008a0c0 con 0x7f5ea0101910 2024-09-17T01:53:13.155 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:12 smithi167 ceph-mon[76323]: pgmap v351: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:13.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.329+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5ea0109e80 con 0x7f5ea0101910 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.330+0000 7f5e9d7fa640 1 -- 172.21.15.82:0/520761732 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v82) ==== 81+0+1838 (secure 0 0 0) 0x7f5e9008ef70 con 0x7f5ea0101910 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6827/3290052476 2024-09-18T01:48:58.581740+0000 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6826/3290052476 2024-09-18T01:48:58.581740+0000 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/256076123 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3572739181 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/826200596 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/3279286605 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1573881497 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/406672030 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1750461309 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6828/3660715592 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1654346047 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/3330979299 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/91177004 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3743181164 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/4062113647 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/256076123 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3700370565 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2272978570 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/406672030 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2005389412 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2005389412 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6829/3660715592 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6827/981106576 2024-09-18T01:48:04.065922+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3909622984 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6826/981106576 2024-09-18T01:48:04.065922+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/198027229 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3595010788 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3452228081 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2107408052 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3452228081 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:13.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/2064068094 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:listed 31 entries 2024-09-17T01:53:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 msgr2=0x7f5e8c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 0x7f5e8c07d3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0075f80 tx=0x7f5e88005bf0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 msgr2=0x7f5ea00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:13.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5e90031460 tx=0x7f5e900048f0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 shutdown_connections 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7f5e8c07af30 0x7f5e8c07d3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ea0107910 0x7f5ea0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 --2- 172.21.15.82:0/520761732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea0101910 0x7f5ea00744f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 >> 172.21.15.82:0/520761732 conn(0x7f5ea00fd610 msgr2=0x7f5ea00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 shutdown_connections 2024-09-17T01:53:13.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:13.332+0000 7f5ea60ca640 1 -- 172.21.15.82:0/520761732 wait complete. 2024-09-17T01:53:13.949 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:13 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/520761732' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T01:53:13.976 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-09-17T01:53:13.976 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T01:53:13.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 5047e42a-7494-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-17T01:53:14.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:13 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/520761732' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T01:53:14.285 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/mon.smithi082/config 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- 172.21.15.82:0/1644178375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981067f0 msgr2=0x7fc698106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 --2- 172.21.15.82:0/1644178375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981067f0 0x7fc698106bd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc688009c20 tx=0x7fc68802a970 comp rx=0 tx=0).stop 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- 172.21.15.82:0/1644178375 shutdown_connections 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 --2- 172.21.15.82:0/1644178375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981007f0 0x7fc698100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 --2- 172.21.15.82:0/1644178375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981067f0 0x7fc698106bd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- 172.21.15.82:0/1644178375 >> 172.21.15.82:0/1644178375 conn(0x7fc6980fc550 msgr2=0x7fc6980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- 172.21.15.82:0/1644178375 shutdown_connections 2024-09-17T01:53:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- 172.21.15.82:0/1644178375 wait complete. 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 Processor -- start 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.667+0000 7fc69d853640 1 -- start start 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69d853640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69d853640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981067f0 0x7fc69819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69d853640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc69810dca0 con 0x7fc6981007f0 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69d853640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc69810db20 con 0x7fc6981067f0 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36918/0 (socket says 172.21.15.82:36918) 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 -- 172.21.15.82:0/498061466 learned_addr learned my addr 172.21.15.82:0/498061466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc6967fc640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981067f0 0x7fc69819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 -- 172.21.15.82:0/498061466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981067f0 msgr2=0x7fc69819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981067f0 0x7fc69819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 -- 172.21.15.82:0/498061466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc698197750 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc696ffd640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc688005cc0 tx=0x7fc68802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc688047070 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc68802f7e0 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6981979e0 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.668+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc688034070 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.669+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc698197ee0 con 0x7fc6981007f0 2024-09-17T01:53:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.669+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc698101f30 con 0x7fc6981007f0 2024-09-17T01:53:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.670+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) ==== 103320+0+0 (secure 0 0 0) 0x7fc68804a070 con 0x7fc6981007f0 2024-09-17T01:53:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.671+0000 7fc69c851640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 0x7fc68407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T01:53:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.671+0000 7fc6967fc640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 0x7fc68407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T01:53:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.671+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6156+0+0 (secure 0 0 0) 0x7fc6880bee60 con 0x7fc6981007f0 2024-09-17T01:53:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.672+0000 7fc6967fc640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 0x7fc68407d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc698198fa0 tx=0x7fc68000a4c0 comp rx=0 tx=0).ready entity=mgr.24519 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T01:53:14.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.675+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197088 (secure 0 0 0) 0x7fc68803f070 con 0x7fc6981007f0 2024-09-17T01:53:14.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.865+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc698198190 con 0x7fc6981007f0 2024-09-17T01:53:14.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.865+0000 7fc69c851640 1 -- 172.21.15.82:0/498061466 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v82) ==== 81+0+1838 (secure 0 0 0) 0x7fc68808a4e0 con 0x7fc6981007f0 2024-09-17T01:53:14.864 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6827/3290052476 2024-09-18T01:48:58.581740+0000 2024-09-17T01:53:14.864 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6826/3290052476 2024-09-18T01:48:58.581740+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/256076123 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3572739181 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/826200596 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/3279286605 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1573881497 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/406672030 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1750461309 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6828/3660715592 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1654346047 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/3330979299 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.865 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/91177004 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3743181164 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/4062113647 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/256076123 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3700370565 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2272978570 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/406672030 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/2005389412 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/2005389412 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:6829/3660715592 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6827/981106576 2024-09-18T01:48:04.065922+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3909622984 2024-09-18T01:32:26.319084+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6826/981106576 2024-09-18T01:48:04.065922+0000 2024-09-17T01:53:14.866 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/198027229 2024-09-18T01:32:57.360758+0000 2024-09-17T01:53:14.867 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3595010788 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:14.867 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3452228081 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:14.867 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2107408052 2024-09-18T01:40:58.644359+0000 2024-09-17T01:53:14.867 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3452228081 2024-09-18T01:33:57.671331+0000 2024-09-17T01:53:14.867 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.167:0/2064068094 2024-09-18T01:42:45.453819+0000 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:listed 31 entries 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 msgr2=0x7fc68407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 0x7fc68407d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc698198fa0 tx=0x7fc68000a4c0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 msgr2=0x7fc69819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc688005cc0 tx=0x7fc68802f5f0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 shutdown_connections 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:6800/3638015872,v1:172.21.15.82:6801/3638015872] conn(0x7fc68407af80 0x7fc68407d440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6981067f0 0x7fc69819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 --2- 172.21.15.82:0/498061466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6981007f0 0x7fc69819d680 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 >> 172.21.15.82:0/498061466 conn(0x7fc6980fc550 msgr2=0x7fc698069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 shutdown_connections 2024-09-17T01:53:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-09-17T01:53:14.868+0000 7fc69d853640 1 -- 172.21.15.82:0/498061466 wait complete. 2024-09-17T01:53:14.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:14 smithi082 ceph-mon[92957]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:15.142 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:14 smithi167 ceph-mon[76323]: pgmap v352: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:15.571 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi082.front.sepia.ceph.com... 2024-09-17T01:53:15.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T01:53:15.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T01:53:15.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T01:53:16.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:15 smithi082 ceph-mon[92957]: from='client.? 172.21.15.82:0/498061466' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T01:53:16.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:15 smithi167 ceph-mon[76323]: from='client.? 172.21.15.82:0/498061466' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-17T01:53:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:16 smithi082 ceph-mon[92957]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:16 smithi167 ceph-mon[76323]: pgmap v353: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:18 smithi082 ceph-mon[92957]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:19.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:18 smithi167 ceph-mon[76323]: pgmap v354: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:20.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:20 smithi082 ceph-mon[92957]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:20 smithi167 ceph-mon[76323]: pgmap v355: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:23.116 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:22 smithi082 ceph-mon[92957]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:22 smithi167 ceph-mon[76323]: pgmap v356: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:24 smithi082 ceph-mon[92957]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:24 smithi167 ceph-mon[76323]: pgmap v357: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:26 smithi082 ceph-mon[92957]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:27.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:26 smithi167 ceph-mon[76323]: pgmap v358: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:28 smithi082 ceph-mon[92957]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:28 smithi167 ceph-mon[76323]: pgmap v359: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:30 smithi082 ceph-mon[92957]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:30 smithi167 ceph-mon[76323]: pgmap v360: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:32 smithi082 ceph-mon[92957]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:32 smithi167 ceph-mon[76323]: pgmap v361: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:34.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:33 smithi082 ceph-mon[92957]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:34.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:33 smithi167 ceph-mon[76323]: pgmap v362: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:36.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:36 smithi082 ceph-mon[92957]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:37.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:36 smithi167 ceph-mon[76323]: pgmap v363: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:38.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:38 smithi082 ceph-mon[92957]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:39.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:38 smithi167 ceph-mon[76323]: pgmap v364: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:41.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:40 smithi167 ceph-mon[76323]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:41.084 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:40 smithi082 ceph-mon[92957]: pgmap v365: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:43.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:42 smithi167 ceph-mon[76323]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:42 smithi082 ceph-mon[92957]: pgmap v366: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:45.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:44 smithi167 ceph-mon[76323]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:44 smithi082 ceph-mon[92957]: pgmap v367: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:46 smithi167 ceph-mon[76323]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:46 smithi082 ceph-mon[92957]: pgmap v368: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:53:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:48 smithi167 ceph-mon[76323]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:48 smithi082 ceph-mon[92957]: pgmap v369: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:51.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:50 smithi167 ceph-mon[76323]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:50 smithi082 ceph-mon[92957]: pgmap v370: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:52 smithi167 ceph-mon[76323]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:53.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:52 smithi082 ceph-mon[92957]: pgmap v371: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:53:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:54 smithi167 ceph-mon[76323]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:54 smithi082 ceph-mon[92957]: pgmap v372: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:53:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:56 smithi167 ceph-mon[76323]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:56 smithi082 ceph-mon[92957]: pgmap v373: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:53:58 smithi167 ceph-mon[76323]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:53:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:53:58 smithi082 ceph-mon[92957]: pgmap v374: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:00 smithi167 ceph-mon[76323]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:00 smithi082 ceph-mon[92957]: pgmap v375: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:02 smithi082 ceph-mon[92957]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:02 smithi167 ceph-mon[76323]: pgmap v376: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:04 smithi082 ceph-mon[92957]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:05.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:04 smithi167 ceph-mon[76323]: pgmap v377: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:06.851 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:06 smithi082 ceph-mon[92957]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:06 smithi167 ceph-mon[76323]: pgmap v378: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:08 smithi082 ceph-mon[92957]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:54:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:54:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:54:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:54:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:08 smithi167 ceph-mon[76323]: pgmap v379: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:54:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:54:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:54:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:54:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:10 smithi082 ceph-mon[92957]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:11.217 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:10 smithi167 ceph-mon[76323]: pgmap v380: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:12 smithi082 ceph-mon[92957]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:12 smithi167 ceph-mon[76323]: pgmap v381: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:15.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:14 smithi167 ceph-mon[76323]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:14 smithi082 ceph-mon[92957]: pgmap v382: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:16 smithi082 ceph-mon[92957]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:16 smithi167 ceph-mon[76323]: pgmap v383: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:19.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:18 smithi082 ceph-mon[92957]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:19.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:18 smithi167 ceph-mon[76323]: pgmap v384: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:20 smithi082 ceph-mon[92957]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:20 smithi167 ceph-mon[76323]: pgmap v385: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:23.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:22 smithi082 ceph-mon[92957]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:22 smithi167 ceph-mon[76323]: pgmap v386: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:24 smithi082 ceph-mon[92957]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:24 smithi167 ceph-mon[76323]: pgmap v387: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:27.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:26 smithi167 ceph-mon[76323]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:27.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:26 smithi082 ceph-mon[92957]: pgmap v388: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:28 smithi082 ceph-mon[92957]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:28 smithi167 ceph-mon[76323]: pgmap v389: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:30 smithi082 ceph-mon[92957]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:30 smithi167 ceph-mon[76323]: pgmap v390: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:32.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:32.087 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:32 smithi082 ceph-mon[92957]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:32 smithi167 ceph-mon[76323]: pgmap v391: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:35.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:34 smithi082 ceph-mon[92957]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:34 smithi167 ceph-mon[76323]: pgmap v392: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:37.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:36 smithi082 ceph-mon[92957]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:37.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:36 smithi167 ceph-mon[76323]: pgmap v393: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:38 smithi082 ceph-mon[92957]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:39.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:38 smithi167 ceph-mon[76323]: pgmap v394: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:40 smithi082 ceph-mon[92957]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:40 smithi167 ceph-mon[76323]: pgmap v395: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:42 smithi082 ceph-mon[92957]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:42 smithi167 ceph-mon[76323]: pgmap v396: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:44.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:43 smithi082 ceph-mon[92957]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:44.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:43 smithi167 ceph-mon[76323]: pgmap v397: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:46 smithi167 ceph-mon[76323]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:47.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:46 smithi082 ceph-mon[92957]: pgmap v398: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:54:49.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:48 smithi167 ceph-mon[76323]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:48 smithi082 ceph-mon[92957]: pgmap v399: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:50 smithi167 ceph-mon[76323]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:50 smithi082 ceph-mon[92957]: pgmap v400: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:53.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:52 smithi167 ceph-mon[76323]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:53.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:52 smithi082 ceph-mon[92957]: pgmap v401: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:54:55.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:54 smithi167 ceph-mon[76323]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:54 smithi082 ceph-mon[92957]: pgmap v402: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:54:57.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:56 smithi167 ceph-mon[76323]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:57.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:56 smithi082 ceph-mon[92957]: pgmap v403: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:59.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:54:58 smithi167 ceph-mon[76323]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:54:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:54:58 smithi082 ceph-mon[92957]: pgmap v404: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:01.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:00 smithi167 ceph-mon[76323]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:00 smithi082 ceph-mon[92957]: pgmap v405: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:02.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:02 smithi082 ceph-mon[92957]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:03.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:02 smithi167 ceph-mon[76323]: pgmap v406: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:04 smithi082 ceph-mon[92957]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:04 smithi167 ceph-mon[76323]: pgmap v407: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:07.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:06 smithi082 ceph-mon[92957]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:06 smithi167 ceph-mon[76323]: pgmap v408: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:08 smithi082 ceph-mon[92957]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:08 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:55:09.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:08 smithi167 ceph-mon[76323]: pgmap v409: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:08 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:55:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:55:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:55:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:55:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:55:10.255 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:55:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:10 smithi082 ceph-mon[92957]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:10 smithi167 ceph-mon[76323]: pgmap v410: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:12.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:11 smithi082 ceph-mon[92957]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:12.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:11 smithi167 ceph-mon[76323]: pgmap v411: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-17T01:55:15.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:14 smithi167 ceph-mon[76323]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:14 smithi082 ceph-mon[92957]: pgmap v412: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:16 smithi167 ceph-mon[76323]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:17.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:16 smithi082 ceph-mon[92957]: pgmap v413: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:19.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:18 smithi167 ceph-mon[76323]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:18 smithi082 ceph-mon[92957]: pgmap v414: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:21.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:20 smithi167 ceph-mon[76323]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:20 smithi082 ceph-mon[92957]: pgmap v415: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:23.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:22 smithi167 ceph-mon[76323]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:55:23.089 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:22 smithi082 ceph-mon[92957]: pgmap v416: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:55:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:24 smithi082 ceph-mon[92957]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:55:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:24 smithi167 ceph-mon[76323]: pgmap v417: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:55:27.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:26 smithi082 ceph-mon[92957]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:27.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:26 smithi167 ceph-mon[76323]: pgmap v418: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:28 smithi082 ceph-mon[92957]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:28 smithi167 ceph-mon[76323]: pgmap v419: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:30 smithi082 ceph-mon[92957]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:30 smithi167 ceph-mon[76323]: pgmap v420: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:55:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:32 smithi082 ceph-mon[92957]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:55:33.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:32 smithi167 ceph-mon[76323]: pgmap v421: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-17T01:55:35.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:34 smithi082 ceph-mon[92957]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:34 smithi167 ceph-mon[76323]: pgmap v422: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:36 smithi082 ceph-mon[92957]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:37.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:36 smithi167 ceph-mon[76323]: pgmap v423: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:38 smithi082 ceph-mon[92957]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:39.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:38 smithi167 ceph-mon[76323]: pgmap v424: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:40 smithi082 ceph-mon[92957]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:55:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:40 smithi167 ceph-mon[76323]: pgmap v425: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:55:43.095 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:42 smithi167 ceph-mon[76323]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:42 smithi082 ceph-mon[92957]: pgmap v426: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:44 smithi082 ceph-mon[92957]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:44 smithi167 ceph-mon[76323]: pgmap v427: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:47.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:46 smithi167 ceph-mon[76323]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:47.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:46 smithi082 ceph-mon[92957]: pgmap v428: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:55:48.855 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:48 smithi082 ceph-mon[92957]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:49.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:48 smithi167 ceph-mon[76323]: pgmap v429: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:50 smithi082 ceph-mon[92957]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:55:51.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:50 smithi167 ceph-mon[76323]: pgmap v430: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:55:53.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:52 smithi082 ceph-mon[92957]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:53.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:52 smithi167 ceph-mon[76323]: pgmap v431: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:54 smithi082 ceph-mon[92957]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:54 smithi167 ceph-mon[76323]: pgmap v432: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:55:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:56 smithi082 ceph-mon[92957]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:56 smithi167 ceph-mon[76323]: pgmap v433: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:55:58 smithi082 ceph-mon[92957]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:55:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:55:58 smithi167 ceph-mon[76323]: pgmap v434: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:01.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:00 smithi082 ceph-mon[92957]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:00 smithi167 ceph-mon[76323]: pgmap v435: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:02 smithi082 ceph-mon[92957]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:02 smithi167 ceph-mon[76323]: pgmap v436: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:04 smithi082 ceph-mon[92957]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:56:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:04 smithi167 ceph-mon[76323]: pgmap v437: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-17T01:56:07.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:06 smithi082 ceph-mon[92957]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:06 smithi167 ceph-mon[76323]: pgmap v438: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:09.003 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:08 smithi167 ceph-mon[76323]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:08 smithi082 ceph-mon[92957]: pgmap v439: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-17T01:56:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:56:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:56:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:56:10.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:56:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:56:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:56:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:56:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:56:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:10 smithi082 ceph-mon[92957]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:10 smithi167 ceph-mon[76323]: pgmap v440: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-17T01:56:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:12 smithi082 ceph-mon[92957]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:13.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:12 smithi167 ceph-mon[76323]: pgmap v441: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:14 smithi082 ceph-mon[92957]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:14 smithi167 ceph-mon[76323]: pgmap v442: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:17.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:16 smithi082 ceph-mon[92957]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:17.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:16 smithi167 ceph-mon[76323]: pgmap v443: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:18.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:17 smithi082 ceph-mon[92957]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:18.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:17 smithi167 ceph-mon[76323]: pgmap v444: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:20 smithi082 ceph-mon[92957]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:20 smithi167 ceph-mon[76323]: pgmap v445: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:23.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:22 smithi082 ceph-mon[92957]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:22 smithi167 ceph-mon[76323]: pgmap v446: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:24 smithi082 ceph-mon[92957]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:25.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:24 smithi167 ceph-mon[76323]: pgmap v447: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:27.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:26 smithi082 ceph-mon[92957]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:27.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:26 smithi167 ceph-mon[76323]: pgmap v448: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:28 smithi082 ceph-mon[92957]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:28 smithi167 ceph-mon[76323]: pgmap v449: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:30 smithi082 ceph-mon[92957]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:31.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:30 smithi167 ceph-mon[76323]: pgmap v450: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:33.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:32 smithi082 ceph-mon[92957]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:33.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:32 smithi167 ceph-mon[76323]: pgmap v451: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:35.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:34 smithi082 ceph-mon[92957]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:35.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:34 smithi167 ceph-mon[76323]: pgmap v452: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:36.464 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:36 smithi082 ceph-mon[92957]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:36.503 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:36 smithi167 ceph-mon[76323]: pgmap v453: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:39.213 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:38 smithi167 ceph-mon[76323]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:38 smithi082 ceph-mon[92957]: pgmap v454: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:40 smithi082 ceph-mon[92957]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:41.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:40 smithi167 ceph-mon[76323]: pgmap v455: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:43.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:42 smithi082 ceph-mon[92957]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:42 smithi167 ceph-mon[76323]: pgmap v456: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:44.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:44 smithi082 ceph-mon[92957]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:44 smithi167 ceph-mon[76323]: pgmap v457: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:47.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:46 smithi167 ceph-mon[76323]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:47.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:46 smithi082 ceph-mon[92957]: pgmap v458: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:47.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:56:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:48 smithi082 ceph-mon[92957]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:49.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:48 smithi167 ceph-mon[76323]: pgmap v459: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:50 smithi082 ceph-mon[92957]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:51.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:50 smithi167 ceph-mon[76323]: pgmap v460: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:56:53.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:52 smithi082 ceph-mon[92957]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:53.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:52 smithi167 ceph-mon[76323]: pgmap v461: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:54 smithi082 ceph-mon[92957]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:54 smithi167 ceph-mon[76323]: pgmap v462: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:56:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:56 smithi082 ceph-mon[92957]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:56 smithi167 ceph-mon[76323]: pgmap v463: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:56:58 smithi082 ceph-mon[92957]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:56:59.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:56:58 smithi167 ceph-mon[76323]: pgmap v464: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:01.216 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:00 smithi082 ceph-mon[92957]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:01.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:00 smithi167 ceph-mon[76323]: pgmap v465: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:02.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:02 smithi082 ceph-mon[92957]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:02 smithi167 ceph-mon[76323]: pgmap v466: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:05.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:04 smithi167 ceph-mon[76323]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:05.096 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:04 smithi082 ceph-mon[92957]: pgmap v467: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:07.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:06 smithi082 ceph-mon[92957]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:06 smithi167 ceph-mon[76323]: pgmap v468: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:08 smithi082 ceph-mon[92957]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:08 smithi167 ceph-mon[76323]: pgmap v469: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:10.196 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:09 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:57:10.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:09 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:57:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:10 smithi082 ceph-mon[92957]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:57:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:57:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:57:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:10 smithi167 ceph-mon[76323]: pgmap v470: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:57:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:57:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:57:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:12 smithi082 ceph-mon[92957]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:12 smithi167 ceph-mon[76323]: pgmap v471: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:15.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:14 smithi082 ceph-mon[92957]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:14 smithi167 ceph-mon[76323]: pgmap v472: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:17.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:16 smithi082 ceph-mon[92957]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:17.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:16 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:16 smithi167 ceph-mon[76323]: pgmap v473: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:16 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:19.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:18 smithi082 ceph-mon[92957]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:19.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:18 smithi167 ceph-mon[76323]: pgmap v474: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:21.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:20 smithi082 ceph-mon[92957]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:21.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:20 smithi167 ceph-mon[76323]: pgmap v475: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:23.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:22 smithi082 ceph-mon[92957]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:23.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:22 smithi167 ceph-mon[76323]: pgmap v476: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:25.134 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:24 smithi167 ceph-mon[76323]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:25.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:24 smithi082 ceph-mon[92957]: pgmap v477: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:27.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:26 smithi082 ceph-mon[92957]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:27.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:26 smithi167 ceph-mon[76323]: pgmap v478: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:29.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:28 smithi082 ceph-mon[92957]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:29.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:28 smithi167 ceph-mon[76323]: pgmap v479: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:31.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:30 smithi082 ceph-mon[92957]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:31.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:30 smithi167 ceph-mon[76323]: pgmap v480: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:31 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:32.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:31 smithi082 ceph-mon[92957]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:31 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:32.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:31 smithi167 ceph-mon[76323]: pgmap v481: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:35.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:34 smithi082 ceph-mon[92957]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:35.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:34 smithi167 ceph-mon[76323]: pgmap v482: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:37.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:36 smithi082 ceph-mon[92957]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:37.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:36 smithi167 ceph-mon[76323]: pgmap v483: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:39.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:38 smithi082 ceph-mon[92957]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:39.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:38 smithi167 ceph-mon[76323]: pgmap v484: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:41.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:40 smithi082 ceph-mon[92957]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:41.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:40 smithi167 ceph-mon[76323]: pgmap v485: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:43.217 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:42 smithi082 ceph-mon[92957]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:43.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:42 smithi167 ceph-mon[76323]: pgmap v486: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:45.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:44 smithi082 ceph-mon[92957]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:45.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:44 smithi167 ceph-mon[76323]: pgmap v487: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:46 smithi082 ceph-mon[92957]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:47.093 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:46 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:47.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:46 smithi167 ceph-mon[76323]: pgmap v488: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:47.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:46 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:57:49.056 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:48 smithi167 ceph-mon[76323]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:49.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:48 smithi082 ceph-mon[92957]: pgmap v489: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:51.004 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:50 smithi167 ceph-mon[76323]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:51.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:50 smithi082 ceph-mon[92957]: pgmap v490: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:57:53.115 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:52 smithi082 ceph-mon[92957]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:53.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:52 smithi167 ceph-mon[76323]: pgmap v491: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:55.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:54 smithi082 ceph-mon[92957]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:55.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:54 smithi167 ceph-mon[76323]: pgmap v492: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:57:57.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:56 smithi082 ceph-mon[92957]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:57.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:56 smithi167 ceph-mon[76323]: pgmap v493: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:59.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:57:58 smithi082 ceph-mon[92957]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:57:59.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:57:58 smithi167 ceph-mon[76323]: pgmap v494: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:01.200 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:00 smithi082 ceph-mon[92957]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:58:01.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:00 smithi167 ceph-mon[76323]: pgmap v495: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:58:02.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:01 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:58:02.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:01 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-17T01:58:03.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:02 smithi082 ceph-mon[92957]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:03.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:02 smithi167 ceph-mon[76323]: pgmap v496: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:05.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:04 smithi082 ceph-mon[92957]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:58:05.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:04 smithi167 ceph-mon[76323]: pgmap v497: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:58:07.094 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:06 smithi082 ceph-mon[92957]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:07.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:06 smithi167 ceph-mon[76323]: pgmap v498: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:09.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:08 smithi082 ceph-mon[92957]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:09.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:08 smithi167 ceph-mon[76323]: pgmap v499: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:10 smithi082 ceph-mon[92957]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:58:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:58:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:58:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:58:11.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:10 smithi082 ceph-mon[92957]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:58:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:10 smithi167 ceph-mon[76323]: pgmap v500: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-17T01:58:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-17T01:58:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-17T01:58:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-17T01:58:11.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:10 smithi167 ceph-mon[76323]: from='mgr.24519 172.21.15.82:0/3462129127' entity='mgr.smithi082.oppacm' 2024-09-17T01:58:13.214 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:12 smithi082 ceph-mon[92957]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:13.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:12 smithi167 ceph-mon[76323]: pgmap v501: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-17T01:58:14.681 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-17T01:58:14.682 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:58:14.684 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T01:58:14.698 INFO:tasks.cephadm:Teardown begin 2024-09-17T01:58:14.699 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephadm.py", line 2380, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T01:58:14.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:58:14.735 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:58:14.769 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T01:58:14.770 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:58:14.794 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T01:58:14.827 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T01:58:14.828 INFO:tasks.cephadm.mon.smithi082:Stopping mon.smithi082... 2024-09-17T01:58:14.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082 2024-09-17T01:58:15.156 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:14 smithi082 ceph-mon[92957]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:58:15.157 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:14 smithi082 systemd[1]: Stopping Ceph mon.smithi082 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:15.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:14 smithi167 ceph-mon[76323]: pgmap v502: 65 pgs: 65 active+clean; 245 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-17T01:58:15.410 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:15 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[92953]: 2024-09-17T01:58:15.155+0000 7f2ca5a48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi082 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:15.410 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:15 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082[92953]: 2024-09-17T01:58:15.155+0000 7f2ca5a48640 -1 mon.smithi082@0(leader) e2 *** Got Signal Terminated *** 2024-09-17T01:58:15.680 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:15 smithi082 podman[152214]: 2024-09-17 01:58:15.412136467 +0000 UTC m=+0.372917926 container died 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:58:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:15 smithi082 podman[152214]: 2024-09-17 01:58:15.899297116 +0000 UTC m=+0.860078568 container cleanup 3f018a9faf44879fb5a1f886012a7ced590fa5143665d31c92897a0a11988618 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-17T01:58:15.964 INFO:journalctl@ceph.mon.smithi082.smithi082.stdout:Sep 17 01:58:15 smithi082 bash[152214]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi082 2024-09-17T01:58:16.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi082.service' 2024-09-17T01:58:16.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:16.343 INFO:tasks.cephadm.mon.smithi082:Stopped mon.smithi082 2024-09-17T01:58:16.343 INFO:tasks.cephadm.mon.smithi167:Stopping mon.smithi167... 2024-09-17T01:58:16.343 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi167 2024-09-17T01:58:16.504 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:16 smithi167 systemd[1]: Stopping Ceph mon.smithi167 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:16.961 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:16 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167[76319]: 2024-09-17T01:58:16.637+0000 7fcbd411a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi167 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:16.961 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:16 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167[76319]: 2024-09-17T01:58:16.637+0000 7fcbd411a640 -1 mon.smithi167@1(peon) e2 *** Got Signal Terminated *** 2024-09-17T01:58:16.961 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:16 smithi167 podman[114656]: 2024-09-17 01:58:16.709067537 +0000 UTC m=+0.177709366 container died ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-17T01:58:17.253 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:17 smithi167 podman[114656]: 2024-09-17 01:58:17.13803794 +0000 UTC m=+0.606679773 container cleanup ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0) 2024-09-17T01:58:17.254 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:17 smithi167 bash[114656]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167 2024-09-17T01:58:17.607 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Sep 17 01:58:17 smithi167 podman[114669]: 2024-09-17 01:58:17.35662949 +0000 UTC m=+0.645290700 container remove ae72af1edf12f0cd768cbd78982393e1213b2a8f39bfb5159890aa5987eeaba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-mon-smithi167, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True) 2024-09-17T01:58:17.611 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@mon.smithi167.service' 2024-09-17T01:58:17.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:17.658 INFO:tasks.cephadm.mon.smithi167:Stopped mon.smithi167 2024-09-17T01:58:17.658 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T01:58:17.658 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.0 2024-09-17T01:58:17.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:17 smithi082 systemd[1]: Stopping Ceph osd.0 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:18.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:18 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:58:18.177+0000 7fad5f06e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:18.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:18 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:58:18.177+0000 7fad5f06e640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-17T01:58:18.464 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:18 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0[101827]: 2024-09-17T01:58:18.177+0000 7fad5f06e640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:23.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:23 smithi082 podman[152349]: 2024-09-17 01:58:23.689719723 +0000 UTC m=+5.834765170 container died cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:58:24.327 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:24 smithi082 podman[152349]: 2024-09-17 01:58:24.103911321 +0000 UTC m=+6.248956755 container cleanup cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True) 2024-09-17T01:58:24.328 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:24 smithi082 bash[152349]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0 2024-09-17T01:58:24.678 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:24 smithi082 podman[152366]: 2024-09-17 01:58:24.330195491 +0000 UTC m=+0.636363778 container remove cb7e40179579942070d31403c9020f078e25c53c567997dc7039120f356296a5 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:58:24.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:24 smithi082 podman[152454]: 2024-09-17 01:58:24.583662255 +0000 UTC m=+0.016526791 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:58:24.964 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:24 smithi082 podman[152454]: 2024-09-17 01:58:24.714823921 +0000 UTC m=+0.147688504 container create 9a2a7c1ea14e7c5f0fcefe3fd5ee740202e2111f027d961d5802e12534cf3540 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:58:25.231 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:25 smithi082 podman[152454]: 2024-09-17 01:58:25.017453384 +0000 UTC m=+0.450317920 container init 9a2a7c1ea14e7c5f0fcefe3fd5ee740202e2111f027d961d5802e12534cf3540 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-17T01:58:25.231 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:25 smithi082 podman[152454]: 2024-09-17 01:58:25.02196961 +0000 UTC m=+0.454834150 container start 9a2a7c1ea14e7c5f0fcefe3fd5ee740202e2111f027d961d5802e12534cf3540 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T01:58:25.231 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:25 smithi082 podman[152454]: 2024-09-17 01:58:25.125824908 +0000 UTC m=+0.558689459 container attach 9a2a7c1ea14e7c5f0fcefe3fd5ee740202e2111f027d961d5802e12534cf3540 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T01:58:25.231 INFO:journalctl@ceph.osd.0.smithi082.stdout:Sep 17 01:58:25 smithi082 podman[152454]: 2024-09-17 01:58:25.214969875 +0000 UTC m=+0.647834415 container died 9a2a7c1ea14e7c5f0fcefe3fd5ee740202e2111f027d961d5802e12534cf3540 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-17T01:58:25.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T01:58:25.894 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:25.894 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T01:58:25.894 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T01:58:25.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.1 2024-09-17T01:58:26.214 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:25 smithi082 systemd[1]: Stopping Ceph osd.1 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:26.678 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:26 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:58:26.250+0000 7f6baf667640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:26.678 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:26 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:58:26.250+0000 7f6baf667640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-17T01:58:26.678 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:26 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1[106966]: 2024-09-17T01:58:26.250+0000 7f6baf667640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:31.990 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:31 smithi082 podman[152568]: 2024-09-17 01:58:31.72019351 +0000 UTC m=+5.592495910 container died 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:58:32.348 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152568]: 2024-09-17 01:58:32.091656031 +0000 UTC m=+5.963958421 container cleanup 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-17T01:58:32.348 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 bash[152568]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1 2024-09-17T01:58:32.710 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152586]: 2024-09-17 01:58:32.351184031 +0000 UTC m=+0.620320554 container remove 3cbea6819dcaccaeb20d9bd333bfc07f611408a0d4aff4c6943172659095a741 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:58:32.964 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152675]: 2024-09-17 01:58:32.615441858 +0000 UTC m=+0.016377931 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:58:32.964 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152675]: 2024-09-17 01:58:32.718936294 +0000 UTC m=+0.119872353 container create 7a31bc61d1f1c9b42dc5a35dc869b97bf8c01909be9cf8f0e82645dece864804 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T01:58:32.964 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152675]: 2024-09-17 01:58:32.929724495 +0000 UTC m=+0.330660572 container init 7a31bc61d1f1c9b42dc5a35dc869b97bf8c01909be9cf8f0e82645dece864804 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:58:32.964 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:32 smithi082 podman[152675]: 2024-09-17 01:58:32.933550062 +0000 UTC m=+0.334486122 container start 7a31bc61d1f1c9b42dc5a35dc869b97bf8c01909be9cf8f0e82645dece864804 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:58:33.398 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:33 smithi082 podman[152675]: 2024-09-17 01:58:33.013173979 +0000 UTC m=+0.414110053 container attach 7a31bc61d1f1c9b42dc5a35dc869b97bf8c01909be9cf8f0e82645dece864804 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:58:33.398 INFO:journalctl@ceph.osd.1.smithi082.stdout:Sep 17 01:58:33 smithi082 podman[152675]: 2024-09-17 01:58:33.124339549 +0000 UTC m=+0.525275618 container died 7a31bc61d1f1c9b42dc5a35dc869b97bf8c01909be9cf8f0e82645dece864804 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:58:33.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T01:58:33.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:33.745 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T01:58:33.745 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T01:58:33.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.2 2024-09-17T01:58:33.964 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:33 smithi082 systemd[1]: Stopping Ceph osd.2 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:34.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:58:34.086+0000 7f0449684640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:34.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:58:34.086+0000 7f0449684640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-17T01:58:34.464 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:34 smithi082 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2[112559]: 2024-09-17T01:58:34.086+0000 7f0449684640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:39.860 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:39 smithi082 podman[152778]: 2024-09-17 01:58:39.598683414 +0000 UTC m=+5.626809839 container died 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:58:40.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:39 smithi082 podman[152778]: 2024-09-17 01:58:39.960973917 +0000 UTC m=+5.989100342 container cleanup 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:58:40.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:39 smithi082 bash[152778]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2 2024-09-17T01:58:40.569 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152794]: 2024-09-17 01:58:40.229155268 +0000 UTC m=+0.623720562 container remove 6a499b30949e8abad4a47719b71483063759147e31bc8ea1ee35ee6c4a0d4b7d (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:58:40.854 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.571673681 +0000 UTC m=+0.103724538 container create a9c1ea8f113bce6906c6032b927b9aa08d96318b421ee236fe18861c62f7b5ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-17T01:58:40.855 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.485098762 +0000 UTC m=+0.017149565 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:58:40.855 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.782329811 +0000 UTC m=+0.314380608 container init a9c1ea8f113bce6906c6032b927b9aa08d96318b421ee236fe18861c62f7b5ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:58:40.855 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.785530652 +0000 UTC m=+0.317581444 container start a9c1ea8f113bce6906c6032b927b9aa08d96318b421ee236fe18861c62f7b5ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T01:58:40.855 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.85728492 +0000 UTC m=+0.389335727 container attach a9c1ea8f113bce6906c6032b927b9aa08d96318b421ee236fe18861c62f7b5ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:58:41.214 INFO:journalctl@ceph.osd.2.smithi082.stdout:Sep 17 01:58:40 smithi082 podman[152880]: 2024-09-17 01:58:40.972270398 +0000 UTC m=+0.504321191 container died a9c1ea8f113bce6906c6032b927b9aa08d96318b421ee236fe18861c62f7b5ed (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:58:41.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T01:58:41.620 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:41.621 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T01:58:41.621 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-17T01:58:41.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.3 2024-09-17T01:58:41.940 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:41 smithi167 systemd[1]: Stopping Ceph osd.3 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:42.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:41 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:58:41.941+0000 7f82fd263640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:42.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:41 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:58:41.941+0000 7f82fd263640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-17T01:58:42.254 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:41 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3[84568]: 2024-09-17T01:58:41.941+0000 7f82fd263640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:47.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:46 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:46.684+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:47.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:47.246+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:47.504 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:47 smithi167 podman[114795]: 2024-09-17 01:58:47.492783455 +0000 UTC m=+5.673076874 container died 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-17T01:58:48.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:47 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:47.662+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:48.004 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:47 smithi167 podman[114795]: 2024-09-17 01:58:47.874908147 +0000 UTC m=+6.055201564 container cleanup 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T01:58:48.004 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:47 smithi167 bash[114795]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3 2024-09-17T01:58:48.439 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114811]: 2024-09-17 01:58:48.109719894 +0000 UTC m=+0.616380652 container remove 3ca40366e9b92514a4a891a1d32d7c26314892c30f5718ff4ce8c2d04ae25bdb (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-17T01:58:48.439 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:48 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:48.277+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:48.754 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.344847885 +0000 UTC m=+0.016572278 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:58:48.754 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.477684775 +0000 UTC m=+0.149409198 container create 9dd37af94638d93a747af3e71fb0eeec56f84ac349b842033b760137854b4284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-17T01:58:48.754 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.688696766 +0000 UTC m=+0.360421155 container init 9dd37af94638d93a747af3e71fb0eeec56f84ac349b842033b760137854b4284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-17T01:58:48.755 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.691923627 +0000 UTC m=+0.363648004 container start 9dd37af94638d93a747af3e71fb0eeec56f84ac349b842033b760137854b4284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-17T01:58:48.755 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:48 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:48.636+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:49.189 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.777937259 +0000 UTC m=+0.449661648 container attach 9dd37af94638d93a747af3e71fb0eeec56f84ac349b842033b760137854b4284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True) 2024-09-17T01:58:49.189 INFO:journalctl@ceph.osd.3.smithi167.stdout:Sep 17 01:58:48 smithi167 podman[114899]: 2024-09-17 01:58:48.881482383 +0000 UTC m=+0.553206773 container died 9dd37af94638d93a747af3e71fb0eeec56f84ac349b842033b760137854b4284 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T01:58:49.448 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:49 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:49.308+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:49.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.3.service' 2024-09-17T01:58:49.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:49.514 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-17T01:58:49.514 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-17T01:58:49.514 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.4 2024-09-17T01:58:49.743 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:49 smithi167 systemd[1]: Stopping Ceph osd.4 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:49.743 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:49 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:49.659+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:50.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:49 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:49.895+0000 7f9490167640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:50.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:49 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:49.895+0000 7f9490167640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-17T01:58:50.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:49 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:49.895+0000 7f9490167640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:50.666 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:50 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:50.260+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:51.003 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:50 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:50.668+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:51.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:51 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:51.238+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:52.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:51 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:51.701+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:52.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:52 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:52.223+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:52.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:52 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:52.223+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:53.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:52 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:52.668+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:53.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:52 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:52.668+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:26.223622+0000 front 2024-09-17T01:58:26.223657+0000 (oldest deadline 2024-09-17T01:58:52.123613+0000) 2024-09-17T01:58:53.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:53.240+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:53.504 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:53.240+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:54.003 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:53.714+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:54.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:53 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:53.714+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:26.223622+0000 front 2024-09-17T01:58:26.223657+0000 (oldest deadline 2024-09-17T01:58:52.123613+0000) 2024-09-17T01:58:54.706 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:54 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:54.258+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:54.706 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:54 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:54.258+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:55.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:54 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:54.708+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:21.523295+0000 front 2024-09-17T01:58:21.523338+0000 (oldest deadline 2024-09-17T01:58:46.223224+0000) 2024-09-17T01:58:55.004 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:54 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4[89204]: 2024-09-17T01:58:54.708+0000 7f948c752640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:26.223622+0000 front 2024-09-17T01:58:26.223657+0000 (oldest deadline 2024-09-17T01:58:52.123613+0000) 2024-09-17T01:58:55.644 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:55 smithi167 podman[115001]: 2024-09-17 01:58:55.349660056 +0000 UTC m=+5.589252810 container died ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-17T01:58:55.644 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:55 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:55.287+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:55.645 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:55 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:55.287+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:56.003 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:55 smithi167 podman[115001]: 2024-09-17 01:58:55.745588435 +0000 UTC m=+5.985181181 container cleanup ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.vendor=CentOS) 2024-09-17T01:58:56.003 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:55 smithi167 bash[115001]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4 2024-09-17T01:58:56.254 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115027]: 2024-09-17 01:58:56.005549396 +0000 UTC m=+0.654260689 container remove ea8d8c7c12c59670e89100cec436d02a91008ffd2df18ecb8d5545d31dc58e51 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-17T01:58:56.606 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:56 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:56.316+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:56.606 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:56 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:56.316+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:56.607 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.274164939 +0000 UTC m=+0.015875629 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:58:56.607 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.372926834 +0000 UTC m=+0.114637521 container create 69a3cc0841c5aa2cb57bceea4a82f581081654340a194c6fffcba9c8603b094e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-17T01:58:56.607 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.608876502 +0000 UTC m=+0.350587207 container init 69a3cc0841c5aa2cb57bceea4a82f581081654340a194c6fffcba9c8603b094e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:58:56.877 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.612256574 +0000 UTC m=+0.353967262 container start 69a3cc0841c5aa2cb57bceea4a82f581081654340a194c6fffcba9c8603b094e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2) 2024-09-17T01:58:56.877 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.708871264 +0000 UTC m=+0.450581964 container attach 69a3cc0841c5aa2cb57bceea4a82f581081654340a194c6fffcba9c8603b094e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-17T01:58:56.877 INFO:journalctl@ceph.osd.4.smithi167.stdout:Sep 17 01:58:56 smithi167 podman[115120]: 2024-09-17 01:58:56.793396129 +0000 UTC m=+0.535106829 container died 69a3cc0841c5aa2cb57bceea4a82f581081654340a194c6fffcba9c8603b094e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-17T01:58:57.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.4.service' 2024-09-17T01:58:57.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:58:57.439 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-17T01:58:57.439 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-17T01:58:57.439 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.5 2024-09-17T01:58:57.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:57.316+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:57.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:57.316+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:57.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 systemd[1]: Stopping Ceph osd.5 for 5047e42a-7494-11ef-bceb-c7b262605968... 2024-09-17T01:58:58.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:57.787+0000 7fa80ee94640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T01:58:58.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:57.787+0000 7fa80ee94640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-17T01:58:58.254 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:57 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:57.787+0000 7fa80ee94640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T01:58:58.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:58 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:58.285+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:58.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:58 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:58.285+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:58:59.753 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:59 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:59.283+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:58:59.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:58:59 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:58:59.283+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:59:00.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:00 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:00.288+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:59:00.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:00 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:00.288+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:59:01.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:01 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:01.310+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:59:01.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:01 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:01.310+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:59:02.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:02 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:02.294+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-09-17T01:58:22.405426+0000 front 2024-09-17T01:58:22.405446+0000 (oldest deadline 2024-09-17T01:58:47.105286+0000) 2024-09-17T01:59:02.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:02 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:02.294+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6814 osd.1 since back 2024-09-17T01:58:31.006984+0000 front 2024-09-17T01:58:31.006906+0000 (oldest deadline 2024-09-17T01:58:52.106890+0000) 2024-09-17T01:59:02.754 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:02 smithi167 ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5[94318]: 2024-09-17T01:59:02.294+0000 7fa807477640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.82:6822 osd.2 since back 2024-09-17T01:58:38.007960+0000 front 2024-09-17T01:58:38.007915+0000 (oldest deadline 2024-09-17T01:59:01.408130+0000) 2024-09-17T01:59:03.415 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:03 smithi167 podman[115225]: 2024-09-17 01:59:03.113395959 +0000 UTC m=+5.449032476 container died 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-17T01:59:03.714 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:03 smithi167 podman[115225]: 2024-09-17 01:59:03.515777648 +0000 UTC m=+5.851414164 container cleanup 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342) 2024-09-17T01:59:03.714 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:03 smithi167 bash[115225]: ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5 2024-09-17T01:59:04.004 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:03 smithi167 podman[115241]: 2024-09-17 01:59:03.716981311 +0000 UTC m=+0.600131584 container remove 2480e639d0202f4135bd6d78b469998fe968f171b6300475e2e8641cab0c3497 (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T01:59:04.434 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.033272633 +0000 UTC m=+0.015623604 image pull 8e039cb7fe1eece5854872e8884a61a26632c7691b2c85cbac9078a9c5c62fae quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f 2024-09-17T01:59:04.435 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.143205971 +0000 UTC m=+0.125556930 container create e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T01:59:04.435 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.353959486 +0000 UTC m=+0.336310442 container init e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-17T01:59:04.435 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.357334946 +0000 UTC m=+0.339685903 container start e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-17T01:59:04.435 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.437166793 +0000 UTC m=+0.419517783 container attach e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T01:59:04.753 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:04 smithi167 podman[115331]: 2024-09-17 01:59:04.549736249 +0000 UTC m=+0.532087205 container died e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T01:59:05.115 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 17 01:59:05 smithi167 podman[115354]: 2024-09-17 01:59:05.115806867 +0000 UTC m=+0.557120470 container remove e01611e90e15c6af94eed442c80833440907857ff5698a81913c2ada13a8d66e (image=quay.ceph.io/ceph-ci/ceph@sha256:8d976035ac6dfa5a89d235aefb0485fb86cf8e6ab71c18fe871b2e2d2f059d0f, name=ceph-5047e42a-7494-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240916.200549-debug-ce1b342, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-17T01:59:05.136 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5047e42a-7494-11ef-bceb-c7b262605968@osd.5.service' 2024-09-17T01:59:05.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T01:59:05.177 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-17T01:59:05.178 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5047e42a-7494-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:59:05.381 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:59:09.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi082.stderr:ceph-fuse[78152]: fuse finished with error 0 and tester_r 0 2024-09-17T01:59:24.357 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5047e42a-7494-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T01:59:24.556 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T01:59:41.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:59:41.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T01:59:41.886 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T01:59:41.888 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi082/crash 2024-09-17T01:59:41.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:59:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:59:41.926 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:59:41.928 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi167/crash 2024-09-17T01:59:41.929 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash -- . 2024-09-17T01:59:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/5047e42a-7494-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T01:59:41.953 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-09-17T01:59:41.954 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T01:59:41.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-17T01:59:42.011 INFO:tasks.cephadm:Compressing logs... 2024-09-17T01:59:42.012 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:59:42.054 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.haarnz.log 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.pwukvc.log 2024-09-17T01:59:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.haarnz.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:59:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:59:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.pwukvc.log: /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi082.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:: No such file or directory 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.ypfdyj.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:gzip/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.ypfdyj.log: -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.vbekqg.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-17T01:59:42.083 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.vbekqg.log: /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi167.log 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi167.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log: 84.7% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:59:42.084 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.5.log: 93.9% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi167.log.gz 2024-09-17T01:59:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi167.ysmbcy.log 2024-09-17T01:59:42.087 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log: 91.6% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:59:42.087 INFO:teuthology.orchestra.run.smithi167.stderr: 88.7% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi082.log 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi082.log: /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi082.log: 94.4% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi082.log.gz 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.3% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi082.oppacm.log 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log: 88.6% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-17T01:59:42.091 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-17T01:59:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-17T01:59:42.092 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi167.ysmbcy.log: gzip -5 --verbose -- /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi167.log 2024-09-17T01:59:42.097 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi082.oppacm.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:59:42.104 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-17T01:59:42.104 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi167.log: 91.1% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:59:42.106 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-17T01:59:42.107 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:59:42.138 INFO:teuthology.orchestra.run.smithi167.stderr: 89.3% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi167.ysmbcy.log.gz 2024-09-17T01:59:42.146 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.0.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-17T01:59:42.397 INFO:teuthology.orchestra.run.smithi167.stderr: 92.4% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi167.log.gz 2024-09-17T01:59:42.500 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mgr.smithi082.oppacm.log.gz 2024-09-17T01:59:43.274 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mon.smithi082.log.gz 2024-09-17T01:59:46.939 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-17T01:59:47.365 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-17T01:59:47.524 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-17T01:59:47.863 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-17T01:59:47.915 INFO:teuthology.orchestra.run.smithi167.stderr: 94.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.ypfdyj.log.gz 2024-09-17T01:59:48.218 INFO:teuthology.orchestra.run.smithi082.stderr: 93.7% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-17T01:59:49.266 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-17T01:59:49.713 INFO:teuthology.orchestra.run.smithi167.stderr: 94.8% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi167.vbekqg.log.gz 2024-09-17T01:59:50.891 INFO:teuthology.orchestra.run.smithi082.stderr: 94.9% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.pwukvc.log.gz 2024-09-17T01:59:57.808 INFO:teuthology.orchestra.run.smithi167.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-17T01:59:57.809 INFO:teuthology.orchestra.run.smithi167.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-17T01:59:57.810 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-17T01:59:57.811 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m15.741s 2024-09-17T01:59:57.811 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m45.512s 2024-09-17T01:59:57.811 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m1.298s 2024-09-17T01:59:58.373 INFO:teuthology.orchestra.run.smithi082.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-17T02:01:23.920 INFO:teuthology.orchestra.run.smithi082.stderr: 93.0% -- replaced with /var/log/ceph/5047e42a-7494-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi082.haarnz.log.gz 2024-09-17T02:01:23.922 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-09-17T02:01:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:real 1m41.854s 2024-09-17T02:01:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:user 2m21.040s 2024-09-17T02:01:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m4.635s 2024-09-17T02:01:23.922 INFO:tasks.cephadm:Archiving logs... 2024-09-17T02:01:23.923 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi082/log 2024-09-17T02:01:23.924 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:44.830 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi167/log 2024-09-17T02:01:44.831 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T02:01:50.554 INFO:tasks.cephadm:Removing cluster... 2024-09-17T02:01:50.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5047e42a-7494-11ef-bceb-c7b262605968 --force 2024-09-17T02:01:50.757 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T02:01:51.175 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5047e42a-7494-11ef-bceb-c7b262605968 --force 2024-09-17T02:01:51.379 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 5047e42a-7494-11ef-bceb-c7b262605968 2024-09-17T02:01:51.664 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T02:01:51.664 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T02:01:51.681 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T02:01:51.696 INFO:tasks.cephadm:Teardown complete 2024-09-17T02:01:51.697 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T02:01:51.711 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:01:51.712 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T02:01:51.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:51.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T02:01:51.811 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T02:01:51.829 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T02:01:51.830 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:51.833 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:01:51.845 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:01:51.847 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +3300us[+3262us] +/- 63ms 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -2481us[-2530us] +/- 77ms 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1671us[-1721us] +/- 80ms 2024-09-17T02:01:51.850 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:01:51.852 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:01:51.852 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-17T02:01:51.852 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +3295us[+3297us] +/- 63ms 2024-09-17T02:01:51.852 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -2507us[-2507us] +/- 78ms 2024-09-17T02:01:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 -1723us[-1724us] +/- 80ms 2024-09-17T02:01:51.853 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:01:51.853 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T02:01:51.866 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T02:01:51.867 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T02:01:51.902 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T02:01:51.982 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T02:01:52.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T02:01:52.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:52.085 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-17T02:01:52.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:52.113 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T02:01:52.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T02:01:52.156 INFO:teuthology.task.internal:Duration was 2301.894287 seconds 2024-09-17T02:01:52.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T02:01:52.190 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T02:01:52.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:52.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T02:01:52.229 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:01:52.232 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:01:52.538 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T02:01:52.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-09-17T02:01:52.539 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:52.564 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-17T02:01:52.564 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T02:01:52.604 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T02:01:52.604 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:52.607 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T02:01:52.671 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T02:01:52.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:52.674 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T02:01:53.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T02:01:53.359 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T02:01:53.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:53.384 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T02:01:53.411 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T02:01:53.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:53.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:53.448 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-09-17T02:01:53.475 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-17T02:01:53.499 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:53.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:53.525 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T02:01:53.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:53.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T02:01:53.568 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T02:01:53.569 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi082 2024-09-17T02:01:53.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:53.618 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_01:09:11-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908332/remote/smithi167 2024-09-17T02:01:53.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T02:01:53.655 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T02:01:53.655 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:53.658 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T02:01:53.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T02:01:53.719 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T02:01:53.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T02:01:53.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T02:01:53.748 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:53.751 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T02:01:53.763 INFO:teuthology.orchestra.run.smithi082.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 17 02:01 /home/ubuntu/cephtest 2024-09-17T02:01:53.764 INFO:teuthology.orchestra.run.smithi082.stdout: 531313 4 d--------- 2 ubuntu ubuntu 4096 Sep 17 01:39 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:01:53.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:01:53.765 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-17T02:01:53.765 INFO:teuthology.orchestra.run.smithi082.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-17T02:01:53.765 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi082 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-17T02:01:53.766 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T02:01:53.782 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T02:01:53.910 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-17T02:01:53.913 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2301.8942868709564 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-09-17T02:01:53.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:01:54.085 INFO:teuthology.run:FAIL